[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:07:00.282016 20640 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.40.62:46749
I20260709 13:07:00.283553 20640 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:07:00.284570 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:00.302189 20647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:00.302189 20646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:00.304785 20640 server_base.cc:1061] running on GCE node
W20260709 13:07:00.302889 20649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:01.538615 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:01.538904 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:01.539191 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602421539165 us; error 0 us; skew 500 ppm
I20260709 13:07:01.540129 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:01.548380 20640 webserver.cc:533] Webserver started at http://127.20.40.62:40463/ using document root <none> and password file <none>
I20260709 13:07:01.549392 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:01.549714 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:01.550241 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:01.556792 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602420111825-20640-0/minicluster-data/master-0-root/instance:
uuid: "9f67188cba504b5e914cd7df85b43356"
format_stamp: "Formatted at 2026-07-09 13:07:01 on dist-test-slave-rnv4"
I20260709 13:07:01.565594 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:07:01.571264 20655 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:01.572515 20640 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:07:01.572893 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602420111825-20640-0/minicluster-data/master-0-root
uuid: "9f67188cba504b5e914cd7df85b43356"
format_stamp: "Formatted at 2026-07-09 13:07:01 on dist-test-slave-rnv4"
I20260709 13:07:01.573248 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602420111825-20640-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602420111825-20640-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602420111825-20640-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:01.636260 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:01.638108 20640 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:07:01.638652 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:01.718767 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.62:46749
I20260709 13:07:01.718852 20706 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.62:46749 every 8 connection(s)
I20260709 13:07:01.727100 20707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:01.749907 20707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356: Bootstrap starting.
I20260709 13:07:01.755885 20707 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:01.757880 20707 log.cc:826] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356: Log is configured to *not* fsync() on all Append() calls
I20260709 13:07:01.762838 20707 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356: No bootstrap required, opened a new log
I20260709 13:07:01.783689 20707 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f67188cba504b5e914cd7df85b43356" member_type: VOTER }
I20260709 13:07:01.784292 20707 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:01.784585 20707 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f67188cba504b5e914cd7df85b43356, State: Initialized, Role: FOLLOWER
I20260709 13:07:01.785602 20707 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f67188cba504b5e914cd7df85b43356" member_type: VOTER }
I20260709 13:07:01.786119 20707 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:01.786425 20707 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:01.786770 20707 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:01.791122 20707 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f67188cba504b5e914cd7df85b43356" member_type: VOTER }
I20260709 13:07:01.791887 20707 leader_election.cc:304] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f67188cba504b5e914cd7df85b43356; no voters: 
I20260709 13:07:01.793802 20707 leader_election.cc:290] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:01.794138 20710 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:01.796967 20710 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356 [term 1 LEADER]: Becoming Leader. State: Replica: 9f67188cba504b5e914cd7df85b43356, State: Running, Role: LEADER
I20260709 13:07:01.797995 20710 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f67188cba504b5e914cd7df85b43356" member_type: VOTER }
I20260709 13:07:01.799012 20707 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:01.811079 20711 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f67188cba504b5e914cd7df85b43356" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f67188cba504b5e914cd7df85b43356" member_type: VOTER } }
I20260709 13:07:01.811434 20712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f67188cba504b5e914cd7df85b43356. Latest consensus state: current_term: 1 leader_uuid: "9f67188cba504b5e914cd7df85b43356" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f67188cba504b5e914cd7df85b43356" member_type: VOTER } }
I20260709 13:07:01.811929 20711 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:01.812057 20712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:01.814662 20720 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:01.826414 20720 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:01.828985 20640 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:01.845538 20720 catalog_manager.cc:1383] Generated new cluster ID: b76265fbba2145839e9e34bc96fefdf3
I20260709 13:07:01.845928 20720 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:01.867444 20720 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:01.869181 20720 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:01.882668 20720 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356: Generated new TSK 0
I20260709 13:07:01.883683 20720 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:01.896667 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:01.907953 20729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:01.909303 20730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:01.914794 20732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:01.914846 20640 server_base.cc:1061] running on GCE node
I20260709 13:07:01.916038 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:01.916326 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:01.916538 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602421916518 us; error 0 us; skew 500 ppm
I20260709 13:07:01.917330 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:01.921979 20640 webserver.cc:533] Webserver started at http://127.20.40.1:39449/ using document root <none> and password file <none>
I20260709 13:07:01.922796 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:01.923096 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:01.923491 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:01.925192 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602420111825-20640-0/minicluster-data/ts-0-root/instance:
uuid: "4ae7be6f1f9f42699d94c3df434e0428"
format_stamp: "Formatted at 2026-07-09 13:07:01 on dist-test-slave-rnv4"
I20260709 13:07:01.933707 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:07:01.939704 20737 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:01.940701 20640 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:07:01.941071 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602420111825-20640-0/minicluster-data/ts-0-root
uuid: "4ae7be6f1f9f42699d94c3df434e0428"
format_stamp: "Formatted at 2026-07-09 13:07:01 on dist-test-slave-rnv4"
I20260709 13:07:01.941517 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602420111825-20640-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602420111825-20640-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602420111825-20640-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:01.968194 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:01.970081 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:01.972936 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:01.978669 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:01.979010 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:01.979357 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:01.979584 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:02.082170 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.1:38797
I20260709 13:07:02.082230 20799 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.1:38797 every 8 connection(s)
I20260709 13:07:02.090806 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:02.104405 20804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:02.107600 20805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:02.118605 20640 server_base.cc:1061] running on GCE node
I20260709 13:07:02.119527 20800 heartbeater.cc:344] Connected to a master server at 127.20.40.62:46749
I20260709 13:07:02.120003 20800 heartbeater.cc:461] Registering TS with master...
W20260709 13:07:02.120617 20807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:02.121261 20800 heartbeater.cc:507] Master 127.20.40.62:46749 requested a full tablet report, sending...
I20260709 13:07:02.121932 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:02.122223 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:02.122437 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602422122415 us; error 0 us; skew 500 ppm
I20260709 13:07:02.123236 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:02.124974 20672 ts_manager.cc:194] Registered new tserver with Master: 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797)
I20260709 13:07:02.128167 20672 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49334
I20260709 13:07:02.129238 20640 webserver.cc:533] Webserver started at http://127.20.40.2:37397/ using document root <none> and password file <none>
I20260709 13:07:02.129951 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:02.130234 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:02.130535 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:02.132315 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602420111825-20640-0/minicluster-data/ts-1-root/instance:
uuid: "27012f69cd1c41f1900022cdf9843d3b"
format_stamp: "Formatted at 2026-07-09 13:07:02 on dist-test-slave-rnv4"
I20260709 13:07:02.138573 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.002s
I20260709 13:07:02.143172 20812 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:02.144225 20640 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:07:02.144608 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602420111825-20640-0/minicluster-data/ts-1-root
uuid: "27012f69cd1c41f1900022cdf9843d3b"
format_stamp: "Formatted at 2026-07-09 13:07:02 on dist-test-slave-rnv4"
I20260709 13:07:02.144970 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602420111825-20640-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602420111825-20640-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602420111825-20640-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:02.172210 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:02.173911 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:02.176424 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:02.180903 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:02.181180 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:02.181492 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:02.181655 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:02.286901 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.2:32867
I20260709 13:07:02.287022 20874 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.2:32867 every 8 connection(s)
I20260709 13:07:02.296083 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:02.304780 20878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:02.307585 20879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:02.309737 20875 heartbeater.cc:344] Connected to a master server at 127.20.40.62:46749
I20260709 13:07:02.310201 20875 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:02.311128 20875 heartbeater.cc:507] Master 127.20.40.62:46749 requested a full tablet report, sending...
I20260709 13:07:02.314152 20672 ts_manager.cc:194] Registered new tserver with Master: 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867)
I20260709 13:07:02.316555 20672 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49342
W20260709 13:07:02.318461 20881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:02.319116 20640 server_base.cc:1061] running on GCE node
I20260709 13:07:02.320106 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:02.320326 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:02.320520 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602422320497 us; error 0 us; skew 500 ppm
I20260709 13:07:02.321135 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:02.323793 20640 webserver.cc:533] Webserver started at http://127.20.40.3:35655/ using document root <none> and password file <none>
I20260709 13:07:02.324282 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:02.324492 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:02.324779 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:02.326036 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602420111825-20640-0/minicluster-data/ts-2-root/instance:
uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
format_stamp: "Formatted at 2026-07-09 13:07:02 on dist-test-slave-rnv4"
I20260709 13:07:02.330840 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:07:02.334327 20886 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:02.335109 20640 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:07:02.335439 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602420111825-20640-0/minicluster-data/ts-2-root
uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
format_stamp: "Formatted at 2026-07-09 13:07:02 on dist-test-slave-rnv4"
I20260709 13:07:02.335772 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602420111825-20640-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602420111825-20640-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602420111825-20640-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:02.361783 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:02.363046 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:02.365173 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:02.368613 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:02.368854 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:02.369109 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:02.369338 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:02.467042 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.3:39209
I20260709 13:07:02.467185 20948 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.3:39209 every 8 connection(s)
I20260709 13:07:02.489706 20949 heartbeater.cc:344] Connected to a master server at 127.20.40.62:46749
I20260709 13:07:02.490206 20949 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:02.491243 20949 heartbeater.cc:507] Master 127.20.40.62:46749 requested a full tablet report, sending...
I20260709 13:07:02.493911 20672 ts_manager.cc:194] Registered new tserver with Master: 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:02.495004 20640 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018479593s
I20260709 13:07:02.495497 20672 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49350
I20260709 13:07:02.556381 20672 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49358:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:02.560530 20672 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:02.676906 20914 tablet_service.cc:1511] Processing CreateTablet for tablet aef02495bba0445fa3bdd7cd7a6e5982 (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:02.680178 20913 tablet_service.cc:1511] Processing CreateTablet for tablet 1c903c9524124e92bf9904d93c83a581 (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:02.683975 20913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c903c9524124e92bf9904d93c83a581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.689025 20914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aef02495bba0445fa3bdd7cd7a6e5982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.694443 20912 tablet_service.cc:1511] Processing CreateTablet for tablet 66af6be5c900401dace8dfefb501fefc (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:02.697082 20912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66af6be5c900401dace8dfefb501fefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.718539 20839 tablet_service.cc:1511] Processing CreateTablet for tablet 1c903c9524124e92bf9904d93c83a581 (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:02.709021 20911 tablet_service.cc:1511] Processing CreateTablet for tablet 51c5fcfb4ee74084ab476ebda66e1fe4 (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:02.721319 20839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c903c9524124e92bf9904d93c83a581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.705814 20840 tablet_service.cc:1511] Processing CreateTablet for tablet aef02495bba0445fa3bdd7cd7a6e5982 (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:02.723311 20840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aef02495bba0445fa3bdd7cd7a6e5982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.724737 20911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51c5fcfb4ee74084ab476ebda66e1fe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.738751 20765 tablet_service.cc:1511] Processing CreateTablet for tablet aef02495bba0445fa3bdd7cd7a6e5982 (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:02.739784 20838 tablet_service.cc:1511] Processing CreateTablet for tablet 66af6be5c900401dace8dfefb501fefc (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:02.740478 20765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aef02495bba0445fa3bdd7cd7a6e5982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.743374 20837 tablet_service.cc:1511] Processing CreateTablet for tablet 51c5fcfb4ee74084ab476ebda66e1fe4 (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:02.741348 20838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66af6be5c900401dace8dfefb501fefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.748682 20764 tablet_service.cc:1511] Processing CreateTablet for tablet 1c903c9524124e92bf9904d93c83a581 (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:02.749851 20837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51c5fcfb4ee74084ab476ebda66e1fe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.750167 20764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c903c9524124e92bf9904d93c83a581. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.785388 20836 tablet_service.cc:1511] Processing CreateTablet for tablet 06a6425feef84a3e8d7c2396bcd7b521 (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:02.787045 20836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06a6425feef84a3e8d7c2396bcd7b521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.800346 20761 tablet_service.cc:1511] Processing CreateTablet for tablet 06a6425feef84a3e8d7c2396bcd7b521 (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:02.802618 20761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06a6425feef84a3e8d7c2396bcd7b521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.789228 20763 tablet_service.cc:1511] Processing CreateTablet for tablet 66af6be5c900401dace8dfefb501fefc (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:02.813004 20763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66af6be5c900401dace8dfefb501fefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.827382 20967 tablet_bootstrap.cc:492] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab: Bootstrap starting.
I20260709 13:07:02.826052 20762 tablet_service.cc:1511] Processing CreateTablet for tablet 51c5fcfb4ee74084ab476ebda66e1fe4 (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:02.832870 20762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51c5fcfb4ee74084ab476ebda66e1fe4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.840654 20968 tablet_bootstrap.cc:492] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428: Bootstrap starting.
W20260709 13:07:02.840757 20719 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:02.845202 20912 tablet_service.cc:1511] Processing CreateTablet for tablet 06a6425feef84a3e8d7c2396bcd7b521 (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:02.846086 20764 tablet_service.cc:1511] Processing CreateTablet for tablet d614ab9dad544ec58b5abef1e2e53bfa (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:02.846766 20912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06a6425feef84a3e8d7c2396bcd7b521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.847812 20969 tablet_bootstrap.cc:492] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b: Bootstrap starting.
I20260709 13:07:02.857074 20764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d614ab9dad544ec58b5abef1e2e53bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.861680 20839 tablet_service.cc:1511] Processing CreateTablet for tablet d614ab9dad544ec58b5abef1e2e53bfa (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:02.863049 20839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d614ab9dad544ec58b5abef1e2e53bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.884732 20967 tablet_bootstrap.cc:654] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:02.892236 20914 tablet_service.cc:1511] Processing CreateTablet for tablet d614ab9dad544ec58b5abef1e2e53bfa (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:02.893764 20765 tablet_service.cc:1511] Processing CreateTablet for tablet 95f080cfb4234f168dc1ed6433c0a42a (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:02.894281 20914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d614ab9dad544ec58b5abef1e2e53bfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.895121 20765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f080cfb4234f168dc1ed6433c0a42a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.898245 20968 tablet_bootstrap.cc:654] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:02.918105 20911 tablet_service.cc:1511] Processing CreateTablet for tablet 95f080cfb4234f168dc1ed6433c0a42a (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:02.919601 20911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f080cfb4234f168dc1ed6433c0a42a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.922624 20837 tablet_service.cc:1511] Processing CreateTablet for tablet 95f080cfb4234f168dc1ed6433c0a42a (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:02.924070 20837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95f080cfb4234f168dc1ed6433c0a42a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.934404 20969 tablet_bootstrap.cc:654] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:02.939459 20967 tablet_bootstrap.cc:492] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab: No bootstrap required, opened a new log
I20260709 13:07:02.939997 20967 ts_tablet_manager.cc:1403] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab: Time spent bootstrapping tablet: real 0.114s	user 0.006s	sys 0.009s
I20260709 13:07:02.944628 20765 tablet_service.cc:1511] Processing CreateTablet for tablet f30cd5e45ed84494b8873834fae6b662 (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:02.944657 20836 tablet_service.cc:1511] Processing CreateTablet for tablet f30cd5e45ed84494b8873834fae6b662 (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:02.947114 20836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f30cd5e45ed84494b8873834fae6b662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.949056 20968 tablet_bootstrap.cc:492] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428: No bootstrap required, opened a new log
I20260709 13:07:02.949613 20968 ts_tablet_manager.cc:1403] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428: Time spent bootstrapping tablet: real 0.129s	user 0.008s	sys 0.009s
I20260709 13:07:02.949842 20765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f30cd5e45ed84494b8873834fae6b662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.943313 20967 raft_consensus.cc:359] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:02.951167 20967 raft_consensus.cc:385] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:02.951514 20967 raft_consensus.cc:740] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Initialized, Role: FOLLOWER
I20260709 13:07:02.949393 20914 tablet_service.cc:1511] Processing CreateTablet for tablet f30cd5e45ed84494b8873834fae6b662 (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:02.952591 20840 tablet_service.cc:1511] Processing CreateTablet for tablet 9bb6caaaeb6d47f0924ea57eb2ff331c (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:02.953646 20914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f30cd5e45ed84494b8873834fae6b662. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.953706 20761 tablet_service.cc:1511] Processing CreateTablet for tablet 9bb6caaaeb6d47f0924ea57eb2ff331c (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:02.955056 20840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bb6caaaeb6d47f0924ea57eb2ff331c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.955338 20761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bb6caaaeb6d47f0924ea57eb2ff331c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.961769 20911 tablet_service.cc:1511] Processing CreateTablet for tablet 9bb6caaaeb6d47f0924ea57eb2ff331c (DEFAULT_TABLE table=test-workload [id=7bf82340832c4a459a7c55b5033a99c4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:02.963210 20911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bb6caaaeb6d47f0924ea57eb2ff331c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:02.969741 20967 consensus_queue.cc:260] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:02.983506 20967 ts_tablet_manager.cc:1434] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.005s
I20260709 13:07:02.976981 20968 raft_consensus.cc:359] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } }
I20260709 13:07:02.989893 20949 heartbeater.cc:499] Master 127.20.40.62:46749 was elected leader, sending a full tablet report...
I20260709 13:07:02.992118 20968 raft_consensus.cc:385] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:02.992611 20968 raft_consensus.cc:740] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Initialized, Role: FOLLOWER
I20260709 13:07:02.994735 20967 tablet_bootstrap.cc:492] T 1c903c9524124e92bf9904d93c83a581 P 63439ba2d4f540329fe3cfe3cdcf53ab: Bootstrap starting.
I20260709 13:07:02.994426 20968 consensus_queue.cc:260] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } }
I20260709 13:07:03.000211 20969 tablet_bootstrap.cc:492] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b: No bootstrap required, opened a new log
I20260709 13:07:03.000897 20969 ts_tablet_manager.cc:1403] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b: Time spent bootstrapping tablet: real 0.191s	user 0.012s	sys 0.022s
I20260709 13:07:03.004894 20969 raft_consensus.cc:359] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.005692 20969 raft_consensus.cc:385] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.005995 20969 raft_consensus.cc:740] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.006904 20969 consensus_queue.cc:260] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.011475 20967 tablet_bootstrap.cc:654] T 1c903c9524124e92bf9904d93c83a581 P 63439ba2d4f540329fe3cfe3cdcf53ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.016137 20800 heartbeater.cc:499] Master 127.20.40.62:46749 was elected leader, sending a full tablet report...
I20260709 13:07:03.017226 20875 heartbeater.cc:499] Master 127.20.40.62:46749 was elected leader, sending a full tablet report...
I20260709 13:07:03.022684 20969 ts_tablet_manager.cc:1434] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 13:07:03.024247 20969 tablet_bootstrap.cc:492] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b: Bootstrap starting.
I20260709 13:07:03.030799 20968 ts_tablet_manager.cc:1434] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.000s
I20260709 13:07:03.031244 20967 tablet_bootstrap.cc:492] T 1c903c9524124e92bf9904d93c83a581 P 63439ba2d4f540329fe3cfe3cdcf53ab: No bootstrap required, opened a new log
I20260709 13:07:03.031677 20969 tablet_bootstrap.cc:654] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.031769 20967 ts_tablet_manager.cc:1403] T 1c903c9524124e92bf9904d93c83a581 P 63439ba2d4f540329fe3cfe3cdcf53ab: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.006s
I20260709 13:07:03.031888 20968 tablet_bootstrap.cc:492] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428: Bootstrap starting.
I20260709 13:07:03.035508 20967 raft_consensus.cc:359] T 1c903c9524124e92bf9904d93c83a581 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.036376 20967 raft_consensus.cc:385] T 1c903c9524124e92bf9904d93c83a581 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.037242 20967 raft_consensus.cc:740] T 1c903c9524124e92bf9904d93c83a581 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.038380 20967 consensus_queue.cc:260] T 1c903c9524124e92bf9904d93c83a581 P 63439ba2d4f540329fe3cfe3cdcf53ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.041028 20967 ts_tablet_manager.cc:1434] T 1c903c9524124e92bf9904d93c83a581 P 63439ba2d4f540329fe3cfe3cdcf53ab: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:07:03.042102 20967 tablet_bootstrap.cc:492] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab: Bootstrap starting.
I20260709 13:07:03.046339 20968 tablet_bootstrap.cc:654] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:03.049124 20876 tablet.cc:2406] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:07:03.051635 20967 tablet_bootstrap.cc:654] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.062600 20967 tablet_bootstrap.cc:492] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab: No bootstrap required, opened a new log
I20260709 13:07:03.063102 20967 ts_tablet_manager.cc:1403] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 13:07:03.064248 20968 tablet_bootstrap.cc:492] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428: No bootstrap required, opened a new log
I20260709 13:07:03.064756 20968 ts_tablet_manager.cc:1403] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.000s
I20260709 13:07:03.066210 20967 raft_consensus.cc:359] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } }
I20260709 13:07:03.066967 20967 raft_consensus.cc:385] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.067282 20967 raft_consensus.cc:740] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.067644 20968 raft_consensus.cc:359] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.068127 20967 consensus_queue.cc:260] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } }
I20260709 13:07:03.068701 20968 raft_consensus.cc:385] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.069020 20968 raft_consensus.cc:740] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.069928 20968 consensus_queue.cc:260] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.070422 20967 ts_tablet_manager.cc:1434] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:07:03.071520 20967 tablet_bootstrap.cc:492] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab: Bootstrap starting.
I20260709 13:07:03.072058 20973 raft_consensus.cc:493] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.072327 20968 ts_tablet_manager.cc:1434] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:07:03.073352 20968 tablet_bootstrap.cc:492] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428: Bootstrap starting.
I20260709 13:07:03.072744 20973 raft_consensus.cc:515] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.078195 20967 tablet_bootstrap.cc:654] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.081313 20973 leader_election.cc:290] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867)
I20260709 13:07:03.091988 20968 tablet_bootstrap.cc:654] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.101536 20975 raft_consensus.cc:493] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.102145 20975 raft_consensus.cc:515] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.112671 20968 tablet_bootstrap.cc:492] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428: No bootstrap required, opened a new log
I20260709 13:07:03.114043 20968 ts_tablet_manager.cc:1403] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.006s
I20260709 13:07:03.116101 20975 leader_election.cc:290] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:03.117503 20968 raft_consensus.cc:359] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.118350 20968 raft_consensus.cc:385] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.118695 20968 raft_consensus.cc:740] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.119544 20968 consensus_queue.cc:260] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.127831 20968 ts_tablet_manager.cc:1434] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:07:03.128196 20967 tablet_bootstrap.cc:492] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab: No bootstrap required, opened a new log
I20260709 13:07:03.128752 20967 ts_tablet_manager.cc:1403] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.008s
I20260709 13:07:03.128793 20968 tablet_bootstrap.cc:492] T 06a6425feef84a3e8d7c2396bcd7b521 P 4ae7be6f1f9f42699d94c3df434e0428: Bootstrap starting.
I20260709 13:07:03.130395 20974 raft_consensus.cc:493] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.130929 20974 raft_consensus.cc:515] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.132436 20967 raft_consensus.cc:359] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.133190 20967 raft_consensus.cc:385] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.133517 20967 raft_consensus.cc:740] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.140283 20974 leader_election.cc:290] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:03.143563 20967 consensus_queue.cc:260] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.170897 20968 tablet_bootstrap.cc:654] T 06a6425feef84a3e8d7c2396bcd7b521 P 4ae7be6f1f9f42699d94c3df434e0428: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.174077 20967 ts_tablet_manager.cc:1434] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.003s
I20260709 13:07:03.174690 20969 tablet_bootstrap.cc:492] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b: No bootstrap required, opened a new log
I20260709 13:07:03.175235 20969 ts_tablet_manager.cc:1403] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b: Time spent bootstrapping tablet: real 0.151s	user 0.022s	sys 0.033s
I20260709 13:07:03.179668 20967 tablet_bootstrap.cc:492] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab: Bootstrap starting.
I20260709 13:07:03.181874 20775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66af6be5c900401dace8dfefb501fefc" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428" is_pre_election: true
I20260709 13:07:03.181972 20850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66af6be5c900401dace8dfefb501fefc" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27012f69cd1c41f1900022cdf9843d3b" is_pre_election: true
W20260709 13:07:03.191944 20889 leader_election.cc:343] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:03.197818 20924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c903c9524124e92bf9904d93c83a581" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" is_pre_election: true
I20260709 13:07:03.204128 20924 raft_consensus.cc:2468] T 1c903c9524124e92bf9904d93c83a581 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 0.
I20260709 13:07:03.220858 20813 leader_election.cc:304] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:03.222088 20975 raft_consensus.cc:2804] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:03.222563 20975 raft_consensus.cc:493] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.222931 20975 raft_consensus.cc:3060] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.234316 20969 raft_consensus.cc:359] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.235106 20969 raft_consensus.cc:385] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:03.235387 20889 leader_election.cc:343] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:03.236053 20889 leader_election.cc:304] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 27012f69cd1c41f1900022cdf9843d3b, 4ae7be6f1f9f42699d94c3df434e0428
I20260709 13:07:03.237166 20973 raft_consensus.cc:2749] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:03.239293 20973 raft_consensus.cc:493] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.239739 20973 raft_consensus.cc:515] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } }
I20260709 13:07:03.241019 20968 tablet_bootstrap.cc:492] T 06a6425feef84a3e8d7c2396bcd7b521 P 4ae7be6f1f9f42699d94c3df434e0428: No bootstrap required, opened a new log
I20260709 13:07:03.241645 20968 ts_tablet_manager.cc:1403] T 06a6425feef84a3e8d7c2396bcd7b521 P 4ae7be6f1f9f42699d94c3df434e0428: Time spent bootstrapping tablet: real 0.113s	user 0.035s	sys 0.022s
I20260709 13:07:03.241717 20973 leader_election.cc:290] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867), 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797)
I20260709 13:07:03.242918 20850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef02495bba0445fa3bdd7cd7a6e5982" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27012f69cd1c41f1900022cdf9843d3b" is_pre_election: true
I20260709 13:07:03.243279 20924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c903c9524124e92bf9904d93c83a581" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" is_pre_election: true
I20260709 13:07:03.243896 20924 raft_consensus.cc:2468] T 1c903c9524124e92bf9904d93c83a581 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ae7be6f1f9f42699d94c3df434e0428 in term 0.
I20260709 13:07:03.245117 20738 leader_election.cc:304] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:03.245404 20775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef02495bba0445fa3bdd7cd7a6e5982" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428" is_pre_election: true
I20260709 13:07:03.245522 20975 raft_consensus.cc:515] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.246061 20974 raft_consensus.cc:2804] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:03.245725 20968 raft_consensus.cc:359] T 06a6425feef84a3e8d7c2396bcd7b521 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.246430 20974 raft_consensus.cc:493] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.246253 20775 raft_consensus.cc:2468] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in term 0.
I20260709 13:07:03.246907 20974 raft_consensus.cc:3060] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.246910 20968 raft_consensus.cc:385] T 06a6425feef84a3e8d7c2396bcd7b521 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.247653 20968 raft_consensus.cc:740] T 06a6425feef84a3e8d7c2396bcd7b521 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.235417 20969 raft_consensus.cc:740] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.247990 20889 leader_election.cc:304] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:03.249156 20973 raft_consensus.cc:2804] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:07:03.249326 20889 leader_election.cc:343] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:03.249604 20973 raft_consensus.cc:493] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.249991 20973 raft_consensus.cc:3060] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.254324 20974 raft_consensus.cc:515] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.256434 20974 leader_election.cc:290] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 1 election: Requested vote from peers 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:03.257808 20924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c903c9524124e92bf9904d93c83a581" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
I20260709 13:07:03.258512 20924 raft_consensus.cc:3060] T 1c903c9524124e92bf9904d93c83a581 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.248621 20968 consensus_queue.cc:260] T 06a6425feef84a3e8d7c2396bcd7b521 P 4ae7be6f1f9f42699d94c3df434e0428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.259691 20849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c903c9524124e92bf9904d93c83a581" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
I20260709 13:07:03.260612 20968 ts_tablet_manager.cc:1434] T 06a6425feef84a3e8d7c2396bcd7b521 P 4ae7be6f1f9f42699d94c3df434e0428: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:07:03.260787 20849 raft_consensus.cc:2393] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ae7be6f1f9f42699d94c3df434e0428 in current term 1: Already voted for candidate 27012f69cd1c41f1900022cdf9843d3b in this term.
I20260709 13:07:03.258597 20850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c903c9524124e92bf9904d93c83a581" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27012f69cd1c41f1900022cdf9843d3b" is_pre_election: true
I20260709 13:07:03.261590 20968 tablet_bootstrap.cc:492] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428: Bootstrap starting.
I20260709 13:07:03.262019 20850 raft_consensus.cc:2393] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ae7be6f1f9f42699d94c3df434e0428 in current term 1: Already voted for candidate 27012f69cd1c41f1900022cdf9843d3b in this term.
I20260709 13:07:03.256896 20973 raft_consensus.cc:515] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } }
I20260709 13:07:03.269688 20975 leader_election.cc:290] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 1 election: Requested vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:03.269920 20923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c903c9524124e92bf9904d93c83a581" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
I20260709 13:07:03.270318 20850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef02495bba0445fa3bdd7cd7a6e5982" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
I20260709 13:07:03.270495 20973 leader_election.cc:290] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 election: Requested vote from peers 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867), 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797)
I20260709 13:07:03.248819 20969 consensus_queue.cc:260] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
W20260709 13:07:03.274590 20889 leader_election.cc:343] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:03.276539 20968 tablet_bootstrap.cc:654] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.276309 20775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef02495bba0445fa3bdd7cd7a6e5982" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
I20260709 13:07:03.277050 20775 raft_consensus.cc:3060] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.278533 20969 ts_tablet_manager.cc:1434] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.001s
I20260709 13:07:03.279608 20969 tablet_bootstrap.cc:492] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b: Bootstrap starting.
I20260709 13:07:03.280334 20924 raft_consensus.cc:2468] T 1c903c9524124e92bf9904d93c83a581 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae7be6f1f9f42699d94c3df434e0428 in term 1.
I20260709 13:07:03.281976 20738 leader_election.cc:304] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 27012f69cd1c41f1900022cdf9843d3b
I20260709 13:07:03.282914 20974 raft_consensus.cc:2804] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:03.285229 20775 raft_consensus.cc:2468] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in term 1.
I20260709 13:07:03.287227 20774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c903c9524124e92bf9904d93c83a581" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428" is_pre_election: true
I20260709 13:07:03.287555 20773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c903c9524124e92bf9904d93c83a581" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
I20260709 13:07:03.289460 20889 leader_election.cc:304] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 27012f69cd1c41f1900022cdf9843d3b
I20260709 13:07:03.289484 20815 leader_election.cc:304] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b; no voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab
I20260709 13:07:03.290771 20973 raft_consensus.cc:2804] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:03.291172 20975 raft_consensus.cc:2749] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:03.287941 20967 tablet_bootstrap.cc:654] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.300433 20969 tablet_bootstrap.cc:654] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.300637 20974 raft_consensus.cc:697] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 LEADER]: Becoming Leader. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Running, Role: LEADER
I20260709 13:07:03.301915 20974 consensus_queue.cc:237] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.304631 20973 raft_consensus.cc:697] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 LEADER]: Becoming Leader. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Running, Role: LEADER
I20260709 13:07:03.305637 20973 consensus_queue.cc:237] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } }
I20260709 13:07:03.318583 20967 tablet_bootstrap.cc:492] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab: No bootstrap required, opened a new log
I20260709 13:07:03.316730 20672 catalog_manager.cc:5697] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "4ae7be6f1f9f42699d94c3df434e0428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:03.319159 20967 ts_tablet_manager.cc:1403] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab: Time spent bootstrapping tablet: real 0.142s	user 0.022s	sys 0.009s
I20260709 13:07:03.322973 20967 raft_consensus.cc:359] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.324033 20967 raft_consensus.cc:385] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.324416 20967 raft_consensus.cc:740] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.326745 20967 consensus_queue.cc:260] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.329720 20967 ts_tablet_manager.cc:1434] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.005s
I20260709 13:07:03.330781 20967 tablet_bootstrap.cc:492] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab: Bootstrap starting.
I20260709 13:07:03.346098 20967 tablet_bootstrap.cc:654] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.349812 20969 tablet_bootstrap.cc:492] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b: No bootstrap required, opened a new log
I20260709 13:07:03.350342 20969 ts_tablet_manager.cc:1403] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.011s
I20260709 13:07:03.351560 20968 tablet_bootstrap.cc:492] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428: No bootstrap required, opened a new log
I20260709 13:07:03.352083 20968 ts_tablet_manager.cc:1403] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.013s
I20260709 13:07:03.353319 20969 raft_consensus.cc:359] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.354223 20969 raft_consensus.cc:385] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.354544 20969 raft_consensus.cc:740] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.355566 20969 consensus_queue.cc:260] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.357805 20969 ts_tablet_manager.cc:1434] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:07:03.358775 20969 tablet_bootstrap.cc:492] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b: Bootstrap starting.
I20260709 13:07:03.359998 20968 raft_consensus.cc:359] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.361584 20968 raft_consensus.cc:385] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.361950 20968 raft_consensus.cc:740] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.376029 20973 raft_consensus.cc:493] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.376528 20973 raft_consensus.cc:515] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.378587 20974 raft_consensus.cc:493] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.379153 20973 leader_election.cc:290] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867)
I20260709 13:07:03.379213 20974 raft_consensus.cc:515] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.376713 20670 catalog_manager.cc:5697] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3). New cstate: current_term: 1 leader_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:03.382436 20850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06a6425feef84a3e8d7c2396bcd7b521" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27012f69cd1c41f1900022cdf9843d3b" is_pre_election: true
I20260709 13:07:03.385764 20974 leader_election.cc:290] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:03.386463 20849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c5fcfb4ee74084ab476ebda66e1fe4" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27012f69cd1c41f1900022cdf9843d3b" is_pre_election: true
I20260709 13:07:03.387135 20849 raft_consensus.cc:2468] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ae7be6f1f9f42699d94c3df434e0428 in term 0.
I20260709 13:07:03.387408 20924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c5fcfb4ee74084ab476ebda66e1fe4" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" is_pre_election: true
I20260709 13:07:03.388049 20924 raft_consensus.cc:2468] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ae7be6f1f9f42699d94c3df434e0428 in term 0.
I20260709 13:07:03.375397 20968 consensus_queue.cc:260] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.383479 20774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06a6425feef84a3e8d7c2396bcd7b521" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428" is_pre_election: true
I20260709 13:07:03.390937 20774 raft_consensus.cc:2468] T 06a6425feef84a3e8d7c2396bcd7b521 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in term 0.
I20260709 13:07:03.392813 20889 leader_election.cc:304] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:03.389124 20740 leader_election.cc:304] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b, 4ae7be6f1f9f42699d94c3df434e0428; no voters: 
W20260709 13:07:03.394527 20889 leader_election.cc:343] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:03.394527 20991 raft_consensus.cc:2804] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:03.395800 20991 raft_consensus.cc:493] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.396168 20991 raft_consensus.cc:3060] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.397109 20973 raft_consensus.cc:2804] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:03.398510 20973 raft_consensus.cc:493] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.398931 20973 raft_consensus.cc:3060] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.403096 20968 ts_tablet_manager.cc:1434] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.012s
I20260709 13:07:03.404166 20968 tablet_bootstrap.cc:492] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428: Bootstrap starting.
I20260709 13:07:03.406901 20973 raft_consensus.cc:515] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.410475 20973 leader_election.cc:290] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 election: Requested vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867)
I20260709 13:07:03.411731 20774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06a6425feef84a3e8d7c2396bcd7b521" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
I20260709 13:07:03.412094 20850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06a6425feef84a3e8d7c2396bcd7b521" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
I20260709 13:07:03.412396 20774 raft_consensus.cc:3060] T 06a6425feef84a3e8d7c2396bcd7b521 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:03.413774 20889 leader_election.cc:343] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:03.418673 20991 raft_consensus.cc:515] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.421330 20969 tablet_bootstrap.cc:654] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.422814 20774 raft_consensus.cc:2468] T 06a6425feef84a3e8d7c2396bcd7b521 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in term 1.
I20260709 13:07:03.425632 20850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c5fcfb4ee74084ab476ebda66e1fe4" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
I20260709 13:07:03.428364 20850 raft_consensus.cc:3060] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.428301 20889 leader_election.cc:304] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 27012f69cd1c41f1900022cdf9843d3b
I20260709 13:07:03.431535 20968 tablet_bootstrap.cc:654] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.426112 20924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c5fcfb4ee74084ab476ebda66e1fe4" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
I20260709 13:07:03.433722 20973 raft_consensus.cc:2804] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:03.424834 20991 leader_election.cc:290] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 1 election: Requested vote from peers 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:03.434463 20924 raft_consensus.cc:3060] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.433630 20850 raft_consensus.cc:2468] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae7be6f1f9f42699d94c3df434e0428 in term 1.
I20260709 13:07:03.434811 20973 raft_consensus.cc:697] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 LEADER]: Becoming Leader. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Running, Role: LEADER
I20260709 13:07:03.435807 20740 leader_election.cc:304] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b, 4ae7be6f1f9f42699d94c3df434e0428; no voters: 
I20260709 13:07:03.435755 20973 consensus_queue.cc:237] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.436918 20991 raft_consensus.cc:2804] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:03.437649 20991 raft_consensus.cc:697] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 LEADER]: Becoming Leader. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Running, Role: LEADER
I20260709 13:07:03.438530 20991 consensus_queue.cc:237] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.426887 20967 tablet_bootstrap.cc:492] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab: No bootstrap required, opened a new log
I20260709 13:07:03.441865 20967 ts_tablet_manager.cc:1403] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab: Time spent bootstrapping tablet: real 0.111s	user 0.022s	sys 0.009s
I20260709 13:07:03.446712 20924 raft_consensus.cc:2468] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae7be6f1f9f42699d94c3df434e0428 in term 1.
I20260709 13:07:03.445168 20967 raft_consensus.cc:359] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.450109 20967 raft_consensus.cc:385] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.452474 20967 raft_consensus.cc:740] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.453459 20967 consensus_queue.cc:260] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.455968 20967 ts_tablet_manager.cc:1434] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:07:03.456987 20967 tablet_bootstrap.cc:492] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab: Bootstrap starting.
I20260709 13:07:03.460382 20670 catalog_manager.cc:5697] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "4ae7be6f1f9f42699d94c3df434e0428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:03.471138 20969 tablet_bootstrap.cc:492] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b: No bootstrap required, opened a new log
I20260709 13:07:03.471695 20969 ts_tablet_manager.cc:1403] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b: Time spent bootstrapping tablet: real 0.113s	user 0.010s	sys 0.005s
I20260709 13:07:03.474866 20969 raft_consensus.cc:359] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } }
I20260709 13:07:03.475677 20969 raft_consensus.cc:385] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.475981 20969 raft_consensus.cc:740] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.476717 20969 consensus_queue.cc:260] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } }
I20260709 13:07:03.482540 20967 tablet_bootstrap.cc:654] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.482671 20968 tablet_bootstrap.cc:492] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428: No bootstrap required, opened a new log
I20260709 13:07:03.483233 20968 ts_tablet_manager.cc:1403] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428: Time spent bootstrapping tablet: real 0.079s	user 0.012s	sys 0.003s
I20260709 13:07:03.483932 20670 catalog_manager.cc:5697] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3). New cstate: current_term: 1 leader_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.485605 20969 ts_tablet_manager.cc:1434] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.005s
I20260709 13:07:03.486654 20969 tablet_bootstrap.cc:492] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b: Bootstrap starting.
I20260709 13:07:03.495580 20968 raft_consensus.cc:359] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.496500 20968 raft_consensus.cc:385] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.496825 20968 raft_consensus.cc:740] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.497578 20968 consensus_queue.cc:260] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.499886 20968 ts_tablet_manager.cc:1434] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:07:03.501075 20968 tablet_bootstrap.cc:492] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428: Bootstrap starting.
I20260709 13:07:03.505620 20969 tablet_bootstrap.cc:654] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.511159 20968 tablet_bootstrap.cc:654] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.520746 20969 tablet_bootstrap.cc:492] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b: No bootstrap required, opened a new log
I20260709 13:07:03.521291 20969 ts_tablet_manager.cc:1403] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b: Time spent bootstrapping tablet: real 0.035s	user 0.005s	sys 0.006s
I20260709 13:07:03.524561 20969 raft_consensus.cc:359] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.525348 20969 raft_consensus.cc:385] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.525724 20969 raft_consensus.cc:740] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.528671 20968 tablet_bootstrap.cc:492] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428: No bootstrap required, opened a new log
I20260709 13:07:03.529194 20968 ts_tablet_manager.cc:1403] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 13:07:03.532279 20968 raft_consensus.cc:359] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.533093 20968 raft_consensus.cc:385] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.533417 20968 raft_consensus.cc:740] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.534276 20968 consensus_queue.cc:260] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.535458 20969 consensus_queue.cc:260] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.538528 20969 ts_tablet_manager.cc:1434] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:07:03.539701 20969 tablet_bootstrap.cc:492] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b: Bootstrap starting.
I20260709 13:07:03.545565 20968 ts_tablet_manager.cc:1434] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:07:03.546679 20968 tablet_bootstrap.cc:492] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428: Bootstrap starting.
I20260709 13:07:03.550582 20969 tablet_bootstrap.cc:654] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.557252 20968 tablet_bootstrap.cc:654] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.566780 20968 tablet_bootstrap.cc:492] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428: No bootstrap required, opened a new log
I20260709 13:07:03.568790 20968 ts_tablet_manager.cc:1403] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.002s
I20260709 13:07:03.571823 20969 tablet_bootstrap.cc:492] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b: No bootstrap required, opened a new log
I20260709 13:07:03.572391 20969 ts_tablet_manager.cc:1403] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.004s
I20260709 13:07:03.571944 20968 raft_consensus.cc:359] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.572638 20967 tablet_bootstrap.cc:492] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab: No bootstrap required, opened a new log
I20260709 13:07:03.572999 20968 raft_consensus.cc:385] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.573275 20967 ts_tablet_manager.cc:1403] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab: Time spent bootstrapping tablet: real 0.116s	user 0.044s	sys 0.048s
I20260709 13:07:03.573385 20968 raft_consensus.cc:740] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.574312 20968 consensus_queue.cc:260] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.575819 20969 raft_consensus.cc:359] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.576723 20968 ts_tablet_manager.cc:1434] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:03.577894 20968 tablet_bootstrap.cc:492] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428: Bootstrap starting.
I20260709 13:07:03.578680 20967 raft_consensus.cc:359] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.579514 20967 raft_consensus.cc:385] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.579849 20967 raft_consensus.cc:740] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.576686 20969 raft_consensus.cc:385] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.580686 20969 raft_consensus.cc:740] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.581907 20973 raft_consensus.cc:493] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.582433 20973 raft_consensus.cc:515] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.584180 20991 raft_consensus.cc:493] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.584654 20973 leader_election.cc:290] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867)
I20260709 13:07:03.584671 20991 raft_consensus.cc:515] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.587108 20991 leader_election.cc:290] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:03.587126 20774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f080cfb4234f168dc1ed6433c0a42a" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428" is_pre_election: true
I20260709 13:07:03.587975 20774 raft_consensus.cc:2468] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in term 0.
I20260709 13:07:03.588795 20924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d614ab9dad544ec58b5abef1e2e53bfa" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" is_pre_election: true
I20260709 13:07:03.589355 20889 leader_election.cc:304] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:03.589994 20850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f080cfb4234f168dc1ed6433c0a42a" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27012f69cd1c41f1900022cdf9843d3b" is_pre_election: true
I20260709 13:07:03.590312 20973 raft_consensus.cc:2804] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:03.590710 20973 raft_consensus.cc:493] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.590883 20968 tablet_bootstrap.cc:654] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.591113 20973 raft_consensus.cc:3060] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.591863 20849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d614ab9dad544ec58b5abef1e2e53bfa" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27012f69cd1c41f1900022cdf9843d3b" is_pre_election: true
W20260709 13:07:03.596949 20740 leader_election.cc:343] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:03.598903 20973 raft_consensus.cc:515] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.581583 20969 consensus_queue.cc:260] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.599884 20850 raft_consensus.cc:2468] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in term 0.
I20260709 13:07:03.601822 20774 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f080cfb4234f168dc1ed6433c0a42a" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
I20260709 13:07:03.602391 20774 raft_consensus.cc:3060] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.603274 20969 ts_tablet_manager.cc:1434] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:07:03.604353 20969 tablet_bootstrap.cc:492] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b: Bootstrap starting.
I20260709 13:07:03.609303 20967 consensus_queue.cc:260] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.610679 20924 raft_consensus.cc:2468] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ae7be6f1f9f42699d94c3df434e0428 in term 0.
I20260709 13:07:03.610822 20774 raft_consensus.cc:2468] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in term 1.
I20260709 13:07:03.612557 20889 leader_election.cc:304] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:03.613547 20738 leader_election.cc:304] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 27012f69cd1c41f1900022cdf9843d3b
I20260709 13:07:03.614580 20992 raft_consensus.cc:2804] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:03.614701 20991 raft_consensus.cc:2804] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:03.615127 20991 raft_consensus.cc:493] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.615136 20850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f080cfb4234f168dc1ed6433c0a42a" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
I20260709 13:07:03.616106 20850 raft_consensus.cc:3060] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.615631 20991 raft_consensus.cc:3060] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.621477 20967 ts_tablet_manager.cc:1434] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:07:03.622596 20967 tablet_bootstrap.cc:492] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab: Bootstrap starting.
I20260709 13:07:03.624197 20850 raft_consensus.cc:2468] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in term 1.
I20260709 13:07:03.625856 20973 leader_election.cc:290] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 election: Requested vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867)
I20260709 13:07:03.627727 20992 raft_consensus.cc:697] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 LEADER]: Becoming Leader. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Running, Role: LEADER
I20260709 13:07:03.628507 20992 consensus_queue.cc:237] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.636108 20967 tablet_bootstrap.cc:654] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.638301 20969 tablet_bootstrap.cc:654] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.636883 20991 raft_consensus.cc:515] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.645244 20968 tablet_bootstrap.cc:492] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428: No bootstrap required, opened a new log
I20260709 13:07:03.645776 20968 ts_tablet_manager.cc:1403] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428: Time spent bootstrapping tablet: real 0.068s	user 0.017s	sys 0.001s
I20260709 13:07:03.651783 20850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d614ab9dad544ec58b5abef1e2e53bfa" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
W20260709 13:07:03.653642 20740 leader_election.cc:343] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:03.654999 20991 leader_election.cc:290] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 1 election: Requested vote from peers 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:03.656105 20924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d614ab9dad544ec58b5abef1e2e53bfa" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
I20260709 13:07:03.656719 20924 raft_consensus.cc:3060] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.656522 20968 raft_consensus.cc:359] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.657501 20968 raft_consensus.cc:385] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.657881 20968 raft_consensus.cc:740] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.653831 20671 catalog_manager.cc:5697] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3). New cstate: current_term: 1 leader_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:03.658803 20968 consensus_queue.cc:260] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.661134 20967 tablet_bootstrap.cc:492] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab: No bootstrap required, opened a new log
I20260709 13:07:03.661182 20969 tablet_bootstrap.cc:492] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b: No bootstrap required, opened a new log
I20260709 13:07:03.663460 20969 ts_tablet_manager.cc:1403] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b: Time spent bootstrapping tablet: real 0.059s	user 0.017s	sys 0.003s
I20260709 13:07:03.664373 20968 ts_tablet_manager.cc:1434] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:07:03.665454 20967 ts_tablet_manager.cc:1403] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.005s
I20260709 13:07:03.671509 20967 raft_consensus.cc:359] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.672245 20967 raft_consensus.cc:385] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.667622 20969 raft_consensus.cc:359] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.672535 20967 raft_consensus.cc:740] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.672763 20969 raft_consensus.cc:385] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.673238 20969 raft_consensus.cc:740] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.673404 20967 consensus_queue.cc:260] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.674127 20969 consensus_queue.cc:260] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.675942 20967 ts_tablet_manager.cc:1434] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:03.676750 20969 ts_tablet_manager.cc:1434] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:07:03.676915 20967 tablet_bootstrap.cc:492] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab: Bootstrap starting.
I20260709 13:07:03.677883 20969 tablet_bootstrap.cc:492] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b: Bootstrap starting.
I20260709 13:07:03.684382 20967 tablet_bootstrap.cc:654] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.685545 20969 tablet_bootstrap.cc:654] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.686638 20975 raft_consensus.cc:493] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.687189 20975 raft_consensus.cc:515] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } }
I20260709 13:07:03.690778 20992 consensus_queue.cc:1048] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:03.691330 20923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef02495bba0445fa3bdd7cd7a6e5982" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" is_pre_election: true
I20260709 13:07:03.700379 21017 raft_consensus.cc:493] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.697827 20924 raft_consensus.cc:2468] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae7be6f1f9f42699d94c3df434e0428 in term 1.
I20260709 13:07:03.700879 21017 raft_consensus.cc:515] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.704365 20738 leader_election.cc:304] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 27012f69cd1c41f1900022cdf9843d3b
I20260709 13:07:03.704705 21017 leader_election.cc:290] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:03.704631 20775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66af6be5c900401dace8dfefb501fefc" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428" is_pre_election: true
I20260709 13:07:03.705569 20991 raft_consensus.cc:2804] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:03.705821 20923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66af6be5c900401dace8dfefb501fefc" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" is_pre_election: true
I20260709 13:07:03.706331 20991 raft_consensus.cc:697] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 LEADER]: Becoming Leader. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Running, Role: LEADER
I20260709 13:07:03.706699 20923 raft_consensus.cc:2468] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 0.
I20260709 13:07:03.708420 20813 leader_election.cc:304] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:03.707787 20991 consensus_queue.cc:237] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.709455 20775 raft_consensus.cc:2468] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 0.
I20260709 13:07:03.710641 20974 consensus_queue.cc:1048] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:03.712492 21017 raft_consensus.cc:2804] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:03.713754 21017 raft_consensus.cc:493] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.714159 21017 raft_consensus.cc:3060] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.718528 20967 tablet_bootstrap.cc:492] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab: No bootstrap required, opened a new log
I20260709 13:07:03.719115 20967 ts_tablet_manager.cc:1403] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.010s
I20260709 13:07:03.721539 20969 tablet_bootstrap.cc:492] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b: No bootstrap required, opened a new log
I20260709 13:07:03.722023 20969 ts_tablet_manager.cc:1403] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.010s
I20260709 13:07:03.732918 20967 raft_consensus.cc:359] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.733819 20967 raft_consensus.cc:385] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.733666 20969 raft_consensus.cc:359] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.734138 20967 raft_consensus.cc:740] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.734458 20969 raft_consensus.cc:385] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.734781 20969 raft_consensus.cc:740] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.735074 20967 consensus_queue.cc:260] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.736179 20969 consensus_queue.cc:260] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.743633 20967 ts_tablet_manager.cc:1434] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.004s
I20260709 13:07:03.744660 21017 raft_consensus.cc:515] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.755949 20850 raft_consensus.cc:3060] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.756155 21017 leader_election.cc:290] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 1 election: Requested vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:03.757790 20775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66af6be5c900401dace8dfefb501fefc" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
I20260709 13:07:03.762272 20775 raft_consensus.cc:3060] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.764160 20924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66af6be5c900401dace8dfefb501fefc" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
I20260709 13:07:03.767441 20924 raft_consensus.cc:3060] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.770169 21017 raft_consensus.cc:493] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.770676 21017 raft_consensus.cc:515] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.773711 20773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f30cd5e45ed84494b8873834fae6b662" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428" is_pre_election: true
I20260709 13:07:03.774649 20773 raft_consensus.cc:2468] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 0.
I20260709 13:07:03.774806 21017 leader_election.cc:290] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:03.778265 20815 leader_election.cc:304] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b, 4ae7be6f1f9f42699d94c3df434e0428; no voters: 
I20260709 13:07:03.780265 21017 raft_consensus.cc:2804] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:03.778813 20923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f30cd5e45ed84494b8873834fae6b662" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" is_pre_election: true
I20260709 13:07:03.780974 21017 raft_consensus.cc:493] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.784040 21017 raft_consensus.cc:3060] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.784508 20775 raft_consensus.cc:2468] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 1.
I20260709 13:07:03.785773 20815 leader_election.cc:304] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b, 4ae7be6f1f9f42699d94c3df434e0428; no voters: 
I20260709 13:07:03.782507 20969 ts_tablet_manager.cc:1434] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b: Time spent starting tablet: real 0.060s	user 0.012s	sys 0.006s
I20260709 13:07:03.787722 20969 tablet_bootstrap.cc:492] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 27012f69cd1c41f1900022cdf9843d3b: Bootstrap starting.
I20260709 13:07:03.787451 20923 raft_consensus.cc:2468] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 0.
I20260709 13:07:03.788228 21024 raft_consensus.cc:2804] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:03.787384 20991 consensus_queue.cc:1048] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:07:03.800282 21024 raft_consensus.cc:697] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 1 LEADER]: Becoming Leader. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Running, Role: LEADER
I20260709 13:07:03.800572 21017 raft_consensus.cc:515] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.801656 21024 consensus_queue.cc:237] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.802058 20924 raft_consensus.cc:2468] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 1.
I20260709 13:07:03.804355 20969 tablet_bootstrap.cc:654] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 27012f69cd1c41f1900022cdf9843d3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:03.804979 20992 consensus_queue.cc:1048] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:03.804203 20775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f30cd5e45ed84494b8873834fae6b662" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
I20260709 13:07:03.810842 20975 leader_election.cc:290] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209), 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797)
I20260709 13:07:03.829841 20975 raft_consensus.cc:493] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.831254 20975 raft_consensus.cc:515] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.830595 20773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef02495bba0445fa3bdd7cd7a6e5982" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428" is_pre_election: true
I20260709 13:07:03.835389 20991 raft_consensus.cc:493] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.837846 20991 raft_consensus.cc:515] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.838485 20924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d614ab9dad544ec58b5abef1e2e53bfa" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" is_pre_election: true
I20260709 13:07:03.839382 20924 raft_consensus.cc:2393] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27012f69cd1c41f1900022cdf9843d3b in current term 1: Already voted for candidate 4ae7be6f1f9f42699d94c3df434e0428 in this term.
I20260709 13:07:03.835322 20773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d614ab9dad544ec58b5abef1e2e53bfa" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428" is_pre_election: true
I20260709 13:07:03.835947 20775 raft_consensus.cc:3060] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:03.845939 20719 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:03.836215 20815 leader_election.cc:304] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b; no voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab
I20260709 13:07:03.849738 21026 raft_consensus.cc:2749] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:03.851339 20975 leader_election.cc:290] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:03.855813 20969 tablet_bootstrap.cc:492] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 27012f69cd1c41f1900022cdf9843d3b: No bootstrap required, opened a new log
I20260709 13:07:03.856581 20969 ts_tablet_manager.cc:1403] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 27012f69cd1c41f1900022cdf9843d3b: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.003s
I20260709 13:07:03.857451 20992 raft_consensus.cc:493] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.857991 20992 raft_consensus.cc:515] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.860232 20992 leader_election.cc:290] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867)
I20260709 13:07:03.860816 20969 raft_consensus.cc:359] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.861887 20969 raft_consensus.cc:385] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:03.862299 20969 raft_consensus.cc:740] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Initialized, Role: FOLLOWER
I20260709 13:07:03.862793 20773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb6caaaeb6d47f0924ea57eb2ff331c" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428" is_pre_election: true
I20260709 13:07:03.863570 20773 raft_consensus.cc:2468] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in term 0.
I20260709 13:07:03.865041 20889 leader_election.cc:304] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:03.857491 20815 leader_election.cc:304] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b; no voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab
I20260709 13:07:03.865960 20848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb6caaaeb6d47f0924ea57eb2ff331c" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27012f69cd1c41f1900022cdf9843d3b" is_pre_election: true
I20260709 13:07:03.866955 20992 raft_consensus.cc:2804] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:03.867448 20992 raft_consensus.cc:493] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.867890 20992 raft_consensus.cc:3060] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.865821 20969 consensus_queue.cc:260] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 27012f69cd1c41f1900022cdf9843d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.870925 20848 raft_consensus.cc:2468] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ae7be6f1f9f42699d94c3df434e0428 in term 0.
I20260709 13:07:03.872689 20672 catalog_manager.cc:5697] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "4ae7be6f1f9f42699d94c3df434e0428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:03.874135 20849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb6caaaeb6d47f0924ea57eb2ff331c" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27012f69cd1c41f1900022cdf9843d3b" is_pre_election: true
I20260709 13:07:03.876458 20924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f30cd5e45ed84494b8873834fae6b662" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
I20260709 13:07:03.885296 20849 raft_consensus.cc:2468] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in term 0.
I20260709 13:07:03.885576 20924 raft_consensus.cc:3060] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.876108 20992 raft_consensus.cc:515] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.886584 20991 leader_election.cc:290] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:03.887590 20740 leader_election.cc:304] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b, 4ae7be6f1f9f42699d94c3df434e0428; no voters: 
I20260709 13:07:03.887622 20992 leader_election.cc:290] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 election: Requested vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867)
I20260709 13:07:03.887740 20923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb6caaaeb6d47f0924ea57eb2ff331c" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" is_pre_election: true
I20260709 13:07:03.888613 20923 raft_consensus.cc:2393] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ae7be6f1f9f42699d94c3df434e0428 in current term 1: Already voted for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in this term.
I20260709 13:07:03.889166 21025 raft_consensus.cc:2804] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:03.889571 21025 raft_consensus.cc:493] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.889921 21025 raft_consensus.cc:3060] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.890584 20773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb6caaaeb6d47f0924ea57eb2ff331c" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
I20260709 13:07:03.891904 20850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb6caaaeb6d47f0924ea57eb2ff331c" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
I20260709 13:07:03.877035 20975 raft_consensus.cc:3060] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.890048 20775 raft_consensus.cc:2468] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 1.
I20260709 13:07:03.897305 20815 leader_election.cc:304] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b, 4ae7be6f1f9f42699d94c3df434e0428; no voters: 
I20260709 13:07:03.897454 21025 raft_consensus.cc:515] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.898680 20773 raft_consensus.cc:2393] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 63439ba2d4f540329fe3cfe3cdcf53ab in current term 1: Already voted for candidate 4ae7be6f1f9f42699d94c3df434e0428 in this term.
I20260709 13:07:03.898893 20969 ts_tablet_manager.cc:1434] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 27012f69cd1c41f1900022cdf9843d3b: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.010s
I20260709 13:07:03.899688 21025 leader_election.cc:290] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 1 election: Requested vote from peers 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:03.900663 20924 raft_consensus.cc:2468] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 1.
I20260709 13:07:03.905608 20975 raft_consensus.cc:2749] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:03.877089 21017 leader_election.cc:290] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 1 election: Requested vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:03.900794 21032 raft_consensus.cc:2804] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:03.907835 21032 raft_consensus.cc:697] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 1 LEADER]: Becoming Leader. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Running, Role: LEADER
I20260709 13:07:03.908819 21032 consensus_queue.cc:237] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.900872 20923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb6caaaeb6d47f0924ea57eb2ff331c" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
I20260709 13:07:03.910228 20923 raft_consensus.cc:2393] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ae7be6f1f9f42699d94c3df434e0428 in current term 1: Already voted for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in this term.
I20260709 13:07:03.901589 20889 leader_election.cc:304] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 27012f69cd1c41f1900022cdf9843d3b, 4ae7be6f1f9f42699d94c3df434e0428
I20260709 13:07:03.903196 20850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb6caaaeb6d47f0924ea57eb2ff331c" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
I20260709 13:07:03.912101 20850 raft_consensus.cc:3060] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:03.919140 20850 raft_consensus.cc:2468] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae7be6f1f9f42699d94c3df434e0428 in term 1.
I20260709 13:07:03.920236 20992 raft_consensus.cc:2749] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:03.920248 20740 leader_election.cc:304] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b, 4ae7be6f1f9f42699d94c3df434e0428; no voters: 63439ba2d4f540329fe3cfe3cdcf53ab
I20260709 13:07:03.921480 20991 raft_consensus.cc:2804] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:03.921999 20991 raft_consensus.cc:697] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 LEADER]: Becoming Leader. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Running, Role: LEADER
I20260709 13:07:03.922749 20991 consensus_queue.cc:237] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:03.923839 20671 catalog_manager.cc:5697] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2). New cstate: current_term: 1 leader_uuid: "27012f69cd1c41f1900022cdf9843d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:03.928725 21025 consensus_queue.cc:1048] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:03.934785 20670 catalog_manager.cc:5697] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "4ae7be6f1f9f42699d94c3df434e0428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:03.950942 20671 catalog_manager.cc:5697] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2). New cstate: current_term: 1 leader_uuid: "27012f69cd1c41f1900022cdf9843d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:03.956029 20991 consensus_queue.cc:1048] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:03.976059 20992 consensus_queue.cc:1048] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:03.991338 20850 raft_consensus.cc:3060] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:04.001466 21038 consensus_queue.cc:1048] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:04.024266 21038 consensus_queue.cc:1048] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:04.037209 21012 consensus_queue.cc:1048] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:04.195585 20923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aef02495bba0445fa3bdd7cd7a6e5982"
dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
mode: GRACEFUL
new_leader_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
 from {username='slave'} at 127.0.0.1:42304
I20260709 13:07:04.196313 20923 raft_consensus.cc:606] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 LEADER]: Received request to transfer leadership to TS 4ae7be6f1f9f42699d94c3df434e0428
I20260709 13:07:04.214812 20850 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66af6be5c900401dace8dfefb501fefc"
dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
mode: GRACEFUL
new_leader_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
 from {username='slave'} at 127.0.0.1:36694
I20260709 13:07:04.215391 20850 raft_consensus.cc:606] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 1 LEADER]: Received request to transfer leadership to TS 4ae7be6f1f9f42699d94c3df434e0428
I20260709 13:07:04.224495 20923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06a6425feef84a3e8d7c2396bcd7b521"
dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
mode: GRACEFUL
new_leader_uuid: "27012f69cd1c41f1900022cdf9843d3b"
 from {username='slave'} at 127.0.0.1:42304
I20260709 13:07:04.225111 20923 raft_consensus.cc:606] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 LEADER]: Received request to transfer leadership to TS 27012f69cd1c41f1900022cdf9843d3b
I20260709 13:07:04.240474 20773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d614ab9dad544ec58b5abef1e2e53bfa"
dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
mode: GRACEFUL
new_leader_uuid: "27012f69cd1c41f1900022cdf9843d3b"
 from {username='slave'} at 127.0.0.1:36916
I20260709 13:07:04.241055 20773 raft_consensus.cc:606] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 LEADER]: Received request to transfer leadership to TS 27012f69cd1c41f1900022cdf9843d3b
I20260709 13:07:04.247267 20923 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95f080cfb4234f168dc1ed6433c0a42a"
dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
mode: GRACEFUL
new_leader_uuid: "27012f69cd1c41f1900022cdf9843d3b"
 from {username='slave'} at 127.0.0.1:42304
I20260709 13:07:04.247898 20923 raft_consensus.cc:606] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 LEADER]: Received request to transfer leadership to TS 27012f69cd1c41f1900022cdf9843d3b
I20260709 13:07:04.256942 20773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9bb6caaaeb6d47f0924ea57eb2ff331c"
dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
mode: GRACEFUL
new_leader_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
 from {username='slave'} at 127.0.0.1:36916
I20260709 13:07:04.257504 20773 raft_consensus.cc:606] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 LEADER]: Received request to transfer leadership to TS 63439ba2d4f540329fe3cfe3cdcf53ab
I20260709 13:07:04.285812 21032 consensus_queue.cc:1048] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:04.290283 20975 consensus_queue.cc:1048] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:04.304694 20991 consensus_queue.cc:1048] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:04.308750 21017 raft_consensus.cc:993] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b: : Instructing follower 4ae7be6f1f9f42699d94c3df434e0428 to start an election
I20260709 13:07:04.309227 21017 raft_consensus.cc:1081] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 1 LEADER]: Signalling peer 4ae7be6f1f9f42699d94c3df434e0428 to start an election
I20260709 13:07:04.310264 20974 consensus_queue.cc:1048] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:04.322882 21024 consensus_queue.cc:1048] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:04.326399 21012 raft_consensus.cc:993] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab: : Instructing follower 4ae7be6f1f9f42699d94c3df434e0428 to start an election
I20260709 13:07:04.326583 20773 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66af6be5c900401dace8dfefb501fefc"
dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
 from {username='slave'} at 127.0.0.1:36914
I20260709 13:07:04.326864 21012 raft_consensus.cc:1081] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 LEADER]: Signalling peer 4ae7be6f1f9f42699d94c3df434e0428 to start an election
I20260709 13:07:04.327184 20773 raft_consensus.cc:493] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:04.327557 20773 raft_consensus.cc:3060] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.332737 20775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aef02495bba0445fa3bdd7cd7a6e5982"
dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
 from {username='slave'} at 127.0.0.1:36900
I20260709 13:07:04.333365 20775 raft_consensus.cc:493] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:04.333750 20775 raft_consensus.cc:3060] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.334641 20773 raft_consensus.cc:515] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:04.338078 20849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66af6be5c900401dace8dfefb501fefc" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
I20260709 13:07:04.338670 20849 raft_consensus.cc:3055] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:04.338586 20922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66af6be5c900401dace8dfefb501fefc" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
I20260709 13:07:04.339136 20849 raft_consensus.cc:740] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Running, Role: LEADER
I20260709 13:07:04.339304 20922 raft_consensus.cc:3060] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.339970 20849 consensus_queue.cc:260] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:04.341572 20849 raft_consensus.cc:3060] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.343659 20775 raft_consensus.cc:515] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } }
I20260709 13:07:04.346063 20775 leader_election.cc:290] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 2 election: Requested vote from peers 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209), 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867)
I20260709 13:07:04.346951 20921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef02495bba0445fa3bdd7cd7a6e5982" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
I20260709 13:07:04.347347 20848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef02495bba0445fa3bdd7cd7a6e5982" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
I20260709 13:07:04.347759 20921 raft_consensus.cc:3055] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:04.347982 20848 raft_consensus.cc:3060] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.348297 20921 raft_consensus.cc:740] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Running, Role: LEADER
I20260709 13:07:04.349308 20921 consensus_queue.cc:260] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } }
I20260709 13:07:04.351105 20921 raft_consensus.cc:3060] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.354341 20773 leader_election.cc:290] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 2 election: Requested vote from peers 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:04.360337 20921 raft_consensus.cc:2468] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae7be6f1f9f42699d94c3df434e0428 in term 2.
I20260709 13:07:04.361665 20738 leader_election.cc:304] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:04.361865 20922 raft_consensus.cc:2468] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae7be6f1f9f42699d94c3df434e0428 in term 2.
I20260709 13:07:04.362525 20974 raft_consensus.cc:2804] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:04.363032 20974 raft_consensus.cc:697] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 LEADER]: Becoming Leader. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Running, Role: LEADER
I20260709 13:07:04.363870 20974 consensus_queue.cc:237] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } }
I20260709 13:07:04.367259 20738 leader_election.cc:304] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:04.368162 20991 raft_consensus.cc:2804] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:04.368625 20991 raft_consensus.cc:697] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 LEADER]: Becoming Leader. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Running, Role: LEADER
I20260709 13:07:04.369403 20991 consensus_queue.cc:237] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:04.378562 20975 consensus_queue.cc:1048] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:04.381345 20848 raft_consensus.cc:2468] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae7be6f1f9f42699d94c3df434e0428 in term 2.
I20260709 13:07:04.380308 20849 raft_consensus.cc:2468] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae7be6f1f9f42699d94c3df434e0428 in term 2.
I20260709 13:07:04.402127 20672 catalog_manager.cc:5697] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 reported cstate change: term changed from 1 to 2, leader changed from 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3) to 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "4ae7be6f1f9f42699d94c3df434e0428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:04.411356 20991 raft_consensus.cc:993] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428: : Instructing follower 27012f69cd1c41f1900022cdf9843d3b to start an election
I20260709 13:07:04.411844 20991 raft_consensus.cc:1081] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 LEADER]: Signalling peer 27012f69cd1c41f1900022cdf9843d3b to start an election
I20260709 13:07:04.430522 20991 consensus_queue.cc:1048] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:04.431068 20849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d614ab9dad544ec58b5abef1e2e53bfa"
dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
 from {username='slave'} at 127.0.0.1:36678
I20260709 13:07:04.431681 20849 raft_consensus.cc:493] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:04.432053 20849 raft_consensus.cc:3060] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.442824 20849 raft_consensus.cc:515] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:04.445875 20773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d614ab9dad544ec58b5abef1e2e53bfa" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
I20260709 13:07:04.446516 20773 raft_consensus.cc:3055] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:04.446827 20773 raft_consensus.cc:740] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Running, Role: LEADER
I20260709 13:07:04.447592 21025 raft_consensus.cc:993] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428: : Instructing follower 63439ba2d4f540329fe3cfe3cdcf53ab to start an election
I20260709 13:07:04.447664 20773 consensus_queue.cc:260] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:04.449054 20773 raft_consensus.cc:3060] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.448342 21025 raft_consensus.cc:1081] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 LEADER]: Signalling peer 63439ba2d4f540329fe3cfe3cdcf53ab to start an election
I20260709 13:07:04.453938 20671 catalog_manager.cc:5697] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 reported cstate change: term changed from 1 to 2, leader changed from 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2) to 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "4ae7be6f1f9f42699d94c3df434e0428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:04.456694 20773 raft_consensus.cc:2468] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 2.
I20260709 13:07:04.458045 20815 leader_election.cc:304] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b, 4ae7be6f1f9f42699d94c3df434e0428; no voters: 
I20260709 13:07:04.458838 21024 raft_consensus.cc:2804] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:04.458956 21025 consensus_queue.cc:1048] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:04.459363 21024 raft_consensus.cc:697] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 2 LEADER]: Becoming Leader. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Running, Role: LEADER
I20260709 13:07:04.460423 20921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d614ab9dad544ec58b5abef1e2e53bfa" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
I20260709 13:07:04.461102 20921 raft_consensus.cc:3060] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.462589 20849 leader_election.cc:290] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 2 election: Requested vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:04.466802 21024 consensus_queue.cc:237] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:04.473613 20921 raft_consensus.cc:2468] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 2.
I20260709 13:07:04.482348 20921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9bb6caaaeb6d47f0924ea57eb2ff331c"
dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
 from {username='slave'} at 127.0.0.1:42300
I20260709 13:07:04.482960 20921 raft_consensus.cc:493] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:04.485265 20921 raft_consensus.cc:3060] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.486371 20973 raft_consensus.cc:993] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab: : Instructing follower 27012f69cd1c41f1900022cdf9843d3b to start an election
I20260709 13:07:04.486804 20973 raft_consensus.cc:1081] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 LEADER]: Signalling peer 27012f69cd1c41f1900022cdf9843d3b to start an election
I20260709 13:07:04.491724 21012 raft_consensus.cc:993] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab: : Instructing follower 27012f69cd1c41f1900022cdf9843d3b to start an election
I20260709 13:07:04.492169 21012 raft_consensus.cc:1081] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 LEADER]: Signalling peer 27012f69cd1c41f1900022cdf9843d3b to start an election
I20260709 13:07:04.492311 20921 raft_consensus.cc:515] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:04.481732 20672 catalog_manager.cc:5697] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b reported cstate change: term changed from 1 to 2, leader changed from 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1) to 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2). New cstate: current_term: 2 leader_uuid: "27012f69cd1c41f1900022cdf9843d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:04.494796 20921 leader_election.cc:290] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 2 election: Requested vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867)
I20260709 13:07:04.498483 20850 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb6caaaeb6d47f0924ea57eb2ff331c" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
I20260709 13:07:04.496030 20773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9bb6caaaeb6d47f0924ea57eb2ff331c" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
I20260709 13:07:04.499330 20773 raft_consensus.cc:3055] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:04.499655 20773 raft_consensus.cc:740] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Running, Role: LEADER
I20260709 13:07:04.499874 20850 raft_consensus.cc:3060] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.500422 20773 consensus_queue.cc:260] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:04.501701 20773 raft_consensus.cc:3060] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.496470 20848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95f080cfb4234f168dc1ed6433c0a42a"
dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
 from {username='slave'} at 127.0.0.1:36662
I20260709 13:07:04.496857 20849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06a6425feef84a3e8d7c2396bcd7b521"
dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
 from {username='slave'} at 127.0.0.1:36662
I20260709 13:07:04.504220 20849 raft_consensus.cc:493] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:04.504601 20849 raft_consensus.cc:3060] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.507368 20850 raft_consensus.cc:2468] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in term 2.
I20260709 13:07:04.508386 20773 raft_consensus.cc:2468] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in term 2.
I20260709 13:07:04.508723 20889 leader_election.cc:304] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:04.509378 20848 raft_consensus.cc:493] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:04.509680 20992 raft_consensus.cc:2804] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:04.509867 20848 raft_consensus.cc:3060] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.510247 20992 raft_consensus.cc:697] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 LEADER]: Becoming Leader. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Running, Role: LEADER
I20260709 13:07:04.511101 20992 consensus_queue.cc:237] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:04.517036 20848 raft_consensus.cc:515] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:04.518179 20849 raft_consensus.cc:515] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:04.519922 20773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f080cfb4234f168dc1ed6433c0a42a" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
I20260709 13:07:04.520418 20849 leader_election.cc:290] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 2 election: Requested vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:04.520519 20773 raft_consensus.cc:3060] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.520911 20848 leader_election.cc:290] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 2 election: Requested vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:04.522614 20924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06a6425feef84a3e8d7c2396bcd7b521" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
I20260709 13:07:04.522811 20921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f080cfb4234f168dc1ed6433c0a42a" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
I20260709 13:07:04.523208 20924 raft_consensus.cc:3055] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:04.523370 20921 raft_consensus.cc:3055] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:04.523602 20924 raft_consensus.cc:740] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Running, Role: LEADER
I20260709 13:07:04.523782 20921 raft_consensus.cc:740] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Running, Role: LEADER
I20260709 13:07:04.524560 20921 consensus_queue.cc:260] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:04.525729 20775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06a6425feef84a3e8d7c2396bcd7b521" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
I20260709 13:07:04.525911 20921 raft_consensus.cc:3060] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.526309 20775 raft_consensus.cc:3060] T 06a6425feef84a3e8d7c2396bcd7b521 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.531924 20773 raft_consensus.cc:2468] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 2.
I20260709 13:07:04.532404 20921 raft_consensus.cc:2468] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 2.
I20260709 13:07:04.534556 20815 leader_election.cc:304] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b, 4ae7be6f1f9f42699d94c3df434e0428; no voters: 
I20260709 13:07:04.535362 21024 raft_consensus.cc:2804] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:04.535844 21024 raft_consensus.cc:697] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [term 2 LEADER]: Becoming Leader. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Running, Role: LEADER
I20260709 13:07:04.524502 20924 consensus_queue.cc:260] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:04.536616 21024 consensus_queue.cc:237] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:04.540256 20924 raft_consensus.cc:3060] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:04.541392 20775 raft_consensus.cc:2468] T 06a6425feef84a3e8d7c2396bcd7b521 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 2.
I20260709 13:07:04.542614 20815 leader_election.cc:304] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b, 4ae7be6f1f9f42699d94c3df434e0428; no voters: 
I20260709 13:07:04.543839 21024 raft_consensus.cc:2804] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:04.544415 21024 raft_consensus.cc:697] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b [term 2 LEADER]: Becoming Leader. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Running, Role: LEADER
I20260709 13:07:04.545199 21024 consensus_queue.cc:237] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:04.551823 20924 raft_consensus.cc:2468] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 2.
I20260709 13:07:04.553519 20672 catalog_manager.cc:5697] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b reported cstate change: term changed from 1 to 2, leader changed from 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3) to 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2). New cstate: current_term: 2 leader_uuid: "27012f69cd1c41f1900022cdf9843d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:04.561635 20671 catalog_manager.cc:5697] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab reported cstate change: term changed from 1 to 2, leader changed from 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1) to 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3). New cstate: current_term: 2 leader_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:04.566411 20672 catalog_manager.cc:5697] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b reported cstate change: term changed from 1 to 2, leader changed from 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3) to 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2). New cstate: current_term: 2 leader_uuid: "27012f69cd1c41f1900022cdf9843d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:04.753360 20848 raft_consensus.cc:1275] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Refusing update from remote peer 4ae7be6f1f9f42699d94c3df434e0428: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:04.754902 20991 consensus_queue.cc:1048] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:04.763398 20924 raft_consensus.cc:1275] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Refusing update from remote peer 4ae7be6f1f9f42699d94c3df434e0428: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:04.765625 20991 consensus_queue.cc:1048] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:04.833531 20924 raft_consensus.cc:1275] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Refusing update from remote peer 4ae7be6f1f9f42699d94c3df434e0428: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:04.835017 20991 consensus_queue.cc:1048] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:04.845504 20848 raft_consensus.cc:1275] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Refusing update from remote peer 4ae7be6f1f9f42699d94c3df434e0428: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:04.847944 20991 consensus_queue.cc:1048] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:04.903107 20775 raft_consensus.cc:1275] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Refusing update from remote peer 63439ba2d4f540329fe3cfe3cdcf53ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:04.904487 20992 consensus_queue.cc:1048] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:04.913007 20848 raft_consensus.cc:1275] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Refusing update from remote peer 63439ba2d4f540329fe3cfe3cdcf53ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:04.914680 20973 consensus_queue.cc:1048] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:04.925638 20775 raft_consensus.cc:1275] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Refusing update from remote peer 27012f69cd1c41f1900022cdf9843d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:04.927716 20975 consensus_queue.cc:1048] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:04.935989 20924 raft_consensus.cc:1275] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Refusing update from remote peer 27012f69cd1c41f1900022cdf9843d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:04.937779 21032 consensus_queue.cc:1048] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:05.050417 20924 raft_consensus.cc:1275] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Refusing update from remote peer 27012f69cd1c41f1900022cdf9843d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:05.051658 21032 consensus_queue.cc:1048] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:05.059772 20775 raft_consensus.cc:1275] T 06a6425feef84a3e8d7c2396bcd7b521 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Refusing update from remote peer 27012f69cd1c41f1900022cdf9843d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:05.061589 21024 consensus_queue.cc:1048] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:05.094393 20924 raft_consensus.cc:1275] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Refusing update from remote peer 27012f69cd1c41f1900022cdf9843d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:05.095686 21024 consensus_queue.cc:1048] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:05.107167 20775 raft_consensus.cc:1275] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Refusing update from remote peer 27012f69cd1c41f1900022cdf9843d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:05.109112 21032 consensus_queue.cc:1048] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:07.285689 20640 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:07:07.286541 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:07.305382 20775 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51c5fcfb4ee74084ab476ebda66e1fe4"
dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
mode: GRACEFUL
new_leader_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
 from {username='slave'} at 127.0.0.1:36922
I20260709 13:07:07.306020 20775 raft_consensus.cc:606] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 LEADER]: Received request to transfer leadership to TS 63439ba2d4f540329fe3cfe3cdcf53ab
I20260709 13:07:07.316977 20849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f30cd5e45ed84494b8873834fae6b662"
dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
mode: GRACEFUL
new_leader_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
 from {username='slave'} at 127.0.0.1:36710
I20260709 13:07:07.317588 20849 raft_consensus.cc:606] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 1 LEADER]: Received request to transfer leadership to TS 63439ba2d4f540329fe3cfe3cdcf53ab
I20260709 13:07:07.318907 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:07.319537 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:07.320789 20975 raft_consensus.cc:993] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b: : Instructing follower 63439ba2d4f540329fe3cfe3cdcf53ab to start an election
I20260709 13:07:07.321240 21066 raft_consensus.cc:1081] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 1 LEADER]: Signalling peer 63439ba2d4f540329fe3cfe3cdcf53ab to start an election
I20260709 13:07:07.323129 20924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f30cd5e45ed84494b8873834fae6b662"
dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
 from {username='slave'} at 127.0.0.1:42286
I20260709 13:07:07.323844 20924 raft_consensus.cc:493] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:07.324224 20924 raft_consensus.cc:3060] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.328926 20924 raft_consensus.cc:515] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:07.330446 20924 leader_election.cc:290] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 2 election: Requested vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867)
I20260709 13:07:07.331398 20775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f30cd5e45ed84494b8873834fae6b662" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
I20260709 13:07:07.331581 20849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f30cd5e45ed84494b8873834fae6b662" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
I20260709 13:07:07.331888 20775 raft_consensus.cc:3060] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.332166 20849 raft_consensus.cc:3055] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:07.332469 20849 raft_consensus.cc:740] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Running, Role: LEADER
I20260709 13:07:07.333173 20849 consensus_queue.cc:260] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:07.334081 20849 raft_consensus.cc:3060] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.336651 20775 raft_consensus.cc:2468] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in term 2.
I20260709 13:07:07.337816 20889 leader_election.cc:304] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:07.338541 21061 raft_consensus.cc:2804] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:07.338510 20849 raft_consensus.cc:2468] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in term 2.
I20260709 13:07:07.340410 21061 raft_consensus.cc:697] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 LEADER]: Becoming Leader. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Running, Role: LEADER
I20260709 13:07:07.341271 21061 consensus_queue.cc:237] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:07.349185 20671 catalog_manager.cc:5697] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab reported cstate change: term changed from 1 to 2, leader changed from 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2) to 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3). New cstate: current_term: 2 leader_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:07.480094 20991 raft_consensus.cc:993] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428: : Instructing follower 63439ba2d4f540329fe3cfe3cdcf53ab to start an election
I20260709 13:07:07.480463 20991 raft_consensus.cc:1081] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 LEADER]: Signalling peer 63439ba2d4f540329fe3cfe3cdcf53ab to start an election
I20260709 13:07:07.481984 20924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51c5fcfb4ee74084ab476ebda66e1fe4"
dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
 from {username='slave'} at 127.0.0.1:42300
I20260709 13:07:07.482482 20924 raft_consensus.cc:493] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:07.482776 20924 raft_consensus.cc:3060] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.487164 20924 raft_consensus.cc:515] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:07.488673 20924 leader_election.cc:290] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 2 election: Requested vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867)
I20260709 13:07:07.489598 20775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c5fcfb4ee74084ab476ebda66e1fe4" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
I20260709 13:07:07.490094 20775 raft_consensus.cc:3055] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:07.490078 20849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c5fcfb4ee74084ab476ebda66e1fe4" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
I20260709 13:07:07.490507 20775 raft_consensus.cc:740] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Running, Role: LEADER
I20260709 13:07:07.490733 20849 raft_consensus.cc:3060] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.491338 20775 consensus_queue.cc:260] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:07.492523 20775 raft_consensus.cc:3060] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:07.496688 20849 raft_consensus.cc:2468] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in term 2.
I20260709 13:07:07.497704 20889 leader_election.cc:304] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:07.498173 20775 raft_consensus.cc:2468] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in term 2.
I20260709 13:07:07.498363 21061 raft_consensus.cc:2804] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:07.498811 21061 raft_consensus.cc:697] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 LEADER]: Becoming Leader. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Running, Role: LEADER
I20260709 13:07:07.499629 21061 consensus_queue.cc:237] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:07.509639 20671 catalog_manager.cc:5697] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab reported cstate change: term changed from 1 to 2, leader changed from 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1) to 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3). New cstate: current_term: 2 leader_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:07.871604 20775 raft_consensus.cc:1275] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Refusing update from remote peer 63439ba2d4f540329fe3cfe3cdcf53ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:07.872941 21061 consensus_queue.cc:1048] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:07.883705 20849 raft_consensus.cc:1275] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Refusing update from remote peer 63439ba2d4f540329fe3cfe3cdcf53ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:07.885282 21061 consensus_queue.cc:1048] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:08.028519 20849 raft_consensus.cc:1275] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Refusing update from remote peer 63439ba2d4f540329fe3cfe3cdcf53ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:08.029906 21061 consensus_queue.cc:1048] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:08.039491 20775 raft_consensus.cc:1275] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Refusing update from remote peer 63439ba2d4f540329fe3cfe3cdcf53ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:08.040940 21081 consensus_queue.cc:1048] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:08.320407 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:08.330044 20773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aef02495bba0445fa3bdd7cd7a6e5982"
dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
mode: GRACEFUL
new_leader_uuid: "27012f69cd1c41f1900022cdf9843d3b"
 from {username='slave'} at 127.0.0.1:36916
I20260709 13:07:08.330586 20773 raft_consensus.cc:606] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 LEADER]: Received request to transfer leadership to TS 27012f69cd1c41f1900022cdf9843d3b
I20260709 13:07:08.335332 20773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c903c9524124e92bf9904d93c83a581"
dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
mode: GRACEFUL
new_leader_uuid: "27012f69cd1c41f1900022cdf9843d3b"
 from {username='slave'} at 127.0.0.1:36916
I20260709 13:07:08.335830 20773 raft_consensus.cc:606] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 LEADER]: Received request to transfer leadership to TS 27012f69cd1c41f1900022cdf9843d3b
I20260709 13:07:08.340775 20773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66af6be5c900401dace8dfefb501fefc"
dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
mode: GRACEFUL
new_leader_uuid: "27012f69cd1c41f1900022cdf9843d3b"
 from {username='slave'} at 127.0.0.1:36916
I20260709 13:07:08.341462 20773 raft_consensus.cc:606] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 LEADER]: Received request to transfer leadership to TS 27012f69cd1c41f1900022cdf9843d3b
I20260709 13:07:08.346797 20921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51c5fcfb4ee74084ab476ebda66e1fe4"
dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
mode: GRACEFUL
new_leader_uuid: "27012f69cd1c41f1900022cdf9843d3b"
 from {username='slave'} at 127.0.0.1:42304
I20260709 13:07:08.347337 20921 raft_consensus.cc:606] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 LEADER]: Received request to transfer leadership to TS 27012f69cd1c41f1900022cdf9843d3b
I20260709 13:07:08.360059 20921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f30cd5e45ed84494b8873834fae6b662"
dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
mode: GRACEFUL
new_leader_uuid: "27012f69cd1c41f1900022cdf9843d3b"
 from {username='slave'} at 127.0.0.1:42304
I20260709 13:07:08.360615 20921 raft_consensus.cc:606] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 LEADER]: Received request to transfer leadership to TS 27012f69cd1c41f1900022cdf9843d3b
I20260709 13:07:08.396644 21061 raft_consensus.cc:993] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab: : Instructing follower 27012f69cd1c41f1900022cdf9843d3b to start an election
I20260709 13:07:08.397107 21061 raft_consensus.cc:1081] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 LEADER]: Signalling peer 27012f69cd1c41f1900022cdf9843d3b to start an election
I20260709 13:07:08.398730 20849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f30cd5e45ed84494b8873834fae6b662"
dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
 from {username='slave'} at 127.0.0.1:36662
I20260709 13:07:08.399338 20849 raft_consensus.cc:493] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:08.399716 20849 raft_consensus.cc:3060] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:08.404572 20849 raft_consensus.cc:515] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:08.406185 20849 leader_election.cc:290] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 3 election: Requested vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:08.407106 20773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f30cd5e45ed84494b8873834fae6b662" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
I20260709 13:07:08.407294 20921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f30cd5e45ed84494b8873834fae6b662" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
I20260709 13:07:08.407614 20773 raft_consensus.cc:3060] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:08.407831 20921 raft_consensus.cc:3055] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:08.408192 20921 raft_consensus.cc:740] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Running, Role: LEADER
I20260709 13:07:08.408855 20921 consensus_queue.cc:260] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:08.409785 20921 raft_consensus.cc:3060] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:08.412869 20773 raft_consensus.cc:2468] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 3.
I20260709 13:07:08.414269 20815 leader_election.cc:304] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b, 4ae7be6f1f9f42699d94c3df434e0428; no voters: 
I20260709 13:07:08.415244 20975 raft_consensus.cc:2804] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:08.415258 20921 raft_consensus.cc:2468] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 3.
I20260709 13:07:08.415784 20975 raft_consensus.cc:697] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 3 LEADER]: Becoming Leader. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Running, Role: LEADER
I20260709 13:07:08.416723 20975 consensus_queue.cc:237] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:08.419613 21081 raft_consensus.cc:993] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab: : Instructing follower 27012f69cd1c41f1900022cdf9843d3b to start an election
I20260709 13:07:08.420042 21081 raft_consensus.cc:1081] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 LEADER]: Signalling peer 27012f69cd1c41f1900022cdf9843d3b to start an election
I20260709 13:07:08.421590 20849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51c5fcfb4ee74084ab476ebda66e1fe4"
dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
 from {username='slave'} at 127.0.0.1:36662
I20260709 13:07:08.422048 20849 raft_consensus.cc:493] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:08.422412 20849 raft_consensus.cc:3060] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:08.423813 20671 catalog_manager.cc:5697] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b reported cstate change: term changed from 2 to 3, leader changed from 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3) to 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2). New cstate: current_term: 3 leader_uuid: "27012f69cd1c41f1900022cdf9843d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:08.426972 20849 raft_consensus.cc:515] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:08.428823 20849 leader_election.cc:290] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 3 election: Requested vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:08.430107 20921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c5fcfb4ee74084ab476ebda66e1fe4" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
I20260709 13:07:08.430281 20773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c5fcfb4ee74084ab476ebda66e1fe4" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
I20260709 13:07:08.431036 20773 raft_consensus.cc:3060] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:08.430845 20921 raft_consensus.cc:3055] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:08.431442 20921 raft_consensus.cc:740] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Running, Role: LEADER
I20260709 13:07:08.432320 20921 consensus_queue.cc:260] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:08.433549 20921 raft_consensus.cc:3060] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:08.437836 20773 raft_consensus.cc:2468] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 3.
I20260709 13:07:08.439157 20815 leader_election.cc:304] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b, 4ae7be6f1f9f42699d94c3df434e0428; no voters: 
I20260709 13:07:08.440018 20975 raft_consensus.cc:2804] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:08.440507 20975 raft_consensus.cc:697] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 3 LEADER]: Becoming Leader. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Running, Role: LEADER
I20260709 13:07:08.440613 20921 raft_consensus.cc:2468] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 3.
I20260709 13:07:08.441378 20975 consensus_queue.cc:237] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:08.446056 21088 raft_consensus.cc:993] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428: : Instructing follower 27012f69cd1c41f1900022cdf9843d3b to start an election
I20260709 13:07:08.446630 21073 raft_consensus.cc:1081] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 LEADER]: Signalling peer 27012f69cd1c41f1900022cdf9843d3b to start an election
I20260709 13:07:08.448201 20849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66af6be5c900401dace8dfefb501fefc"
dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
 from {username='slave'} at 127.0.0.1:36678
I20260709 13:07:08.448699 20849 raft_consensus.cc:493] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:08.448997 20849 raft_consensus.cc:3060] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:08.449072 20671 catalog_manager.cc:5697] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b reported cstate change: term changed from 2 to 3, leader changed from 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3) to 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2). New cstate: current_term: 3 leader_uuid: "27012f69cd1c41f1900022cdf9843d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:08.454516 20849 raft_consensus.cc:515] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:08.456924 20849 leader_election.cc:290] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 3 election: Requested vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:08.457077 20773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66af6be5c900401dace8dfefb501fefc" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
I20260709 13:07:08.457732 20773 raft_consensus.cc:3055] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:08.458081 20773 raft_consensus.cc:740] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Running, Role: LEADER
I20260709 13:07:08.458278 20921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66af6be5c900401dace8dfefb501fefc" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
I20260709 13:07:08.458916 20921 raft_consensus.cc:3060] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:08.459234 20773 consensus_queue.cc:260] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:08.460145 20773 raft_consensus.cc:3060] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:08.464282 20921 raft_consensus.cc:2468] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 3.
I20260709 13:07:08.464599 20773 raft_consensus.cc:2468] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 3.
I20260709 13:07:08.465353 20813 leader_election.cc:304] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:08.466053 20975 raft_consensus.cc:2804] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:08.466578 20975 raft_consensus.cc:697] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 3 LEADER]: Becoming Leader. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Running, Role: LEADER
I20260709 13:07:08.467391 20975 consensus_queue.cc:237] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:08.476380 20671 catalog_manager.cc:5697] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b reported cstate change: term changed from 2 to 3, leader changed from 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1) to 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2). New cstate: current_term: 3 leader_uuid: "27012f69cd1c41f1900022cdf9843d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:08.499537 21088 raft_consensus.cc:993] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428: : Instructing follower 27012f69cd1c41f1900022cdf9843d3b to start an election
I20260709 13:07:08.500007 21073 raft_consensus.cc:1081] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 LEADER]: Signalling peer 27012f69cd1c41f1900022cdf9843d3b to start an election
I20260709 13:07:08.501638 20849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c903c9524124e92bf9904d93c83a581"
dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
 from {username='slave'} at 127.0.0.1:36678
I20260709 13:07:08.502168 20849 raft_consensus.cc:493] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:08.502629 20849 raft_consensus.cc:3060] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.505739 21088 raft_consensus.cc:993] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428: : Instructing follower 27012f69cd1c41f1900022cdf9843d3b to start an election
I20260709 13:07:08.506176 21088 raft_consensus.cc:1081] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 LEADER]: Signalling peer 27012f69cd1c41f1900022cdf9843d3b to start an election
I20260709 13:07:08.507771 20848 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aef02495bba0445fa3bdd7cd7a6e5982"
dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
 from {username='slave'} at 127.0.0.1:36678
I20260709 13:07:08.508242 20848 raft_consensus.cc:493] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:08.508575 20848 raft_consensus.cc:3060] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:08.508333 20849 raft_consensus.cc:515] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:08.510488 20849 leader_election.cc:290] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 2 election: Requested vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:08.511188 20773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c903c9524124e92bf9904d93c83a581" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
I20260709 13:07:08.511634 20921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c903c9524124e92bf9904d93c83a581" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
I20260709 13:07:08.511828 20773 raft_consensus.cc:3055] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:08.512269 20773 raft_consensus.cc:740] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Running, Role: LEADER
I20260709 13:07:08.512351 20921 raft_consensus.cc:3060] T 1c903c9524124e92bf9904d93c83a581 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.513222 20773 consensus_queue.cc:260] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:08.514456 20773 raft_consensus.cc:3060] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:08.515065 20848 raft_consensus.cc:515] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } }
I20260709 13:07:08.517632 20848 leader_election.cc:290] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 3 election: Requested vote from peers 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209), 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797)
I20260709 13:07:08.518226 20924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef02495bba0445fa3bdd7cd7a6e5982" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
I20260709 13:07:08.518313 20921 raft_consensus.cc:2468] T 1c903c9524124e92bf9904d93c83a581 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 2.
I20260709 13:07:08.518286 20775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef02495bba0445fa3bdd7cd7a6e5982" candidate_uuid: "27012f69cd1c41f1900022cdf9843d3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
I20260709 13:07:08.518877 20924 raft_consensus.cc:3060] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:08.519170 20775 raft_consensus.cc:3055] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:08.519577 20775 raft_consensus.cc:740] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Running, Role: LEADER
I20260709 13:07:08.519773 20813 leader_election.cc:304] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:08.520640 20975 raft_consensus.cc:2804] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:08.520328 20775 consensus_queue.cc:260] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } }
I20260709 13:07:08.521136 20975 raft_consensus.cc:697] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [term 2 LEADER]: Becoming Leader. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Running, Role: LEADER
I20260709 13:07:08.521696 20775 raft_consensus.cc:3060] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:08.522042 20975 consensus_queue.cc:237] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:08.524765 20924 raft_consensus.cc:2468] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 3.
I20260709 13:07:08.524765 20773 raft_consensus.cc:2468] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 2.
I20260709 13:07:08.526065 20813 leader_election.cc:304] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:08.526865 21084 raft_consensus.cc:2804] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:08.527302 21084 raft_consensus.cc:697] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 3 LEADER]: Becoming Leader. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Running, Role: LEADER
I20260709 13:07:08.528254 21084 consensus_queue.cc:237] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } }
I20260709 13:07:08.529229 20775 raft_consensus.cc:2468] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27012f69cd1c41f1900022cdf9843d3b in term 3.
I20260709 13:07:08.532289 20671 catalog_manager.cc:5697] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b reported cstate change: term changed from 1 to 2, leader changed from 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1) to 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2). New cstate: current_term: 2 leader_uuid: "27012f69cd1c41f1900022cdf9843d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:08.544090 20671 catalog_manager.cc:5697] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b reported cstate change: term changed from 2 to 3, leader changed from 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1) to 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2). New cstate: current_term: 3 leader_uuid: "27012f69cd1c41f1900022cdf9843d3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:08.869154 20924 raft_consensus.cc:1275] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Refusing update from remote peer 27012f69cd1c41f1900022cdf9843d3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:08.870814 21084 consensus_queue.cc:1048] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:08.878629 20775 raft_consensus.cc:1275] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 FOLLOWER]: Refusing update from remote peer 27012f69cd1c41f1900022cdf9843d3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:08.880990 21084 consensus_queue.cc:1048] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:08.972489 20775 raft_consensus.cc:1275] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Refusing update from remote peer 27012f69cd1c41f1900022cdf9843d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:08.974218 21084 consensus_queue.cc:1048] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:08.974660 20775 raft_consensus.cc:1275] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 FOLLOWER]: Refusing update from remote peer 27012f69cd1c41f1900022cdf9843d3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:08.975795 21084 consensus_queue.cc:1048] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:08.983510 20924 raft_consensus.cc:1275] T 1c903c9524124e92bf9904d93c83a581 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Refusing update from remote peer 27012f69cd1c41f1900022cdf9843d3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:08.984966 20975 consensus_queue.cc:1048] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:08.986979 20924 raft_consensus.cc:1275] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Refusing update from remote peer 27012f69cd1c41f1900022cdf9843d3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:08.989786 21083 consensus_queue.cc:1048] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:09.004751 20773 raft_consensus.cc:1275] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 FOLLOWER]: Refusing update from remote peer 27012f69cd1c41f1900022cdf9843d3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:09.006175 21083 consensus_queue.cc:1048] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:09.012465 20924 raft_consensus.cc:1275] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Refusing update from remote peer 27012f69cd1c41f1900022cdf9843d3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:09.013999 21084 consensus_queue.cc:1048] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:09.015225 20921 raft_consensus.cc:1275] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Refusing update from remote peer 27012f69cd1c41f1900022cdf9843d3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:09.017562 20975 consensus_queue.cc:1048] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:09.028504 20773 raft_consensus.cc:1275] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 FOLLOWER]: Refusing update from remote peer 27012f69cd1c41f1900022cdf9843d3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:09.030067 21083 consensus_queue.cc:1048] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:11.365526 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:11.372933 20848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51c5fcfb4ee74084ab476ebda66e1fe4"
dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
mode: GRACEFUL
new_leader_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
 from {username='slave'} at 127.0.0.1:36710
I20260709 13:07:11.373647 20848 raft_consensus.cc:606] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 3 LEADER]: Received request to transfer leadership to TS 4ae7be6f1f9f42699d94c3df434e0428
I20260709 13:07:11.376482 20848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95f080cfb4234f168dc1ed6433c0a42a"
dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
mode: GRACEFUL
new_leader_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
 from {username='slave'} at 127.0.0.1:36710
I20260709 13:07:11.376904 20848 raft_consensus.cc:606] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [term 2 LEADER]: Received request to transfer leadership to TS 4ae7be6f1f9f42699d94c3df434e0428
I20260709 13:07:11.379334 20848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aef02495bba0445fa3bdd7cd7a6e5982"
dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
mode: GRACEFUL
new_leader_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
 from {username='slave'} at 127.0.0.1:36710
I20260709 13:07:11.379745 20848 raft_consensus.cc:606] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 3 LEADER]: Received request to transfer leadership to TS 63439ba2d4f540329fe3cfe3cdcf53ab
I20260709 13:07:11.382186 20848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d614ab9dad544ec58b5abef1e2e53bfa"
dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
mode: GRACEFUL
new_leader_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
 from {username='slave'} at 127.0.0.1:36710
I20260709 13:07:11.382649 20848 raft_consensus.cc:606] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 2 LEADER]: Received request to transfer leadership to TS 4ae7be6f1f9f42699d94c3df434e0428
I20260709 13:07:11.385223 20848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f30cd5e45ed84494b8873834fae6b662"
dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
mode: GRACEFUL
new_leader_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
 from {username='slave'} at 127.0.0.1:36710
I20260709 13:07:11.385809 20848 raft_consensus.cc:606] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 3 LEADER]: Received request to transfer leadership to TS 63439ba2d4f540329fe3cfe3cdcf53ab
I20260709 13:07:11.387061 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:11.387557 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:11.403626 21083 raft_consensus.cc:993] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b: : Instructing follower 4ae7be6f1f9f42699d94c3df434e0428 to start an election
I20260709 13:07:11.404147 21105 raft_consensus.cc:1081] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 2 LEADER]: Signalling peer 4ae7be6f1f9f42699d94c3df434e0428 to start an election
I20260709 13:07:11.405748 20773 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d614ab9dad544ec58b5abef1e2e53bfa"
dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
 from {username='slave'} at 127.0.0.1:36914
I20260709 13:07:11.406157 20773 raft_consensus.cc:493] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:11.406417 20773 raft_consensus.cc:3060] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.411237 20773 raft_consensus.cc:515] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:11.412870 20773 leader_election.cc:290] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 3 election: Requested vote from peers 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:11.414018 20848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d614ab9dad544ec58b5abef1e2e53bfa" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
I20260709 13:07:11.414389 20921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d614ab9dad544ec58b5abef1e2e53bfa" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
I20260709 13:07:11.414875 20848 raft_consensus.cc:3055] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:11.414897 20921 raft_consensus.cc:3060] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.415477 20848 raft_consensus.cc:740] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Running, Role: LEADER
I20260709 13:07:11.416476 20848 consensus_queue.cc:260] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:11.417861 20848 raft_consensus.cc:3060] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.422935 20921 raft_consensus.cc:2468] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae7be6f1f9f42699d94c3df434e0428 in term 3.
I20260709 13:07:11.424255 20738 leader_election.cc:304] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:11.424441 20848 raft_consensus.cc:2468] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae7be6f1f9f42699d94c3df434e0428 in term 3.
I20260709 13:07:11.429039 21106 raft_consensus.cc:2804] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:11.429265 21083 raft_consensus.cc:993] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b: : Instructing follower 63439ba2d4f540329fe3cfe3cdcf53ab to start an election
I20260709 13:07:11.429739 21083 raft_consensus.cc:1081] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 3 LEADER]: Signalling peer 63439ba2d4f540329fe3cfe3cdcf53ab to start an election
I20260709 13:07:11.430285 21106 raft_consensus.cc:697] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 LEADER]: Becoming Leader. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Running, Role: LEADER
I20260709 13:07:11.431416 20921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aef02495bba0445fa3bdd7cd7a6e5982"
dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
 from {username='slave'} at 127.0.0.1:42286
I20260709 13:07:11.431375 21106 consensus_queue.cc:237] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:11.432045 20921 raft_consensus.cc:493] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:11.432412 20921 raft_consensus.cc:3060] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.439615 21105 raft_consensus.cc:993] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b: : Instructing follower 4ae7be6f1f9f42699d94c3df434e0428 to start an election
I20260709 13:07:11.439589 20921 raft_consensus.cc:515] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } }
I20260709 13:07:11.440253 21083 raft_consensus.cc:1081] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 3 LEADER]: Signalling peer 4ae7be6f1f9f42699d94c3df434e0428 to start an election
I20260709 13:07:11.440284 20670 catalog_manager.cc:5697] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 reported cstate change: term changed from 2 to 3, leader changed from 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2) to 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1). New cstate: current_term: 3 leader_uuid: "4ae7be6f1f9f42699d94c3df434e0428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.441991 20773 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51c5fcfb4ee74084ab476ebda66e1fe4"
dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
 from {username='slave'} at 127.0.0.1:36914
I20260709 13:07:11.442118 20921 leader_election.cc:290] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 4 election: Requested vote from peers 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867), 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797)
I20260709 13:07:11.442524 20773 raft_consensus.cc:493] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:11.442970 20773 raft_consensus.cc:3060] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.443332 20848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef02495bba0445fa3bdd7cd7a6e5982" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
I20260709 13:07:11.443964 20848 raft_consensus.cc:3055] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:11.444352 20848 raft_consensus.cc:740] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Running, Role: LEADER
I20260709 13:07:11.445128 20848 consensus_queue.cc:260] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } }
I20260709 13:07:11.446372 20848 raft_consensus.cc:3060] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.450831 20775 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aef02495bba0445fa3bdd7cd7a6e5982" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
I20260709 13:07:11.451432 20775 raft_consensus.cc:3060] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.453683 20848 raft_consensus.cc:2468] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in term 4.
I20260709 13:07:11.455097 20889 leader_election.cc:304] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27012f69cd1c41f1900022cdf9843d3b, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:11.456180 21081 raft_consensus.cc:2804] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:11.449766 20773 raft_consensus.cc:515] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:11.458827 20775 raft_consensus.cc:2468] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in term 4.
I20260709 13:07:11.459343 20773 leader_election.cc:290] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 4 election: Requested vote from peers 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:11.460116 20848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c5fcfb4ee74084ab476ebda66e1fe4" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
I20260709 13:07:11.461612 20848 raft_consensus.cc:3055] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:11.460065 21081 raft_consensus.cc:697] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 4 LEADER]: Becoming Leader. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Running, Role: LEADER
I20260709 13:07:11.460700 20921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c5fcfb4ee74084ab476ebda66e1fe4" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
I20260709 13:07:11.462069 20848 raft_consensus.cc:740] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Running, Role: LEADER
I20260709 13:07:11.462576 20921 raft_consensus.cc:3060] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.463198 20848 consensus_queue.cc:260] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:11.463760 21081 consensus_queue.cc:237] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } }
I20260709 13:07:11.464779 20848 raft_consensus.cc:3060] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.470072 20921 raft_consensus.cc:2468] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae7be6f1f9f42699d94c3df434e0428 in term 4.
I20260709 13:07:11.471728 20738 leader_election.cc:304] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:11.473204 20848 raft_consensus.cc:2468] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae7be6f1f9f42699d94c3df434e0428 in term 4.
I20260709 13:07:11.473613 21106 raft_consensus.cc:2804] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:11.474176 21106 raft_consensus.cc:697] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 4 LEADER]: Becoming Leader. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Running, Role: LEADER
I20260709 13:07:11.473289 20670 catalog_manager.cc:5697] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab reported cstate change: term changed from 3 to 4, leader changed from 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2) to 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3). New cstate: current_term: 4 leader_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.475136 21106 consensus_queue.cc:237] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:11.483705 20672 catalog_manager.cc:5697] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 reported cstate change: term changed from 3 to 4, leader changed from 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2) to 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1). New cstate: current_term: 4 leader_uuid: "4ae7be6f1f9f42699d94c3df434e0428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.518311 21105 raft_consensus.cc:993] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b: : Instructing follower 63439ba2d4f540329fe3cfe3cdcf53ab to start an election
I20260709 13:07:11.518874 21083 raft_consensus.cc:1081] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 3 LEADER]: Signalling peer 63439ba2d4f540329fe3cfe3cdcf53ab to start an election
I20260709 13:07:11.520545 20921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f30cd5e45ed84494b8873834fae6b662"
dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
 from {username='slave'} at 127.0.0.1:42286
I20260709 13:07:11.521029 20921 raft_consensus.cc:493] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:11.521399 20921 raft_consensus.cc:3060] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.525564 20921 raft_consensus.cc:515] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:11.527303 20921 leader_election.cc:290] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 4 election: Requested vote from peers 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797), 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867)
I20260709 13:07:11.528337 20773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f30cd5e45ed84494b8873834fae6b662" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
I20260709 13:07:11.528337 20848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f30cd5e45ed84494b8873834fae6b662" candidate_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
I20260709 13:07:11.528991 21105 raft_consensus.cc:993] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b: : Instructing follower 4ae7be6f1f9f42699d94c3df434e0428 to start an election
I20260709 13:07:11.529088 20773 raft_consensus.cc:3060] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.529102 20848 raft_consensus.cc:3055] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:11.529732 21083 raft_consensus.cc:1081] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [term 2 LEADER]: Signalling peer 4ae7be6f1f9f42699d94c3df434e0428 to start an election
I20260709 13:07:11.529706 20848 raft_consensus.cc:740] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Running, Role: LEADER
I20260709 13:07:11.531268 20848 consensus_queue.cc:260] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:11.532027 20775 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95f080cfb4234f168dc1ed6433c0a42a"
dest_uuid: "4ae7be6f1f9f42699d94c3df434e0428"
 from {username='slave'} at 127.0.0.1:36914
I20260709 13:07:11.532531 20775 raft_consensus.cc:493] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:11.532590 20848 raft_consensus.cc:3060] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:11.532904 20775 raft_consensus.cc:3060] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.535226 20773 raft_consensus.cc:2468] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in term 4.
I20260709 13:07:11.536381 20889 leader_election.cc:304] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:11.537189 21081 raft_consensus.cc:2804] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:11.537748 21081 raft_consensus.cc:697] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 4 LEADER]: Becoming Leader. State: Replica: 63439ba2d4f540329fe3cfe3cdcf53ab, State: Running, Role: LEADER
I20260709 13:07:11.538733 20848 raft_consensus.cc:2468] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63439ba2d4f540329fe3cfe3cdcf53ab in term 4.
I20260709 13:07:11.539048 20775 raft_consensus.cc:515] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:11.538712 21081 consensus_queue.cc:237] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:11.540906 20775 leader_election.cc:290] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 3 election: Requested vote from peers 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867), 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3:39209)
I20260709 13:07:11.541904 20921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f080cfb4234f168dc1ed6433c0a42a" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab"
I20260709 13:07:11.541756 20848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95f080cfb4234f168dc1ed6433c0a42a" candidate_uuid: "4ae7be6f1f9f42699d94c3df434e0428" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "27012f69cd1c41f1900022cdf9843d3b"
I20260709 13:07:11.542367 20921 raft_consensus.cc:3060] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.542443 20848 raft_consensus.cc:3055] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:11.542871 20848 raft_consensus.cc:740] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 27012f69cd1c41f1900022cdf9843d3b, State: Running, Role: LEADER
I20260709 13:07:11.543808 20848 consensus_queue.cc:260] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:11.545130 20848 raft_consensus.cc:3060] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:11.549233 20921 raft_consensus.cc:2468] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae7be6f1f9f42699d94c3df434e0428 in term 3.
I20260709 13:07:11.548588 20672 catalog_manager.cc:5697] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab reported cstate change: term changed from 3 to 4, leader changed from 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2) to 63439ba2d4f540329fe3cfe3cdcf53ab (127.20.40.3). New cstate: current_term: 4 leader_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:11.550314 20738 leader_election.cc:304] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ae7be6f1f9f42699d94c3df434e0428, 63439ba2d4f540329fe3cfe3cdcf53ab; no voters: 
I20260709 13:07:11.551000 21106 raft_consensus.cc:2804] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:11.551420 21106 raft_consensus.cc:697] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 LEADER]: Becoming Leader. State: Replica: 4ae7be6f1f9f42699d94c3df434e0428, State: Running, Role: LEADER
I20260709 13:07:11.551752 20848 raft_consensus.cc:2468] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ae7be6f1f9f42699d94c3df434e0428 in term 3.
I20260709 13:07:11.552274 21106 consensus_queue.cc:237] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } }
I20260709 13:07:11.559470 20670 catalog_manager.cc:5697] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 reported cstate change: term changed from 2 to 3, leader changed from 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2) to 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1). New cstate: current_term: 3 leader_uuid: "4ae7be6f1f9f42699d94c3df434e0428" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.909885 20848 raft_consensus.cc:1275] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 4 FOLLOWER]: Refusing update from remote peer 63439ba2d4f540329fe3cfe3cdcf53ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:11.911087 21081 consensus_queue.cc:1048] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:11.921082 20775 raft_consensus.cc:1275] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 4 FOLLOWER]: Refusing update from remote peer 63439ba2d4f540329fe3cfe3cdcf53ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:11.922788 21081 consensus_queue.cc:1048] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:11.954679 20921 raft_consensus.cc:1275] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 4 FOLLOWER]: Refusing update from remote peer 4ae7be6f1f9f42699d94c3df434e0428: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:11.955814 21106 consensus_queue.cc:1048] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:11.964838 20848 raft_consensus.cc:1275] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 4 FOLLOWER]: Refusing update from remote peer 4ae7be6f1f9f42699d94c3df434e0428: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:11.966243 21125 consensus_queue.cc:1048] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:11.983301 20848 raft_consensus.cc:1275] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 3 FOLLOWER]: Refusing update from remote peer 4ae7be6f1f9f42699d94c3df434e0428: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:11.984490 21125 consensus_queue.cc:1048] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:11.993523 20921 raft_consensus.cc:1275] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Refusing update from remote peer 4ae7be6f1f9f42699d94c3df434e0428: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:11.995136 21125 consensus_queue.cc:1048] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:12.075001 20921 raft_consensus.cc:1275] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Refusing update from remote peer 4ae7be6f1f9f42699d94c3df434e0428: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:12.076359 21125 consensus_queue.cc:1048] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63439ba2d4f540329fe3cfe3cdcf53ab" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 39209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:12.085935 20848 raft_consensus.cc:1275] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [term 3 FOLLOWER]: Refusing update from remote peer 4ae7be6f1f9f42699d94c3df434e0428: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:12.087811 20775 raft_consensus.cc:1275] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428 [term 4 FOLLOWER]: Refusing update from remote peer 63439ba2d4f540329fe3cfe3cdcf53ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:12.087622 21107 consensus_queue.cc:1048] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:12.089393 21081 consensus_queue.cc:1048] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ae7be6f1f9f42699d94c3df434e0428" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:12.103909 20848 raft_consensus.cc:1275] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 4 FOLLOWER]: Refusing update from remote peer 63439ba2d4f540329fe3cfe3cdcf53ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:12.105412 21112 consensus_queue.cc:1048] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "27012f69cd1c41f1900022cdf9843d3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:12.388463 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:12.394270 20640 tablet_server.cc:179] TabletServer@127.20.40.1:0 shutting down...
I20260709 13:07:12.428699 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:12.429610 20640 tablet_replica.cc:333] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428: stopping tablet replica
I20260709 13:07:12.430398 20640 raft_consensus.cc:2243] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:12.430936 20640 raft_consensus.cc:2272] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.433320 20640 tablet_replica.cc:333] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428: stopping tablet replica
I20260709 13:07:12.433938 20640 raft_consensus.cc:2243] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:12.434674 20640 raft_consensus.cc:2272] T 95f080cfb4234f168dc1ed6433c0a42a P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.436867 20640 tablet_replica.cc:333] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428: stopping tablet replica
I20260709 13:07:12.437582 20640 raft_consensus.cc:2243] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:12.438277 20640 raft_consensus.cc:2272] T d614ab9dad544ec58b5abef1e2e53bfa P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.440899 20640 tablet_replica.cc:333] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428: stopping tablet replica
I20260709 13:07:12.441520 20640 raft_consensus.cc:2243] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:12.442019 20640 raft_consensus.cc:2272] T 66af6be5c900401dace8dfefb501fefc P 4ae7be6f1f9f42699d94c3df434e0428 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:12.444412 20815 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:07:12.444633 20640 tablet_replica.cc:333] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428: stopping tablet replica
I20260709 13:07:12.445415 20640 raft_consensus.cc:2243] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:12.446123 20640 raft_consensus.cc:2272] T f30cd5e45ed84494b8873834fae6b662 P 4ae7be6f1f9f42699d94c3df434e0428 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:12.448410 20815 consensus_peers.cc:597] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b -> Peer 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797): Couldn't send request to peer 4ae7be6f1f9f42699d94c3df434e0428. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:12.448851 20640 tablet_replica.cc:333] T 06a6425feef84a3e8d7c2396bcd7b521 P 4ae7be6f1f9f42699d94c3df434e0428: stopping tablet replica
I20260709 13:07:12.449358 20640 raft_consensus.cc:2243] T 06a6425feef84a3e8d7c2396bcd7b521 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:12.449844 20640 raft_consensus.cc:2272] T 06a6425feef84a3e8d7c2396bcd7b521 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.451526 20640 tablet_replica.cc:333] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428: stopping tablet replica
I20260709 13:07:12.451973 20640 raft_consensus.cc:2243] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:12.452620 20640 raft_consensus.cc:2272] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 4ae7be6f1f9f42699d94c3df434e0428 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.454605 20640 tablet_replica.cc:333] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428: stopping tablet replica
I20260709 13:07:12.455040 20640 raft_consensus.cc:2243] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:12.455392 20640 raft_consensus.cc:2272] T 1c903c9524124e92bf9904d93c83a581 P 4ae7be6f1f9f42699d94c3df434e0428 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.457088 20640 tablet_replica.cc:333] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428: stopping tablet replica
I20260709 13:07:12.457746 20640 raft_consensus.cc:2243] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:12.458227 20640 raft_consensus.cc:2272] T aef02495bba0445fa3bdd7cd7a6e5982 P 4ae7be6f1f9f42699d94c3df434e0428 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:12.460664 20815 consensus_peers.cc:597] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b -> Peer 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797): Couldn't send request to peer 4ae7be6f1f9f42699d94c3df434e0428. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:12.566447 20640 tablet_server.cc:196] TabletServer@127.20.40.1:0 shutdown complete.
I20260709 13:07:12.584249 20640 tablet_server.cc:179] TabletServer@127.20.40.2:0 shutting down...
W20260709 13:07:12.615056 20889 consensus_peers.cc:597] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab -> Peer 4ae7be6f1f9f42699d94c3df434e0428 (127.20.40.1:38797): Couldn't send request to peer 4ae7be6f1f9f42699d94c3df434e0428. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:38797: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:12.615968 20889 consensus_peers.cc:597] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab -> Peer 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867): Couldn't send request to peer 27012f69cd1c41f1900022cdf9843d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:12.621759 20889 consensus_peers.cc:597] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab -> Peer 27012f69cd1c41f1900022cdf9843d3b (127.20.40.2:32867): Couldn't send request to peer 27012f69cd1c41f1900022cdf9843d3b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:12.625384 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:12.626147 20640 tablet_replica.cc:333] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 27012f69cd1c41f1900022cdf9843d3b: stopping tablet replica
I20260709 13:07:12.627002 20640 raft_consensus.cc:2243] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:12.627564 20640 raft_consensus.cc:2272] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.629231 20640 tablet_replica.cc:333] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b: stopping tablet replica
I20260709 13:07:12.629781 20640 raft_consensus.cc:2243] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:12.630138 20640 raft_consensus.cc:2272] T d614ab9dad544ec58b5abef1e2e53bfa P 27012f69cd1c41f1900022cdf9843d3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.632503 20640 tablet_replica.cc:333] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b: stopping tablet replica
I20260709 13:07:12.632933 20640 raft_consensus.cc:2243] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:12.633262 20640 raft_consensus.cc:2272] T 95f080cfb4234f168dc1ed6433c0a42a P 27012f69cd1c41f1900022cdf9843d3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.635337 20640 tablet_replica.cc:333] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b: stopping tablet replica
I20260709 13:07:12.635814 20640 raft_consensus.cc:2243] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:12.636145 20640 raft_consensus.cc:2272] T f30cd5e45ed84494b8873834fae6b662 P 27012f69cd1c41f1900022cdf9843d3b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.638172 20640 tablet_replica.cc:333] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b: stopping tablet replica
I20260709 13:07:12.638600 20640 raft_consensus.cc:2243] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:12.638922 20640 raft_consensus.cc:2272] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 27012f69cd1c41f1900022cdf9843d3b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.640846 20640 tablet_replica.cc:333] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b: stopping tablet replica
I20260709 13:07:12.641312 20640 raft_consensus.cc:2243] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:12.642002 20640 raft_consensus.cc:2272] T 06a6425feef84a3e8d7c2396bcd7b521 P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.643410 20640 tablet_replica.cc:333] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b: stopping tablet replica
I20260709 13:07:12.643791 20640 raft_consensus.cc:2243] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:12.644093 20640 raft_consensus.cc:2272] T aef02495bba0445fa3bdd7cd7a6e5982 P 27012f69cd1c41f1900022cdf9843d3b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.645848 20640 tablet_replica.cc:333] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b: stopping tablet replica
I20260709 13:07:12.646272 20640 raft_consensus.cc:2243] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:12.647020 20640 raft_consensus.cc:2272] T 66af6be5c900401dace8dfefb501fefc P 27012f69cd1c41f1900022cdf9843d3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.648471 20640 tablet_replica.cc:333] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b: stopping tablet replica
I20260709 13:07:12.648819 20640 raft_consensus.cc:2243] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:12.649417 20640 raft_consensus.cc:2272] T 1c903c9524124e92bf9904d93c83a581 P 27012f69cd1c41f1900022cdf9843d3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.677361 20640 tablet_server.cc:196] TabletServer@127.20.40.2:0 shutdown complete.
I20260709 13:07:12.695225 20640 tablet_server.cc:179] TabletServer@127.20.40.3:0 shutting down...
I20260709 13:07:12.722486 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:12.723196 20640 tablet_replica.cc:333] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab: stopping tablet replica
I20260709 13:07:12.723815 20640 raft_consensus.cc:2243] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:12.724586 20640 raft_consensus.cc:2272] T 9bb6caaaeb6d47f0924ea57eb2ff331c P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.726326 20640 tablet_replica.cc:333] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab: stopping tablet replica
I20260709 13:07:12.726826 20640 raft_consensus.cc:2243] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:12.727239 20640 raft_consensus.cc:2272] T d614ab9dad544ec58b5abef1e2e53bfa P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.729602 20640 tablet_replica.cc:333] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab: stopping tablet replica
I20260709 13:07:12.730139 20640 raft_consensus.cc:2243] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:12.730620 20640 raft_consensus.cc:2272] T 95f080cfb4234f168dc1ed6433c0a42a P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.733156 20640 tablet_replica.cc:333] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab: stopping tablet replica
I20260709 13:07:12.733793 20640 raft_consensus.cc:2243] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:12.734551 20640 raft_consensus.cc:2272] T f30cd5e45ed84494b8873834fae6b662 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.736533 20640 tablet_replica.cc:333] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab: stopping tablet replica
I20260709 13:07:12.737071 20640 raft_consensus.cc:2243] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:12.737680 20640 raft_consensus.cc:2272] T 51c5fcfb4ee74084ab476ebda66e1fe4 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.739778 20640 tablet_replica.cc:333] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab: stopping tablet replica
I20260709 13:07:12.740309 20640 raft_consensus.cc:2243] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:12.740742 20640 raft_consensus.cc:2272] T 06a6425feef84a3e8d7c2396bcd7b521 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.742612 20640 tablet_replica.cc:333] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab: stopping tablet replica
I20260709 13:07:12.743148 20640 raft_consensus.cc:2243] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:12.743829 20640 raft_consensus.cc:2272] T aef02495bba0445fa3bdd7cd7a6e5982 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.745779 20640 tablet_replica.cc:333] T 1c903c9524124e92bf9904d93c83a581 P 63439ba2d4f540329fe3cfe3cdcf53ab: stopping tablet replica
I20260709 13:07:12.746241 20640 raft_consensus.cc:2243] T 1c903c9524124e92bf9904d93c83a581 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:12.746629 20640 raft_consensus.cc:2272] T 1c903c9524124e92bf9904d93c83a581 P 63439ba2d4f540329fe3cfe3cdcf53ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.748078 20640 tablet_replica.cc:333] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab: stopping tablet replica
I20260709 13:07:12.748478 20640 raft_consensus.cc:2243] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:12.748857 20640 raft_consensus.cc:2272] T 66af6be5c900401dace8dfefb501fefc P 63439ba2d4f540329fe3cfe3cdcf53ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.774255 20640 tablet_server.cc:196] TabletServer@127.20.40.3:0 shutdown complete.
I20260709 13:07:12.790031 20640 master.cc:562] Master@127.20.40.62:46749 shutting down...
I20260709 13:07:12.918675 20640 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:12.919384 20640 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:12.919741 20640 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9f67188cba504b5e914cd7df85b43356: stopping tablet replica
I20260709 13:07:12.939777 20640 master.cc:584] Master@127.20.40.62:46749 shutdown complete.
27012f69cd1c41f1900022cdf9843d3b  4
4ae7be6f1f9f42699d94c3df434e0428  4
63439ba2d4f540329fe3cfe3cdcf53ab  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12703 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:07:12.981956 20640 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.40.62:38159
I20260709 13:07:12.983074 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:12.988795 21137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:12.988914 21138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:12.989568 21140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:12.990885 20640 server_base.cc:1061] running on GCE node
I20260709 13:07:12.991883 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:12.992138 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:12.992357 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602432992321 us; error 0 us; skew 500 ppm
I20260709 13:07:12.992957 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:12.995757 20640 webserver.cc:533] Webserver started at http://127.20.40.62:41571/ using document root <none> and password file <none>
I20260709 13:07:12.996320 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:12.996519 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:12.996852 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:12.998165 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602420111825-20640-0/minicluster-data/master-0-root/instance:
uuid: "042c2530076948208c42b86b9c9b4265"
format_stamp: "Formatted at 2026-07-09 13:07:12 on dist-test-slave-rnv4"
I20260709 13:07:13.003047 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:07:13.006641 21145 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:13.007541 20640 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:07:13.007777 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602420111825-20640-0/minicluster-data/master-0-root
uuid: "042c2530076948208c42b86b9c9b4265"
format_stamp: "Formatted at 2026-07-09 13:07:12 on dist-test-slave-rnv4"
I20260709 13:07:13.008015 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602420111825-20640-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602420111825-20640-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602420111825-20640-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:13.036443 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:13.037849 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:13.079282 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.62:38159
I20260709 13:07:13.079425 21196 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.62:38159 every 8 connection(s)
I20260709 13:07:13.083552 21197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.094381 21197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265: Bootstrap starting.
I20260709 13:07:13.099699 21197 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:13.103965 21197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265: No bootstrap required, opened a new log
I20260709 13:07:13.106025 21197 raft_consensus.cc:359] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "042c2530076948208c42b86b9c9b4265" member_type: VOTER }
I20260709 13:07:13.106413 21197 raft_consensus.cc:385] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:13.106585 21197 raft_consensus.cc:740] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 042c2530076948208c42b86b9c9b4265, State: Initialized, Role: FOLLOWER
I20260709 13:07:13.107191 21197 consensus_queue.cc:260] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "042c2530076948208c42b86b9c9b4265" member_type: VOTER }
I20260709 13:07:13.107594 21197 raft_consensus.cc:399] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:13.107776 21197 raft_consensus.cc:493] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:13.107975 21197 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.112157 21197 raft_consensus.cc:515] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "042c2530076948208c42b86b9c9b4265" member_type: VOTER }
I20260709 13:07:13.112656 21197 leader_election.cc:304] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 042c2530076948208c42b86b9c9b4265; no voters: 
I20260709 13:07:13.113767 21197 leader_election.cc:290] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:13.114079 21200 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:13.115407 21200 raft_consensus.cc:697] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265 [term 1 LEADER]: Becoming Leader. State: Replica: 042c2530076948208c42b86b9c9b4265, State: Running, Role: LEADER
I20260709 13:07:13.116104 21200 consensus_queue.cc:237] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "042c2530076948208c42b86b9c9b4265" member_type: VOTER }
I20260709 13:07:13.116780 21197 sys_catalog.cc:565] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:13.121862 21201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "042c2530076948208c42b86b9c9b4265" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "042c2530076948208c42b86b9c9b4265" member_type: VOTER } }
I20260709 13:07:13.122018 21202 sys_catalog.cc:455] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 042c2530076948208c42b86b9c9b4265. Latest consensus state: current_term: 1 leader_uuid: "042c2530076948208c42b86b9c9b4265" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "042c2530076948208c42b86b9c9b4265" member_type: VOTER } }
I20260709 13:07:13.122994 21202 sys_catalog.cc:458] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:13.125123 21201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:13.126569 21208 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:13.132200 21208 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:13.137127 20640 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:13.143007 21208 catalog_manager.cc:1383] Generated new cluster ID: be2be6f172d447b4ab92994aa0959aac
I20260709 13:07:13.143520 21208 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:13.176506 21208 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:13.177856 21208 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:13.192116 21208 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265: Generated new TSK 0
I20260709 13:07:13.192791 21208 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:13.208431 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:13.214573 21218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:13.215592 21219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:13.216723 21221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:13.218374 20640 server_base.cc:1061] running on GCE node
I20260709 13:07:13.219309 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:13.219480 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:13.219596 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602433219585 us; error 0 us; skew 500 ppm
I20260709 13:07:13.220077 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:13.222406 20640 webserver.cc:533] Webserver started at http://127.20.40.1:46055/ using document root <none> and password file <none>
I20260709 13:07:13.222836 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:13.222990 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:13.223194 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:13.224184 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602420111825-20640-0/minicluster-data/ts-0-root/instance:
uuid: "adfa72e0f05945afa5a8a00185015668"
format_stamp: "Formatted at 2026-07-09 13:07:13 on dist-test-slave-rnv4"
I20260709 13:07:13.228819 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:13.232470 21226 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:13.233394 20640 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:07:13.233850 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602420111825-20640-0/minicluster-data/ts-0-root
uuid: "adfa72e0f05945afa5a8a00185015668"
format_stamp: "Formatted at 2026-07-09 13:07:13 on dist-test-slave-rnv4"
I20260709 13:07:13.234162 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602420111825-20640-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602420111825-20640-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602420111825-20640-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:13.248041 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:13.249372 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:13.251025 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:13.253410 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:13.253727 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:13.254000 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:13.254202 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:13.298146 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.1:35319
I20260709 13:07:13.298245 21288 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.1:35319 every 8 connection(s)
I20260709 13:07:13.303486 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:13.310619 21293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:13.311990 21294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:13.316293 21289 heartbeater.cc:344] Connected to a master server at 127.20.40.62:38159
I20260709 13:07:13.316370 20640 server_base.cc:1061] running on GCE node
W20260709 13:07:13.316807 21297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:13.317045 21289 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:13.318223 21289 heartbeater.cc:507] Master 127.20.40.62:38159 requested a full tablet report, sending...
I20260709 13:07:13.318331 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:13.318630 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:13.318848 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602433318830 us; error 0 us; skew 500 ppm
I20260709 13:07:13.319640 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:13.320914 21162 ts_manager.cc:194] Registered new tserver with Master: adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319)
I20260709 13:07:13.322569 20640 webserver.cc:533] Webserver started at http://127.20.40.2:36449/ using document root <none> and password file <none>
I20260709 13:07:13.323025 21162 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60926
I20260709 13:07:13.323107 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:13.323396 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:13.323710 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:13.325227 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602420111825-20640-0/minicluster-data/ts-1-root/instance:
uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
format_stamp: "Formatted at 2026-07-09 13:07:13 on dist-test-slave-rnv4"
I20260709 13:07:13.329685 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:07:13.332962 21301 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:13.333776 20640 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:07:13.334071 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602420111825-20640-0/minicluster-data/ts-1-root
uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
format_stamp: "Formatted at 2026-07-09 13:07:13 on dist-test-slave-rnv4"
I20260709 13:07:13.334337 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602420111825-20640-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602420111825-20640-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602420111825-20640-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:13.350672 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:13.351941 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:13.353494 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:13.355703 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:13.355942 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:13.356202 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:13.356382 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:13.396366 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.2:32949
I20260709 13:07:13.396464 21363 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.2:32949 every 8 connection(s)
I20260709 13:07:13.400941 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:13.407501 21367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:13.409795 21368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:13.410982 20640 server_base.cc:1061] running on GCE node
W20260709 13:07:13.412352 21370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:13.413133 21364 heartbeater.cc:344] Connected to a master server at 127.20.40.62:38159
I20260709 13:07:13.413389 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:07:13.413511 21364 heartbeater.cc:461] Registering TS with master...
W20260709 13:07:13.413748 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:13.413970 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602433413955 us; error 0 us; skew 500 ppm
I20260709 13:07:13.414443 21364 heartbeater.cc:507] Master 127.20.40.62:38159 requested a full tablet report, sending...
I20260709 13:07:13.414572 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:13.416682 21162 ts_manager.cc:194] Registered new tserver with Master: 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949)
I20260709 13:07:13.417778 20640 webserver.cc:533] Webserver started at http://127.20.40.3:35723/ using document root <none> and password file <none>
I20260709 13:07:13.418258 21162 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60942
I20260709 13:07:13.418524 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:13.418797 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:13.419130 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:13.420315 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602420111825-20640-0/minicluster-data/ts-2-root/instance:
uuid: "a97cd63ce357411d809c3f635367fa4f"
format_stamp: "Formatted at 2026-07-09 13:07:13 on dist-test-slave-rnv4"
I20260709 13:07:13.424647 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:13.428022 21375 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:13.428882 20640 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:07:13.429291 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602420111825-20640-0/minicluster-data/ts-2-root
uuid: "a97cd63ce357411d809c3f635367fa4f"
format_stamp: "Formatted at 2026-07-09 13:07:13 on dist-test-slave-rnv4"
I20260709 13:07:13.429694 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602420111825-20640-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602420111825-20640-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602420111825-20640-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:13.452174 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:13.453652 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:13.455183 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:13.457397 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:13.457656 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:13.457897 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:13.458079 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:13.499658 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.3:43535
I20260709 13:07:13.499766 21437 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.3:43535 every 8 connection(s)
I20260709 13:07:13.515100 21438 heartbeater.cc:344] Connected to a master server at 127.20.40.62:38159
I20260709 13:07:13.515484 21438 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:13.516249 21438 heartbeater.cc:507] Master 127.20.40.62:38159 requested a full tablet report, sending...
I20260709 13:07:13.518186 21162 ts_manager.cc:194] Registered new tserver with Master: a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:13.519017 20640 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016004041s
I20260709 13:07:13.519692 21162 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60956
I20260709 13:07:13.545240 21162 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60972:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:13.548447 21162 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:13.624311 21403 tablet_service.cc:1511] Processing CreateTablet for tablet ff0dfa40502743f1bb236356fee7ac37 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:13.625180 21254 tablet_service.cc:1511] Processing CreateTablet for tablet ff0dfa40502743f1bb236356fee7ac37 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:13.625855 21403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff0dfa40502743f1bb236356fee7ac37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.626744 21254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff0dfa40502743f1bb236356fee7ac37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.630209 21402 tablet_service.cc:1511] Processing CreateTablet for tablet 2a6069c81e9f45af883980cf178eff55 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:13.630851 21253 tablet_service.cc:1511] Processing CreateTablet for tablet 2a6069c81e9f45af883980cf178eff55 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:13.631631 21402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a6069c81e9f45af883980cf178eff55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.632112 21253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a6069c81e9f45af883980cf178eff55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.637668 21401 tablet_service.cc:1511] Processing CreateTablet for tablet b3641d6e17724842a599a120e0bab201 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:13.638983 21401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3641d6e17724842a599a120e0bab201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.646268 21400 tablet_service.cc:1511] Processing CreateTablet for tablet 09a65548d6c8412bb3ac33940e9f1204 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:13.647626 21400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a65548d6c8412bb3ac33940e9f1204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.651690 21252 tablet_service.cc:1511] Processing CreateTablet for tablet b3641d6e17724842a599a120e0bab201 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:13.653085 21252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3641d6e17724842a599a120e0bab201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.654044 21399 tablet_service.cc:1511] Processing CreateTablet for tablet 41e792a787dc4230b8ef02f0938c5936 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:13.655349 21399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e792a787dc4230b8ef02f0938c5936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.667179 21398 tablet_service.cc:1511] Processing CreateTablet for tablet e7634d671d1d47b78d4c0d77adfb1e3b (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:13.668181 21251 tablet_service.cc:1511] Processing CreateTablet for tablet 09a65548d6c8412bb3ac33940e9f1204 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:13.668673 21398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7634d671d1d47b78d4c0d77adfb1e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.672188 21250 tablet_service.cc:1511] Processing CreateTablet for tablet 41e792a787dc4230b8ef02f0938c5936 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:13.674542 21397 tablet_service.cc:1511] Processing CreateTablet for tablet 413c0d05b82d47c2a3d165f97a93fc3e (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:13.675908 21397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 413c0d05b82d47c2a3d165f97a93fc3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.675719 21248 tablet_service.cc:1511] Processing CreateTablet for tablet 413c0d05b82d47c2a3d165f97a93fc3e (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:13.674546 21249 tablet_service.cc:1511] Processing CreateTablet for tablet e7634d671d1d47b78d4c0d77adfb1e3b (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:13.677929 21329 tablet_service.cc:1511] Processing CreateTablet for tablet ff0dfa40502743f1bb236356fee7ac37 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:13.679143 21329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff0dfa40502743f1bb236356fee7ac37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.682710 21247 tablet_service.cc:1511] Processing CreateTablet for tablet d572dc7700f248e2ad13917e1069fd49 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:13.685067 21328 tablet_service.cc:1511] Processing CreateTablet for tablet 2a6069c81e9f45af883980cf178eff55 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:13.685534 21325 tablet_service.cc:1511] Processing CreateTablet for tablet 41e792a787dc4230b8ef02f0938c5936 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:13.686420 21328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a6069c81e9f45af883980cf178eff55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.687704 21324 tablet_service.cc:1511] Processing CreateTablet for tablet e7634d671d1d47b78d4c0d77adfb1e3b (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:13.688949 21324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7634d671d1d47b78d4c0d77adfb1e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.690660 21327 tablet_service.cc:1511] Processing CreateTablet for tablet b3641d6e17724842a599a120e0bab201 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:13.691111 21322 tablet_service.cc:1511] Processing CreateTablet for tablet d572dc7700f248e2ad13917e1069fd49 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:13.691992 21327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3641d6e17724842a599a120e0bab201. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.694037 21320 tablet_service.cc:1511] Processing CreateTablet for tablet 0e51fb5ce2404067bf74493759c5258a (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:13.693940 21323 tablet_service.cc:1511] Processing CreateTablet for tablet 413c0d05b82d47c2a3d165f97a93fc3e (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:13.694800 21321 tablet_service.cc:1511] Processing CreateTablet for tablet de8a5ea7063344b98f2f91c355140713 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:13.695988 21326 tablet_service.cc:1511] Processing CreateTablet for tablet 09a65548d6c8412bb3ac33940e9f1204 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:13.696810 21253 tablet_service.cc:1511] Processing CreateTablet for tablet 0e51fb5ce2404067bf74493759c5258a (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:13.701053 21325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e792a787dc4230b8ef02f0938c5936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.701653 21251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a65548d6c8412bb3ac33940e9f1204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.702392 21250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41e792a787dc4230b8ef02f0938c5936. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.705770 21247 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d572dc7700f248e2ad13917e1069fd49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.706593 21249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7634d671d1d47b78d4c0d77adfb1e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.701704 21320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e51fb5ce2404067bf74493759c5258a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.709764 21248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 413c0d05b82d47c2a3d165f97a93fc3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.713799 21321 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de8a5ea7063344b98f2f91c355140713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.714658 21396 tablet_service.cc:1511] Processing CreateTablet for tablet d572dc7700f248e2ad13917e1069fd49 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:13.715984 21396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d572dc7700f248e2ad13917e1069fd49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.720759 21395 tablet_service.cc:1511] Processing CreateTablet for tablet de8a5ea7063344b98f2f91c355140713 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:13.721114 21252 tablet_service.cc:1511] Processing CreateTablet for tablet de8a5ea7063344b98f2f91c355140713 (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:13.721747 21323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 413c0d05b82d47c2a3d165f97a93fc3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.725741 21395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de8a5ea7063344b98f2f91c355140713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.729602 21394 tablet_service.cc:1511] Processing CreateTablet for tablet 0e51fb5ce2404067bf74493759c5258a (DEFAULT_TABLE table=test-workload [id=bf28ce30d455486fa69af29bfc4d47d9]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:13.733738 21394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e51fb5ce2404067bf74493759c5258a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.738585 21322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d572dc7700f248e2ad13917e1069fd49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.731740 21253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e51fb5ce2404067bf74493759c5258a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.740461 21326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09a65548d6c8412bb3ac33940e9f1204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.765648 21252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de8a5ea7063344b98f2f91c355140713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:13.806164 21453 tablet_bootstrap.cc:492] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668: Bootstrap starting.
I20260709 13:07:13.828016 21453 tablet_bootstrap.cc:654] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:13.876801 21455 tablet_bootstrap.cc:492] T ff0dfa40502743f1bb236356fee7ac37 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Bootstrap starting.
I20260709 13:07:13.886234 21454 tablet_bootstrap.cc:492] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f: Bootstrap starting.
I20260709 13:07:13.922400 21455 tablet_bootstrap.cc:654] T ff0dfa40502743f1bb236356fee7ac37 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:13.923286 21454 tablet_bootstrap.cc:654] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:13.941557 21453 tablet_bootstrap.cc:492] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668: No bootstrap required, opened a new log
I20260709 13:07:13.941557 21454 tablet_bootstrap.cc:492] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f: No bootstrap required, opened a new log
I20260709 13:07:13.942070 21453 ts_tablet_manager.cc:1403] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668: Time spent bootstrapping tablet: real 0.136s	user 0.046s	sys 0.025s
I20260709 13:07:13.942314 21455 tablet_bootstrap.cc:492] T ff0dfa40502743f1bb236356fee7ac37 P 4535cfe88f4945b6b3dc02fc7cb3be3b: No bootstrap required, opened a new log
I20260709 13:07:13.942312 21454 ts_tablet_manager.cc:1403] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f: Time spent bootstrapping tablet: real 0.056s	user 0.000s	sys 0.015s
I20260709 13:07:13.942926 21455 ts_tablet_manager.cc:1403] T ff0dfa40502743f1bb236356fee7ac37 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Time spent bootstrapping tablet: real 0.066s	user 0.005s	sys 0.007s
I20260709 13:07:13.944943 21453 raft_consensus.cc:359] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } } peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } }
I20260709 13:07:13.945727 21453 raft_consensus.cc:385] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:13.945398 21454 raft_consensus.cc:359] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:13.945760 21455 raft_consensus.cc:359] T ff0dfa40502743f1bb236356fee7ac37 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } } peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } }
I20260709 13:07:13.946286 21454 raft_consensus.cc:385] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:13.946159 21453 raft_consensus.cc:740] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Initialized, Role: FOLLOWER
I20260709 13:07:13.946600 21455 raft_consensus.cc:385] T ff0dfa40502743f1bb236356fee7ac37 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:13.946640 21454 raft_consensus.cc:740] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Initialized, Role: FOLLOWER
I20260709 13:07:13.947043 21455 raft_consensus.cc:740] T ff0dfa40502743f1bb236356fee7ac37 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Initialized, Role: FOLLOWER
I20260709 13:07:13.947306 21453 consensus_queue.cc:260] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } } peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } }
I20260709 13:07:13.947650 21454 consensus_queue.cc:260] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:13.949123 21455 consensus_queue.cc:260] T ff0dfa40502743f1bb236356fee7ac37 P 4535cfe88f4945b6b3dc02fc7cb3be3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } } peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } }
I20260709 13:07:13.954799 21438 heartbeater.cc:499] Master 127.20.40.62:38159 was elected leader, sending a full tablet report...
I20260709 13:07:13.955328 21454 ts_tablet_manager.cc:1434] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f: Time spent starting tablet: real 0.012s	user 0.000s	sys 0.010s
I20260709 13:07:13.956326 21454 tablet_bootstrap.cc:492] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f: Bootstrap starting.
I20260709 13:07:13.956486 21453 ts_tablet_manager.cc:1434] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.003s
I20260709 13:07:13.957242 21289 heartbeater.cc:499] Master 127.20.40.62:38159 was elected leader, sending a full tablet report...
I20260709 13:07:13.960907 21364 heartbeater.cc:499] Master 127.20.40.62:38159 was elected leader, sending a full tablet report...
I20260709 13:07:13.962885 21454 tablet_bootstrap.cc:654] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:13.966759 21455 ts_tablet_manager.cc:1434] T ff0dfa40502743f1bb236356fee7ac37 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.008s
I20260709 13:07:13.967828 21455 tablet_bootstrap.cc:492] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b: Bootstrap starting.
I20260709 13:07:13.970099 21453 tablet_bootstrap.cc:492] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668: Bootstrap starting.
I20260709 13:07:13.973822 21459 raft_consensus.cc:493] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.974380 21455 tablet_bootstrap.cc:654] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:13.974319 21459 raft_consensus.cc:515] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } } peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } }
I20260709 13:07:13.974757 21454 tablet_bootstrap.cc:492] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f: No bootstrap required, opened a new log
I20260709 13:07:13.975414 21454 ts_tablet_manager.cc:1403] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.006s
I20260709 13:07:13.980667 21454 raft_consensus.cc:359] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } } peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } }
I20260709 13:07:13.981583 21454 raft_consensus.cc:385] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:13.981957 21454 raft_consensus.cc:740] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Initialized, Role: FOLLOWER
I20260709 13:07:13.983080 21454 consensus_queue.cc:260] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } } peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } }
I20260709 13:07:13.986745 21454 ts_tablet_manager.cc:1434] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.005s
I20260709 13:07:13.987771 21454 tablet_bootstrap.cc:492] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f: Bootstrap starting.
I20260709 13:07:13.997963 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0dfa40502743f1bb236356fee7ac37" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f" is_pre_election: true
I20260709 13:07:13.998926 21413 raft_consensus.cc:2468] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 0.
I20260709 13:07:14.000928 21230 leader_election.cc:304] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a97cd63ce357411d809c3f635367fa4f, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:14.002753 21454 tablet_bootstrap.cc:654] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.011693 21463 raft_consensus.cc:2804] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:14.012187 21463 raft_consensus.cc:493] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.012135 21455 tablet_bootstrap.cc:492] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b: No bootstrap required, opened a new log
I20260709 13:07:14.012676 21463 raft_consensus.cc:3060] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.013137 21455 ts_tablet_manager.cc:1403] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.030s
I20260709 13:07:14.013792 21459 leader_election.cc:290] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535), 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949)
I20260709 13:07:14.016296 21455 raft_consensus.cc:359] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.017071 21455 raft_consensus.cc:385] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.017998 21453 tablet_bootstrap.cc:654] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.020320 21454 tablet_bootstrap.cc:492] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f: No bootstrap required, opened a new log
I20260709 13:07:14.020813 21454 ts_tablet_manager.cc:1403] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 13:07:14.017392 21455 raft_consensus.cc:740] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.023686 21455 consensus_queue.cc:260] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.025720 21455 ts_tablet_manager.cc:1434] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:07:14.026319 21339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0dfa40502743f1bb236356fee7ac37" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" is_pre_election: true
I20260709 13:07:14.027020 21339 raft_consensus.cc:2468] T ff0dfa40502743f1bb236356fee7ac37 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 0.
I20260709 13:07:14.027576 21454 raft_consensus.cc:359] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.028443 21454 raft_consensus.cc:385] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.028666 21455 tablet_bootstrap.cc:492] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b: Bootstrap starting.
I20260709 13:07:14.028779 21454 raft_consensus.cc:740] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.029860 21454 consensus_queue.cc:260] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.030391 21463 raft_consensus.cc:515] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } } peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } }
I20260709 13:07:14.035241 21454 ts_tablet_manager.cc:1434] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 13:07:14.036512 21454 tablet_bootstrap.cc:492] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f: Bootstrap starting.
I20260709 13:07:14.037289 21455 tablet_bootstrap.cc:654] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.039983 21453 tablet_bootstrap.cc:492] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668: No bootstrap required, opened a new log
I20260709 13:07:14.040485 21453 ts_tablet_manager.cc:1403] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.000s
I20260709 13:07:14.042557 21463 leader_election.cc:290] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 election: Requested vote from peers a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535), 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949)
I20260709 13:07:14.043587 21339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0dfa40502743f1bb236356fee7ac37" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
I20260709 13:07:14.044184 21339 raft_consensus.cc:3060] T ff0dfa40502743f1bb236356fee7ac37 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.046505 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0dfa40502743f1bb236356fee7ac37" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
I20260709 13:07:14.047299 21413 raft_consensus.cc:3060] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.049388 21454 tablet_bootstrap.cc:654] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.051842 21339 raft_consensus.cc:2468] T ff0dfa40502743f1bb236356fee7ac37 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 1.
I20260709 13:07:14.053902 21229 leader_election.cc:304] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:14.053854 21453 raft_consensus.cc:359] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.054646 21453 raft_consensus.cc:385] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.054961 21453 raft_consensus.cc:740] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.055104 21463 raft_consensus.cc:2804] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:14.055706 21453 consensus_queue.cc:260] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.056824 21463 raft_consensus.cc:697] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Becoming Leader. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:14.057907 21453 ts_tablet_manager.cc:1434] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 13:07:14.057765 21463 consensus_queue.cc:237] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } } peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } }
I20260709 13:07:14.058825 21453 tablet_bootstrap.cc:492] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668: Bootstrap starting.
I20260709 13:07:14.060031 21413 raft_consensus.cc:2468] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 1.
I20260709 13:07:14.064167 21460 raft_consensus.cc:493] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.064641 21460 raft_consensus.cc:515] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.066567 21453 tablet_bootstrap.cc:654] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.068084 21455 tablet_bootstrap.cc:492] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b: No bootstrap required, opened a new log
I20260709 13:07:14.068550 21455 ts_tablet_manager.cc:1403] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.020s
I20260709 13:07:14.068652 21454 tablet_bootstrap.cc:492] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f: No bootstrap required, opened a new log
I20260709 13:07:14.069119 21454 ts_tablet_manager.cc:1403] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.001s
I20260709 13:07:14.070063 21460 leader_election.cc:290] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949)
I20260709 13:07:14.071966 21454 raft_consensus.cc:359] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.071907 21455 raft_consensus.cc:359] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.072906 21454 raft_consensus.cc:385] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.072412 21160 catalog_manager.cc:5697] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 reported cstate change: term changed from 0 to 1, leader changed from <none> to adfa72e0f05945afa5a8a00185015668 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "adfa72e0f05945afa5a8a00185015668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:14.073098 21455 raft_consensus.cc:385] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.073235 21454 raft_consensus.cc:740] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.073681 21455 raft_consensus.cc:740] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.074219 21454 consensus_queue.cc:260] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.074697 21455 consensus_queue.cc:260] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.076504 21454 ts_tablet_manager.cc:1434] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:14.077034 21455 ts_tablet_manager.cc:1434] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:14.077402 21454 tablet_bootstrap.cc:492] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f: Bootstrap starting.
I20260709 13:07:14.078297 21455 tablet_bootstrap.cc:492] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Bootstrap starting.
I20260709 13:07:14.087587 21455 tablet_bootstrap.cc:654] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.088825 21454 tablet_bootstrap.cc:654] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.093238 21453 tablet_bootstrap.cc:492] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668: No bootstrap required, opened a new log
I20260709 13:07:14.093770 21453 ts_tablet_manager.cc:1403] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.005s
I20260709 13:07:14.096776 21453 raft_consensus.cc:359] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.097479 21453 raft_consensus.cc:385] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.097770 21453 raft_consensus.cc:740] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.101089 21453 consensus_queue.cc:260] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.102980 21453 ts_tablet_manager.cc:1434] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:07:14.103818 21453 tablet_bootstrap.cc:492] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668: Bootstrap starting.
I20260709 13:07:14.111779 21454 tablet_bootstrap.cc:492] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f: No bootstrap required, opened a new log
I20260709 13:07:14.112282 21454 ts_tablet_manager.cc:1403] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f: Time spent bootstrapping tablet: real 0.035s	user 0.004s	sys 0.008s
I20260709 13:07:14.115296 21454 raft_consensus.cc:359] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.115998 21454 raft_consensus.cc:385] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.116281 21454 raft_consensus.cc:740] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.118144 21264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7634d671d1d47b78d4c0d77adfb1e3b" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adfa72e0f05945afa5a8a00185015668" is_pre_election: true
I20260709 13:07:14.119572 21455 tablet_bootstrap.cc:492] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b: No bootstrap required, opened a new log
I20260709 13:07:14.120194 21455 ts_tablet_manager.cc:1403] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.016s
W20260709 13:07:14.120272 21378 leader_election.cc:343] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.121788 21454 consensus_queue.cc:260] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.122830 21453 tablet_bootstrap.cc:654] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.123623 21455 raft_consensus.cc:359] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.124435 21455 raft_consensus.cc:385] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.124776 21455 raft_consensus.cc:740] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.125145 21454 ts_tablet_manager.cc:1434] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:07:14.125680 21455 consensus_queue.cc:260] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.126750 21454 tablet_bootstrap.cc:492] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f: Bootstrap starting.
W20260709 13:07:14.132778 21210 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:14.133989 21454 tablet_bootstrap.cc:654] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.135511 21455 ts_tablet_manager.cc:1434] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:07:14.145521 21455 tablet_bootstrap.cc:492] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b: Bootstrap starting.
I20260709 13:07:14.156847 21455 tablet_bootstrap.cc:654] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.163708 21339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7634d671d1d47b78d4c0d77adfb1e3b" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" is_pre_election: true
W20260709 13:07:14.165848 21378 leader_election.cc:343] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.166252 21461 raft_consensus.cc:493] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.166451 21378 leader_election.cc:304] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a97cd63ce357411d809c3f635367fa4f; no voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, adfa72e0f05945afa5a8a00185015668
I20260709 13:07:14.166882 21461 raft_consensus.cc:515] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.167412 21460 raft_consensus.cc:2749] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:14.169631 21455 tablet_bootstrap.cc:492] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b: No bootstrap required, opened a new log
I20260709 13:07:14.170113 21455 ts_tablet_manager.cc:1403] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.002s
I20260709 13:07:14.172012 21461 leader_election.cc:290] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:14.173556 21463 raft_consensus.cc:493] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.173839 21453 tablet_bootstrap.cc:492] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668: No bootstrap required, opened a new log
I20260709 13:07:14.174372 21453 ts_tablet_manager.cc:1403] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668: Time spent bootstrapping tablet: real 0.071s	user 0.020s	sys 0.031s
I20260709 13:07:14.174161 21463 raft_consensus.cc:515] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.178359 21463 leader_election.cc:290] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:14.178097 21453 raft_consensus.cc:359] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.179008 21453 raft_consensus.cc:385] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.178185 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3641d6e17724842a599a120e0bab201" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f" is_pre_election: true
I20260709 13:07:14.179358 21455 raft_consensus.cc:359] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.180224 21455 raft_consensus.cc:385] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:14.180425 21230 leader_election.cc:343] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.180600 21455 raft_consensus.cc:740] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.181057 21453 raft_consensus.cc:740] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.182057 21453 consensus_queue.cc:260] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.182803 21339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3641d6e17724842a599a120e0bab201" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" is_pre_election: true
I20260709 13:07:14.181293 21454 tablet_bootstrap.cc:492] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f: No bootstrap required, opened a new log
W20260709 13:07:14.184100 21229 leader_election.cc:343] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.184423 21454 ts_tablet_manager.cc:1403] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.022s
I20260709 13:07:14.184630 21453 ts_tablet_manager.cc:1434] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:07:14.184588 21229 leader_election.cc:304] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: adfa72e0f05945afa5a8a00185015668; no voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, a97cd63ce357411d809c3f635367fa4f
I20260709 13:07:14.185850 21453 tablet_bootstrap.cc:492] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668: Bootstrap starting.
I20260709 13:07:14.185915 21463 raft_consensus.cc:2749] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:14.184624 21264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e51fb5ce2404067bf74493759c5258a" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adfa72e0f05945afa5a8a00185015668" is_pre_election: true
I20260709 13:07:14.187824 21454 raft_consensus.cc:359] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
W20260709 13:07:14.188179 21304 leader_election.cc:343] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.188680 21454 raft_consensus.cc:385] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.189054 21454 raft_consensus.cc:740] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.189627 21455 consensus_queue.cc:260] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.190023 21454 consensus_queue.cc:260] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.192859 21453 tablet_bootstrap.cc:654] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.194387 21454 ts_tablet_manager.cc:1434] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:07:14.195421 21454 tablet_bootstrap.cc:492] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f: Bootstrap starting.
I20260709 13:07:14.201802 21454 tablet_bootstrap.cc:654] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.204998 21453 tablet_bootstrap.cc:492] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668: No bootstrap required, opened a new log
I20260709 13:07:14.205549 21453 ts_tablet_manager.cc:1403] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.012s
I20260709 13:07:14.205974 21455 ts_tablet_manager.cc:1434] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.001s
I20260709 13:07:14.208695 21453 raft_consensus.cc:359] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.209324 21453 raft_consensus.cc:385] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.209663 21453 raft_consensus.cc:740] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.210150 21454 tablet_bootstrap.cc:492] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f: No bootstrap required, opened a new log
I20260709 13:07:14.210670 21454 ts_tablet_manager.cc:1403] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f: Time spent bootstrapping tablet: real 0.015s	user 0.004s	sys 0.009s
I20260709 13:07:14.210459 21453 consensus_queue.cc:260] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.213946 21455 tablet_bootstrap.cc:492] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Bootstrap starting.
I20260709 13:07:14.213882 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e51fb5ce2404067bf74493759c5258a" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f" is_pre_election: true
W20260709 13:07:14.215417 21305 leader_election.cc:343] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.215497 21453 ts_tablet_manager.cc:1434] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:07:14.215934 21305 leader_election.cc:304] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b; no voters: a97cd63ce357411d809c3f635367fa4f, adfa72e0f05945afa5a8a00185015668
I20260709 13:07:14.216671 21453 tablet_bootstrap.cc:492] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668: Bootstrap starting.
I20260709 13:07:14.217042 21461 raft_consensus.cc:2749] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:14.219236 21461 raft_consensus.cc:493] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.219689 21461 raft_consensus.cc:515] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.220839 21455 tablet_bootstrap.cc:654] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.221844 21461 leader_election.cc:290] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:14.223464 21264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "413c0d05b82d47c2a3d165f97a93fc3e" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adfa72e0f05945afa5a8a00185015668" is_pre_election: true
I20260709 13:07:14.224732 21453 tablet_bootstrap.cc:654] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.227432 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "413c0d05b82d47c2a3d165f97a93fc3e" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f" is_pre_election: true
W20260709 13:07:14.229787 21304 leader_election.cc:343] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:14.230620 21305 leader_election.cc:343] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.231029 21305 leader_election.cc:304] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b; no voters: a97cd63ce357411d809c3f635367fa4f, adfa72e0f05945afa5a8a00185015668
I20260709 13:07:14.232168 21461 raft_consensus.cc:2749] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:14.232977 21454 raft_consensus.cc:359] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.234014 21454 raft_consensus.cc:385] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.234414 21454 raft_consensus.cc:740] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.235591 21454 consensus_queue.cc:260] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.236722 21453 tablet_bootstrap.cc:492] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668: No bootstrap required, opened a new log
I20260709 13:07:14.237239 21453 ts_tablet_manager.cc:1403] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:07:14.239230 21454 ts_tablet_manager.cc:1434] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:07:14.240492 21454 tablet_bootstrap.cc:492] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f: Bootstrap starting.
I20260709 13:07:14.240432 21453 raft_consensus.cc:359] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.241348 21453 raft_consensus.cc:385] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.241703 21453 raft_consensus.cc:740] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.242633 21453 consensus_queue.cc:260] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.244139 21461 raft_consensus.cc:493] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.244745 21461 raft_consensus.cc:515] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.247726 21453 ts_tablet_manager.cc:1434] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:07:14.248099 21460 raft_consensus.cc:493] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.248791 21453 tablet_bootstrap.cc:492] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668: Bootstrap starting.
I20260709 13:07:14.248564 21460 raft_consensus.cc:515] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.249806 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6069c81e9f45af883980cf178eff55" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f" is_pre_election: true
I20260709 13:07:14.250383 21413 raft_consensus.cc:2468] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in term 0.
I20260709 13:07:14.252108 21264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6069c81e9f45af883980cf178eff55" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adfa72e0f05945afa5a8a00185015668" is_pre_election: true
I20260709 13:07:14.252707 21264 raft_consensus.cc:2468] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in term 0.
I20260709 13:07:14.253937 21305 leader_election.cc:304] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, a97cd63ce357411d809c3f635367fa4f; no voters: 
I20260709 13:07:14.256155 21453 tablet_bootstrap.cc:654] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.256201 21460 leader_election.cc:290] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949)
I20260709 13:07:14.257684 21461 leader_election.cc:290] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:14.258373 21461 raft_consensus.cc:2804] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:14.258795 21461 raft_consensus.cc:493] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.259006 21339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8a5ea7063344b98f2f91c355140713" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" is_pre_election: true
I20260709 13:07:14.261153 21264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8a5ea7063344b98f2f91c355140713" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adfa72e0f05945afa5a8a00185015668" is_pre_election: true
W20260709 13:07:14.263190 21378 leader_election.cc:343] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:14.264108 21378 leader_election.cc:343] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.264703 21378 leader_election.cc:304] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a97cd63ce357411d809c3f635367fa4f; no voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, adfa72e0f05945afa5a8a00185015668
I20260709 13:07:14.265769 21460 raft_consensus.cc:2749] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:14.259248 21461 raft_consensus.cc:3060] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.266769 21455 tablet_bootstrap.cc:492] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b: No bootstrap required, opened a new log
I20260709 13:07:14.267357 21455 ts_tablet_manager.cc:1403] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.023s
I20260709 13:07:14.270614 21455 raft_consensus.cc:359] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.271441 21455 raft_consensus.cc:385] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.271746 21455 raft_consensus.cc:740] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.272518 21455 consensus_queue.cc:260] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.274346 21454 tablet_bootstrap.cc:654] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.274876 21455 ts_tablet_manager.cc:1434] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:07:14.277848 21455 tablet_bootstrap.cc:492] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Bootstrap starting.
I20260709 13:07:14.279798 21454 tablet_bootstrap.cc:492] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f: No bootstrap required, opened a new log
I20260709 13:07:14.280246 21454 ts_tablet_manager.cc:1403] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 13:07:14.282984 21454 raft_consensus.cc:359] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.283634 21454 raft_consensus.cc:385] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.283886 21454 raft_consensus.cc:740] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.284160 21455 tablet_bootstrap.cc:654] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.284777 21454 consensus_queue.cc:260] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.293040 21454 ts_tablet_manager.cc:1434] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:07:14.294332 21454 tablet_bootstrap.cc:492] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f: Bootstrap starting.
I20260709 13:07:14.302192 21461 raft_consensus.cc:515] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.306159 21453 tablet_bootstrap.cc:492] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668: No bootstrap required, opened a new log
I20260709 13:07:14.306689 21453 ts_tablet_manager.cc:1403] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.037s
I20260709 13:07:14.307135 21264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6069c81e9f45af883980cf178eff55" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adfa72e0f05945afa5a8a00185015668"
I20260709 13:07:14.307788 21264 raft_consensus.cc:3060] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.310004 21453 raft_consensus.cc:359] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.310801 21453 raft_consensus.cc:385] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.311116 21453 raft_consensus.cc:740] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.312085 21463 raft_consensus.cc:493] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.312601 21463 raft_consensus.cc:515] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.314921 21463 leader_election.cc:290] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:14.315266 21454 tablet_bootstrap.cc:654] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.316658 21339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d572dc7700f248e2ad13917e1069fd49" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" is_pre_election: true
I20260709 13:07:14.317338 21339 raft_consensus.cc:2468] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 0.
I20260709 13:07:14.317691 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d572dc7700f248e2ad13917e1069fd49" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f" is_pre_election: true
I20260709 13:07:14.318534 21229 leader_election.cc:304] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:14.316169 21264 raft_consensus.cc:2468] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in term 1.
I20260709 13:07:14.320001 21461 leader_election.cc:290] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 election: Requested vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:14.320763 21460 raft_consensus.cc:493] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.320011 21230 leader_election.cc:343] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.321287 21460 raft_consensus.cc:515] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.321105 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6069c81e9f45af883980cf178eff55" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
I20260709 13:07:14.322530 21413 raft_consensus.cc:3060] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.323297 21455 tablet_bootstrap.cc:492] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b: No bootstrap required, opened a new log
I20260709 13:07:14.323567 21460 leader_election.cc:290] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949)
I20260709 13:07:14.323882 21455 ts_tablet_manager.cc:1403] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Time spent bootstrapping tablet: real 0.046s	user 0.024s	sys 0.021s
I20260709 13:07:14.324088 21460 raft_consensus.cc:493] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.324563 21460 raft_consensus.cc:515] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.325716 21463 raft_consensus.cc:2804] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:14.326148 21463 raft_consensus.cc:493] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.326534 21463 raft_consensus.cc:3060] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.320629 21304 leader_election.cc:304] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:14.327737 21339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e792a787dc4230b8ef02f0938c5936" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" is_pre_election: true
W20260709 13:07:14.329336 21378 leader_election.cc:343] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.327708 21455 raft_consensus.cc:359] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.330415 21455 raft_consensus.cc:385] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.330776 21455 raft_consensus.cc:740] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.331784 21263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3641d6e17724842a599a120e0bab201" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adfa72e0f05945afa5a8a00185015668" is_pre_election: true
I20260709 13:07:14.332573 21263 raft_consensus.cc:2468] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97cd63ce357411d809c3f635367fa4f in term 0.
I20260709 13:07:14.331674 21455 consensus_queue.cc:260] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.334108 21486 raft_consensus.cc:2804] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:14.317577 21453 consensus_queue.cc:260] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.334264 21378 leader_election.cc:304] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a97cd63ce357411d809c3f635367fa4f, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:14.334277 21413 raft_consensus.cc:2468] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in term 1.
I20260709 13:07:14.337060 21339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3641d6e17724842a599a120e0bab201" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" is_pre_election: true
W20260709 13:07:14.338661 21378 leader_election.cc:343] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.335747 21460 leader_election.cc:290] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949)
I20260709 13:07:14.339872 21491 raft_consensus.cc:2804] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:14.340397 21491 raft_consensus.cc:493] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.340842 21491 raft_consensus.cc:3060] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.343554 21453 ts_tablet_manager.cc:1434] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.001s
I20260709 13:07:14.340564 21264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e792a787dc4230b8ef02f0938c5936" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adfa72e0f05945afa5a8a00185015668" is_pre_election: true
I20260709 13:07:14.344617 21453 tablet_bootstrap.cc:492] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668: Bootstrap starting.
I20260709 13:07:14.344677 21264 raft_consensus.cc:2468] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a97cd63ce357411d809c3f635367fa4f in term 0.
I20260709 13:07:14.346072 21378 leader_election.cc:304] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a97cd63ce357411d809c3f635367fa4f, adfa72e0f05945afa5a8a00185015668; no voters: 4535cfe88f4945b6b3dc02fc7cb3be3b
I20260709 13:07:14.347283 21460 raft_consensus.cc:2804] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:14.347728 21460 raft_consensus.cc:493] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.348188 21460 raft_consensus.cc:3060] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.340572 21463 raft_consensus.cc:515] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.352629 21339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d572dc7700f248e2ad13917e1069fd49" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
I20260709 13:07:14.353235 21339 raft_consensus.cc:3060] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.357933 21460 raft_consensus.cc:515] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.360656 21339 raft_consensus.cc:2468] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 1.
I20260709 13:07:14.361066 21264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e792a787dc4230b8ef02f0938c5936" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adfa72e0f05945afa5a8a00185015668"
I20260709 13:07:14.361713 21264 raft_consensus.cc:3060] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.362016 21229 leader_election.cc:304] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:14.362890 21459 raft_consensus.cc:2804] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:14.361824 21455 ts_tablet_manager.cc:1434] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 13:07:14.367384 21455 tablet_bootstrap.cc:492] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Bootstrap starting.
I20260709 13:07:14.370558 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d572dc7700f248e2ad13917e1069fd49" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
I20260709 13:07:14.371793 21486 raft_consensus.cc:697] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 LEADER]: Becoming Leader. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Running, Role: LEADER
W20260709 13:07:14.371937 21230 leader_election.cc:343] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.373171 21463 leader_election.cc:290] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 election: Requested vote from peers 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:14.374429 21339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e792a787dc4230b8ef02f0938c5936" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
I20260709 13:07:14.373353 21486 consensus_queue.cc:237] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.375404 21460 leader_election.cc:290] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 election: Requested vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949)
W20260709 13:07:14.375845 21378 leader_election.cc:343] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.379864 21264 raft_consensus.cc:2468] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97cd63ce357411d809c3f635367fa4f in term 1.
I20260709 13:07:14.382097 21454 tablet_bootstrap.cc:492] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f: No bootstrap required, opened a new log
I20260709 13:07:14.382628 21454 ts_tablet_manager.cc:1403] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f: Time spent bootstrapping tablet: real 0.089s	user 0.034s	sys 0.023s
I20260709 13:07:14.383041 21378 leader_election.cc:304] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a97cd63ce357411d809c3f635367fa4f, adfa72e0f05945afa5a8a00185015668; no voters: 4535cfe88f4945b6b3dc02fc7cb3be3b
I20260709 13:07:14.384243 21460 raft_consensus.cc:2804] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:14.384600 21491 raft_consensus.cc:515] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.385300 21459 raft_consensus.cc:697] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Becoming Leader. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:14.385779 21454 raft_consensus.cc:359] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.386560 21454 raft_consensus.cc:385] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.386301 21459 consensus_queue.cc:237] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.386915 21454 raft_consensus.cc:740] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.388185 21460 raft_consensus.cc:697] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 1 LEADER]: Becoming Leader. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Running, Role: LEADER
I20260709 13:07:14.387754 21454 consensus_queue.cc:260] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.388019 21263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3641d6e17724842a599a120e0bab201" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adfa72e0f05945afa5a8a00185015668"
I20260709 13:07:14.389046 21460 consensus_queue.cc:237] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.389940 21263 raft_consensus.cc:3060] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.391152 21454 ts_tablet_manager.cc:1434] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:07:14.392159 21454 tablet_bootstrap.cc:492] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f: Bootstrap starting.
I20260709 13:07:14.400674 21263 raft_consensus.cc:2468] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97cd63ce357411d809c3f635367fa4f in term 1.
I20260709 13:07:14.401203 21453 tablet_bootstrap.cc:654] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.406782 21455 tablet_bootstrap.cc:654] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.410545 21454 tablet_bootstrap.cc:654] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.410573 21378 leader_election.cc:304] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a97cd63ce357411d809c3f635367fa4f, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:14.414024 21491 leader_election.cc:290] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 election: Requested vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949)
I20260709 13:07:14.414253 21339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3641d6e17724842a599a120e0bab201" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
W20260709 13:07:14.415668 21378 leader_election.cc:343] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.415820 21495 raft_consensus.cc:2804] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:14.416373 21495 raft_consensus.cc:697] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 1 LEADER]: Becoming Leader. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Running, Role: LEADER
I20260709 13:07:14.417269 21495 consensus_queue.cc:237] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.423951 21459 raft_consensus.cc:493] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.422582 21159 catalog_manager.cc:5697] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2). New cstate: current_term: 1 leader_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:14.432152 21453 tablet_bootstrap.cc:492] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668: No bootstrap required, opened a new log
I20260709 13:07:14.432543 21453 ts_tablet_manager.cc:1403] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668: Time spent bootstrapping tablet: real 0.088s	user 0.015s	sys 0.000s
I20260709 13:07:14.425542 21459 raft_consensus.cc:515] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.430895 21160 catalog_manager.cc:5697] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 reported cstate change: term changed from 0 to 1, leader changed from <none> to adfa72e0f05945afa5a8a00185015668 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "adfa72e0f05945afa5a8a00185015668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:14.438184 21339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a65548d6c8412bb3ac33940e9f1204" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" is_pre_election: true
I20260709 13:07:14.445487 21493 raft_consensus.cc:493] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.448323 21229 leader_election.cc:343] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.446198 21493 raft_consensus.cc:515] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.451408 21459 leader_election.cc:290] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:14.453052 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a65548d6c8412bb3ac33940e9f1204" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f" is_pre_election: true
I20260709 13:07:14.453727 21413 raft_consensus.cc:2468] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 0.
I20260709 13:07:14.454949 21453 raft_consensus.cc:359] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.455034 21230 leader_election.cc:304] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a97cd63ce357411d809c3f635367fa4f, adfa72e0f05945afa5a8a00185015668; no voters: 4535cfe88f4945b6b3dc02fc7cb3be3b
I20260709 13:07:14.455749 21453 raft_consensus.cc:385] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.456025 21453 raft_consensus.cc:740] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.456979 21453 consensus_queue.cc:260] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.458184 21459 raft_consensus.cc:2804] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:14.458542 21459 raft_consensus.cc:493] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.458889 21459 raft_consensus.cc:3060] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.459508 21455 tablet_bootstrap.cc:492] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b: No bootstrap required, opened a new log
I20260709 13:07:14.460016 21455 ts_tablet_manager.cc:1403] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Time spent bootstrapping tablet: real 0.093s	user 0.016s	sys 0.006s
I20260709 13:07:14.463449 21455 raft_consensus.cc:359] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.464164 21455 raft_consensus.cc:385] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.464476 21455 raft_consensus.cc:740] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.464847 21453 ts_tablet_manager.cc:1434] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:07:14.465348 21455 consensus_queue.cc:260] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.466115 21453 tablet_bootstrap.cc:492] T de8a5ea7063344b98f2f91c355140713 P adfa72e0f05945afa5a8a00185015668: Bootstrap starting.
I20260709 13:07:14.468312 21455 ts_tablet_manager.cc:1434] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:07:14.469416 21455 tablet_bootstrap.cc:492] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Bootstrap starting.
I20260709 13:07:14.436964 21158 catalog_manager.cc:5697] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f reported cstate change: term changed from 0 to 1, leader changed from <none> to a97cd63ce357411d809c3f635367fa4f (127.20.40.3). New cstate: current_term: 1 leader_uuid: "a97cd63ce357411d809c3f635367fa4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:14.473062 21453 tablet_bootstrap.cc:654] T de8a5ea7063344b98f2f91c355140713 P adfa72e0f05945afa5a8a00185015668: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.484102 21486 raft_consensus.cc:493] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.484404 21339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "413c0d05b82d47c2a3d165f97a93fc3e" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" is_pre_election: true
I20260709 13:07:14.484695 21486 raft_consensus.cc:515] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.485095 21339 raft_consensus.cc:2468] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 0.
I20260709 13:07:14.487421 21486 leader_election.cc:290] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:14.488653 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e792a787dc4230b8ef02f0938c5936" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f" is_pre_election: true
I20260709 13:07:14.490567 21263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e792a787dc4230b8ef02f0938c5936" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adfa72e0f05945afa5a8a00185015668" is_pre_election: true
I20260709 13:07:14.490764 21463 consensus_queue.cc:1048] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:14.491433 21263 raft_consensus.cc:2393] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in current term 1: Already voted for candidate a97cd63ce357411d809c3f635367fa4f in this term.
I20260709 13:07:14.494904 21493 leader_election.cc:290] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:14.495839 21229 leader_election.cc:304] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:14.496117 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "413c0d05b82d47c2a3d165f97a93fc3e" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f" is_pre_election: true
I20260709 13:07:14.496754 21413 raft_consensus.cc:2468] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 0.
I20260709 13:07:14.497553 21493 raft_consensus.cc:2804] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:14.497925 21493 raft_consensus.cc:493] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.497812 21304 leader_election.cc:304] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b; no voters: a97cd63ce357411d809c3f635367fa4f, adfa72e0f05945afa5a8a00185015668
I20260709 13:07:14.500626 21486 raft_consensus.cc:3060] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.499697 21493 raft_consensus.cc:3060] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.504091 21455 tablet_bootstrap.cc:654] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.515372 21454 tablet_bootstrap.cc:492] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f: No bootstrap required, opened a new log
I20260709 13:07:14.515836 21454 ts_tablet_manager.cc:1403] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f: Time spent bootstrapping tablet: real 0.124s	user 0.022s	sys 0.010s
I20260709 13:07:14.516914 21459 raft_consensus.cc:515] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.524665 21459 leader_election.cc:290] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 election: Requested vote from peers 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:14.524539 21454 raft_consensus.cc:359] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.524945 21339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a65548d6c8412bb3ac33940e9f1204" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
I20260709 13:07:14.525370 21454 raft_consensus.cc:385] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.525701 21454 raft_consensus.cc:740] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Initialized, Role: FOLLOWER
W20260709 13:07:14.526778 21229 leader_election.cc:343] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.528460 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a65548d6c8412bb3ac33940e9f1204" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
I20260709 13:07:14.529109 21413 raft_consensus.cc:3060] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.531638 21159 catalog_manager.cc:5697] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f reported cstate change: term changed from 0 to 1, leader changed from <none> to a97cd63ce357411d809c3f635367fa4f (127.20.40.3). New cstate: current_term: 1 leader_uuid: "a97cd63ce357411d809c3f635367fa4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:14.533830 21455 tablet_bootstrap.cc:492] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b: No bootstrap required, opened a new log
I20260709 13:07:14.533522 21454 consensus_queue.cc:260] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.534399 21455 ts_tablet_manager.cc:1403] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.008s
I20260709 13:07:14.531168 21493 raft_consensus.cc:515] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.537046 21454 ts_tablet_manager.cc:1434] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:07:14.538446 21339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "413c0d05b82d47c2a3d165f97a93fc3e" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
I20260709 13:07:14.539259 21339 raft_consensus.cc:3060] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.551270 21459 consensus_queue.cc:1048] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:14.555282 21493 leader_election.cc:290] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 election: Requested vote from peers 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:14.557859 21339 raft_consensus.cc:2468] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 1.
I20260709 13:07:14.558351 21486 raft_consensus.cc:2749] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:14.556733 21412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "413c0d05b82d47c2a3d165f97a93fc3e" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
I20260709 13:07:14.560019 21412 raft_consensus.cc:3060] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.559288 21229 leader_election.cc:304] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:14.564600 21413 raft_consensus.cc:2468] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 1.
I20260709 13:07:14.565689 21493 raft_consensus.cc:2804] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:14.566197 21230 leader_election.cc:304] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a97cd63ce357411d809c3f635367fa4f, adfa72e0f05945afa5a8a00185015668; no voters: 4535cfe88f4945b6b3dc02fc7cb3be3b
I20260709 13:07:14.567361 21455 raft_consensus.cc:359] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.568375 21455 raft_consensus.cc:385] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.568770 21455 raft_consensus.cc:740] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.570818 21459 raft_consensus.cc:2804] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:14.571483 21459 raft_consensus.cc:697] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Becoming Leader. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:14.572379 21459 consensus_queue.cc:237] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.573968 21493 raft_consensus.cc:697] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Becoming Leader. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:14.574966 21493 consensus_queue.cc:237] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.578215 21455 consensus_queue.cc:260] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.580487 21455 ts_tablet_manager.cc:1434] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.003s
I20260709 13:07:14.581388 21455 tablet_bootstrap.cc:492] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Bootstrap starting.
I20260709 13:07:14.596271 21412 raft_consensus.cc:2468] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 1.
I20260709 13:07:14.600514 21453 tablet_bootstrap.cc:492] T de8a5ea7063344b98f2f91c355140713 P adfa72e0f05945afa5a8a00185015668: No bootstrap required, opened a new log
I20260709 13:07:14.600991 21453 ts_tablet_manager.cc:1403] T de8a5ea7063344b98f2f91c355140713 P adfa72e0f05945afa5a8a00185015668: Time spent bootstrapping tablet: real 0.135s	user 0.018s	sys 0.027s
I20260709 13:07:14.602469 21455 tablet_bootstrap.cc:654] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.603859 21453 raft_consensus.cc:359] T de8a5ea7063344b98f2f91c355140713 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.604373 21453 raft_consensus.cc:385] T de8a5ea7063344b98f2f91c355140713 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.604597 21453 raft_consensus.cc:740] T de8a5ea7063344b98f2f91c355140713 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.605234 21453 consensus_queue.cc:260] T de8a5ea7063344b98f2f91c355140713 P adfa72e0f05945afa5a8a00185015668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.607229 21453 ts_tablet_manager.cc:1434] T de8a5ea7063344b98f2f91c355140713 P adfa72e0f05945afa5a8a00185015668: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:14.607486 21459 raft_consensus.cc:493] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.607647 21455 tablet_bootstrap.cc:492] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b: No bootstrap required, opened a new log
I20260709 13:07:14.608057 21453 tablet_bootstrap.cc:492] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668: Bootstrap starting.
I20260709 13:07:14.608166 21455 ts_tablet_manager.cc:1403] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.002s
I20260709 13:07:14.607985 21459 raft_consensus.cc:515] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.610973 21455 raft_consensus.cc:359] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.610479 21160 catalog_manager.cc:5697] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 reported cstate change: term changed from 0 to 1, leader changed from <none> to adfa72e0f05945afa5a8a00185015668 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "adfa72e0f05945afa5a8a00185015668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:14.611788 21455 raft_consensus.cc:385] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.611593 21338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e51fb5ce2404067bf74493759c5258a" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" is_pre_election: true
I20260709 13:07:14.612435 21338 raft_consensus.cc:2468] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 0.
I20260709 13:07:14.612645 21459 leader_election.cc:290] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:14.613322 21455 raft_consensus.cc:740] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.613827 21229 leader_election.cc:304] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:14.613911 21412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e51fb5ce2404067bf74493759c5258a" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f" is_pre_election: true
I20260709 13:07:14.614049 21455 consensus_queue.cc:260] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.614694 21412 raft_consensus.cc:2468] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 0.
I20260709 13:07:14.614905 21453 tablet_bootstrap.cc:654] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.615028 21459 raft_consensus.cc:2804] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:14.615453 21459 raft_consensus.cc:493] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.615832 21459 raft_consensus.cc:3060] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.616914 21455 ts_tablet_manager.cc:1434] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:14.612519 21160 catalog_manager.cc:5697] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 reported cstate change: term changed from 0 to 1, leader changed from <none> to adfa72e0f05945afa5a8a00185015668 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "adfa72e0f05945afa5a8a00185015668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:14.617646 21495 raft_consensus.cc:493] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.621466 21495 raft_consensus.cc:515] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.623641 21495 leader_election.cc:290] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949)
I20260709 13:07:14.623548 21459 raft_consensus.cc:515] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.625247 21338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d572dc7700f248e2ad13917e1069fd49" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" is_pre_election: true
I20260709 13:07:14.626524 21339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e51fb5ce2404067bf74493759c5258a" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
I20260709 13:07:14.626802 21338 raft_consensus.cc:2393] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a97cd63ce357411d809c3f635367fa4f in current term 1: Already voted for candidate adfa72e0f05945afa5a8a00185015668 in this term.
I20260709 13:07:14.627154 21339 raft_consensus.cc:3060] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.625247 21263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d572dc7700f248e2ad13917e1069fd49" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adfa72e0f05945afa5a8a00185015668" is_pre_election: true
I20260709 13:07:14.629875 21412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e51fb5ce2404067bf74493759c5258a" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
I20260709 13:07:14.630486 21412 raft_consensus.cc:3060] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.630872 21378 leader_election.cc:304] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a97cd63ce357411d809c3f635367fa4f; no voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, adfa72e0f05945afa5a8a00185015668
I20260709 13:07:14.632102 21495 raft_consensus.cc:3060] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.634223 21453 tablet_bootstrap.cc:492] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668: No bootstrap required, opened a new log
I20260709 13:07:14.634680 21453 ts_tablet_manager.cc:1403] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.002s
I20260709 13:07:14.634858 21339 raft_consensus.cc:2468] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 1.
I20260709 13:07:14.636157 21229 leader_election.cc:304] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:14.637024 21493 raft_consensus.cc:2804] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:14.637560 21493 raft_consensus.cc:697] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Becoming Leader. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:14.637409 21453 raft_consensus.cc:359] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.638108 21453 raft_consensus.cc:385] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.638388 21453 raft_consensus.cc:740] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.638535 21493 consensus_queue.cc:237] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.639076 21453 consensus_queue.cc:260] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.639698 21495 raft_consensus.cc:2749] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:14.644944 21412 raft_consensus.cc:2468] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 1.
I20260709 13:07:14.646679 21459 leader_election.cc:290] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 1 election: Requested vote from peers 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:14.647979 21453 ts_tablet_manager.cc:1434] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.003s
I20260709 13:07:14.652174 21158 catalog_manager.cc:5697] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 reported cstate change: term changed from 0 to 1, leader changed from <none> to adfa72e0f05945afa5a8a00185015668 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "adfa72e0f05945afa5a8a00185015668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:14.659255 21486 raft_consensus.cc:493] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.659677 21486 raft_consensus.cc:515] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.661545 21486 leader_election.cc:290] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:14.662346 21263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3641d6e17724842a599a120e0bab201" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adfa72e0f05945afa5a8a00185015668" is_pre_election: true
I20260709 13:07:14.662812 21412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3641d6e17724842a599a120e0bab201" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f" is_pre_election: true
I20260709 13:07:14.663167 21263 raft_consensus.cc:2393] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in current term 1: Already voted for candidate a97cd63ce357411d809c3f635367fa4f in this term.
I20260709 13:07:14.664683 21486 raft_consensus.cc:493] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.664755 21305 leader_election.cc:304] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b; no voters: a97cd63ce357411d809c3f635367fa4f, adfa72e0f05945afa5a8a00185015668
I20260709 13:07:14.665212 21486 raft_consensus.cc:515] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.665904 21492 raft_consensus.cc:3060] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.667273 21486 leader_election.cc:290] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:14.668208 21263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7634d671d1d47b78d4c0d77adfb1e3b" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adfa72e0f05945afa5a8a00185015668" is_pre_election: true
I20260709 13:07:14.668982 21263 raft_consensus.cc:2468] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in term 0.
I20260709 13:07:14.669303 21412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7634d671d1d47b78d4c0d77adfb1e3b" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f" is_pre_election: true
I20260709 13:07:14.670063 21412 raft_consensus.cc:2468] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in term 0.
I20260709 13:07:14.670351 21304 leader_election.cc:304] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:14.671341 21486 raft_consensus.cc:2804] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:14.671741 21486 raft_consensus.cc:493] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.672107 21486 raft_consensus.cc:3060] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.672902 21492 raft_consensus.cc:2749] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:14.677078 21486 raft_consensus.cc:515] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.679105 21486 leader_election.cc:290] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 election: Requested vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:14.679989 21263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7634d671d1d47b78d4c0d77adfb1e3b" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adfa72e0f05945afa5a8a00185015668"
I20260709 13:07:14.680140 21412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7634d671d1d47b78d4c0d77adfb1e3b" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
I20260709 13:07:14.680487 21263 raft_consensus.cc:3060] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.680733 21412 raft_consensus.cc:3060] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.685588 21412 raft_consensus.cc:2468] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in term 1.
I20260709 13:07:14.686086 21263 raft_consensus.cc:2468] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in term 1.
I20260709 13:07:14.686722 21305 leader_election.cc:304] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, a97cd63ce357411d809c3f635367fa4f; no voters: 
I20260709 13:07:14.687630 21486 raft_consensus.cc:2804] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:14.688045 21486 raft_consensus.cc:697] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 LEADER]: Becoming Leader. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Running, Role: LEADER
I20260709 13:07:14.688851 21486 consensus_queue.cc:237] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.696436 21158 catalog_manager.cc:5697] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2). New cstate: current_term: 1 leader_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:14.769508 21486 raft_consensus.cc:493] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.770000 21486 raft_consensus.cc:515] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.771693 21486 leader_election.cc:290] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:14.772440 21263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8a5ea7063344b98f2f91c355140713" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adfa72e0f05945afa5a8a00185015668" is_pre_election: true
I20260709 13:07:14.772655 21412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8a5ea7063344b98f2f91c355140713" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f" is_pre_election: true
I20260709 13:07:14.773057 21263 raft_consensus.cc:2468] T de8a5ea7063344b98f2f91c355140713 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in term 0.
I20260709 13:07:14.773202 21412 raft_consensus.cc:2468] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in term 0.
I20260709 13:07:14.774139 21304 leader_election.cc:304] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:14.774816 21486 raft_consensus.cc:2804] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:14.775125 21492 raft_consensus.cc:493] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.775202 21486 raft_consensus.cc:493] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.775647 21486 raft_consensus.cc:3060] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.775537 21492 raft_consensus.cc:515] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.777307 21492 leader_election.cc:290] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:14.778059 21263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a65548d6c8412bb3ac33940e9f1204" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adfa72e0f05945afa5a8a00185015668" is_pre_election: true
I20260709 13:07:14.778383 21412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a65548d6c8412bb3ac33940e9f1204" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f" is_pre_election: true
I20260709 13:07:14.779242 21412 raft_consensus.cc:2393] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in current term 1: Already voted for candidate adfa72e0f05945afa5a8a00185015668 in this term.
I20260709 13:07:14.780432 21305 leader_election.cc:304] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b; no voters: a97cd63ce357411d809c3f635367fa4f, adfa72e0f05945afa5a8a00185015668
I20260709 13:07:14.781478 21492 raft_consensus.cc:3060] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.781636 21495 consensus_queue.cc:1048] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:14.782780 21486 raft_consensus.cc:515] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.785249 21486 leader_election.cc:290] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 election: Requested vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:14.785691 21264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8a5ea7063344b98f2f91c355140713" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "adfa72e0f05945afa5a8a00185015668"
I20260709 13:07:14.786324 21264 raft_consensus.cc:3060] T de8a5ea7063344b98f2f91c355140713 P adfa72e0f05945afa5a8a00185015668 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.788817 21492 raft_consensus.cc:2749] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:14.793186 21412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de8a5ea7063344b98f2f91c355140713" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
I20260709 13:07:14.794031 21412 raft_consensus.cc:3060] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.794546 21492 consensus_queue.cc:1048] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:14.801000 21495 consensus_queue.cc:1048] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:14.811858 21264 raft_consensus.cc:2468] T de8a5ea7063344b98f2f91c355140713 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in term 1.
I20260709 13:07:14.811923 21412 raft_consensus.cc:2468] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in term 1.
I20260709 13:07:14.813297 21304 leader_election.cc:304] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:14.815603 21521 raft_consensus.cc:2804] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:14.816164 21521 raft_consensus.cc:697] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 LEADER]: Becoming Leader. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Running, Role: LEADER
I20260709 13:07:14.817612 21521 consensus_queue.cc:237] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:14.826813 21523 consensus_queue.cc:1048] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:14.845587 21459 consensus_queue.cc:1048] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:14.846349 21160 catalog_manager.cc:5697] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2). New cstate: current_term: 1 leader_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:14.856986 21493 consensus_queue.cc:1048] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:14.968060 21518 consensus_queue.cc:1048] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:14.979916 21491 consensus_queue.cc:1048] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:14.982225 21493 consensus_queue.cc:1048] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:14.995386 21463 consensus_queue.cc:1048] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:15.004772 21514 consensus_queue.cc:1048] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:15.020274 21493 consensus_queue.cc:1048] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:15.054828 21338 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a6069c81e9f45af883980cf178eff55"
dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
mode: GRACEFUL
new_leader_uuid: "adfa72e0f05945afa5a8a00185015668"
 from {username='slave'} at 127.0.0.1:49920
I20260709 13:07:15.055450 21338 raft_consensus.cc:606] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 LEADER]: Received request to transfer leadership to TS adfa72e0f05945afa5a8a00185015668
I20260709 13:07:15.063227 21493 consensus_queue.cc:1048] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:15.070498 21413 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3641d6e17724842a599a120e0bab201"
dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
mode: GRACEFUL
new_leader_uuid: "adfa72e0f05945afa5a8a00185015668"
 from {username='slave'} at 127.0.0.1:36602
I20260709 13:07:15.071028 21413 raft_consensus.cc:606] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 1 LEADER]: Received request to transfer leadership to TS adfa72e0f05945afa5a8a00185015668
I20260709 13:07:15.076293 21459 consensus_queue.cc:1048] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:15.082319 21486 consensus_queue.cc:1048] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:15.090245 21413 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41e792a787dc4230b8ef02f0938c5936"
dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
mode: GRACEFUL
new_leader_uuid: "adfa72e0f05945afa5a8a00185015668"
 from {username='slave'} at 127.0.0.1:36602
I20260709 13:07:15.090905 21413 raft_consensus.cc:606] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 1 LEADER]: Received request to transfer leadership to TS adfa72e0f05945afa5a8a00185015668
I20260709 13:07:15.101817 21523 consensus_queue.cc:1048] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:15.118151 21264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "413c0d05b82d47c2a3d165f97a93fc3e"
dest_uuid: "adfa72e0f05945afa5a8a00185015668"
mode: GRACEFUL
new_leader_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
 from {username='slave'} at 127.0.0.1:52524
I20260709 13:07:15.118775 21264 raft_consensus.cc:606] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Received request to transfer leadership to TS 4535cfe88f4945b6b3dc02fc7cb3be3b
I20260709 13:07:15.126271 21264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d572dc7700f248e2ad13917e1069fd49"
dest_uuid: "adfa72e0f05945afa5a8a00185015668"
mode: GRACEFUL
new_leader_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
 from {username='slave'} at 127.0.0.1:52524
I20260709 13:07:15.126794 21264 raft_consensus.cc:606] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Received request to transfer leadership to TS 4535cfe88f4945b6b3dc02fc7cb3be3b
I20260709 13:07:15.134298 21264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e51fb5ce2404067bf74493759c5258a"
dest_uuid: "adfa72e0f05945afa5a8a00185015668"
mode: GRACEFUL
new_leader_uuid: "a97cd63ce357411d809c3f635367fa4f"
 from {username='slave'} at 127.0.0.1:52524
I20260709 13:07:15.134841 21264 raft_consensus.cc:606] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Received request to transfer leadership to TS a97cd63ce357411d809c3f635367fa4f
I20260709 13:07:15.226291 21523 consensus_queue.cc:1048] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:15.228010 21523 consensus_queue.cc:1048] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:15.265085 21495 raft_consensus.cc:993] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f: : Instructing follower adfa72e0f05945afa5a8a00185015668 to start an election
I20260709 13:07:15.265590 21491 raft_consensus.cc:1081] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 1 LEADER]: Signalling peer adfa72e0f05945afa5a8a00185015668 to start an election
I20260709 13:07:15.266995 21264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41e792a787dc4230b8ef02f0938c5936"
dest_uuid: "adfa72e0f05945afa5a8a00185015668"
 from {username='slave'} at 127.0.0.1:52506
I20260709 13:07:15.267457 21264 raft_consensus.cc:493] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:15.267737 21264 raft_consensus.cc:3060] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.273051 21264 raft_consensus.cc:515] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:15.275075 21264 leader_election.cc:290] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 2 election: Requested vote from peers 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:15.276077 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e792a787dc4230b8ef02f0938c5936" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
I20260709 13:07:15.276067 21338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e792a787dc4230b8ef02f0938c5936" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
I20260709 13:07:15.276829 21338 raft_consensus.cc:3060] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.276803 21413 raft_consensus.cc:3055] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:15.277381 21413 raft_consensus.cc:740] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Running, Role: LEADER
I20260709 13:07:15.278254 21413 consensus_queue.cc:260] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:15.279498 21413 raft_consensus.cc:3060] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.283962 21338 raft_consensus.cc:2468] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 2.
I20260709 13:07:15.285274 21229 leader_election.cc:304] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:15.285900 21413 raft_consensus.cc:2468] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 2.
I20260709 13:07:15.286180 21459 raft_consensus.cc:2804] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:15.286700 21459 raft_consensus.cc:697] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 2 LEADER]: Becoming Leader. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:15.287454 21459 consensus_queue.cc:237] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:15.294528 21158 catalog_manager.cc:5697] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 reported cstate change: term changed from 1 to 2, leader changed from a97cd63ce357411d809c3f635367fa4f (127.20.40.3) to adfa72e0f05945afa5a8a00185015668 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "adfa72e0f05945afa5a8a00185015668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.302505 21521 raft_consensus.cc:993] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b: : Instructing follower adfa72e0f05945afa5a8a00185015668 to start an election
I20260709 13:07:15.303016 21521 raft_consensus.cc:1081] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 LEADER]: Signalling peer adfa72e0f05945afa5a8a00185015668 to start an election
I20260709 13:07:15.304543 21264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a6069c81e9f45af883980cf178eff55"
dest_uuid: "adfa72e0f05945afa5a8a00185015668"
 from {username='slave'} at 127.0.0.1:52520
I20260709 13:07:15.305043 21264 raft_consensus.cc:493] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:15.305478 21264 raft_consensus.cc:3060] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.309933 21264 raft_consensus.cc:515] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:15.311554 21264 leader_election.cc:290] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 2 election: Requested vote from peers 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:15.312449 21338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6069c81e9f45af883980cf178eff55" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
I20260709 13:07:15.312706 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6069c81e9f45af883980cf178eff55" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
I20260709 13:07:15.312983 21338 raft_consensus.cc:3055] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:15.313256 21413 raft_consensus.cc:3060] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.313294 21338 raft_consensus.cc:740] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Running, Role: LEADER
I20260709 13:07:15.314203 21338 consensus_queue.cc:260] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:15.315140 21338 raft_consensus.cc:3060] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.318871 21413 raft_consensus.cc:2468] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 2.
I20260709 13:07:15.319619 21338 raft_consensus.cc:2468] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 2.
I20260709 13:07:15.320163 21230 leader_election.cc:304] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a97cd63ce357411d809c3f635367fa4f, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:15.320871 21459 raft_consensus.cc:2804] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:15.321204 21459 raft_consensus.cc:697] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 2 LEADER]: Becoming Leader. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:15.321966 21459 consensus_queue.cc:237] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:15.327786 21160 catalog_manager.cc:5697] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 reported cstate change: term changed from 1 to 2, leader changed from 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2) to adfa72e0f05945afa5a8a00185015668 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "adfa72e0f05945afa5a8a00185015668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.360004 21463 raft_consensus.cc:993] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668: : Instructing follower 4535cfe88f4945b6b3dc02fc7cb3be3b to start an election
I20260709 13:07:15.360419 21459 raft_consensus.cc:1081] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Signalling peer 4535cfe88f4945b6b3dc02fc7cb3be3b to start an election
I20260709 13:07:15.361749 21338 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d572dc7700f248e2ad13917e1069fd49"
dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
 from {username='slave'} at 127.0.0.1:49900
I20260709 13:07:15.362346 21338 raft_consensus.cc:493] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:15.362689 21338 raft_consensus.cc:3060] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.367604 21338 raft_consensus.cc:515] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:15.369464 21338 leader_election.cc:290] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 2 election: Requested vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:15.370226 21264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d572dc7700f248e2ad13917e1069fd49" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adfa72e0f05945afa5a8a00185015668"
I20260709 13:07:15.370568 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d572dc7700f248e2ad13917e1069fd49" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
I20260709 13:07:15.370831 21264 raft_consensus.cc:3055] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:15.371115 21413 raft_consensus.cc:3060] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.371155 21264 raft_consensus.cc:740] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:15.372017 21264 consensus_queue.cc:260] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:15.373209 21264 raft_consensus.cc:3060] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.377805 21413 raft_consensus.cc:2468] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in term 2.
I20260709 13:07:15.379005 21305 leader_election.cc:304] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, a97cd63ce357411d809c3f635367fa4f; no voters: 
I20260709 13:07:15.379482 21264 raft_consensus.cc:2468] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in term 2.
I20260709 13:07:15.379745 21521 raft_consensus.cc:2804] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:15.380216 21521 raft_consensus.cc:697] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 LEADER]: Becoming Leader. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Running, Role: LEADER
I20260709 13:07:15.381000 21521 consensus_queue.cc:237] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:15.386777 21160 catalog_manager.cc:5697] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b reported cstate change: term changed from 1 to 2, leader changed from adfa72e0f05945afa5a8a00185015668 (127.20.40.1) to 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2). New cstate: current_term: 2 leader_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.407007 21463 raft_consensus.cc:993] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668: : Instructing follower 4535cfe88f4945b6b3dc02fc7cb3be3b to start an election
I20260709 13:07:15.407450 21459 raft_consensus.cc:1081] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Signalling peer 4535cfe88f4945b6b3dc02fc7cb3be3b to start an election
I20260709 13:07:15.408780 21338 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "413c0d05b82d47c2a3d165f97a93fc3e"
dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
 from {username='slave'} at 127.0.0.1:49900
I20260709 13:07:15.409312 21338 raft_consensus.cc:493] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:15.409662 21338 raft_consensus.cc:3060] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.413763 21338 raft_consensus.cc:515] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:15.416085 21338 leader_election.cc:290] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 2 election: Requested vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:15.416487 21264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "413c0d05b82d47c2a3d165f97a93fc3e" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adfa72e0f05945afa5a8a00185015668"
I20260709 13:07:15.416687 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "413c0d05b82d47c2a3d165f97a93fc3e" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
I20260709 13:07:15.417187 21413 raft_consensus.cc:3060] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.417752 21264 raft_consensus.cc:3055] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:15.418092 21264 raft_consensus.cc:740] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:15.419067 21264 consensus_queue.cc:260] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:15.420265 21264 raft_consensus.cc:3060] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.422128 21460 raft_consensus.cc:993] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f: : Instructing follower adfa72e0f05945afa5a8a00185015668 to start an election
I20260709 13:07:15.422528 21460 raft_consensus.cc:1081] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 1 LEADER]: Signalling peer adfa72e0f05945afa5a8a00185015668 to start an election
I20260709 13:07:15.424028 21413 raft_consensus.cc:2468] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in term 2.
I20260709 13:07:15.424089 21263 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3641d6e17724842a599a120e0bab201"
dest_uuid: "adfa72e0f05945afa5a8a00185015668"
 from {username='slave'} at 127.0.0.1:52506
I20260709 13:07:15.424764 21263 raft_consensus.cc:493] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:15.425133 21263 raft_consensus.cc:3060] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.425220 21305 leader_election.cc:304] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, a97cd63ce357411d809c3f635367fa4f; no voters: 
I20260709 13:07:15.426216 21521 raft_consensus.cc:2804] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:15.426669 21521 raft_consensus.cc:697] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 LEADER]: Becoming Leader. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Running, Role: LEADER
I20260709 13:07:15.427518 21264 raft_consensus.cc:2468] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in term 2.
I20260709 13:07:15.427428 21521 consensus_queue.cc:237] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:15.432765 21263 raft_consensus.cc:515] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:15.435302 21338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3641d6e17724842a599a120e0bab201" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
I20260709 13:07:15.434659 21263 leader_election.cc:290] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 2 election: Requested vote from peers 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:15.436105 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3641d6e17724842a599a120e0bab201" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
I20260709 13:07:15.436371 21338 raft_consensus.cc:3060] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.436736 21413 raft_consensus.cc:3055] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:15.435967 21158 catalog_manager.cc:5697] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b reported cstate change: term changed from 1 to 2, leader changed from adfa72e0f05945afa5a8a00185015668 (127.20.40.1) to 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2). New cstate: current_term: 2 leader_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.437114 21413 raft_consensus.cc:740] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Running, Role: LEADER
I20260709 13:07:15.437932 21413 consensus_queue.cc:260] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:15.439179 21413 raft_consensus.cc:3060] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.442445 21338 raft_consensus.cc:2468] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 2.
I20260709 13:07:15.443528 21229 leader_election.cc:304] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:15.444262 21459 raft_consensus.cc:2804] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:15.444741 21459 raft_consensus.cc:697] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 2 LEADER]: Becoming Leader. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:15.444895 21413 raft_consensus.cc:2468] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 2.
I20260709 13:07:15.445708 21459 consensus_queue.cc:237] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:15.451711 21158 catalog_manager.cc:5697] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 reported cstate change: term changed from 1 to 2, leader changed from a97cd63ce357411d809c3f635367fa4f (127.20.40.3) to adfa72e0f05945afa5a8a00185015668 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "adfa72e0f05945afa5a8a00185015668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.635761 21459 raft_consensus.cc:993] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668: : Instructing follower a97cd63ce357411d809c3f635367fa4f to start an election
I20260709 13:07:15.636345 21463 raft_consensus.cc:1081] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Signalling peer a97cd63ce357411d809c3f635367fa4f to start an election
I20260709 13:07:15.637897 21413 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e51fb5ce2404067bf74493759c5258a"
dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
 from {username='slave'} at 127.0.0.1:36580
I20260709 13:07:15.638468 21413 raft_consensus.cc:493] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:15.638854 21413 raft_consensus.cc:3060] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.643648 21413 raft_consensus.cc:515] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:15.645344 21413 leader_election.cc:290] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 2 election: Requested vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949)
I20260709 13:07:15.646224 21263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e51fb5ce2404067bf74493759c5258a" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adfa72e0f05945afa5a8a00185015668"
I20260709 13:07:15.646443 21338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e51fb5ce2404067bf74493759c5258a" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
I20260709 13:07:15.646852 21263 raft_consensus.cc:3055] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:15.646952 21338 raft_consensus.cc:3060] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.647224 21263 raft_consensus.cc:740] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:15.648075 21263 consensus_queue.cc:260] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:15.649241 21263 raft_consensus.cc:3060] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.653833 21338 raft_consensus.cc:2468] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97cd63ce357411d809c3f635367fa4f in term 2.
I20260709 13:07:15.654999 21378 leader_election.cc:304] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, a97cd63ce357411d809c3f635367fa4f; no voters: 
I20260709 13:07:15.655731 21491 raft_consensus.cc:2804] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:15.655807 21263 raft_consensus.cc:2468] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97cd63ce357411d809c3f635367fa4f in term 2.
I20260709 13:07:15.656404 21491 raft_consensus.cc:697] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f [term 2 LEADER]: Becoming Leader. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Running, Role: LEADER
I20260709 13:07:15.657282 21491 consensus_queue.cc:237] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:15.663661 21158 catalog_manager.cc:5697] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f reported cstate change: term changed from 1 to 2, leader changed from adfa72e0f05945afa5a8a00185015668 (127.20.40.1) to a97cd63ce357411d809c3f635367fa4f (127.20.40.3). New cstate: current_term: 2 leader_uuid: "a97cd63ce357411d809c3f635367fa4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.713205 21338 raft_consensus.cc:1275] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Refusing update from remote peer adfa72e0f05945afa5a8a00185015668: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:15.714716 21463 consensus_queue.cc:1048] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:15.717818 21339 raft_consensus.cc:1275] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Refusing update from remote peer adfa72e0f05945afa5a8a00185015668: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:15.719355 21459 consensus_queue.cc:1048] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:15.719722 21413 raft_consensus.cc:1275] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Refusing update from remote peer adfa72e0f05945afa5a8a00185015668: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:15.721364 21463 consensus_queue.cc:1048] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:15.725381 21412 raft_consensus.cc:1275] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Refusing update from remote peer adfa72e0f05945afa5a8a00185015668: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:15.729876 21463 consensus_queue.cc:1048] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:15.861611 21263 raft_consensus.cc:1275] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Refusing update from remote peer 4535cfe88f4945b6b3dc02fc7cb3be3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:15.862941 21521 consensus_queue.cc:1048] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:15.870942 21413 raft_consensus.cc:1275] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Refusing update from remote peer 4535cfe88f4945b6b3dc02fc7cb3be3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:15.872362 21521 consensus_queue.cc:1048] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:15.926820 21338 raft_consensus.cc:1275] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Refusing update from remote peer adfa72e0f05945afa5a8a00185015668: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:15.927832 21413 raft_consensus.cc:1275] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Refusing update from remote peer 4535cfe88f4945b6b3dc02fc7cb3be3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:15.928264 21263 raft_consensus.cc:1275] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Refusing update from remote peer 4535cfe88f4945b6b3dc02fc7cb3be3b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:15.928143 21546 consensus_queue.cc:1048] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:15.929343 21524 consensus_queue.cc:1048] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:15.930124 21521 consensus_queue.cc:1048] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:15.937345 21412 raft_consensus.cc:1275] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Refusing update from remote peer adfa72e0f05945afa5a8a00185015668: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:15.938704 21546 consensus_queue.cc:1048] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:16.103753 21338 raft_consensus.cc:1275] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Refusing update from remote peer a97cd63ce357411d809c3f635367fa4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:16.105075 21491 consensus_queue.cc:1048] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:16.114243 21263 raft_consensus.cc:1275] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Refusing update from remote peer a97cd63ce357411d809c3f635367fa4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:16.116165 21491 consensus_queue.cc:1048] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:18.295827 21304 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:35319, user_credentials={real_user=slave}} blocked reactor thread for 235135us
I20260709 13:07:18.629359 20640 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:07:18.630116 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:18.654292 21264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a6069c81e9f45af883980cf178eff55"
dest_uuid: "adfa72e0f05945afa5a8a00185015668"
mode: GRACEFUL
new_leader_uuid: "a97cd63ce357411d809c3f635367fa4f"
 from {username='slave'} at 127.0.0.1:52526
I20260709 13:07:18.654824 21264 raft_consensus.cc:606] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 2 LEADER]: Received request to transfer leadership to TS a97cd63ce357411d809c3f635367fa4f
I20260709 13:07:18.657308 21264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3641d6e17724842a599a120e0bab201"
dest_uuid: "adfa72e0f05945afa5a8a00185015668"
mode: GRACEFUL
new_leader_uuid: "a97cd63ce357411d809c3f635367fa4f"
 from {username='slave'} at 127.0.0.1:52526
I20260709 13:07:18.657913 21264 raft_consensus.cc:606] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 2 LEADER]: Received request to transfer leadership to TS a97cd63ce357411d809c3f635367fa4f
I20260709 13:07:18.658954 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:18.659377 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:18.665907 21561 raft_consensus.cc:993] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668: : Instructing follower a97cd63ce357411d809c3f635367fa4f to start an election
I20260709 13:07:18.666388 21559 raft_consensus.cc:1081] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 2 LEADER]: Signalling peer a97cd63ce357411d809c3f635367fa4f to start an election
I20260709 13:07:18.667832 21413 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a6069c81e9f45af883980cf178eff55"
dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
 from {username='slave'} at 127.0.0.1:36580
I20260709 13:07:18.668247 21413 raft_consensus.cc:493] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:18.668515 21413 raft_consensus.cc:3060] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.672839 21413 raft_consensus.cc:515] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:18.674351 21413 leader_election.cc:290] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 3 election: Requested vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949)
I20260709 13:07:18.675179 21264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6069c81e9f45af883980cf178eff55" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "adfa72e0f05945afa5a8a00185015668"
I20260709 13:07:18.675565 21336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6069c81e9f45af883980cf178eff55" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
I20260709 13:07:18.675794 21264 raft_consensus.cc:3055] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:18.676148 21336 raft_consensus.cc:3060] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.676111 21264 raft_consensus.cc:740] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:18.677030 21264 consensus_queue.cc:260] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:18.678293 21264 raft_consensus.cc:3060] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.683287 21336 raft_consensus.cc:2468] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97cd63ce357411d809c3f635367fa4f in term 3.
I20260709 13:07:18.684537 21378 leader_election.cc:304] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, a97cd63ce357411d809c3f635367fa4f; no voters: 
I20260709 13:07:18.685173 21264 raft_consensus.cc:2468] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97cd63ce357411d809c3f635367fa4f in term 3.
I20260709 13:07:18.685400 21556 raft_consensus.cc:2804] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:18.686705 21556 raft_consensus.cc:697] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 3 LEADER]: Becoming Leader. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Running, Role: LEADER
I20260709 13:07:18.687551 21556 consensus_queue.cc:237] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:18.691066 21561 raft_consensus.cc:993] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668: : Instructing follower a97cd63ce357411d809c3f635367fa4f to start an election
I20260709 13:07:18.691527 21559 raft_consensus.cc:1081] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 2 LEADER]: Signalling peer a97cd63ce357411d809c3f635367fa4f to start an election
I20260709 13:07:18.693192 21413 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3641d6e17724842a599a120e0bab201"
dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
 from {username='slave'} at 127.0.0.1:36580
I20260709 13:07:18.693708 21413 raft_consensus.cc:493] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:18.694059 21413 raft_consensus.cc:3060] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.700099 21413 raft_consensus.cc:515] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:18.699572 21160 catalog_manager.cc:5697] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f reported cstate change: term changed from 2 to 3, leader changed from adfa72e0f05945afa5a8a00185015668 (127.20.40.1) to a97cd63ce357411d809c3f635367fa4f (127.20.40.3). New cstate: current_term: 3 leader_uuid: "a97cd63ce357411d809c3f635367fa4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:18.701958 21413 leader_election.cc:290] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 3 election: Requested vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949)
I20260709 13:07:18.702579 21264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3641d6e17724842a599a120e0bab201" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "adfa72e0f05945afa5a8a00185015668"
I20260709 13:07:18.703058 21336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3641d6e17724842a599a120e0bab201" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
I20260709 13:07:18.703228 21264 raft_consensus.cc:3055] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:18.703545 21264 raft_consensus.cc:740] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:18.703574 21336 raft_consensus.cc:3060] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.704422 21264 consensus_queue.cc:260] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:18.705633 21264 raft_consensus.cc:3060] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:18.710336 21336 raft_consensus.cc:2468] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97cd63ce357411d809c3f635367fa4f in term 3.
I20260709 13:07:18.711427 21378 leader_election.cc:304] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, a97cd63ce357411d809c3f635367fa4f; no voters: 
I20260709 13:07:18.712224 21556 raft_consensus.cc:2804] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:18.712551 21264 raft_consensus.cc:2468] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97cd63ce357411d809c3f635367fa4f in term 3.
I20260709 13:07:18.712734 21556 raft_consensus.cc:697] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 3 LEADER]: Becoming Leader. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Running, Role: LEADER
I20260709 13:07:18.713901 21556 consensus_queue.cc:237] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:18.724584 21160 catalog_manager.cc:5697] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f reported cstate change: term changed from 2 to 3, leader changed from adfa72e0f05945afa5a8a00185015668 (127.20.40.1) to a97cd63ce357411d809c3f635367fa4f (127.20.40.3). New cstate: current_term: 3 leader_uuid: "a97cd63ce357411d809c3f635367fa4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:18.907109 21360 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff640 after lost signal to thread 20643
W20260709 13:07:18.908046 21360 debug-util.cc:398] Leaking SignalData structure 0x7b08000ffd20 after lost signal to thread 21196
W20260709 13:07:18.909385 21360 debug-util.cc:398] Leaking SignalData structure 0x7b08000afbe0 after lost signal to thread 21363
W20260709 13:07:18.910221 21360 debug-util.cc:398] Leaking SignalData structure 0x7b08000b3320 after lost signal to thread 21437
I20260709 13:07:19.082563 21264 raft_consensus.cc:1275] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 3 FOLLOWER]: Refusing update from remote peer a97cd63ce357411d809c3f635367fa4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:19.084317 21556 consensus_queue.cc:1048] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:19.102551 21336 raft_consensus.cc:1275] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 3 FOLLOWER]: Refusing update from remote peer a97cd63ce357411d809c3f635367fa4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:19.108872 21336 raft_consensus.cc:1275] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 3 FOLLOWER]: Refusing update from remote peer a97cd63ce357411d809c3f635367fa4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:19.108953 21556 consensus_queue.cc:1048] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:19.110780 21556 consensus_queue.cc:1048] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:19.139317 21262 raft_consensus.cc:1275] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 3 FOLLOWER]: Refusing update from remote peer a97cd63ce357411d809c3f635367fa4f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:19.141921 21565 consensus_queue.cc:1048] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:19.660235 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:19.674451 21413 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a6069c81e9f45af883980cf178eff55"
dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
mode: GRACEFUL
new_leader_uuid: "adfa72e0f05945afa5a8a00185015668"
 from {username='slave'} at 127.0.0.1:36602
I20260709 13:07:19.674955 21413 raft_consensus.cc:606] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 3 LEADER]: Received request to transfer leadership to TS adfa72e0f05945afa5a8a00185015668
I20260709 13:07:19.680198 21413 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3641d6e17724842a599a120e0bab201"
dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
mode: GRACEFUL
new_leader_uuid: "adfa72e0f05945afa5a8a00185015668"
 from {username='slave'} at 127.0.0.1:36602
I20260709 13:07:19.680683 21413 raft_consensus.cc:606] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 3 LEADER]: Received request to transfer leadership to TS adfa72e0f05945afa5a8a00185015668
I20260709 13:07:19.691936 21337 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7634d671d1d47b78d4c0d77adfb1e3b"
dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
mode: GRACEFUL
new_leader_uuid: "adfa72e0f05945afa5a8a00185015668"
 from {username='slave'} at 127.0.0.1:49920
I20260709 13:07:19.692584 21337 raft_consensus.cc:606] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 LEADER]: Received request to transfer leadership to TS adfa72e0f05945afa5a8a00185015668
I20260709 13:07:19.697940 21337 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "413c0d05b82d47c2a3d165f97a93fc3e"
dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
mode: GRACEFUL
new_leader_uuid: "adfa72e0f05945afa5a8a00185015668"
 from {username='slave'} at 127.0.0.1:49920
I20260709 13:07:19.698529 21337 raft_consensus.cc:606] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 LEADER]: Received request to transfer leadership to TS adfa72e0f05945afa5a8a00185015668
I20260709 13:07:19.703735 21337 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d572dc7700f248e2ad13917e1069fd49"
dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
mode: GRACEFUL
new_leader_uuid: "adfa72e0f05945afa5a8a00185015668"
 from {username='slave'} at 127.0.0.1:49920
I20260709 13:07:19.704306 21337 raft_consensus.cc:606] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 LEADER]: Received request to transfer leadership to TS adfa72e0f05945afa5a8a00185015668
I20260709 13:07:19.706102 21576 raft_consensus.cc:993] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f: : Instructing follower adfa72e0f05945afa5a8a00185015668 to start an election
I20260709 13:07:19.706581 21556 raft_consensus.cc:1081] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 3 LEADER]: Signalling peer adfa72e0f05945afa5a8a00185015668 to start an election
I20260709 13:07:19.708841 21262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a6069c81e9f45af883980cf178eff55"
dest_uuid: "adfa72e0f05945afa5a8a00185015668"
 from {username='slave'} at 127.0.0.1:52506
I20260709 13:07:19.709734 21262 raft_consensus.cc:493] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:19.712476 21262 raft_consensus.cc:3060] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.719857 21262 raft_consensus.cc:515] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:19.722697 21337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6069c81e9f45af883980cf178eff55" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
I20260709 13:07:19.722994 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a6069c81e9f45af883980cf178eff55" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
I20260709 13:07:19.723382 21337 raft_consensus.cc:3060] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.723511 21413 raft_consensus.cc:3055] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:19.723843 21413 raft_consensus.cc:740] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Running, Role: LEADER
I20260709 13:07:19.724635 21413 consensus_queue.cc:260] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:19.725755 21413 raft_consensus.cc:3060] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:19.730804 21337 raft_consensus.cc:2468] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 4.
I20260709 13:07:19.732741 21413 raft_consensus.cc:2468] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 4.
I20260709 13:07:19.733026 21229 leader_election.cc:304] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:19.734019 21559 raft_consensus.cc:2804] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:19.734230 21262 leader_election.cc:290] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 4 election: Requested vote from peers 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:19.736491 21581 raft_consensus.cc:993] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b: : Instructing follower adfa72e0f05945afa5a8a00185015668 to start an election
I20260709 13:07:19.736670 21559 raft_consensus.cc:697] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 4 LEADER]: Becoming Leader. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:19.738225 21572 raft_consensus.cc:1081] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 LEADER]: Signalling peer adfa72e0f05945afa5a8a00185015668 to start an election
I20260709 13:07:19.737725 21559 consensus_queue.cc:237] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:19.740060 21262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d572dc7700f248e2ad13917e1069fd49"
dest_uuid: "adfa72e0f05945afa5a8a00185015668"
 from {username='slave'} at 127.0.0.1:52520
I20260709 13:07:19.740656 21262 raft_consensus.cc:493] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:19.741099 21262 raft_consensus.cc:3060] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.748209 21262 raft_consensus.cc:515] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:19.748147 21158 catalog_manager.cc:5697] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 reported cstate change: term changed from 3 to 4, leader changed from a97cd63ce357411d809c3f635367fa4f (127.20.40.3) to adfa72e0f05945afa5a8a00185015668 (127.20.40.1). New cstate: current_term: 4 leader_uuid: "adfa72e0f05945afa5a8a00185015668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:19.751279 21336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d572dc7700f248e2ad13917e1069fd49" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
I20260709 13:07:19.751998 21336 raft_consensus.cc:3055] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:19.752388 21336 raft_consensus.cc:740] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Running, Role: LEADER
I20260709 13:07:19.753388 21336 consensus_queue.cc:260] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:19.754920 21336 raft_consensus.cc:3060] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.761937 21336 raft_consensus.cc:2468] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 3.
I20260709 13:07:19.762626 21262 leader_election.cc:290] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 3 election: Requested vote from peers 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:19.763758 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d572dc7700f248e2ad13917e1069fd49" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
I20260709 13:07:19.764361 21413 raft_consensus.cc:3060] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.764611 21229 leader_election.cc:304] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:19.765492 21559 raft_consensus.cc:2804] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:19.765946 21559 raft_consensus.cc:697] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 3 LEADER]: Becoming Leader. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:19.766723 21559 consensus_queue.cc:237] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:19.773945 21413 raft_consensus.cc:2468] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 3.
I20260709 13:07:19.777038 21583 raft_consensus.cc:993] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b: : Instructing follower adfa72e0f05945afa5a8a00185015668 to start an election
I20260709 13:07:19.777599 21583 raft_consensus.cc:1081] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 LEADER]: Signalling peer adfa72e0f05945afa5a8a00185015668 to start an election
I20260709 13:07:19.779829 21262 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "413c0d05b82d47c2a3d165f97a93fc3e"
dest_uuid: "adfa72e0f05945afa5a8a00185015668"
 from {username='slave'} at 127.0.0.1:52520
I20260709 13:07:19.780452 21262 raft_consensus.cc:493] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:19.780844 21262 raft_consensus.cc:3060] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.786779 21158 catalog_manager.cc:5697] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 reported cstate change: term changed from 2 to 3, leader changed from 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2) to adfa72e0f05945afa5a8a00185015668 (127.20.40.1). New cstate: current_term: 3 leader_uuid: "adfa72e0f05945afa5a8a00185015668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:19.788617 21262 raft_consensus.cc:515] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:19.794356 21572 raft_consensus.cc:993] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b: : Instructing follower adfa72e0f05945afa5a8a00185015668 to start an election
I20260709 13:07:19.794798 21572 raft_consensus.cc:1081] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 LEADER]: Signalling peer adfa72e0f05945afa5a8a00185015668 to start an election
I20260709 13:07:19.794994 21336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "413c0d05b82d47c2a3d165f97a93fc3e" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
I20260709 13:07:19.795549 21336 raft_consensus.cc:3055] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:19.795867 21336 raft_consensus.cc:740] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Running, Role: LEADER
I20260709 13:07:19.796650 21336 consensus_queue.cc:260] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:19.796654 21264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7634d671d1d47b78d4c0d77adfb1e3b"
dest_uuid: "adfa72e0f05945afa5a8a00185015668"
 from {username='slave'} at 127.0.0.1:52520
I20260709 13:07:19.797744 21336 raft_consensus.cc:3060] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.798187 21264 raft_consensus.cc:493] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:19.798635 21264 raft_consensus.cc:3060] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:19.798965 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "413c0d05b82d47c2a3d165f97a93fc3e" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
I20260709 13:07:19.799480 21413 raft_consensus.cc:3060] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:19.804646 21336 raft_consensus.cc:2468] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 3.
I20260709 13:07:19.805686 21413 raft_consensus.cc:2468] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 3.
I20260709 13:07:19.805981 21229 leader_election.cc:304] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:19.806852 21559 raft_consensus.cc:2804] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:19.807075 21262 leader_election.cc:290] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 3 election: Requested vote from peers 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:19.807302 21559 raft_consensus.cc:697] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 3 LEADER]: Becoming Leader. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:19.807161 21264 raft_consensus.cc:515] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:19.808184 21559 consensus_queue.cc:237] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:19.810489 21264 leader_election.cc:290] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 2 election: Requested vote from peers 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:19.811280 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7634d671d1d47b78d4c0d77adfb1e3b" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
I20260709 13:07:19.811908 21413 raft_consensus.cc:3060] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:19.812601 21336 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7634d671d1d47b78d4c0d77adfb1e3b" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
I20260709 13:07:19.813408 21336 raft_consensus.cc:3055] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:19.813925 21336 raft_consensus.cc:740] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Running, Role: LEADER
I20260709 13:07:19.815392 21336 consensus_queue.cc:260] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:19.817095 21336 raft_consensus.cc:3060] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:19.821271 21413 raft_consensus.cc:2468] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 2.
I20260709 13:07:19.822597 21230 leader_election.cc:304] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a97cd63ce357411d809c3f635367fa4f, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:19.823405 21559 raft_consensus.cc:2804] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:19.823390 21158 catalog_manager.cc:5697] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 reported cstate change: term changed from 2 to 3, leader changed from 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2) to adfa72e0f05945afa5a8a00185015668 (127.20.40.1). New cstate: current_term: 3 leader_uuid: "adfa72e0f05945afa5a8a00185015668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:19.824559 21336 raft_consensus.cc:2468] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 2.
I20260709 13:07:19.824378 21559 raft_consensus.cc:697] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668 [term 2 LEADER]: Becoming Leader. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:19.826946 21559 consensus_queue.cc:237] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:19.837630 21158 catalog_manager.cc:5697] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668 reported cstate change: term changed from 1 to 2, leader changed from 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2) to adfa72e0f05945afa5a8a00185015668 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "adfa72e0f05945afa5a8a00185015668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:20.178732 21413 raft_consensus.cc:1275] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 4 FOLLOWER]: Refusing update from remote peer adfa72e0f05945afa5a8a00185015668: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:20.179963 21559 consensus_queue.cc:1048] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:20.187273 21576 raft_consensus.cc:993] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f: : Instructing follower adfa72e0f05945afa5a8a00185015668 to start an election
I20260709 13:07:20.187705 21576 raft_consensus.cc:1081] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 3 LEADER]: Signalling peer adfa72e0f05945afa5a8a00185015668 to start an election
I20260709 13:07:20.189337 21264 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3641d6e17724842a599a120e0bab201"
dest_uuid: "adfa72e0f05945afa5a8a00185015668"
 from {username='slave'} at 127.0.0.1:52506
I20260709 13:07:20.190079 21264 raft_consensus.cc:493] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:20.190465 21264 raft_consensus.cc:3060] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.195474 21413 raft_consensus.cc:1275] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f [term 3 FOLLOWER]: Refusing update from remote peer adfa72e0f05945afa5a8a00185015668: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:20.196697 21593 consensus_queue.cc:1048] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:20.204613 21336 raft_consensus.cc:1275] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 4 FOLLOWER]: Refusing update from remote peer adfa72e0f05945afa5a8a00185015668: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:20.208524 21264 raft_consensus.cc:515] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:20.208946 21559 consensus_queue.cc:1048] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:20.216434 21264 leader_election.cc:290] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 4 election: Requested vote from peers 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:20.217298 21337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3641d6e17724842a599a120e0bab201" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
I20260709 13:07:20.217859 21413 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3641d6e17724842a599a120e0bab201" candidate_uuid: "adfa72e0f05945afa5a8a00185015668" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
I20260709 13:07:20.218503 21413 raft_consensus.cc:3055] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:20.218801 21413 raft_consensus.cc:740] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Running, Role: LEADER
I20260709 13:07:20.219527 21413 consensus_queue.cc:260] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:20.217931 21337 raft_consensus.cc:3060] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.220624 21413 raft_consensus.cc:3060] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:20.229753 21339 raft_consensus.cc:1275] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 3 FOLLOWER]: Refusing update from remote peer adfa72e0f05945afa5a8a00185015668: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:20.231262 21594 consensus_queue.cc:1048] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:20.234406 21337 raft_consensus.cc:2468] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 4.
I20260709 13:07:20.238965 21229 leader_election.cc:304] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, adfa72e0f05945afa5a8a00185015668; no voters: 
I20260709 13:07:20.239794 21559 raft_consensus.cc:2804] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:20.240949 21559 raft_consensus.cc:697] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 4 LEADER]: Becoming Leader. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:20.236868 21413 raft_consensus.cc:2468] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adfa72e0f05945afa5a8a00185015668 in term 4.
I20260709 13:07:20.245658 21559 consensus_queue.cc:237] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:20.263290 21158 catalog_manager.cc:5697] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 reported cstate change: term changed from 3 to 4, leader changed from a97cd63ce357411d809c3f635367fa4f (127.20.40.3) to adfa72e0f05945afa5a8a00185015668 (127.20.40.1). New cstate: current_term: 4 leader_uuid: "adfa72e0f05945afa5a8a00185015668" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:20.281028 21413 raft_consensus.cc:1275] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f [term 3 FOLLOWER]: Refusing update from remote peer adfa72e0f05945afa5a8a00185015668: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:20.282241 21559 consensus_queue.cc:1048] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:20.293170 21336 raft_consensus.cc:1275] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 3 FOLLOWER]: Refusing update from remote peer adfa72e0f05945afa5a8a00185015668: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:20.294778 21559 consensus_queue.cc:1048] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:20.323197 21339 raft_consensus.cc:1275] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Refusing update from remote peer adfa72e0f05945afa5a8a00185015668: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:20.325181 21593 consensus_queue.cc:1048] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:20.339479 21413 raft_consensus.cc:1275] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Refusing update from remote peer adfa72e0f05945afa5a8a00185015668: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:20.341027 21582 consensus_queue.cc:1048] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:20.746353 21339 raft_consensus.cc:1275] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 4 FOLLOWER]: Refusing update from remote peer adfa72e0f05945afa5a8a00185015668: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:20.748499 21559 consensus_queue.cc:1048] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:20.762635 21413 raft_consensus.cc:1275] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 4 FOLLOWER]: Refusing update from remote peer adfa72e0f05945afa5a8a00185015668: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:20.765465 21582 consensus_queue.cc:1048] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:22.716511 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:22.724606 21264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09a65548d6c8412bb3ac33940e9f1204"
dest_uuid: "adfa72e0f05945afa5a8a00185015668"
mode: GRACEFUL
new_leader_uuid: "a97cd63ce357411d809c3f635367fa4f"
 from {username='slave'} at 127.0.0.1:52526
I20260709 13:07:22.725334 21264 raft_consensus.cc:606] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Received request to transfer leadership to TS a97cd63ce357411d809c3f635367fa4f
I20260709 13:07:22.728235 21264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41e792a787dc4230b8ef02f0938c5936"
dest_uuid: "adfa72e0f05945afa5a8a00185015668"
mode: GRACEFUL
new_leader_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
 from {username='slave'} at 127.0.0.1:52526
I20260709 13:07:22.728731 21264 raft_consensus.cc:606] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 2 LEADER]: Received request to transfer leadership to TS 4535cfe88f4945b6b3dc02fc7cb3be3b
I20260709 13:07:22.731146 21264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b3641d6e17724842a599a120e0bab201"
dest_uuid: "adfa72e0f05945afa5a8a00185015668"
mode: GRACEFUL
new_leader_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
 from {username='slave'} at 127.0.0.1:52526
I20260709 13:07:22.731494 21264 raft_consensus.cc:606] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 4 LEADER]: Received request to transfer leadership to TS 4535cfe88f4945b6b3dc02fc7cb3be3b
I20260709 13:07:22.733551 21264 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff0dfa40502743f1bb236356fee7ac37"
dest_uuid: "adfa72e0f05945afa5a8a00185015668"
mode: GRACEFUL
new_leader_uuid: "a97cd63ce357411d809c3f635367fa4f"
 from {username='slave'} at 127.0.0.1:52526
I20260709 13:07:22.733954 21264 raft_consensus.cc:606] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Received request to transfer leadership to TS a97cd63ce357411d809c3f635367fa4f
I20260709 13:07:22.734964 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:07:22.735477 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:22.914835 21611 raft_consensus.cc:993] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668: : Instructing follower 4535cfe88f4945b6b3dc02fc7cb3be3b to start an election
I20260709 13:07:22.915408 21612 raft_consensus.cc:1081] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 4 LEADER]: Signalling peer 4535cfe88f4945b6b3dc02fc7cb3be3b to start an election
I20260709 13:07:22.916816 21339 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b3641d6e17724842a599a120e0bab201"
dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
 from {username='slave'} at 127.0.0.1:49900
I20260709 13:07:22.917346 21339 raft_consensus.cc:493] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:22.917681 21339 raft_consensus.cc:3060] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.923556 21339 raft_consensus.cc:515] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:22.925547 21339 leader_election.cc:290] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 5 election: Requested vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:22.926474 21264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3641d6e17724842a599a120e0bab201" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "adfa72e0f05945afa5a8a00185015668"
I20260709 13:07:22.926738 21411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3641d6e17724842a599a120e0bab201" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
I20260709 13:07:22.927066 21264 raft_consensus.cc:3055] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:22.927295 21411 raft_consensus.cc:3060] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.927418 21264 raft_consensus.cc:740] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:22.928236 21264 consensus_queue.cc:260] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:22.929090 21264 raft_consensus.cc:3060] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:22.933007 21411 raft_consensus.cc:2468] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in term 5.
I20260709 13:07:22.933867 21264 raft_consensus.cc:2468] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in term 5.
I20260709 13:07:22.934307 21305 leader_election.cc:304] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, a97cd63ce357411d809c3f635367fa4f; no voters: 
I20260709 13:07:22.935124 21583 raft_consensus.cc:2804] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:22.935871 21583 raft_consensus.cc:697] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 5 LEADER]: Becoming Leader. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Running, Role: LEADER
I20260709 13:07:22.936599 21583 consensus_queue.cc:237] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:22.943691 21158 catalog_manager.cc:5697] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b reported cstate change: term changed from 4 to 5, leader changed from adfa72e0f05945afa5a8a00185015668 (127.20.40.1) to 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2). New cstate: current_term: 5 leader_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:23.021389 21611 raft_consensus.cc:993] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668: : Instructing follower a97cd63ce357411d809c3f635367fa4f to start an election
I20260709 13:07:23.021785 21611 raft_consensus.cc:1081] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Signalling peer a97cd63ce357411d809c3f635367fa4f to start an election
I20260709 13:07:23.023221 21411 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09a65548d6c8412bb3ac33940e9f1204"
dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
 from {username='slave'} at 127.0.0.1:36580
I20260709 13:07:23.023633 21411 raft_consensus.cc:493] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:23.023880 21411 raft_consensus.cc:3060] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.028486 21411 raft_consensus.cc:515] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:23.030257 21411 leader_election.cc:290] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 2 election: Requested vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949)
I20260709 13:07:23.031066 21264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a65548d6c8412bb3ac33940e9f1204" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adfa72e0f05945afa5a8a00185015668"
I20260709 13:07:23.031347 21339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09a65548d6c8412bb3ac33940e9f1204" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
I20260709 13:07:23.031656 21264 raft_consensus.cc:3055] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:23.031852 21339 raft_consensus.cc:3060] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.031978 21264 raft_consensus.cc:740] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:23.032856 21264 consensus_queue.cc:260] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:23.033996 21264 raft_consensus.cc:3060] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.038867 21339 raft_consensus.cc:2468] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97cd63ce357411d809c3f635367fa4f in term 2.
I20260709 13:07:23.040206 21264 raft_consensus.cc:2468] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97cd63ce357411d809c3f635367fa4f in term 2.
I20260709 13:07:23.040305 21378 leader_election.cc:304] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, a97cd63ce357411d809c3f635367fa4f; no voters: 
I20260709 13:07:23.041234 21556 raft_consensus.cc:2804] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:23.042373 21556 raft_consensus.cc:697] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f [term 2 LEADER]: Becoming Leader. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Running, Role: LEADER
I20260709 13:07:23.043251 21556 consensus_queue.cc:237] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:23.049816 21158 catalog_manager.cc:5697] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f reported cstate change: term changed from 1 to 2, leader changed from adfa72e0f05945afa5a8a00185015668 (127.20.40.1) to a97cd63ce357411d809c3f635367fa4f (127.20.40.3). New cstate: current_term: 2 leader_uuid: "a97cd63ce357411d809c3f635367fa4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:23.133556 21612 raft_consensus.cc:993] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668: : Instructing follower 4535cfe88f4945b6b3dc02fc7cb3be3b to start an election
I20260709 13:07:23.134023 21612 raft_consensus.cc:1081] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 2 LEADER]: Signalling peer 4535cfe88f4945b6b3dc02fc7cb3be3b to start an election
I20260709 13:07:23.135562 21339 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41e792a787dc4230b8ef02f0938c5936"
dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
 from {username='slave'} at 127.0.0.1:49900
I20260709 13:07:23.136113 21339 raft_consensus.cc:493] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:23.136488 21339 raft_consensus.cc:3060] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.141150 21339 raft_consensus.cc:515] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:23.142688 21339 leader_election.cc:290] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 3 election: Requested vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), a97cd63ce357411d809c3f635367fa4f (127.20.40.3:43535)
I20260709 13:07:23.143600 21264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e792a787dc4230b8ef02f0938c5936" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "adfa72e0f05945afa5a8a00185015668"
I20260709 13:07:23.143807 21411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41e792a787dc4230b8ef02f0938c5936" candidate_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
I20260709 13:07:23.144104 21264 raft_consensus.cc:3055] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:23.144373 21411 raft_consensus.cc:3060] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.144373 21264 raft_consensus.cc:740] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:23.145305 21264 consensus_queue.cc:260] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:23.146266 21264 raft_consensus.cc:3060] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:23.150527 21411 raft_consensus.cc:2468] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in term 3.
I20260709 13:07:23.151367 21264 raft_consensus.cc:2468] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4535cfe88f4945b6b3dc02fc7cb3be3b in term 3.
I20260709 13:07:23.151507 21305 leader_election.cc:304] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, a97cd63ce357411d809c3f635367fa4f; no voters: 
I20260709 13:07:23.152310 21583 raft_consensus.cc:2804] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:23.152698 21583 raft_consensus.cc:697] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 3 LEADER]: Becoming Leader. State: Replica: 4535cfe88f4945b6b3dc02fc7cb3be3b, State: Running, Role: LEADER
I20260709 13:07:23.153542 21583 consensus_queue.cc:237] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } }
I20260709 13:07:23.160254 21158 catalog_manager.cc:5697] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b reported cstate change: term changed from 2 to 3, leader changed from adfa72e0f05945afa5a8a00185015668 (127.20.40.1) to 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2). New cstate: current_term: 3 leader_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:23.278144 21611 raft_consensus.cc:993] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668: : Instructing follower a97cd63ce357411d809c3f635367fa4f to start an election
I20260709 13:07:23.278614 21612 raft_consensus.cc:1081] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Signalling peer a97cd63ce357411d809c3f635367fa4f to start an election
I20260709 13:07:23.280000 21411 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff0dfa40502743f1bb236356fee7ac37"
dest_uuid: "a97cd63ce357411d809c3f635367fa4f"
 from {username='slave'} at 127.0.0.1:36580
I20260709 13:07:23.280406 21411 raft_consensus.cc:493] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:23.280652 21411 raft_consensus.cc:3060] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.286031 21411 raft_consensus.cc:515] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } } peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } }
I20260709 13:07:23.287505 21411 leader_election.cc:290] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 2 election: Requested vote from peers adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319), 4535cfe88f4945b6b3dc02fc7cb3be3b (127.20.40.2:32949)
I20260709 13:07:23.288280 21264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0dfa40502743f1bb236356fee7ac37" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "adfa72e0f05945afa5a8a00185015668"
I20260709 13:07:23.288511 21339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff0dfa40502743f1bb236356fee7ac37" candidate_uuid: "a97cd63ce357411d809c3f635367fa4f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b"
I20260709 13:07:23.288810 21264 raft_consensus.cc:3055] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:23.288998 21339 raft_consensus.cc:3060] T ff0dfa40502743f1bb236356fee7ac37 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.289111 21264 raft_consensus.cc:740] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: adfa72e0f05945afa5a8a00185015668, State: Running, Role: LEADER
I20260709 13:07:23.289892 21264 consensus_queue.cc:260] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } } peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } }
I20260709 13:07:23.290756 21264 raft_consensus.cc:3060] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.293699 21339 raft_consensus.cc:2468] T ff0dfa40502743f1bb236356fee7ac37 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97cd63ce357411d809c3f635367fa4f in term 2.
I20260709 13:07:23.294651 21378 leader_election.cc:304] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4535cfe88f4945b6b3dc02fc7cb3be3b, a97cd63ce357411d809c3f635367fa4f; no voters: 
I20260709 13:07:23.295037 21264 raft_consensus.cc:2468] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a97cd63ce357411d809c3f635367fa4f in term 2.
I20260709 13:07:23.295395 21556 raft_consensus.cc:2804] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:23.296662 21556 raft_consensus.cc:697] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f [term 2 LEADER]: Becoming Leader. State: Replica: a97cd63ce357411d809c3f635367fa4f, State: Running, Role: LEADER
I20260709 13:07:23.297717 21556 consensus_queue.cc:237] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } } peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } }
I20260709 13:07:23.304388 21158 catalog_manager.cc:5697] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f reported cstate change: term changed from 1 to 2, leader changed from adfa72e0f05945afa5a8a00185015668 (127.20.40.1) to a97cd63ce357411d809c3f635367fa4f (127.20.40.3). New cstate: current_term: 2 leader_uuid: "a97cd63ce357411d809c3f635367fa4f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:23.450053 21339 raft_consensus.cc:1275] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Refusing update from remote peer a97cd63ce357411d809c3f635367fa4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:23.451259 21556 consensus_queue.cc:1048] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:23.464782 21264 raft_consensus.cc:1275] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Refusing update from remote peer a97cd63ce357411d809c3f635367fa4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:23.466212 21556 consensus_queue.cc:1048] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:23.477788 21411 raft_consensus.cc:1275] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 5 FOLLOWER]: Refusing update from remote peer 4535cfe88f4945b6b3dc02fc7cb3be3b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:23.481153 21583 consensus_queue.cc:1048] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:23.490396 21264 raft_consensus.cc:1275] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 5 FOLLOWER]: Refusing update from remote peer 4535cfe88f4945b6b3dc02fc7cb3be3b: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:07:23.492003 21583 consensus_queue.cc:1048] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:23.540616 21264 raft_consensus.cc:1275] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 3 FOLLOWER]: Refusing update from remote peer 4535cfe88f4945b6b3dc02fc7cb3be3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:23.542140 21583 consensus_queue.cc:1048] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "adfa72e0f05945afa5a8a00185015668" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 35319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:23.551693 21411 raft_consensus.cc:1275] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 3 FOLLOWER]: Refusing update from remote peer 4535cfe88f4945b6b3dc02fc7cb3be3b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:23.553290 21583 consensus_queue.cc:1048] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a97cd63ce357411d809c3f635367fa4f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43535 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:23.736315 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:23.742436 20640 tablet_server.cc:179] TabletServer@127.20.40.1:0 shutting down...
I20260709 13:07:23.759730 21339 raft_consensus.cc:1275] T ff0dfa40502743f1bb236356fee7ac37 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Refusing update from remote peer a97cd63ce357411d809c3f635367fa4f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:23.761166 21556 consensus_queue.cc:1048] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4535cfe88f4945b6b3dc02fc7cb3be3b" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 32949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:23.770119 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:23.771042 20640 tablet_replica.cc:333] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668: stopping tablet replica
I20260709 13:07:23.771903 20640 raft_consensus.cc:2243] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.772903 20640 raft_consensus.cc:2272] T e7634d671d1d47b78d4c0d77adfb1e3b P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:23.774770 21378 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
I20260709 13:07:23.775841 20640 tablet_replica.cc:333] T de8a5ea7063344b98f2f91c355140713 P adfa72e0f05945afa5a8a00185015668: stopping tablet replica
I20260709 13:07:23.778400 20640 raft_consensus.cc:2243] T de8a5ea7063344b98f2f91c355140713 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.779027 20640 raft_consensus.cc:2272] T de8a5ea7063344b98f2f91c355140713 P adfa72e0f05945afa5a8a00185015668 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:23.780295 21378 consensus_peers.cc:597] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f -> Peer adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319): Couldn't send request to peer adfa72e0f05945afa5a8a00185015668. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:23.781769 20640 tablet_replica.cc:333] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668: stopping tablet replica
I20260709 13:07:23.782372 20640 raft_consensus.cc:2243] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.783167 20640 raft_consensus.cc:2272] T 413c0d05b82d47c2a3d165f97a93fc3e P adfa72e0f05945afa5a8a00185015668 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.784775 20640 tablet_replica.cc:333] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668: stopping tablet replica
I20260709 13:07:23.785221 20640 raft_consensus.cc:2243] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.785619 20640 raft_consensus.cc:2272] T 41e792a787dc4230b8ef02f0938c5936 P adfa72e0f05945afa5a8a00185015668 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.787540 20640 tablet_replica.cc:333] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668: stopping tablet replica
I20260709 13:07:23.787985 20640 raft_consensus.cc:2243] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.788303 20640 raft_consensus.cc:2272] T 09a65548d6c8412bb3ac33940e9f1204 P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.790371 20640 tablet_replica.cc:333] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668: stopping tablet replica
I20260709 13:07:23.790805 20640 raft_consensus.cc:2243] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.791121 20640 raft_consensus.cc:2272] T b3641d6e17724842a599a120e0bab201 P adfa72e0f05945afa5a8a00185015668 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.792974 20640 tablet_replica.cc:333] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668: stopping tablet replica
I20260709 13:07:23.793422 20640 raft_consensus.cc:2243] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.794140 20640 raft_consensus.cc:2272] T d572dc7700f248e2ad13917e1069fd49 P adfa72e0f05945afa5a8a00185015668 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.795755 20640 tablet_replica.cc:333] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668: stopping tablet replica
I20260709 13:07:23.796162 20640 raft_consensus.cc:2243] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.796762 20640 raft_consensus.cc:2272] T 2a6069c81e9f45af883980cf178eff55 P adfa72e0f05945afa5a8a00185015668 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.798437 20640 tablet_replica.cc:333] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668: stopping tablet replica
I20260709 13:07:23.798851 20640 raft_consensus.cc:2243] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.799190 20640 raft_consensus.cc:2272] T 0e51fb5ce2404067bf74493759c5258a P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.800815 20640 tablet_replica.cc:333] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668: stopping tablet replica
I20260709 13:07:23.801187 20640 raft_consensus.cc:2243] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.801551 20640 raft_consensus.cc:2272] T ff0dfa40502743f1bb236356fee7ac37 P adfa72e0f05945afa5a8a00185015668 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.830480 20640 tablet_server.cc:196] TabletServer@127.20.40.1:0 shutdown complete.
I20260709 13:07:23.848927 20640 tablet_server.cc:179] TabletServer@127.20.40.2:0 shutting down...
W20260709 13:07:23.870525 21378 consensus_peers.cc:597] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f -> Peer adfa72e0f05945afa5a8a00185015668 (127.20.40.1:35319): Couldn't send request to peer adfa72e0f05945afa5a8a00185015668. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:35319: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:23.879220 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:23.879930 20640 tablet_replica.cc:333] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b: stopping tablet replica
I20260709 13:07:23.880683 20640 raft_consensus.cc:2243] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.881559 20640 raft_consensus.cc:2272] T b3641d6e17724842a599a120e0bab201 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.883876 20640 tablet_replica.cc:333] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b: stopping tablet replica
I20260709 13:07:23.884375 20640 raft_consensus.cc:2243] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.884728 20640 raft_consensus.cc:2272] T 09a65548d6c8412bb3ac33940e9f1204 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.886955 20640 tablet_replica.cc:333] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b: stopping tablet replica
I20260709 13:07:23.887493 20640 raft_consensus.cc:2243] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.888156 20640 raft_consensus.cc:2272] T 41e792a787dc4230b8ef02f0938c5936 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.890420 20640 tablet_replica.cc:333] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b: stopping tablet replica
I20260709 13:07:23.890928 20640 raft_consensus.cc:2243] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.891340 20640 raft_consensus.cc:2272] T d572dc7700f248e2ad13917e1069fd49 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.893116 20640 tablet_replica.cc:333] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b: stopping tablet replica
I20260709 13:07:23.893731 20640 raft_consensus.cc:2243] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:23.894548 20640 raft_consensus.cc:2272] T de8a5ea7063344b98f2f91c355140713 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.896397 20640 tablet_replica.cc:333] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b: stopping tablet replica
I20260709 13:07:23.896917 20640 raft_consensus.cc:2243] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.897362 20640 raft_consensus.cc:2272] T 413c0d05b82d47c2a3d165f97a93fc3e P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.899179 20640 tablet_replica.cc:333] T ff0dfa40502743f1bb236356fee7ac37 P 4535cfe88f4945b6b3dc02fc7cb3be3b: stopping tablet replica
I20260709 13:07:23.899699 20640 raft_consensus.cc:2243] T ff0dfa40502743f1bb236356fee7ac37 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.900141 20640 raft_consensus.cc:2272] T ff0dfa40502743f1bb236356fee7ac37 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.902742 20640 tablet_replica.cc:333] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b: stopping tablet replica
I20260709 13:07:23.903258 20640 raft_consensus.cc:2243] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.903694 20640 raft_consensus.cc:2272] T 0e51fb5ce2404067bf74493759c5258a P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.905557 20640 tablet_replica.cc:333] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b: stopping tablet replica
I20260709 13:07:23.906034 20640 raft_consensus.cc:2243] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.906488 20640 raft_consensus.cc:2272] T e7634d671d1d47b78d4c0d77adfb1e3b P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.908192 20640 tablet_replica.cc:333] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b: stopping tablet replica
I20260709 13:07:23.908661 20640 raft_consensus.cc:2243] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.909114 20640 raft_consensus.cc:2272] T 2a6069c81e9f45af883980cf178eff55 P 4535cfe88f4945b6b3dc02fc7cb3be3b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.946152 20640 tablet_server.cc:196] TabletServer@127.20.40.2:0 shutdown complete.
I20260709 13:07:23.965344 20640 tablet_server.cc:179] TabletServer@127.20.40.3:0 shutting down...
I20260709 13:07:23.989069 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:23.989897 20640 tablet_replica.cc:333] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f: stopping tablet replica
I20260709 13:07:23.990514 20640 raft_consensus.cc:2243] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.991026 20640 raft_consensus.cc:2272] T d572dc7700f248e2ad13917e1069fd49 P a97cd63ce357411d809c3f635367fa4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.992861 20640 tablet_replica.cc:333] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f: stopping tablet replica
I20260709 13:07:23.993404 20640 raft_consensus.cc:2243] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.993907 20640 raft_consensus.cc:2272] T 413c0d05b82d47c2a3d165f97a93fc3e P a97cd63ce357411d809c3f635367fa4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.995488 20640 tablet_replica.cc:333] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f: stopping tablet replica
I20260709 13:07:23.995995 20640 raft_consensus.cc:2243] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.996380 20640 raft_consensus.cc:2272] T de8a5ea7063344b98f2f91c355140713 P a97cd63ce357411d809c3f635367fa4f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:23.997992 20640 tablet_replica.cc:333] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f: stopping tablet replica
I20260709 13:07:23.998486 20640 raft_consensus.cc:2243] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:23.998958 20640 raft_consensus.cc:2272] T b3641d6e17724842a599a120e0bab201 P a97cd63ce357411d809c3f635367fa4f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:24.000888 20640 tablet_replica.cc:333] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f: stopping tablet replica
I20260709 13:07:24.001531 20640 raft_consensus.cc:2243] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:24.002240 20640 raft_consensus.cc:2272] T 09a65548d6c8412bb3ac33940e9f1204 P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:24.004293 20640 tablet_replica.cc:333] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f: stopping tablet replica
I20260709 13:07:24.004799 20640 raft_consensus.cc:2243] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:24.005223 20640 raft_consensus.cc:2272] T 2a6069c81e9f45af883980cf178eff55 P a97cd63ce357411d809c3f635367fa4f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:24.006858 20640 tablet_replica.cc:333] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f: stopping tablet replica
I20260709 13:07:24.007337 20640 raft_consensus.cc:2243] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:24.007730 20640 raft_consensus.cc:2272] T e7634d671d1d47b78d4c0d77adfb1e3b P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:24.009261 20640 tablet_replica.cc:333] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f: stopping tablet replica
I20260709 13:07:24.009747 20640 raft_consensus.cc:2243] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:24.010475 20640 raft_consensus.cc:2272] T 0e51fb5ce2404067bf74493759c5258a P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:24.012022 20640 tablet_replica.cc:333] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f: stopping tablet replica
I20260709 13:07:24.012475 20640 raft_consensus.cc:2243] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:24.013157 20640 raft_consensus.cc:2272] T ff0dfa40502743f1bb236356fee7ac37 P a97cd63ce357411d809c3f635367fa4f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:24.015187 20640 tablet_replica.cc:333] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f: stopping tablet replica
I20260709 13:07:24.015689 20640 raft_consensus.cc:2243] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:24.016098 20640 raft_consensus.cc:2272] T 41e792a787dc4230b8ef02f0938c5936 P a97cd63ce357411d809c3f635367fa4f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:24.044656 20640 tablet_server.cc:196] TabletServer@127.20.40.3:0 shutdown complete.
I20260709 13:07:24.062258 20640 master.cc:562] Master@127.20.40.62:38159 shutting down...
I20260709 13:07:24.084177 20640 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:24.084748 20640 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:24.085103 20640 tablet_replica.cc:333] T 00000000000000000000000000000000 P 042c2530076948208c42b86b9c9b4265: stopping tablet replica
I20260709 13:07:24.105741 20640 master.cc:584] Master@127.20.40.62:38159 shutdown complete.
4535cfe88f4945b6b3dc02fc7cb3be3b  4
a97cd63ce357411d809c3f635367fa4f  1
adfa72e0f05945afa5a8a00185015668  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (11167 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:07:24.149540 20640 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.40.62:38057
I20260709 13:07:24.150635 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:24.156090 21638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:24.157519 21639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:24.157655 21641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:24.158447 20640 server_base.cc:1061] running on GCE node
I20260709 13:07:24.159804 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:24.159986 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:24.160099 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602444160088 us; error 0 us; skew 500 ppm
I20260709 13:07:24.160535 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:24.162900 20640 webserver.cc:533] Webserver started at http://127.20.40.62:34037/ using document root <none> and password file <none>
I20260709 13:07:24.163396 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:24.163547 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:24.163753 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:24.164785 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/master-0-root/instance:
uuid: "ff36b0eb624c458eb7f542eb2e635aa2"
format_stamp: "Formatted at 2026-07-09 13:07:24 on dist-test-slave-rnv4"
I20260709 13:07:24.169198 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:07:24.172314 21646 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:24.173079 20640 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:07:24.173357 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/master-0-root
uuid: "ff36b0eb624c458eb7f542eb2e635aa2"
format_stamp: "Formatted at 2026-07-09 13:07:24 on dist-test-slave-rnv4"
I20260709 13:07:24.173700 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:24.188789 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:24.190071 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:24.229705 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.62:38057
I20260709 13:07:24.229830 21697 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.62:38057 every 8 connection(s)
I20260709 13:07:24.233768 21698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.244506 21698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: Bootstrap starting.
I20260709 13:07:24.249848 21698 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:24.254328 21698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: No bootstrap required, opened a new log
I20260709 13:07:24.256491 21698 raft_consensus.cc:359] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff36b0eb624c458eb7f542eb2e635aa2" member_type: VOTER }
I20260709 13:07:24.256892 21698 raft_consensus.cc:385] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:24.257174 21698 raft_consensus.cc:740] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff36b0eb624c458eb7f542eb2e635aa2, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.257824 21698 consensus_queue.cc:260] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff36b0eb624c458eb7f542eb2e635aa2" member_type: VOTER }
I20260709 13:07:24.258272 21698 raft_consensus.cc:399] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:24.258496 21698 raft_consensus.cc:493] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:24.258760 21698 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:24.262920 21698 raft_consensus.cc:515] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff36b0eb624c458eb7f542eb2e635aa2" member_type: VOTER }
I20260709 13:07:24.263437 21698 leader_election.cc:304] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ff36b0eb624c458eb7f542eb2e635aa2; no voters: 
I20260709 13:07:24.264637 21698 leader_election.cc:290] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:24.265156 21701 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:24.266646 21701 raft_consensus.cc:697] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2 [term 1 LEADER]: Becoming Leader. State: Replica: ff36b0eb624c458eb7f542eb2e635aa2, State: Running, Role: LEADER
I20260709 13:07:24.267274 21701 consensus_queue.cc:237] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff36b0eb624c458eb7f542eb2e635aa2" member_type: VOTER }
I20260709 13:07:24.267557 21698 sys_catalog.cc:565] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:24.272379 21703 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ff36b0eb624c458eb7f542eb2e635aa2. Latest consensus state: current_term: 1 leader_uuid: "ff36b0eb624c458eb7f542eb2e635aa2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff36b0eb624c458eb7f542eb2e635aa2" member_type: VOTER } }
I20260709 13:07:24.272537 21702 sys_catalog.cc:455] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ff36b0eb624c458eb7f542eb2e635aa2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ff36b0eb624c458eb7f542eb2e635aa2" member_type: VOTER } }
I20260709 13:07:24.273043 21703 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:24.273115 21702 sys_catalog.cc:458] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:24.276762 21708 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:24.284667 21708 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:24.285694 20640 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:24.293166 21708 catalog_manager.cc:1383] Generated new cluster ID: fd597bc3acf64199abfc83b8d91ae5f8
I20260709 13:07:24.293494 21708 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:24.310690 21708 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:24.311909 21708 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:24.329471 21708 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: Generated new TSK 0
I20260709 13:07:24.330086 21708 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:24.352373 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:24.358628 21719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:24.359535 21720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:24.361371 21722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:24.361507 20640 server_base.cc:1061] running on GCE node
I20260709 13:07:24.362525 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:24.362728 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:24.362910 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602444362891 us; error 0 us; skew 500 ppm
I20260709 13:07:24.363508 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:24.365723 20640 webserver.cc:533] Webserver started at http://127.20.40.1:37573/ using document root <none> and password file <none>
I20260709 13:07:24.366196 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:24.366381 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:24.366667 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:24.367744 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-0-root/instance:
uuid: "3843e9b794a245dd8608e04ec7915239"
format_stamp: "Formatted at 2026-07-09 13:07:24 on dist-test-slave-rnv4"
I20260709 13:07:24.372413 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:07:24.375857 21727 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:24.376775 20640 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:07:24.377202 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-0-root
uuid: "3843e9b794a245dd8608e04ec7915239"
format_stamp: "Formatted at 2026-07-09 13:07:24 on dist-test-slave-rnv4"
I20260709 13:07:24.377640 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:24.401567 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:24.402923 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:24.404388 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:24.406576 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:24.406791 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:24.407068 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:24.407258 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:24.448108 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.1:46645
I20260709 13:07:24.448195 21789 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.1:46645 every 8 connection(s)
I20260709 13:07:24.452903 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:24.459784 21794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:24.460059 21795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:24.463896 20640 server_base.cc:1061] running on GCE node
W20260709 13:07:24.464321 21797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:24.465387 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:24.465660 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:24.465788 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602444465777 us; error 0 us; skew 500 ppm
I20260709 13:07:24.466220 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:24.469159 20640 webserver.cc:533] Webserver started at http://127.20.40.2:36899/ using document root <none> and password file <none>
I20260709 13:07:24.469918 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:24.470181 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:24.470520 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:24.472204 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-1-root/instance:
uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
format_stamp: "Formatted at 2026-07-09 13:07:24 on dist-test-slave-rnv4"
I20260709 13:07:24.476606 21790 heartbeater.cc:344] Connected to a master server at 127.20.40.62:38057
I20260709 13:07:24.477007 21790 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:24.478056 21790 heartbeater.cc:507] Master 127.20.40.62:38057 requested a full tablet report, sending...
I20260709 13:07:24.478206 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:07:24.480355 21663 ts_manager.cc:194] Registered new tserver with Master: 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645)
I20260709 13:07:24.482820 21663 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45746
I20260709 13:07:24.482846 21802 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:24.483929 20640 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:07:24.484267 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-1-root
uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
format_stamp: "Formatted at 2026-07-09 13:07:24 on dist-test-slave-rnv4"
I20260709 13:07:24.484604 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:24.509912 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:24.511134 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:24.512699 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:24.514981 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:24.515200 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:24.515452 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:24.515625 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:24.556273 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.2:34765
I20260709 13:07:24.556380 21864 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.2:34765 every 8 connection(s)
I20260709 13:07:24.561215 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:24.568051 21868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:24.568859 21869 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:24.573051 21871 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:24.573132 20640 server_base.cc:1061] running on GCE node
I20260709 13:07:24.573163 21865 heartbeater.cc:344] Connected to a master server at 127.20.40.62:38057
I20260709 13:07:24.573866 21865 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:24.574241 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:24.574463 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:24.574652 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602444574617 us; error 0 us; skew 500 ppm
I20260709 13:07:24.574647 21865 heartbeater.cc:507] Master 127.20.40.62:38057 requested a full tablet report, sending...
I20260709 13:07:24.575505 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:24.577023 21663 ts_manager.cc:194] Registered new tserver with Master: 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:24.578416 21663 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45762
I20260709 13:07:24.580972 20640 webserver.cc:533] Webserver started at http://127.20.40.3:45321/ using document root <none> and password file <none>
I20260709 13:07:24.581523 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:24.581733 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:24.582003 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:24.583278 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-2-root/instance:
uuid: "6d698a5544b946939790e7a3972db9fb"
format_stamp: "Formatted at 2026-07-09 13:07:24 on dist-test-slave-rnv4"
I20260709 13:07:24.587993 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:07:24.591588 21876 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:24.592636 20640 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:07:24.592901 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-2-root
uuid: "6d698a5544b946939790e7a3972db9fb"
format_stamp: "Formatted at 2026-07-09 13:07:24 on dist-test-slave-rnv4"
I20260709 13:07:24.593168 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:24.623430 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:24.624598 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:24.626083 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:24.628396 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:24.628587 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:24.628875 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:24.629026 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:24.668243 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.3:43881
I20260709 13:07:24.668346 21938 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.3:43881 every 8 connection(s)
I20260709 13:07:24.682503 21939 heartbeater.cc:344] Connected to a master server at 127.20.40.62:38057
I20260709 13:07:24.682891 21939 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:24.683670 21939 heartbeater.cc:507] Master 127.20.40.62:38057 requested a full tablet report, sending...
I20260709 13:07:24.685672 21663 ts_manager.cc:194] Registered new tserver with Master: 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:24.685966 20640 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014475978s
I20260709 13:07:24.687130 21663 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45778
I20260709 13:07:24.713129 21663 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45794:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:24.721702 21663 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:24.961772 21830 tablet_service.cc:1511] Processing CreateTablet for tablet 2141d5426fcc4d348541c5ff6e33b6e1 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:24.964581 21755 tablet_service.cc:1511] Processing CreateTablet for tablet 2141d5426fcc4d348541c5ff6e33b6e1 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:24.965451 21828 tablet_service.cc:1511] Processing CreateTablet for tablet 2da934436fc940e6abc7519a767e11a7 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:24.966028 21755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2141d5426fcc4d348541c5ff6e33b6e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.967155 21821 tablet_service.cc:1511] Processing CreateTablet for tablet a860581d33304a09b6bd77ea24698076 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:24.967773 21748 tablet_service.cc:1511] Processing CreateTablet for tablet 4e45c5ba8a1f4b0c958677540c41b258 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:24.969079 21748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e45c5ba8a1f4b0c958677540c41b258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.969564 21822 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6d123916f54285a4a4b037399f46ec (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:24.970593 21749 tablet_service.cc:1511] Processing CreateTablet for tablet 701ea15eb74f4429a9b47522314b79a7 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:24.971882 21749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 701ea15eb74f4429a9b47522314b79a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.971946 21823 tablet_service.cc:1511] Processing CreateTablet for tablet 4e45c5ba8a1f4b0c958677540c41b258 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:24.974393 21824 tablet_service.cc:1511] Processing CreateTablet for tablet 701ea15eb74f4429a9b47522314b79a7 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:24.974598 21750 tablet_service.cc:1511] Processing CreateTablet for tablet 0ec128cbd4ca4f3daa63f2db9749837f (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:24.975939 21750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ec128cbd4ca4f3daa63f2db9749837f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.976836 21825 tablet_service.cc:1511] Processing CreateTablet for tablet 0ec128cbd4ca4f3daa63f2db9749837f (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:24.978848 21751 tablet_service.cc:1511] Processing CreateTablet for tablet a0a14b69a1b542de81c41c50c191d109 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:24.979326 21826 tablet_service.cc:1511] Processing CreateTablet for tablet a0a14b69a1b542de81c41c50c191d109 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:24.980185 21751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a14b69a1b542de81c41c50c191d109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.981758 21827 tablet_service.cc:1511] Processing CreateTablet for tablet d90ebc4155df4717946aa00672ba6697 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:24.982532 21752 tablet_service.cc:1511] Processing CreateTablet for tablet d90ebc4155df4717946aa00672ba6697 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:24.984295 21752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90ebc4155df4717946aa00672ba6697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.985368 21829 tablet_service.cc:1511] Processing CreateTablet for tablet 7e7bb11958aa45b0a1f77b20c2e9a6e5 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:24.988597 21754 tablet_service.cc:1511] Processing CreateTablet for tablet 7e7bb11958aa45b0a1f77b20c2e9a6e5 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:24.989193 21830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2141d5426fcc4d348541c5ff6e33b6e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.989949 21822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6d123916f54285a4a4b037399f46ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.990988 21754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e7bb11958aa45b0a1f77b20c2e9a6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.993762 21828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da934436fc940e6abc7519a767e11a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.994421 21825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ec128cbd4ca4f3daa63f2db9749837f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.997759 21823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e45c5ba8a1f4b0c958677540c41b258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:24.998879 21821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a860581d33304a09b6bd77ea24698076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.001734 21829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e7bb11958aa45b0a1f77b20c2e9a6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.003284 21827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90ebc4155df4717946aa00672ba6697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.002875 21747 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6d123916f54285a4a4b037399f46ec (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:25.004271 21824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 701ea15eb74f4429a9b47522314b79a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.004361 21747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6d123916f54285a4a4b037399f46ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.006224 21746 tablet_service.cc:1511] Processing CreateTablet for tablet a860581d33304a09b6bd77ea24698076 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:25.007671 21746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a860581d33304a09b6bd77ea24698076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.009781 21826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a14b69a1b542de81c41c50c191d109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.028277 21746 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcda663ffc2447db5619b817e1c5078 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:24.986967 21753 tablet_service.cc:1511] Processing CreateTablet for tablet 2da934436fc940e6abc7519a767e11a7 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:25.030892 21753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da934436fc940e6abc7519a767e11a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.043612 21746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcda663ffc2447db5619b817e1c5078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.066598 21902 tablet_service.cc:1511] Processing CreateTablet for tablet 2da934436fc940e6abc7519a767e11a7 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:25.068005 21902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da934436fc940e6abc7519a767e11a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.070577 21900 tablet_service.cc:1511] Processing CreateTablet for tablet a0a14b69a1b542de81c41c50c191d109 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:25.071961 21900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0a14b69a1b542de81c41c50c191d109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.073118 21751 tablet_service.cc:1511] Processing CreateTablet for tablet 6c77d056b72142dbaf44be22749d2024 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:25.074507 21899 tablet_service.cc:1511] Processing CreateTablet for tablet 0ec128cbd4ca4f3daa63f2db9749837f (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:25.075744 21899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ec128cbd4ca4f3daa63f2db9749837f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.077626 21747 tablet_service.cc:1511] Processing CreateTablet for tablet b9d0d92d0fde44e8b0697570a1c2024e (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:25.078626 21898 tablet_service.cc:1511] Processing CreateTablet for tablet 701ea15eb74f4429a9b47522314b79a7 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:25.079993 21898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 701ea15eb74f4429a9b47522314b79a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.082841 21904 tablet_service.cc:1511] Processing CreateTablet for tablet 2141d5426fcc4d348541c5ff6e33b6e1 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:25.084173 21904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2141d5426fcc4d348541c5ff6e33b6e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.089802 21901 tablet_service.cc:1511] Processing CreateTablet for tablet d90ebc4155df4717946aa00672ba6697 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:25.091256 21901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d90ebc4155df4717946aa00672ba6697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.079007 21747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d0d92d0fde44e8b0697570a1c2024e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.095388 21903 tablet_service.cc:1511] Processing CreateTablet for tablet 7e7bb11958aa45b0a1f77b20c2e9a6e5 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:25.096720 21903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e7bb11958aa45b0a1f77b20c2e9a6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.101218 21897 tablet_service.cc:1511] Processing CreateTablet for tablet 4e45c5ba8a1f4b0c958677540c41b258 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:25.102916 21897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e45c5ba8a1f4b0c958677540c41b258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.102584 21755 tablet_service.cc:1511] Processing CreateTablet for tablet 6dd623bab71d4824b1463c6a5d774292 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:25.104799 21895 tablet_service.cc:1511] Processing CreateTablet for tablet a860581d33304a09b6bd77ea24698076 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:25.106200 21895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a860581d33304a09b6bd77ea24698076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.092870 21753 tablet_service.cc:1511] Processing CreateTablet for tablet 8f23d2bb6e7e4e44b828b7f7ede73841 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:25.110774 21896 tablet_service.cc:1511] Processing CreateTablet for tablet 9d6d123916f54285a4a4b037399f46ec (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:25.122000 21896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d6d123916f54285a4a4b037399f46ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.129017 21748 tablet_service.cc:1511] Processing CreateTablet for tablet ee8c1089f60b4e52ae7e434904d4d178 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:25.134189 21752 tablet_service.cc:1511] Processing CreateTablet for tablet 7b32fdbf1d5847cb8bb918426813576d (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:25.141652 21751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c77d056b72142dbaf44be22749d2024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.142493 21755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd623bab71d4824b1463c6a5d774292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.146638 21821 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcda663ffc2447db5619b817e1c5078 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:25.147923 21821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcda663ffc2447db5619b817e1c5078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.147969 21746 tablet_service.cc:1511] Processing CreateTablet for tablet b0e72cc3f09a4d549ebd824be85955a3 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:25.153776 21753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f23d2bb6e7e4e44b828b7f7ede73841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.157763 21748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee8c1089f60b4e52ae7e434904d4d178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.157717 21827 tablet_service.cc:1511] Processing CreateTablet for tablet 6c77d056b72142dbaf44be22749d2024 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:25.159171 21827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c77d056b72142dbaf44be22749d2024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.164340 21754 tablet_service.cc:1511] Processing CreateTablet for tablet a218be1e72294b138c21b46dfa317d11 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:25.121253 21750 tablet_service.cc:1511] Processing CreateTablet for tablet 26b137560d844f9bb07a8939c623b0f5 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:25.165841 21754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a218be1e72294b138c21b46dfa317d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.175879 21749 tablet_service.cc:1511] Processing CreateTablet for tablet 3b27c43ce1954bb1ad1f8a4e30f76005 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:25.177219 21749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b27c43ce1954bb1ad1f8a4e30f76005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.177809 21750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b137560d844f9bb07a8939c623b0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.170323 21954 tablet_bootstrap.cc:492] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:25.174055 21826 tablet_service.cc:1511] Processing CreateTablet for tablet 6dd623bab71d4824b1463c6a5d774292 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:25.186998 21823 tablet_service.cc:1511] Processing CreateTablet for tablet b9d0d92d0fde44e8b0697570a1c2024e (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:25.193934 21826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd623bab71d4824b1463c6a5d774292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.201107 21755 tablet_service.cc:1511] Processing CreateTablet for tablet 7f2b8ba156604362aecf8501bef61de4 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:07:25.201968 21752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b32fdbf1d5847cb8bb918426813576d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.212971 21825 tablet_service.cc:1511] Processing CreateTablet for tablet 26b137560d844f9bb07a8939c623b0f5 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:25.215010 21825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b137560d844f9bb07a8939c623b0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.216296 21823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d0d92d0fde44e8b0697570a1c2024e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.220058 21824 tablet_service.cc:1511] Processing CreateTablet for tablet 7b32fdbf1d5847cb8bb918426813576d (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:25.210374 21828 tablet_service.cc:1511] Processing CreateTablet for tablet ee8c1089f60b4e52ae7e434904d4d178 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:25.226583 21824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b32fdbf1d5847cb8bb918426813576d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.229923 21829 tablet_service.cc:1511] Processing CreateTablet for tablet 8f23d2bb6e7e4e44b828b7f7ede73841 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:25.230603 21828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee8c1089f60b4e52ae7e434904d4d178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.233402 21955 tablet_bootstrap.cc:492] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:25.234268 21900 tablet_service.cc:1511] Processing CreateTablet for tablet 6c77d056b72142dbaf44be22749d2024 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:25.232448 21830 tablet_service.cc:1511] Processing CreateTablet for tablet b0e72cc3f09a4d549ebd824be85955a3 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:25.235494 21900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c77d056b72142dbaf44be22749d2024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.237591 21746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e72cc3f09a4d549ebd824be85955a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.241308 21827 tablet_service.cc:1511] Processing CreateTablet for tablet 3b27c43ce1954bb1ad1f8a4e30f76005 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:25.242574 21827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b27c43ce1954bb1ad1f8a4e30f76005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.244254 21901 tablet_service.cc:1511] Processing CreateTablet for tablet b9d0d92d0fde44e8b0697570a1c2024e (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:25.250211 21899 tablet_service.cc:1511] Processing CreateTablet for tablet 8f23d2bb6e7e4e44b828b7f7ede73841 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:25.254079 21830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e72cc3f09a4d549ebd824be85955a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.256076 21902 tablet_service.cc:1511] Processing CreateTablet for tablet 6dd623bab71d4824b1463c6a5d774292 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:25.258884 21904 tablet_service.cc:1511] Processing CreateTablet for tablet ee8c1089f60b4e52ae7e434904d4d178 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:25.259732 21954 tablet_bootstrap.cc:654] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.262275 21829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f23d2bb6e7e4e44b828b7f7ede73841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.264605 21755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f2b8ba156604362aecf8501bef61de4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.271023 21903 tablet_service.cc:1511] Processing CreateTablet for tablet 26b137560d844f9bb07a8939c623b0f5 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:25.274806 21901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d0d92d0fde44e8b0697570a1c2024e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:25.287154 21711 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:25.289642 21895 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcda663ffc2447db5619b817e1c5078 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:25.290624 21898 tablet_service.cc:1511] Processing CreateTablet for tablet b0e72cc3f09a4d549ebd824be85955a3 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:25.291492 21821 tablet_service.cc:1511] Processing CreateTablet for tablet ab7de8b45d37410487e1759ba66727e1 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:25.295742 21821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7de8b45d37410487e1759ba66727e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.293108 21747 tablet_service.cc:1511] Processing CreateTablet for tablet 773a4e5c42d942629a59d30efb0870f6 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:07:25.302229 21747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 773a4e5c42d942629a59d30efb0870f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.302372 21956 tablet_bootstrap.cc:492] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:25.304544 21755 tablet_service.cc:1511] Processing CreateTablet for tablet b87224fb843940c68eca74d28db8e73c (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:25.308683 21828 tablet_service.cc:1511] Processing CreateTablet for tablet a218be1e72294b138c21b46dfa317d11 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:25.310017 21828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a218be1e72294b138c21b46dfa317d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.314008 21755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b87224fb843940c68eca74d28db8e73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.328163 21822 tablet_service.cc:1511] Processing CreateTablet for tablet 773a4e5c42d942629a59d30efb0870f6 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:07:25.329247 21904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee8c1089f60b4e52ae7e434904d4d178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.331717 21955 tablet_bootstrap.cc:654] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.333998 21747 tablet_service.cc:1511] Processing CreateTablet for tablet 3cde61de02cf40daa7e584ca0a574c26 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:25.334959 21895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcda663ffc2447db5619b817e1c5078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.335289 21747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cde61de02cf40daa7e584ca0a574c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.335135 21748 tablet_service.cc:1511] Processing CreateTablet for tablet ab7de8b45d37410487e1759ba66727e1 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:25.337493 21748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7de8b45d37410487e1759ba66727e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.341741 21899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f23d2bb6e7e4e44b828b7f7ede73841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.342448 21827 tablet_service.cc:1511] Processing CreateTablet for tablet 7f2b8ba156604362aecf8501bef61de4 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:07:25.343148 21821 tablet_service.cc:1511] Processing CreateTablet for tablet b87224fb843940c68eca74d28db8e73c (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:25.343828 21827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f2b8ba156604362aecf8501bef61de4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.343932 21828 tablet_service.cc:1511] Processing CreateTablet for tablet 3cde61de02cf40daa7e584ca0a574c26 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:25.344524 21821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b87224fb843940c68eca74d28db8e73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.346203 21828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cde61de02cf40daa7e584ca0a574c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.349887 21755 tablet_service.cc:1511] Processing CreateTablet for tablet c096033d73b64750a7e09d89d0a70c7b (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:25.350790 21902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd623bab71d4824b1463c6a5d774292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.351078 21755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c096033d73b64750a7e09d89d0a70c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.357758 21903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26b137560d844f9bb07a8939c623b0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.363945 21898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e72cc3f09a4d549ebd824be85955a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.370395 21897 tablet_service.cc:1511] Processing CreateTablet for tablet 7b32fdbf1d5847cb8bb918426813576d (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:25.371803 21897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b32fdbf1d5847cb8bb918426813576d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.381224 21954 tablet_bootstrap.cc:492] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:25.381767 21954 ts_tablet_manager.cc:1403] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.212s	user 0.018s	sys 0.012s
I20260709 13:07:25.384725 21954 raft_consensus.cc:359] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:25.385469 21954 raft_consensus.cc:385] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.392761 21751 tablet_service.cc:1511] Processing CreateTablet for tablet 0564e1a5f9d940fa9d28c8d27271a4c5 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:25.387230 21896 tablet_service.cc:1511] Processing CreateTablet for tablet 3b27c43ce1954bb1ad1f8a4e30f76005 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:25.394083 21751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0564e1a5f9d940fa9d28c8d27271a4c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.393182 21955 tablet_bootstrap.cc:492] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:25.394894 21955 ts_tablet_manager.cc:1403] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.162s	user 0.002s	sys 0.011s
I20260709 13:07:25.395340 21896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b27c43ce1954bb1ad1f8a4e30f76005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.399458 21955 raft_consensus.cc:359] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:25.400202 21955 raft_consensus.cc:385] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.400493 21955 raft_consensus.cc:740] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.403530 21747 tablet_service.cc:1511] Processing CreateTablet for tablet 9911866d06f94adfb20f8f0e0890dcd9 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:25.404955 21747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9911866d06f94adfb20f8f0e0890dcd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.387574 21822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 773a4e5c42d942629a59d30efb0870f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.390282 21954 raft_consensus.cc:740] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.414214 21753 tablet_service.cc:1511] Processing CreateTablet for tablet af88ee4a85a24987b0c1513dd7ce39ed (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:25.415104 21956 tablet_bootstrap.cc:654] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.414578 21954 consensus_queue.cc:260] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:25.421733 21753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af88ee4a85a24987b0c1513dd7ce39ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.394276 21750 tablet_service.cc:1511] Processing CreateTablet for tablet 772d060b63de449b996b0ddc91936bcd (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:25.430662 21750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772d060b63de449b996b0ddc91936bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.435627 21828 tablet_service.cc:1511] Processing CreateTablet for tablet 9911866d06f94adfb20f8f0e0890dcd9 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:25.436679 21749 tablet_service.cc:1511] Processing CreateTablet for tablet 71a084e9c0014661925a846711e7a18f (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:07:25.437497 21955 consensus_queue.cc:260] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:25.444118 21790 heartbeater.cc:499] Master 127.20.40.62:38057 was elected leader, sending a full tablet report...
I20260709 13:07:25.463102 21749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71a084e9c0014661925a846711e7a18f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.462706 21828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9911866d06f94adfb20f8f0e0890dcd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.479082 21955 ts_tablet_manager.cc:1434] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.084s	user 0.015s	sys 0.017s
I20260709 13:07:25.480011 21865 heartbeater.cc:499] Master 127.20.40.62:38057 was elected leader, sending a full tablet report...
I20260709 13:07:25.484719 21755 tablet_service.cc:1511] Processing CreateTablet for tablet 1969778971854d32a111e62af7be53fd (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:25.486624 21755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1969778971854d32a111e62af7be53fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.487421 21823 tablet_service.cc:1511] Processing CreateTablet for tablet af88ee4a85a24987b0c1513dd7ce39ed (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:25.488873 21823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af88ee4a85a24987b0c1513dd7ce39ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.492494 21754 tablet_service.cc:1511] Processing CreateTablet for tablet c2c5cb2b121749798f01933921c01ed6 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:25.495668 21824 tablet_service.cc:1511] Processing CreateTablet for tablet 71a084e9c0014661925a846711e7a18f (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:07:25.497102 21824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71a084e9c0014661925a846711e7a18f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.500490 21748 tablet_service.cc:1511] Processing CreateTablet for tablet bfdda4b9a4f14b5c90c55134ebfd6303 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:07:25.502326 21954 ts_tablet_manager.cc:1434] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.120s	user 0.010s	sys 0.000s
I20260709 13:07:25.502686 21747 tablet_service.cc:1511] Processing CreateTablet for tablet c7fc47e7b4534569b3d46ad6ddc619d5 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:25.509847 21821 tablet_service.cc:1511] Processing CreateTablet for tablet c096033d73b64750a7e09d89d0a70c7b (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:25.515128 21753 tablet_service.cc:1511] Processing CreateTablet for tablet 45781e9b2110456fb03406d2393eff1d (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:07:25.554929 21827 tablet_service.cc:1511] Processing CreateTablet for tablet bfdda4b9a4f14b5c90c55134ebfd6303 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:07:25.520649 21896 tablet_service.cc:1511] Processing CreateTablet for tablet 7f2b8ba156604362aecf8501bef61de4 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:07:25.556205 21827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfdda4b9a4f14b5c90c55134ebfd6303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.556450 21896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f2b8ba156604362aecf8501bef61de4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.526053 21830 tablet_service.cc:1511] Processing CreateTablet for tablet 772d060b63de449b996b0ddc91936bcd (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:25.530440 21754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c5cb2b121749798f01933921c01ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.531091 21901 tablet_service.cc:1511] Processing CreateTablet for tablet ab7de8b45d37410487e1759ba66727e1 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:25.532064 21897 tablet_service.cc:1511] Processing CreateTablet for tablet a218be1e72294b138c21b46dfa317d11 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:25.532867 21904 tablet_service.cc:1511] Processing CreateTablet for tablet 773a4e5c42d942629a59d30efb0870f6 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:07:25.563748 21753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45781e9b2110456fb03406d2393eff1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.564019 21904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 773a4e5c42d942629a59d30efb0870f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.564700 21901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7de8b45d37410487e1759ba66727e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.573149 21747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7fc47e7b4534569b3d46ad6ddc619d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.574151 21897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a218be1e72294b138c21b46dfa317d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.573926 21903 tablet_service.cc:1511] Processing CreateTablet for tablet 9911866d06f94adfb20f8f0e0890dcd9 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:25.575460 21903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9911866d06f94adfb20f8f0e0890dcd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.578717 21821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c096033d73b64750a7e09d89d0a70c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.537320 21823 tablet_service.cc:1511] Processing CreateTablet for tablet c2c5cb2b121749798f01933921c01ed6 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:25.538097 21825 tablet_service.cc:1511] Processing CreateTablet for tablet 0564e1a5f9d940fa9d28c8d27271a4c5 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:25.541968 21746 tablet_service.cc:1511] Processing CreateTablet for tablet d76fbf464db84dbeb90facb1538a9ca1 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:25.543664 21956 tablet_bootstrap.cc:492] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:25.582170 21956 ts_tablet_manager.cc:1403] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.280s	user 0.030s	sys 0.022s
I20260709 13:07:25.585228 21956 raft_consensus.cc:359] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:25.586107 21956 raft_consensus.cc:385] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.586464 21956 raft_consensus.cc:740] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.587482 21956 consensus_queue.cc:260] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:25.550783 21954 tablet_bootstrap.cc:492] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:25.582249 21823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c5cb2b121749798f01933921c01ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.588812 21825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0564e1a5f9d940fa9d28c8d27271a4c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.543419 21829 tablet_service.cc:1511] Processing CreateTablet for tablet d76fbf464db84dbeb90facb1538a9ca1 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:25.594312 21954 tablet_bootstrap.cc:654] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.594460 21829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76fbf464db84dbeb90facb1538a9ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.595950 21830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772d060b63de449b996b0ddc91936bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.547145 21902 tablet_service.cc:1511] Processing CreateTablet for tablet b87224fb843940c68eca74d28db8e73c (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:25.596948 21902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b87224fb843940c68eca74d28db8e73c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.597945 21748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfdda4b9a4f14b5c90c55134ebfd6303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.602821 21746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76fbf464db84dbeb90facb1538a9ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.605115 21955 tablet_bootstrap.cc:492] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:25.616214 21899 tablet_service.cc:1511] Processing CreateTablet for tablet 3cde61de02cf40daa7e584ca0a574c26 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:25.556468 21895 tablet_service.cc:1511] Processing CreateTablet for tablet c096033d73b64750a7e09d89d0a70c7b (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:25.618191 21895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c096033d73b64750a7e09d89d0a70c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.621975 21899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cde61de02cf40daa7e584ca0a574c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.628886 21900 tablet_service.cc:1511] Processing CreateTablet for tablet 772d060b63de449b996b0ddc91936bcd (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:25.630352 21900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772d060b63de449b996b0ddc91936bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.633785 21955 tablet_bootstrap.cc:654] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.639936 21750 tablet_service.cc:1511] Processing CreateTablet for tablet f5bb431cadec4a5d9440b6c8743b7b47 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:07:25.641247 21750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5bb431cadec4a5d9440b6c8743b7b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.497008 21826 tablet_service.cc:1511] Processing CreateTablet for tablet 1969778971854d32a111e62af7be53fd (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:25.651489 21822 tablet_service.cc:1511] Processing CreateTablet for tablet c7fc47e7b4534569b3d46ad6ddc619d5 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:25.652799 21822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7fc47e7b4534569b3d46ad6ddc619d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.656248 21959 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.656718 21959 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:25.659281 21959 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:25.682927 21956 ts_tablet_manager.cc:1434] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.100s	user 0.014s	sys 0.010s
I20260709 13:07:25.683135 21754 tablet_service.cc:1511] Processing CreateTablet for tablet a0e492aa4394405bb48ed3b957dd8f23 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:25.683696 21939 heartbeater.cc:499] Master 127.20.40.62:38057 was elected leader, sending a full tablet report...
I20260709 13:07:25.683959 21956 tablet_bootstrap.cc:492] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:25.684419 21754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e492aa4394405bb48ed3b957dd8f23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.690084 21962 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.690531 21956 tablet_bootstrap.cc:654] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.690615 21962 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:25.713737 21828 tablet_service.cc:1511] Processing CreateTablet for tablet 31c81db970e24298b014b6d17fb12a0e (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:25.715500 21830 tablet_service.cc:1511] Processing CreateTablet for tablet 45781e9b2110456fb03406d2393eff1d (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:07:25.716722 21755 tablet_service.cc:1511] Processing CreateTablet for tablet 0b8098340ee849cfae4a080cc2544e82 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:25.718354 21755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b8098340ee849cfae4a080cc2544e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.719617 21955 tablet_bootstrap.cc:492] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:25.720088 21955 ts_tablet_manager.cc:1403] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.157s	user 0.013s	sys 0.008s
I20260709 13:07:25.722344 21962 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:25.699008 21753 tablet_service.cc:1511] Processing CreateTablet for tablet 31c81db970e24298b014b6d17fb12a0e (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:25.723491 21955 raft_consensus.cc:359] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:25.724207 21955 raft_consensus.cc:385] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.722513 21751 tablet_service.cc:1511] Processing CreateTablet for tablet a740500460ba465faaeb007be4b83108 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:25.724733 21955 raft_consensus.cc:740] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.725797 21955 consensus_queue.cc:260] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:25.703938 21826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1969778971854d32a111e62af7be53fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.729664 21830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45781e9b2110456fb03406d2393eff1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.724212 21753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31c81db970e24298b014b6d17fb12a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.728547 21752 tablet_service.cc:1511] Processing CreateTablet for tablet 667c64e212614c7ca822788e9d37fc29 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:07:25.734302 21828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31c81db970e24298b014b6d17fb12a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.763134 21901 tablet_service.cc:1511] Processing CreateTablet for tablet bfdda4b9a4f14b5c90c55134ebfd6303 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:07:25.742254 21904 tablet_service.cc:1511] Processing CreateTablet for tablet af88ee4a85a24987b0c1513dd7ce39ed (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:25.764393 21901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfdda4b9a4f14b5c90c55134ebfd6303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.764963 21904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af88ee4a85a24987b0c1513dd7ce39ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.767881 21897 tablet_service.cc:1511] Processing CreateTablet for tablet c7fc47e7b4534569b3d46ad6ddc619d5 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:25.769162 21897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7fc47e7b4534569b3d46ad6ddc619d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.751603 21954 tablet_bootstrap.cc:492] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:25.759898 21895 tablet_service.cc:1511] Processing CreateTablet for tablet d76fbf464db84dbeb90facb1538a9ca1 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:25.761917 21751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a740500460ba465faaeb007be4b83108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.744277 21902 tablet_service.cc:1511] Processing CreateTablet for tablet 1969778971854d32a111e62af7be53fd (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:25.763134 21749 tablet_service.cc:1511] Processing CreateTablet for tablet 59340daad1394837bb0d56471ed8ce5a (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:25.770959 21896 tablet_service.cc:1511] Processing CreateTablet for tablet 0564e1a5f9d940fa9d28c8d27271a4c5 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:25.774132 21954 ts_tablet_manager.cc:1403] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.224s	user 0.017s	sys 0.001s
I20260709 13:07:25.756956 21899 tablet_service.cc:1511] Processing CreateTablet for tablet c2c5cb2b121749798f01933921c01ed6 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:25.786091 21752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 667c64e212614c7ca822788e9d37fc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.786978 21954 raft_consensus.cc:359] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:25.787719 21954 raft_consensus.cc:385] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:25.788028 21954 raft_consensus.cc:740] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.788667 21821 tablet_service.cc:1511] Processing CreateTablet for tablet a0e492aa4394405bb48ed3b957dd8f23 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:25.790527 21749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59340daad1394837bb0d56471ed8ce5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.793735 21748 tablet_service.cc:1511] Processing CreateTablet for tablet 5e295b8b73874adcb77878c1ca4897ea (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:25.794248 21823 tablet_service.cc:1511] Processing CreateTablet for tablet 59340daad1394837bb0d56471ed8ce5a (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:25.763376 21829 tablet_service.cc:1511] Processing CreateTablet for tablet f5bb431cadec4a5d9440b6c8743b7b47 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:07:25.810691 21747 tablet_service.cc:1511] Processing CreateTablet for tablet dee4ace3bc71491c9c9b19b0f5a8a667 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:25.804829 21955 ts_tablet_manager.cc:1434] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.002s
I20260709 13:07:25.813091 21955 tablet_bootstrap.cc:492] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:25.813781 21903 tablet_service.cc:1511] Processing CreateTablet for tablet 45781e9b2110456fb03406d2393eff1d (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:07:25.830595 21827 tablet_service.cc:1511] Processing CreateTablet for tablet 667c64e212614c7ca822788e9d37fc29 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:07:25.839212 21748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e295b8b73874adcb77878c1ca4897ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.731546 21898 tablet_service.cc:1511] Processing CreateTablet for tablet 71a084e9c0014661925a846711e7a18f (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:07:25.842018 21747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dee4ace3bc71491c9c9b19b0f5a8a667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.793752 21954 consensus_queue.cc:260] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:25.845815 21821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e492aa4394405bb48ed3b957dd8f23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.847360 21954 ts_tablet_manager.cc:1434] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.000s
I20260709 13:07:25.848409 21954 tablet_bootstrap.cc:492] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:25.851326 21825 tablet_service.cc:1511] Processing CreateTablet for tablet 0b8098340ee849cfae4a080cc2544e82 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:25.851871 21754 tablet_service.cc:1511] Processing CreateTablet for tablet 2b5c7b1a9d544cacaea74aa99eefa301 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:07:25.854087 21895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76fbf464db84dbeb90facb1538a9ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.866876 21899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c5cb2b121749798f01933921c01ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.848481 21823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59340daad1394837bb0d56471ed8ce5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.858028 21961 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.869007 21961 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:25.874056 21902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1969778971854d32a111e62af7be53fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.878324 21825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b8098340ee849cfae4a080cc2544e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.887611 21898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71a084e9c0014661925a846711e7a18f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.893069 21829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5bb431cadec4a5d9440b6c8743b7b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.898607 21746 tablet_service.cc:1511] Processing CreateTablet for tablet 3b18a570f5764b538a612ae89ef0327c (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:25.899104 21900 tablet_service.cc:1511] Processing CreateTablet for tablet 31c81db970e24298b014b6d17fb12a0e (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:25.918147 21961 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:25.910786 21754 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b5c7b1a9d544cacaea74aa99eefa301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.901237 21822 tablet_service.cc:1511] Processing CreateTablet for tablet a740500460ba465faaeb007be4b83108 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:25.941646 21824 tablet_service.cc:1511] Processing CreateTablet for tablet 5e295b8b73874adcb77878c1ca4897ea (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:25.941679 21956 tablet_bootstrap.cc:492] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:25.946188 21956 ts_tablet_manager.cc:1403] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.262s	user 0.014s	sys 0.001s
I20260709 13:07:25.951156 21900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31c81db970e24298b014b6d17fb12a0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.948757 21954 tablet_bootstrap.cc:654] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:25.926708 21827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 667c64e212614c7ca822788e9d37fc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.959585 21822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a740500460ba465faaeb007be4b83108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.968555 21826 tablet_service.cc:1511] Processing CreateTablet for tablet dee4ace3bc71491c9c9b19b0f5a8a667 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:25.969658 21903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45781e9b2110456fb03406d2393eff1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.985949 21824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e295b8b73874adcb77878c1ca4897ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:25.988250 21956 raft_consensus.cc:359] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:25.990325 21750 tablet_service.cc:1511] Processing CreateTablet for tablet afc4a5871719461787d91a97d59582af (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:07:26.002703 21753 tablet_service.cc:1511] Processing CreateTablet for tablet c6406f8b01c041c58abe3add218f6b41 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:07:26.003947 21955 tablet_bootstrap.cc:654] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.023176 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:26.025241 21895 tablet_service.cc:1511] Processing CreateTablet for tablet a0e492aa4394405bb48ed3b957dd8f23 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:26.025986 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:26.029541 21752 tablet_service.cc:1511] Processing CreateTablet for tablet 3f7cb5d9283d4cf7969db82011d35ed9 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:26.032209 21751 tablet_service.cc:1511] Processing CreateTablet for tablet 46dafcc946c640c6a029dd71c387264e (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 13:07:26.036787 21879 leader_election.cc:343] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:26.037740 21729 leader_election.cc:343] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.013947 21956 raft_consensus.cc:385] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.049834 21826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dee4ace3bc71491c9c9b19b0f5a8a667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.051679 21896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0564e1a5f9d940fa9d28c8d27271a4c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.057817 21961 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.058444 21961 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.075683 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:26.076454 21840 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:26.079631 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:26.080974 21959 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:26.081380 21959 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.081965 21959 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:26.081748 21828 tablet_service.cc:1511] Processing CreateTablet for tablet 3b18a570f5764b538a612ae89ef0327c (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:26.082446 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:26.083207 21828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b18a570f5764b538a612ae89ef0327c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.083063 21755 tablet_service.cc:1511] Processing CreateTablet for tablet 5871b64f4d9b45f99140a286177ff44f (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:07:26.045040 21746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b18a570f5764b538a612ae89ef0327c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.074913 21901 tablet_service.cc:1511] Processing CreateTablet for tablet f5bb431cadec4a5d9440b6c8743b7b47 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:07:26.057817 21895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e492aa4394405bb48ed3b957dd8f23. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:26.086875 21877 leader_election.cc:343] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.090600 21825 tablet_service.cc:1511] Processing CreateTablet for tablet afc4a5871719461787d91a97d59582af (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:07:26.092476 21899 tablet_service.cc:1511] Processing CreateTablet for tablet 59340daad1394837bb0d56471ed8ce5a (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:26.093804 21829 tablet_service.cc:1511] Processing CreateTablet for tablet c6406f8b01c041c58abe3add218f6b41 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:07:26.097669 21877 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:26.112751 21752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f7cb5d9283d4cf7969db82011d35ed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.104656 21748 tablet_service.cc:1511] Processing CreateTablet for tablet 291227c6f9914476b4363d40f7cfebb8 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:26.113778 21962 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:26.115128 21829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6406f8b01c041c58abe3add218f6b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.086828 21830 tablet_service.cc:1511] Processing CreateTablet for tablet 2b5c7b1a9d544cacaea74aa99eefa301 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:07:26.120954 21830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b5c7b1a9d544cacaea74aa99eefa301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.134698 21829 tablet_service.cc:1511] Processing CreateTablet for tablet 5871b64f4d9b45f99140a286177ff44f (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:07:26.136227 21829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5871b64f4d9b45f99140a286177ff44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.136801 21826 tablet_service.cc:1511] Processing CreateTablet for tablet 3f7cb5d9283d4cf7969db82011d35ed9 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:26.142822 21961 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:26.144142 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:26.144193 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:26.145066 21764 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 0.
I20260709 13:07:26.071214 21956 raft_consensus.cc:740] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.105129 21959 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.144279 21750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc4a5871719461787d91a97d59582af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.148711 21747 tablet_service.cc:1511] Processing CreateTablet for tablet e76639c6d03a4a9697beddbec2ef6411 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:07:26.149887 21805 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:26.151926 21826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f7cb5d9283d4cf7969db82011d35ed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.156119 21959 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:26.156839 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:26.157955 21751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46dafcc946c640c6a029dd71c387264e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.155005 21765 raft_consensus.cc:2393] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 1: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:07:26.160815 21748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 291227c6f9914476b4363d40f7cfebb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.161607 21961 raft_consensus.cc:2804] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:26.161996 21961 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.157673 21954 tablet_bootstrap.cc:492] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:26.162886 21954 ts_tablet_manager.cc:1403] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.315s	user 0.003s	sys 0.015s
I20260709 13:07:26.162359 21961 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:26.152379 21752 tablet_service.cc:1511] Processing CreateTablet for tablet b50256b3ab294021ae20aa34053b59e1 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:26.157405 21840 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:26.165791 21825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc4a5871719461787d91a97d59582af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.166281 21954 raft_consensus.cc:359] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.167129 21954 raft_consensus.cc:385] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.167313 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:26.167548 21954 raft_consensus.cc:740] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.168773 21899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59340daad1394837bb0d56471ed8ce5a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:26.168807 21729 leader_election.cc:343] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.168560 21954 consensus_queue.cc:260] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.173887 21901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5bb431cadec4a5d9440b6c8743b7b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.175107 21900 tablet_service.cc:1511] Processing CreateTablet for tablet 667c64e212614c7ca822788e9d37fc29 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:07:26.176614 21900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 667c64e212614c7ca822788e9d37fc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.182816 21902 tablet_service.cc:1511] Processing CreateTablet for tablet 0b8098340ee849cfae4a080cc2544e82 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:26.157632 21956 consensus_queue.cc:260] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.201258 21904 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49532 (request call id 30) took 1096 ms. Trace:
I20260709 13:07:26.201866 21904 rpcz_store.cc:276] 0709 13:07:25.104694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.680309 (+575615us) service_pool.cc:224] Handling call
0709 13:07:25.764536 (+ 84227us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:25.764623 (+    87us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:25.844890 (+ 80267us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:26.159974 (+315084us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:26.201186 (+ 41212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.162247 21753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6406f8b01c041c58abe3add218f6b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.205731 21752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b50256b3ab294021ae20aa34053b59e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.209725 21755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5871b64f4d9b45f99140a286177ff44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.209870 21903 tablet_service.cc:1511] Processing CreateTablet for tablet a740500460ba465faaeb007be4b83108 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:26.199297 21954 ts_tablet_manager.cc:1434] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.004s
I20260709 13:07:26.202687 21956 ts_tablet_manager.cc:1434] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.256s	user 0.009s	sys 0.000s
I20260709 13:07:26.186318 21840 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:07:26.213567 21904 tablet_service.cc:1511] Processing CreateTablet for tablet 5e295b8b73874adcb77878c1ca4897ea (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:26.216504 21902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b8098340ee849cfae4a080cc2544e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.217084 21954 tablet_bootstrap.cc:492] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:26.223729 21956 tablet_bootstrap.cc:492] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:26.232403 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:26.233768 21903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a740500460ba465faaeb007be4b83108. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:26.234208 21804 leader_election.cc:343] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.232301 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:07:26.236285 21804 leader_election.cc:343] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.236732 21804 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:26.240613 21896 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49532 (request call id 29) took 1136 ms. Trace:
I20260709 13:07:26.241916 21897 tablet_service.cc:1511] Processing CreateTablet for tablet dee4ace3bc71491c9c9b19b0f5a8a667 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:26.242638 21823 tablet_service.cc:1511] Processing CreateTablet for tablet 46dafcc946c640c6a029dd71c387264e (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:07:26.243260 21897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dee4ace3bc71491c9c9b19b0f5a8a667. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.244202 21823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46dafcc946c640c6a029dd71c387264e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.245393 21956 tablet_bootstrap.cc:654] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.249652 21749 tablet_service.cc:1511] Processing CreateTablet for tablet d28f4c429d54450dbbeb1ac9f6b7cd55 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:26.232465 21747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e76639c6d03a4a9697beddbec2ef6411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.255505 21904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e295b8b73874adcb77878c1ca4897ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.258345 21827 tablet_service.cc:1511] Processing CreateTablet for tablet 291227c6f9914476b4363d40f7cfebb8 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:26.259994 21827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 291227c6f9914476b4363d40f7cfebb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.260017 21749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d28f4c429d54450dbbeb1ac9f6b7cd55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.266587 21751 tablet_service.cc:1511] Processing CreateTablet for tablet 915629d8ce0e4452b6308425161f143a (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:26.268651 21751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 915629d8ce0e4452b6308425161f143a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.270854 21822 tablet_service.cc:1511] Processing CreateTablet for tablet e76639c6d03a4a9697beddbec2ef6411 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:07:26.272652 21822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e76639c6d03a4a9697beddbec2ef6411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.278824 21961 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.280728 21898 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49532 (request call id 31) took 1151 ms. Trace:
I20260709 13:07:26.285533 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:26.271485 21955 tablet_bootstrap.cc:492] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:26.287946 21955 ts_tablet_manager.cc:1403] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.475s	user 0.028s	sys 0.025s
W20260709 13:07:26.289619 21711 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:26.290088 21765 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:26.291923 21961 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:26.294430 21961 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:26.292593 21821 tablet_service.cc:1511] Processing CreateTablet for tablet b50256b3ab294021ae20aa34053b59e1 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:26.297528 21821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b50256b3ab294021ae20aa34053b59e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.298309 21765 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:07:26.300390 21805 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:26.301527 21961 raft_consensus.cc:2804] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:26.302067 21961 raft_consensus.cc:697] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:07:26.306704 21961 consensus_queue.cc:237] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.295729 21955 raft_consensus.cc:359] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.311579 21955 raft_consensus.cc:385] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.311230 21903 tablet_service.cc:1511] Processing CreateTablet for tablet 2b5c7b1a9d544cacaea74aa99eefa301 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:07:26.312702 21903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b5c7b1a9d544cacaea74aa99eefa301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.321535 21955 raft_consensus.cc:740] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.322729 21955 consensus_queue.cc:260] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.298976 21954 tablet_bootstrap.cc:654] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.332530 21900 tablet_service.cc:1511] Processing CreateTablet for tablet 3b18a570f5764b538a612ae89ef0327c (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:26.241034 21896 rpcz_store.cc:276] 0709 13:07:25.104311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.678720 (+574409us) service_pool.cc:224] Handling call
0709 13:07:25.853318 (+174598us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b5800003998. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232a22 00007fc6b414bc09 00007fc6b32a5ee0 00007fc6b338b831 00007fc6b3368ac3 00007fc6b3317400 00007fc6ac79caf4 00007fc6ac79ca82 00007fc6ac79c9b1
0709 13:07:25.862353 (+  9035us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:25.862515 (+   162us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:26.092420 (+229905us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:26.240089 (+147669us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:26.240551 (+   462us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3985152}
I20260709 13:07:26.352276 21903 tablet_service.cc:1511] Processing CreateTablet for tablet c6406f8b01c041c58abe3add218f6b41 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:07:26.353941 21903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6406f8b01c041c58abe3add218f6b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.286579 21898 rpcz_store.cc:276] 0709 13:07:25.129855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.730628 (+600773us) service_pool.cc:224] Handling call
0709 13:07:25.839979 (+109351us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:25.840086 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:26.055635 (+215549us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:26.280194 (+224559us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:26.280664 (+   470us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:26.348662 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 102494us
I20260709 13:07:26.366593 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:26.367847 21959 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:26.377195 21829 tablet_service.cc:1511] Processing CreateTablet for tablet d28f4c429d54450dbbeb1ac9f6b7cd55 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:26.378486 21962 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.378948 21829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d28f4c429d54450dbbeb1ac9f6b7cd55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.378990 21962 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.381497 21962 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:26.383019 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:26.383471 21899 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49532 (request call id 41) took 1013 ms. Trace:
I20260709 13:07:26.384183 21902 tablet_service.cc:1511] Processing CreateTablet for tablet 3f7cb5d9283d4cf7969db82011d35ed9 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:26.385069 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:26.385769 21765 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:26.385933 21896 tablet_service.cc:1511] Processing CreateTablet for tablet afc4a5871719461787d91a97d59582af (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 13:07:26.387110 21877 leader_election.cc:343] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.388139 21879 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:26.393599 21962 raft_consensus.cc:2804] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:26.393953 21962 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.394265 21962 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:26.394692 21898 tablet_service.cc:1511] Processing CreateTablet for tablet 5871b64f4d9b45f99140a286177ff44f (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:07:26.383828 21899 rpcz_store.cc:276] 0709 13:07:25.370046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.091515 (+721469us) service_pool.cc:224] Handling call
0709 13:07:26.168290 (+ 76775us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:26.168398 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:26.221029 (+ 52631us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:26.383028 (+161999us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:26.383417 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.400310 21955 ts_tablet_manager.cc:1434] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.112s	user 0.006s	sys 0.015s
I20260709 13:07:26.400568 21954 tablet_bootstrap.cc:492] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:26.401180 21954 ts_tablet_manager.cc:1403] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.184s	user 0.024s	sys 0.001s
I20260709 13:07:26.401515 21955 tablet_bootstrap.cc:492] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:26.406286 21826 tablet_service.cc:1511] Processing CreateTablet for tablet 915629d8ce0e4452b6308425161f143a (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:26.407712 21826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 915629d8ce0e4452b6308425161f143a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.398084 21900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b18a570f5764b538a612ae89ef0327c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.404803 21954 raft_consensus.cc:359] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.414227 21959 raft_consensus.cc:697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:07:26.418385 21954 raft_consensus.cc:385] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.419198 21954 raft_consensus.cc:740] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.419071 21899 tablet_service.cc:1511] Processing CreateTablet for tablet 46dafcc946c640c6a029dd71c387264e (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:07:26.420751 21954 consensus_queue.cc:260] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.422509 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:26.418895 21959 consensus_queue.cc:237] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:26.424149 21804 leader_election.cc:343] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.425078 21661 catalog_manager.cc:5697] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 1 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:26.440223 21902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f7cb5d9283d4cf7969db82011d35ed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.453349 21895 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49532 (request call id 40) took 1106 ms. Trace:
I20260709 13:07:26.454164 21899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46dafcc946c640c6a029dd71c387264e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.458428 21954 ts_tablet_manager.cc:1434] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.057s	user 0.003s	sys 0.005s
I20260709 13:07:26.449013 21962 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.459556 21904 tablet_service.cc:1511] Processing CreateTablet for tablet 291227c6f9914476b4363d40f7cfebb8 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:26.453812 21895 rpcz_store.cc:276] 0709 13:07:25.347157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.024196 (+677039us) service_pool.cc:224] Handling call
0709 13:07:26.050021 (+ 25825us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:26.051376 (+  1355us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:26.285667 (+234291us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:26.388791 (+103124us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:26.453279 (+ 64488us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.464040 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:26.464164 21895 tablet_service.cc:1511] Processing CreateTablet for tablet e76639c6d03a4a9697beddbec2ef6411 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:07:26.459602 21954 tablet_bootstrap.cc:492] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:26.466934 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:26.467516 21765 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:26.469677 21962 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:07:26.470670 21877 leader_election.cc:343] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.473587 21904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 291227c6f9914476b4363d40f7cfebb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.482352 21896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afc4a5871719461787d91a97d59582af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.491173 21895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e76639c6d03a4a9697beddbec2ef6411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.496248 21897 tablet_service.cc:1511] Processing CreateTablet for tablet b50256b3ab294021ae20aa34053b59e1 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:26.498802 21955 tablet_bootstrap.cc:654] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.494167 21901 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:49532 (request call id 39) took 1208 ms. Trace:
I20260709 13:07:26.507123 21956 tablet_bootstrap.cc:492] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:26.521956 21956 ts_tablet_manager.cc:1403] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.299s	user 0.031s	sys 0.004s
I20260709 13:07:26.522101 21899 tablet_service.cc:1511] Processing CreateTablet for tablet d28f4c429d54450dbbeb1ac9f6b7cd55 (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:26.525506 21956 raft_consensus.cc:359] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.525300 21662 catalog_manager.cc:5697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:26.526541 21956 raft_consensus.cc:385] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.526939 21956 raft_consensus.cc:740] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.517803 21901 rpcz_store.cc:276] 0709 13:07:25.285536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.015661 (+730125us) service_pool.cc:224] Handling call
0709 13:07:26.146846 (+131185us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:26.173492 (+ 26646us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:26.362367 (+188875us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:26.493525 (+131158us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:26.494099 (+   574us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:26.531394 21954 tablet_bootstrap.cc:654] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.532526 21901 tablet_service.cc:1511] Processing CreateTablet for tablet 915629d8ce0e4452b6308425161f143a (DEFAULT_TABLE table=test-workload [id=aaafd53c3f48453ab36385f5b86f077f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:26.528468 21897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b50256b3ab294021ae20aa34053b59e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.535159 21899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d28f4c429d54450dbbeb1ac9f6b7cd55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.537568 21898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5871b64f4d9b45f99140a286177ff44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.521245 21765 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:26.542652 21879 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:26.543884 21962 raft_consensus.cc:2804] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:26.527896 21956 consensus_queue.cc:260] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.557183 21901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 915629d8ce0e4452b6308425161f143a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:26.558560 21962 raft_consensus.cc:697] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:26.563426 21962 consensus_queue.cc:237] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.578199 21954 tablet_bootstrap.cc:492] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:26.578742 21954 ts_tablet_manager.cc:1403] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.119s	user 0.021s	sys 0.000s
I20260709 13:07:26.588688 21955 tablet_bootstrap.cc:492] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:26.589730 21955 ts_tablet_manager.cc:1403] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.188s	user 0.012s	sys 0.011s
I20260709 13:07:26.587231 21954 raft_consensus.cc:359] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.600320 21954 raft_consensus.cc:385] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.600734 21954 raft_consensus.cc:740] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.597633 21955 raft_consensus.cc:359] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.601977 21955 raft_consensus.cc:385] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.601646 21954 consensus_queue.cc:260] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.602329 21955 raft_consensus.cc:740] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.603298 21955 consensus_queue.cc:260] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.606355 21956 ts_tablet_manager.cc:1434] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.009s
I20260709 13:07:26.607081 21954 ts_tablet_manager.cc:1434] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:07:26.612463 21956 tablet_bootstrap.cc:492] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:26.612263 21663 catalog_manager.cc:5697] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:26.608793 21955 ts_tablet_manager.cc:1434] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:07:26.614809 21954 tablet_bootstrap.cc:492] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:26.622539 21954 tablet_bootstrap.cc:654] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.626474 21956 tablet_bootstrap.cc:654] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.627451 21955 tablet_bootstrap.cc:492] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:26.633152 21954 tablet_bootstrap.cc:492] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:26.635982 21954 ts_tablet_manager.cc:1403] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.000s
I20260709 13:07:26.636587 21956 tablet_bootstrap.cc:492] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:26.637125 21956 ts_tablet_manager.cc:1403] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.004s
I20260709 13:07:26.639423 21954 raft_consensus.cc:359] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.640162 21954 raft_consensus.cc:385] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.639925 21956 raft_consensus.cc:359] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.640496 21954 raft_consensus.cc:740] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.640681 21956 raft_consensus.cc:385] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.641031 21956 raft_consensus.cc:740] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.641507 21954 consensus_queue.cc:260] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.641801 21956 consensus_queue.cc:260] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.643592 21954 ts_tablet_manager.cc:1434] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:26.644944 21954 tablet_bootstrap.cc:492] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:26.647244 21955 tablet_bootstrap.cc:654] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.653059 21956 ts_tablet_manager.cc:1434] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:07:26.653983 21954 tablet_bootstrap.cc:654] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.654145 21956 tablet_bootstrap.cc:492] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:26.664144 21956 tablet_bootstrap.cc:654] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.664901 21954 tablet_bootstrap.cc:492] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:26.665372 21954 ts_tablet_manager.cc:1403] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.009s
I20260709 13:07:26.667564 21955 tablet_bootstrap.cc:492] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:26.668021 21955 ts_tablet_manager.cc:1403] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.004s
I20260709 13:07:26.668277 21954 raft_consensus.cc:359] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.668967 21954 raft_consensus.cc:385] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.669261 21954 raft_consensus.cc:740] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.669471 21956 tablet_bootstrap.cc:492] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:26.670006 21956 ts_tablet_manager.cc:1403] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:07:26.670104 21954 consensus_queue.cc:260] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.670991 21955 raft_consensus.cc:359] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.671706 21955 raft_consensus.cc:385] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.671989 21955 raft_consensus.cc:740] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.672497 21954 ts_tablet_manager.cc:1434] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:07:26.672814 21955 consensus_queue.cc:260] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.672976 21956 raft_consensus.cc:359] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.673659 21954 tablet_bootstrap.cc:492] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:26.673738 21956 raft_consensus.cc:385] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.674136 21956 raft_consensus.cc:740] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.674883 21956 consensus_queue.cc:260] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.675493 21959 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.676003 21959 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.677523 21956 ts_tablet_manager.cc:1434] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:26.678368 21959 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:26.678555 21956 tablet_bootstrap.cc:492] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:26.680784 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:26.681656 21954 tablet_bootstrap.cc:654] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:26.682554 21729 leader_election.cc:343] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.682768 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:07:26.684229 21728 leader_election.cc:343] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:26.684873 21728 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:26.685400 21956 tablet_bootstrap.cc:654] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.693478 21955 ts_tablet_manager.cc:1434] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:07:26.696641 21959 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:26.697064 21956 tablet_bootstrap.cc:492] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:26.697690 21956 ts_tablet_manager.cc:1403] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.012s
I20260709 13:07:26.700219 21954 tablet_bootstrap.cc:492] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:26.700664 21954 ts_tablet_manager.cc:1403] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.007s
I20260709 13:07:26.700630 21956 raft_consensus.cc:359] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.701555 21956 raft_consensus.cc:385] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.701874 21956 raft_consensus.cc:740] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.702572 21956 consensus_queue.cc:260] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.703310 21954 raft_consensus.cc:359] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.704036 21954 raft_consensus.cc:385] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.704312 21954 raft_consensus.cc:740] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.704785 21956 ts_tablet_manager.cc:1434] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 13:07:26.705130 21954 consensus_queue.cc:260] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.705991 21955 tablet_bootstrap.cc:492] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:26.706203 21956 tablet_bootstrap.cc:492] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:26.707280 21954 ts_tablet_manager.cc:1434] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:26.708289 21954 tablet_bootstrap.cc:492] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:26.712903 21956 tablet_bootstrap.cc:654] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.714581 21981 consensus_queue.cc:1048] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:26.715516 21954 tablet_bootstrap.cc:654] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.738811 21955 tablet_bootstrap.cc:654] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.749396 21954 tablet_bootstrap.cc:492] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:26.749996 21954 ts_tablet_manager.cc:1403] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.021s
I20260709 13:07:26.754658 21954 raft_consensus.cc:359] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.755636 21954 raft_consensus.cc:385] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.756060 21954 raft_consensus.cc:740] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.756995 21954 consensus_queue.cc:260] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.758085 21956 tablet_bootstrap.cc:492] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:26.758639 21956 ts_tablet_manager.cc:1403] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.025s
I20260709 13:07:26.759258 21955 tablet_bootstrap.cc:492] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:26.759485 21954 ts_tablet_manager.cc:1434] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:07:26.759809 21955 ts_tablet_manager.cc:1403] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.002s
I20260709 13:07:26.760897 21954 tablet_bootstrap.cc:492] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:26.763398 21955 raft_consensus.cc:359] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.764505 21955 raft_consensus.cc:385] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.764921 21955 raft_consensus.cc:740] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.767278 21954 tablet_bootstrap.cc:654] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.767849 21956 raft_consensus.cc:359] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.768698 21956 raft_consensus.cc:385] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.767593 21955 consensus_queue.cc:260] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.769148 21956 raft_consensus.cc:740] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.773057 21994 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.773670 21994 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.782585 21994 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:26.782680 21962 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.783284 21962 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.783910 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:26.784636 21840 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:26.779860 21956 consensus_queue.cc:260] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.785964 21962 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:26.787969 21956 ts_tablet_manager.cc:1434] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.003s
I20260709 13:07:26.787842 21877 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:26.788504 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:26.789031 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:26.790047 21955 ts_tablet_manager.cc:1434] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.001s
I20260709 13:07:26.789113 21840 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:26.789901 21764 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:26.792207 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:26.792537 21879 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:26.792937 21765 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:26.794410 21955 tablet_bootstrap.cc:492] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:26.794870 21962 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:26.795284 21962 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.795634 21962 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:26.797814 21989 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:26.798306 21989 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.798695 21989 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:26.802295 21913 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:26.809764 21956 tablet_bootstrap.cc:492] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:26.809734 21989 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.813036 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:26.813791 21765 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:26.816041 21962 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.817688 21956 tablet_bootstrap.cc:654] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.819027 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:26.819665 21764 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:26.821477 21989 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:26.823240 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:26.824044 21955 tablet_bootstrap.cc:654] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.824011 21840 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:26.826550 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:26.828625 21839 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:26.830454 21765 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:26.831888 21879 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:26.835573 21989 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:26.836289 21989 raft_consensus.cc:697] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:26.837498 21839 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:26.838893 21877 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:26.839883 21994 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:26.821482 21962 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:26.837236 21989 consensus_queue.cc:237] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.838202 21961 consensus_queue.cc:1048] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:07:26.845468 21954 tablet_bootstrap.cc:492] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:26.846297 21954 ts_tablet_manager.cc:1403] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.086s	user 0.015s	sys 0.011s
I20260709 13:07:26.849661 21954 raft_consensus.cc:359] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.850545 21954 raft_consensus.cc:385] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.850840 21764 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:26.850860 21954 raft_consensus.cc:740] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.843202 21840 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:26.853996 21954 consensus_queue.cc:260] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.867663 21954 ts_tablet_manager.cc:1434] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:07:26.868992 21954 tablet_bootstrap.cc:492] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:26.871435 21962 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.874624 21994 raft_consensus.cc:697] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:26.876487 21962 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.901227 21954 tablet_bootstrap.cc:654] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.889612 21994 consensus_queue.cc:237] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.919273 21962 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:26.923645 21956 tablet_bootstrap.cc:492] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:26.924155 21956 ts_tablet_manager.cc:1403] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.115s	user 0.013s	sys 0.028s
I20260709 13:07:26.926909 21956 raft_consensus.cc:359] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.927655 21956 raft_consensus.cc:385] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.927946 21956 raft_consensus.cc:740] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.928628 21956 consensus_queue.cc:260] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.930744 21956 ts_tablet_manager.cc:1434] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:07:26.931696 21956 tablet_bootstrap.cc:492] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:26.937640 21959 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.938438 21959 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.941064 21956 tablet_bootstrap.cc:654] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.950592 21994 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.951237 21994 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.958249 21994 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:26.960013 21956 tablet_bootstrap.cc:492] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:26.961998 21956 ts_tablet_manager.cc:1403] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.004s
I20260709 13:07:26.963023 21959 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:26.964663 21956 raft_consensus.cc:359] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.965335 21956 raft_consensus.cc:385] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:26.965629 21956 raft_consensus.cc:740] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.966272 21956 consensus_queue.cc:260] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.967801 21956 ts_tablet_manager.cc:1434] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:07:26.968747 21956 tablet_bootstrap.cc:492] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:26.975598 21956 tablet_bootstrap.cc:654] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:26.986057 21955 tablet_bootstrap.cc:492] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:26.986666 21955 ts_tablet_manager.cc:1403] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.192s	user 0.018s	sys 0.011s
I20260709 13:07:26.996132 21961 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.996673 21961 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:26.998956 21961 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:27.002702 21955 raft_consensus.cc:359] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.003662 21955 raft_consensus.cc:385] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.004040 21955 raft_consensus.cc:740] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.005074 21955 consensus_queue.cc:260] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.042922 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:27.043928 21840 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:27.047528 21728 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:27.049866 22021 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.051451 22021 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.051810 22021 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.052141 22021 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.058841 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:27.059439 21839 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:27.060020 22021 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.060457 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:27.059916 21661 catalog_manager.cc:5697] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.062194 22021 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:27.064927 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:27.065578 21838 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.071033 22021 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.071590 22021 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.072043 21838 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:07:27.073870 22021 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:27.074908 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:27.075049 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:27.075733 21764 raft_consensus.cc:2393] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 1: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:07:27.075701 21911 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.077397 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:27.078683 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:27.080330 21912 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.082330 21911 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:07:27.086146 21954 tablet_bootstrap.cc:492] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:27.086265 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:27.086602 21954 ts_tablet_manager.cc:1403] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.218s	user 0.010s	sys 0.019s
I20260709 13:07:27.087070 21765 raft_consensus.cc:2393] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 1: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:07:27.089249 21954 raft_consensus.cc:359] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.090066 21954 raft_consensus.cc:385] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.090349 21954 raft_consensus.cc:740] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.091046 21954 consensus_queue.cc:260] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.091831 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:27.093092 21954 ts_tablet_manager.cc:1434] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:27.093971 21954 tablet_bootstrap.cc:492] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:27.094679 21729 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:27.095465 21959 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.095935 21959 raft_consensus.cc:697] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:07:27.096742 21959 consensus_queue.cc:237] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.100347 21954 tablet_bootstrap.cc:654] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.100791 21955 ts_tablet_manager.cc:1434] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.114s	user 0.004s	sys 0.007s
I20260709 13:07:27.101864 21955 tablet_bootstrap.cc:492] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
W20260709 13:07:27.095664 21729 leader_election.cc:343] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.107111 22021 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.107662 21962 consensus_queue.cc:1048] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.114720 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:27.124131 21955 tablet_bootstrap.cc:654] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:27.125923 21728 leader_election.cc:343] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.126647 21728 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:27.127652 22021 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:27.139011 22021 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.139505 22021 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.141826 21956 tablet_bootstrap.cc:492] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:27.141779 22021 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:27.142402 21956 ts_tablet_manager.cc:1403] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.174s	user 0.026s	sys 0.012s
I20260709 13:07:27.143234 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:27.145359 21955 tablet_bootstrap.cc:492] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:27.145079 21956 raft_consensus.cc:359] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.145740 21956 raft_consensus.cc:385] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.145800 21955 ts_tablet_manager.cc:1403] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.000s
I20260709 13:07:27.150400 21959 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.167361 21956 raft_consensus.cc:740] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.167696 21959 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.168744 21838 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.170815 21959 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:27.171001 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:27.171648 21914 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:27.168283 21956 consensus_queue.cc:260] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.172832 21729 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:27.172562 21661 catalog_manager.cc:5697] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.173615 21959 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.173753 21956 ts_tablet_manager.cc:1434] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.005s
I20260709 13:07:27.173990 21959 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.174417 21959 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.174789 21956 tablet_bootstrap.cc:492] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:27.153568 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:27.166908 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:27.148000 21877 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:07:27.178256 21989 raft_consensus.cc:2764] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:07:27.178764 21877 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:27.179903 21989 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:27.181653 21804 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:27.181746 21959 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.184491 21956 tablet_bootstrap.cc:654] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.184316 21955 raft_consensus.cc:359] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.185026 21955 raft_consensus.cc:385] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.185349 21959 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:27.184890 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:27.186127 21912 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.188000 21663 catalog_manager.cc:5697] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.188797 21954 tablet_bootstrap.cc:492] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:27.189313 21954 ts_tablet_manager.cc:1403] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.096s	user 0.019s	sys 0.037s
I20260709 13:07:27.185376 21955 raft_consensus.cc:740] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.191057 21955 consensus_queue.cc:260] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.152117 21962 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.191957 21954 raft_consensus.cc:359] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.192744 21954 raft_consensus.cc:385] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.193079 21954 raft_consensus.cc:740] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.192608 21962 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.193197 21912 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:07:27.193720 21954 consensus_queue.cc:260] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.194516 21911 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:27.194495 21729 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:27.195544 21959 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.195942 21959 raft_consensus.cc:697] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:07:27.196097 21954 ts_tablet_manager.cc:1434] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:27.196997 21954 tablet_bootstrap.cc:492] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:27.196712 21959 consensus_queue.cc:237] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.198292 21955 ts_tablet_manager.cc:1434] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:07:27.201671 21961 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:27.202126 21962 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:07:27.146284 21728 leader_election.cc:343] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:27.203351 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 57107.8us
I20260709 13:07:27.204311 21956 tablet_bootstrap.cc:492] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:27.204818 21956 ts_tablet_manager.cc:1403] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.030s	user 0.004s	sys 0.007s
I20260709 13:07:27.205474 21954 tablet_bootstrap.cc:654] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.205525 21729 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:27.207706 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:27.208118 21956 raft_consensus.cc:359] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.208410 21839 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:27.209416 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:27.209795 21956 raft_consensus.cc:385] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.210240 21840 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.210201 21956 raft_consensus.cc:740] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.211261 21956 consensus_queue.cc:260] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.212844 22027 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.213398 22027 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.213888 22027 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.214710 21956 ts_tablet_manager.cc:1434] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:07:27.215975 21956 tablet_bootstrap.cc:492] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:27.223889 21956 tablet_bootstrap.cc:654] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.225366 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:27.226171 21839 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:27.227643 21877 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:27.228487 21962 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.228894 21962 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.229233 21962 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.235052 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:27.241986 21954 tablet_bootstrap.cc:492] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:27.242516 21954 ts_tablet_manager.cc:1403] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.004s
I20260709 13:07:27.244347 21956 tablet_bootstrap.cc:492] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:27.245062 21956 ts_tablet_manager.cc:1403] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.008s
I20260709 13:07:27.248327 21962 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.249686 21956 raft_consensus.cc:359] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.250548 21954 raft_consensus.cc:359] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.250720 21956 raft_consensus.cc:385] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.251341 21954 raft_consensus.cc:385] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.251490 21956 raft_consensus.cc:740] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.252322 21954 raft_consensus.cc:740] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.253137 21954 consensus_queue.cc:260] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.253369 21956 consensus_queue.cc:260] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.255705 21954 ts_tablet_manager.cc:1434] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:07:27.256723 21954 tablet_bootstrap.cc:492] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:27.199165 21955 tablet_bootstrap.cc:492] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:27.262382 21956 ts_tablet_manager.cc:1434] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 13:07:27.264040 21956 tablet_bootstrap.cc:492] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:27.264348 21989 consensus_queue.cc:1048] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.274088 21956 tablet_bootstrap.cc:654] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.276701 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:27.262524 21840 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:07:27.279026 21954 tablet_bootstrap.cc:654] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.262447 22027 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.283143 21765 raft_consensus.cc:2393] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 1: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:07:27.288689 21956 tablet_bootstrap.cc:492] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:27.291082 21954 tablet_bootstrap.cc:492] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:27.289148 21956 ts_tablet_manager.cc:1403] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.007s
I20260709 13:07:27.291640 21954 ts_tablet_manager.cc:1403] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.006s
W20260709 13:07:27.292999 21711 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:27.293991 21956 raft_consensus.cc:359] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.294171 21954 raft_consensus.cc:359] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.294767 21954 raft_consensus.cc:385] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.294790 21956 raft_consensus.cc:385] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.295157 21954 raft_consensus.cc:740] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.295248 21956 raft_consensus.cc:740] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.295854 21954 consensus_queue.cc:260] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.296216 21956 consensus_queue.cc:260] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.297878 21954 ts_tablet_manager.cc:1434] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:27.298735 21954 tablet_bootstrap.cc:492] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:27.299108 21956 ts_tablet_manager.cc:1434] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:07:27.299988 21956 tablet_bootstrap.cc:492] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:27.302654 21989 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.303179 21962 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:27.304461 21954 tablet_bootstrap.cc:654] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.305384 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:27.306022 21840 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.309095 21956 tablet_bootstrap.cc:654] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.309763 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:27.314693 22027 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:27.316315 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:27.317512 21911 raft_consensus.cc:2393] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 1: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:07:27.319386 21729 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:27.321452 22027 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:27.330540 22027 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.331128 22027 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.334281 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:07:27.335875 21728 leader_election.cc:343] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.338325 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:07:27.339655 21729 leader_election.cc:343] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.340123 21729 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:27.340932 21959 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:27.342077 22027 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:27.368069 21955 tablet_bootstrap.cc:654] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.376616 22027 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.377360 22027 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.380441 21989 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.380985 21989 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.381253 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:27.382918 21840 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:27.383219 21989 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:07:27.383160 21728 leader_election.cc:343] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.384627 22027 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:27.385025 21877 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:07:27.387733 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:27.388440 21911 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:27.388657 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:27.387737 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:27.388505 21989 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.390008 21729 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:27.390285 21989 raft_consensus.cc:697] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:27.390551 22027 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.390012 21763 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:27.391626 21959 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.391263 21989 consensus_queue.cc:237] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.392112 21959 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:27.392437 21877 leader_election.cc:343] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.392594 21959 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.393718 21879 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:27.395222 21962 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.395638 21962 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.396037 21962 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.391173 22027 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.402056 21954 tablet_bootstrap.cc:492] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:27.402516 21954 ts_tablet_manager.cc:1403] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.104s	user 0.039s	sys 0.057s
I20260709 13:07:27.404170 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:27.405220 21954 raft_consensus.cc:359] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:27.405567 21728 leader_election.cc:343] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.406047 21954 raft_consensus.cc:385] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.406337 21954 raft_consensus.cc:740] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.407039 21954 consensus_queue.cc:260] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.408140 21994 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.409135 21954 ts_tablet_manager.cc:1434] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:27.405298 22011 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.409179 21962 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.411381 21954 tablet_bootstrap.cc:492] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:27.411571 21955 tablet_bootstrap.cc:492] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:27.412066 21955 ts_tablet_manager.cc:1403] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.213s	user 0.009s	sys 0.003s
I20260709 13:07:27.413527 22027 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:27.413445 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:27.414124 21763 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.414858 21955 raft_consensus.cc:359] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.415558 21955 raft_consensus.cc:385] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.415882 21955 raft_consensus.cc:740] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.400856 21959 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.418087 21954 tablet_bootstrap.cc:654] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.418951 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:27.419389 21959 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:27.420140 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:07:27.421036 21729 leader_election.cc:343] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.421578 21729 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:27.425172 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:27.425808 21911 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.432607 21662 catalog_manager.cc:5697] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.437415 22027 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:27.445571 21763 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:27.446991 21962 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:27.448984 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:07:27.455175 21877 leader_election.cc:343] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.449606 21994 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:07:27.449497 21663 catalog_manager.cc:5697] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.459187 21879 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:27.461005 21962 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.461186 21954 tablet_bootstrap.cc:492] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:27.461942 21962 raft_consensus.cc:697] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:27.462085 21954 ts_tablet_manager.cc:1403] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.051s	user 0.018s	sys 0.009s
I20260709 13:07:27.463266 21962 consensus_queue.cc:237] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.465961 21954 raft_consensus.cc:359] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.466902 21954 raft_consensus.cc:385] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.467406 21954 raft_consensus.cc:740] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.468147 21954 consensus_queue.cc:260] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.470451 21954 ts_tablet_manager.cc:1434] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:07:27.449368 21956 tablet_bootstrap.cc:492] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:27.471318 21954 tablet_bootstrap.cc:492] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:27.475263 21959 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.475797 21956 ts_tablet_manager.cc:1403] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.176s	user 0.032s	sys 0.042s
I20260709 13:07:27.475894 21959 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.422354 21955 consensus_queue.cc:260] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.478214 21959 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:27.478730 21837 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.478953 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:07:27.480657 21728 leader_election.cc:343] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.482823 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:07:27.484665 21729 leader_election.cc:343] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.485128 21729 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:27.485872 21959 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:27.486106 21955 ts_tablet_manager.cc:1434] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.001s
I20260709 13:07:27.487087 21955 tablet_bootstrap.cc:492] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:27.489871 21911 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:07:27.494551 21729 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:27.491078 21954 tablet_bootstrap.cc:654] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.493450 21955 tablet_bootstrap.cc:654] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.498464 21663 catalog_manager.cc:5697] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.501163 21959 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.501817 21959 raft_consensus.cc:697] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:07:27.502969 21959 consensus_queue.cc:237] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.489282 21956 raft_consensus.cc:359] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.504758 21956 raft_consensus.cc:385] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.505138 21956 raft_consensus.cc:740] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.505156 21837 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:07:27.505822 21956 consensus_queue.cc:260] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.507728 21954 tablet_bootstrap.cc:492] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:27.507906 21955 tablet_bootstrap.cc:492] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:27.508049 21956 ts_tablet_manager.cc:1434] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:07:27.508232 21954 ts_tablet_manager.cc:1403] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 13:07:27.508559 21955 ts_tablet_manager.cc:1403] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.000s
I20260709 13:07:27.508970 21956 tablet_bootstrap.cc:492] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:27.510885 21954 raft_consensus.cc:359] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.511047 21955 raft_consensus.cc:359] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.511636 21954 raft_consensus.cc:385] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.511842 21955 raft_consensus.cc:385] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.512311 21955 raft_consensus.cc:740] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.513002 21955 consensus_queue.cc:260] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.515066 21955 ts_tablet_manager.cc:1434] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:27.515194 21956 tablet_bootstrap.cc:654] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.516000 21955 tablet_bootstrap.cc:492] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:27.511930 21954 raft_consensus.cc:740] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.518131 21954 consensus_queue.cc:260] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.521301 21954 ts_tablet_manager.cc:1434] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:07:27.522240 21955 tablet_bootstrap.cc:654] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.522619 21954 tablet_bootstrap.cc:492] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:27.533489 21959 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.547966 21954 tablet_bootstrap.cc:654] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.553488 21956 tablet_bootstrap.cc:492] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:27.553977 21956 ts_tablet_manager.cc:1403] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.017s
I20260709 13:07:27.556494 21956 raft_consensus.cc:359] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.557196 21956 raft_consensus.cc:385] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.557518 21956 raft_consensus.cc:740] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.562206 21955 tablet_bootstrap.cc:492] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:27.563150 21955 ts_tablet_manager.cc:1403] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.047s	user 0.020s	sys 0.014s
I20260709 13:07:27.566570 21955 raft_consensus.cc:359] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.566747 21661 catalog_manager.cc:5697] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:27.558396 21956 consensus_queue.cc:260] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.567555 21955 raft_consensus.cc:385] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.569689 22011 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.570271 21956 ts_tablet_manager.cc:1434] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 13:07:27.570189 22011 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.572194 22011 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:27.569689 21955 raft_consensus.cc:740] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.572866 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:27.573608 21954 tablet_bootstrap.cc:492] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:27.573571 21764 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:27.574105 21954 ts_tablet_manager.cc:1403] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.006s
I20260709 13:07:27.573710 21955 consensus_queue.cc:260] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.575496 21879 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:27.576057 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:27.576646 21955 ts_tablet_manager.cc:1434] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:07:27.577544 21981 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.578065 21981 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.578624 22011 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.579044 22011 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:27.579864 21877 leader_election.cc:343] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.580264 21981 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:27.581068 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:07:27.582369 21805 leader_election.cc:343] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.582620 22021 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.579741 22011 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.583307 21962 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.583832 21955 tablet_bootstrap.cc:492] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:27.583739 21962 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.588657 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:07:27.590399 21804 leader_election.cc:343] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.590607 21956 tablet_bootstrap.cc:492] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:27.590883 21804 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:27.591818 21954 raft_consensus.cc:359] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.592443 21954 raft_consensus.cc:385] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.592689 21954 raft_consensus.cc:740] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.593266 21954 consensus_queue.cc:260] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.594116 21961 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:27.595436 21954 ts_tablet_manager.cc:1434] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:07:27.596283 21954 tablet_bootstrap.cc:492] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:27.596951 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:27.597585 21764 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:27.598357 21962 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:27.601373 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:27.605042 21879 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
W20260709 13:07:27.605667 21877 leader_election.cc:343] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.608850 22011 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.610755 21962 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.611147 21962 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.611508 21962 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.612965 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:27.613595 21764 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.615061 22011 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:27.617210 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:27.617990 21962 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:27.621260 21877 leader_election.cc:343] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.626300 22011 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.627457 22011 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.632253 21954 tablet_bootstrap.cc:654] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.634466 22011 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:27.636286 21955 tablet_bootstrap.cc:654] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.636610 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:27.637224 21765 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.639209 21956 tablet_bootstrap.cc:654] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.629582 21764 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:27.640558 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:27.642966 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:27.643348 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:07:27.642978 21879 leader_election.cc:343] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.634480 21962 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:27.644590 21879 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:27.645778 21989 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:27.647439 21877 leader_election.cc:343] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.647512 21989 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.648164 21877 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:27.649056 21765 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:27.649758 21989 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:27.651178 22042 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:27.651594 21879 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:27.652428 22042 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.652872 22042 raft_consensus.cc:697] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:07:27.653272 21877 leader_election.cc:343] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.651919 21962 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.653950 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:27.653810 22042 consensus_queue.cc:237] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.655627 21838 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:27.658097 21877 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:27.659003 22011 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.665134 22011 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.667687 22011 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.673900 22011 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.665508 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:07:27.676119 21879 leader_election.cc:343] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.677678 22011 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:27.660348 21962 raft_consensus.cc:697] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:27.677970 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:27.679117 21837 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.679487 21962 consensus_queue.cc:237] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.682061 21956 tablet_bootstrap.cc:492] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:27.682371 21956 ts_tablet_manager.cc:1403] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.092s	user 0.031s	sys 0.025s
I20260709 13:07:27.678066 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:07:27.683805 21879 leader_election.cc:343] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.685345 21956 raft_consensus.cc:359] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.686189 21956 raft_consensus.cc:385] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.686520 21956 raft_consensus.cc:740] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.687253 21956 consensus_queue.cc:260] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.688942 21956 ts_tablet_manager.cc:1434] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:27.689275 21837 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:27.689747 21956 tablet_bootstrap.cc:492] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:27.690668 21877 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:07:27.691599 22042 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:27.692080 22042 raft_consensus.cc:697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:27.692935 22042 consensus_queue.cc:237] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.692121 21663 catalog_manager.cc:5697] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.698097 21955 tablet_bootstrap.cc:492] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:27.698145 21956 tablet_bootstrap.cc:654] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.698722 21955 ts_tablet_manager.cc:1403] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.115s	user 0.016s	sys 0.003s
I20260709 13:07:27.699226 21954 tablet_bootstrap.cc:492] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:27.699808 21954 ts_tablet_manager.cc:1403] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.009s
I20260709 13:07:27.702544 21954 raft_consensus.cc:359] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.703447 21954 raft_consensus.cc:385] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.703841 21954 raft_consensus.cc:740] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.704742 21954 consensus_queue.cc:260] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.705955 21955 raft_consensus.cc:359] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.706651 21955 raft_consensus.cc:385] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.706947 21955 raft_consensus.cc:740] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.707633 21955 consensus_queue.cc:260] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.709965 21955 ts_tablet_manager.cc:1434] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:27.715004 21954 ts_tablet_manager.cc:1434] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:07:27.716051 21954 tablet_bootstrap.cc:492] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:27.715876 22021 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.716712 21956 tablet_bootstrap.cc:492] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:27.717152 21956 ts_tablet_manager.cc:1403] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.000s
I20260709 13:07:27.719668 21956 raft_consensus.cc:359] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.719647 21663 catalog_manager.cc:5697] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.720384 21956 raft_consensus.cc:385] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.722379 21956 raft_consensus.cc:740] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.722947 21954 tablet_bootstrap.cc:654] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.723066 21956 consensus_queue.cc:260] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.726142 21955 tablet_bootstrap.cc:492] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:27.721340 21663 catalog_manager.cc:5697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:27.733698 21956 ts_tablet_manager.cc:1434] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:07:27.734745 21956 tablet_bootstrap.cc:492] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:27.742300 21954 tablet_bootstrap.cc:492] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:27.742764 21954 ts_tablet_manager.cc:1403] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.007s
I20260709 13:07:27.745394 21954 raft_consensus.cc:359] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.746093 21954 raft_consensus.cc:385] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.746424 21954 raft_consensus.cc:740] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.733421 21955 tablet_bootstrap.cc:654] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.747036 21954 consensus_queue.cc:260] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.748677 21959 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.749289 21954 ts_tablet_manager.cc:1434] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 13:07:27.750653 21954 tablet_bootstrap.cc:492] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:27.751406 21956 tablet_bootstrap.cc:654] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.753185 21959 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.753715 21959 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.756769 21954 tablet_bootstrap.cc:654] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.760877 21956 tablet_bootstrap.cc:492] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:27.763002 21955 tablet_bootstrap.cc:492] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:27.761340 21956 ts_tablet_manager.cc:1403] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.000s
I20260709 13:07:27.767158 21955 ts_tablet_manager.cc:1403] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.007s
I20260709 13:07:27.769188 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:27.769629 21956 raft_consensus.cc:359] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.770413 21956 raft_consensus.cc:385] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.770728 21956 raft_consensus.cc:740] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
W20260709 13:07:27.771376 21728 leader_election.cc:343] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.772421 21959 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:27.772804 21955 raft_consensus.cc:359] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.773530 21955 raft_consensus.cc:385] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.773866 21955 raft_consensus.cc:740] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.774421 21955 consensus_queue.cc:260] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.777670 21955 ts_tablet_manager.cc:1434] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:07:27.781023 21955 tablet_bootstrap.cc:492] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:27.783209 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:27.771446 21956 consensus_queue.cc:260] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:27.790861 21729 leader_election.cc:343] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.792373 21729 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:27.793392 22027 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:27.799763 21956 ts_tablet_manager.cc:1434] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:07:27.800872 21956 tablet_bootstrap.cc:492] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:27.801339 21955 tablet_bootstrap.cc:654] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.804244 21954 tablet_bootstrap.cc:492] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:27.804674 21954 ts_tablet_manager.cc:1403] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.013s
I20260709 13:07:27.807242 21954 raft_consensus.cc:359] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.807895 21954 raft_consensus.cc:385] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.808143 21954 raft_consensus.cc:740] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.808522 21956 tablet_bootstrap.cc:654] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.814164 21954 consensus_queue.cc:260] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.816749 21954 ts_tablet_manager.cc:1434] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 13:07:27.817909 21954 tablet_bootstrap.cc:492] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:27.823542 21954 tablet_bootstrap.cc:654] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.824656 21956 tablet_bootstrap.cc:492] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:27.825311 21956 ts_tablet_manager.cc:1403] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.006s
I20260709 13:07:27.828711 21956 raft_consensus.cc:359] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.829651 21956 raft_consensus.cc:385] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.830009 21956 raft_consensus.cc:740] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.831035 21956 consensus_queue.cc:260] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.834375 21956 ts_tablet_manager.cc:1434] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:07:27.837117 21954 tablet_bootstrap.cc:492] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:27.837622 21954 ts_tablet_manager.cc:1403] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.001s
I20260709 13:07:27.835636 21956 tablet_bootstrap.cc:492] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:27.840113 21954 raft_consensus.cc:359] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.841180 21954 raft_consensus.cc:385] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.841472 21954 raft_consensus.cc:740] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.842092 21954 consensus_queue.cc:260] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.849810 21956 tablet_bootstrap.cc:654] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.854602 21955 tablet_bootstrap.cc:492] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:27.855204 21955 ts_tablet_manager.cc:1403] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.074s	user 0.020s	sys 0.031s
I20260709 13:07:27.856947 21954 ts_tablet_manager.cc:1434] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:07:27.858889 21955 raft_consensus.cc:359] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.859920 21954 tablet_bootstrap.cc:492] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:27.859839 21955 raft_consensus.cc:385] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.861737 21955 raft_consensus.cc:740] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.862524 21956 tablet_bootstrap.cc:492] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:27.863030 21956 ts_tablet_manager.cc:1403] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.004s
I20260709 13:07:27.862623 21955 consensus_queue.cc:260] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.864874 21955 ts_tablet_manager.cc:1434] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:07:27.865698 21956 raft_consensus.cc:359] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.866204 21955 tablet_bootstrap.cc:492] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:27.866367 21956 raft_consensus.cc:385] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.866683 21956 raft_consensus.cc:740] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.867362 21956 consensus_queue.cc:260] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.867856 21954 tablet_bootstrap.cc:654] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.869091 22027 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.869668 21956 ts_tablet_manager.cc:1434] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:07:27.869561 22027 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.870939 21956 tablet_bootstrap.cc:492] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:27.871564 22027 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:27.872337 21955 tablet_bootstrap.cc:654] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.873092 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:27.875192 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:07:27.875454 21728 leader_election.cc:343] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:27.876969 21729 leader_election.cc:343] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.877606 21729 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:27.879608 22011 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.880384 22027 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:27.880110 22011 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.883451 22011 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:27.883575 21956 tablet_bootstrap.cc:654] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.885524 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:27.886260 21764 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:27.887293 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:27.887925 21837 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:27.889142 21877 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:27.891294 22011 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.891597 21955 tablet_bootstrap.cc:492] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:27.891778 22011 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.892158 21955 ts_tablet_manager.cc:1403] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.018s
I20260709 13:07:27.892504 22011 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.895841 21955 raft_consensus.cc:359] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.896627 21955 raft_consensus.cc:385] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.896894 21955 raft_consensus.cc:740] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.897661 21956 tablet_bootstrap.cc:492] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:27.897627 21955 consensus_queue.cc:260] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.898981 21962 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.899767 21955 ts_tablet_manager.cc:1434] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:27.899435 21962 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.900720 21955 tablet_bootstrap.cc:492] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:27.901551 21962 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:27.903347 21954 tablet_bootstrap.cc:492] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:27.903800 21954 ts_tablet_manager.cc:1403] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.006s
I20260709 13:07:27.904628 22011 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.898154 21956 ts_tablet_manager.cc:1403] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.000s
I20260709 13:07:27.906215 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:27.906579 21954 raft_consensus.cc:359] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.906838 21764 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:27.906869 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:27.907701 21954 raft_consensus.cc:385] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.907950 21956 raft_consensus.cc:359] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.908159 21879 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:27.908639 21956 raft_consensus.cc:385] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:27.908576 21962 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:27.907986 21954 raft_consensus.cc:740] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.909085 22042 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:27.909588 22042 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.910012 21955 tablet_bootstrap.cc:654] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:27.909871 21954 consensus_queue.cc:260] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:27.910972 21877 leader_election.cc:343] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:27.912285 21954 ts_tablet_manager.cc:1434] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:27.909057 21956 raft_consensus.cc:740] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:27.909934 22042 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.918465 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:27.919095 21764 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.918751 21956 consensus_queue.cc:260] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.920631 21954 tablet_bootstrap.cc:492] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:27.920770 21956 ts_tablet_manager.cc:1434] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:07:27.924638 21956 tablet_bootstrap.cc:492] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:27.923725 22042 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.935890 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:27.936705 21765 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.945917 22027 consensus_queue.cc:1048] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.967854 21962 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:27.968770 21989 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.969265 21989 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.971375 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:27.972084 21840 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:27.979831 21962 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.980569 21962 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:27.980897 22011 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:27.992939 21764 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
W20260709 13:07:28.014048 21861 debug-util.cc:398] Leaking SignalData structure 0x7b08001c2020 after lost signal to thread 20643
W20260709 13:07:28.034349 21861 debug-util.cc:398] Leaking SignalData structure 0x7b08001dd500 after lost signal to thread 21697
I20260709 13:07:28.034669 22027 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.035056 21956 tablet_bootstrap.cc:654] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:28.035475 21861 debug-util.cc:398] Leaking SignalData structure 0x7b08001f7c60 after lost signal to thread 21789
I20260709 13:07:28.035228 22027 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:28.036556 21861 debug-util.cc:398] Leaking SignalData structure 0x7b080011bbe0 after lost signal to thread 21864
W20260709 13:07:28.037614 21861 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad540 after lost signal to thread 21938
I20260709 13:07:28.042577 21879 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:28.047534 21765 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:28.023523 21981 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.025614 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:28.025928 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:28.049763 21761 raft_consensus.cc:2468] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:28.026851 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:28.051011 21762 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:28.042006 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:07:28.054987 21877 leader_election.cc:343] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.027892 22042 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:28.030095 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:28.030836 21955 tablet_bootstrap.cc:492] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:28.056739 21955 ts_tablet_manager.cc:1403] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.156s	user 0.023s	sys 0.046s
I20260709 13:07:28.057611 21981 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.054013 21837 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:28.059474 21955 raft_consensus.cc:359] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.060695 21955 raft_consensus.cc:385] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.060648 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:28.061108 21955 raft_consensus.cc:740] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.060828 21728 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:28.061388 21762 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 0.
I20260709 13:07:28.061950 21955 consensus_queue.cc:260] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.062379 21959 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:28.062788 21805 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:28.062940 21959 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.063402 21959 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.063639 21961 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:28.064024 21961 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.064256 21955 ts_tablet_manager.cc:1434] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:07:28.064344 21961 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.065254 21955 tablet_bootstrap.cc:492] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:28.031479 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:28.031500 21840 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:28.074095 21961 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.031276 21989 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:07:28.069809 21877 leader_election.cc:343] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.076220 22011 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:28.076881 22011 raft_consensus.cc:697] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:07:28.077466 21877 leader_election.cc:343] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.077867 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:28.078811 21762 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.080413 21962 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:28.094282 21955 tablet_bootstrap.cc:654] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.096374 21959 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.112246 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:28.113214 21911 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 0.
I20260709 13:07:28.114454 21959 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:28.103286 22027 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:28.115403 22027 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.116092 22027 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.117123 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:28.117970 21911 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.119674 22027 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:28.121603 21961 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:28.122597 21961 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.123214 21961 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.126947 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:28.127995 21761 raft_consensus.cc:2393] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 1: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:07:28.128886 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 86433.7us
I20260709 13:07:28.100664 22011 consensus_queue.cc:237] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.129210 22085 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.131840 22085 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.129761 21981 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:28.130576 22083 consensus_queue.cc:1048] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:28.135725 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:07:28.136170 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 49218.8us
I20260709 13:07:28.137151 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:07:28.137360 21805 leader_election.cc:343] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:28.138688 21804 leader_election.cc:343] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.139211 21804 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:28.103884 21954 tablet_bootstrap.cc:654] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.140887 22085 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:28.141275 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:28.141701 22085 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:28.141969 21912 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:28.149214 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:07:28.151489 21877 consensus_peers.cc:597] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:28.152038 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:28.139477 21879 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:28.149741 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:28.150002 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:28.172152 21961 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:28.157083 21836 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.182044 21913 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.149645 21762 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
W20260709 13:07:28.168689 21877 consensus_peers.cc:597] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:28.193629 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 54252.4us
W20260709 13:07:28.200997 21728 leader_election.cc:343] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.216897 21956 tablet_bootstrap.cc:492] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:28.217429 21956 ts_tablet_manager.cc:1403] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.293s	user 0.036s	sys 0.040s
I20260709 13:07:28.206573 21805 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:28.218035 21879 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:28.218814 21961 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:28.219058 22011 raft_consensus.cc:2804] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:28.219537 22011 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.217370 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:28.220001 22011 raft_consensus.cc:3060] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.219369 21961 raft_consensus.cc:697] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:07:28.225565 22081 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:28.226116 22081 raft_consensus.cc:697] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:28.228031 22087 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.226949 22081 consensus_queue.cc:237] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.228528 22087 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.224733 21961 consensus_queue.cc:237] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:28.231633 21729 leader_election.cc:343] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.242934 21956 raft_consensus.cc:359] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.243479 21956 raft_consensus.cc:385] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.243644 21956 raft_consensus.cc:740] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.244050 21956 consensus_queue.cc:260] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.249713 22084 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.249763 22042 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.250367 22084 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.250428 22042 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.252548 22084 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:28.252574 22042 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:28.256357 21956 ts_tablet_manager.cc:1434] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 13:07:28.257107 21956 tablet_bootstrap.cc:492] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:28.258129 21662 catalog_manager.cc:5697] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.261651 21913 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:07:28.263890 21955 tablet_bootstrap.cc:492] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:28.264892 21955 ts_tablet_manager.cc:1403] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.200s	user 0.029s	sys 0.040s
I20260709 13:07:28.268273 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:28.240656 21879 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:07:28.273324 21877 leader_election.cc:343] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.273640 22042 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:28.274175 22042 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.274564 22042 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.275056 21962 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:28.276403 22082 consensus_queue.cc:1048] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:28.253953 21729 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:28.258777 21804 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:28.303970 22087 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:28.304867 21911 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
W20260709 13:07:28.310501 22091 log.cc:927] Time spent T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:07:28.313022 22087 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:28.319073 21961 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.322898 22082 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:07:28.315707 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 85321.4us
I20260709 13:07:28.327600 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:28.328517 21762 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:28.329979 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:28.331214 21729 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:28.332347 21954 tablet_bootstrap.cc:492] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:28.331907 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:28.333360 21954 ts_tablet_manager.cc:1403] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.413s	user 0.014s	sys 0.011s
I20260709 13:07:28.509420 21955 raft_consensus.cc:359] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.510375 21955 raft_consensus.cc:385] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.510617 21956 tablet_bootstrap.cc:654] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.510725 21955 raft_consensus.cc:740] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.511698 21955 consensus_queue.cc:260] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.516250 21955 ts_tablet_manager.cc:1434] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.250s	user 0.004s	sys 0.004s
W20260709 13:07:28.444187 21711 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:28.338274 21961 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:28.517675 21955 tablet_bootstrap.cc:492] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
W20260709 13:07:28.324658 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 78763.8us
W20260709 13:07:28.339399 21729 leader_election.cc:343] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:28.519276 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 179909us
I20260709 13:07:28.521684 22078 consensus_queue.cc:1048] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:07:28.522727 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:07:28.523835 21805 leader_election.cc:343] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.523794 21879 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:28.333644 22086 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:28.525796 22021 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.525873 22086 raft_consensus.cc:697] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:07:28.526331 22021 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.408460 22042 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.508843 21836 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:07:28.518869 22011 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.529402 22021 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:28.530056 21962 consensus_queue.cc:1048] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:28.530282 22082 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.531637 21954 raft_consensus.cc:359] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.534257 21954 raft_consensus.cc:385] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.534510 21954 raft_consensus.cc:740] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.535637 22082 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.532583 22081 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:28.536939 22081 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.527071 22086 consensus_queue.cc:237] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.537622 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:28.542505 22084 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.542230 21954 consensus_queue.cc:260] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.542949 22084 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.543355 22082 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:28.544498 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:28.544773 21954 ts_tablet_manager.cc:1434] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.000s
I20260709 13:07:28.544891 22084 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:28.547688 21954 tablet_bootstrap.cc:492] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:28.537379 22081 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.546072 22042 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:07:28.545855 21877 leader_election.cc:343] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.552927 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:28.553239 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:28.554622 22011 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:07:28.555248 21877 leader_election.cc:343] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.566118 21955 tablet_bootstrap.cc:654] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.568104 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:07:28.569913 21877 leader_election.cc:343] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:28.570814 21804 leader_election.cc:343] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.571379 21804 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:28.574098 21961 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:28.578009 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:28.582000 22021 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.582661 22021 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:28.582051 21728 leader_election.cc:343] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.586621 21728 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:28.586761 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:28.587945 22083 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:28.588397 22021 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:28.580302 21763 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.590332 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:28.591017 21761 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:28.594736 21804 leader_election.cc:343] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.598788 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:07:28.603160 21728 leader_election.cc:343] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.609787 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:28.610567 21765 raft_consensus.cc:3060] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.615018 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:28.619822 21729 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:28.619963 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:28.620734 21764 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 0.
I20260709 13:07:28.624753 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:28.628198 22021 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:28.629616 21954 tablet_bootstrap.cc:654] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.630749 21765 raft_consensus.cc:2468] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:28.613549 21761 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:28.646353 21805 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
W20260709 13:07:28.653177 21879 leader_election.cc:343] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.651340 22085 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:28.653932 22085 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.654340 22085 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.653730 21879 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:28.656296 21956 tablet_bootstrap.cc:492] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:28.656797 21956 ts_tablet_manager.cc:1403] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.400s	user 0.012s	sys 0.024s
I20260709 13:07:28.654503 22081 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:28.659479 21729 leader_election.cc:343] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.660627 21729 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:28.660197 21962 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:28.661448 22021 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:28.665215 21955 tablet_bootstrap.cc:492] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:28.664973 21961 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:28.665707 21955 ts_tablet_manager.cc:1403] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.148s	user 0.017s	sys 0.000s
I20260709 13:07:28.667912 21956 raft_consensus.cc:359] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.668707 21956 raft_consensus.cc:385] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.669013 21956 raft_consensus.cc:740] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.669874 21956 consensus_queue.cc:260] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.672446 21956 ts_tablet_manager.cc:1434] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 13:07:28.672063 22011 consensus_queue.cc:1048] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:28.672104 21962 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:28.673509 21956 tablet_bootstrap.cc:492] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:28.667704 21661 catalog_manager.cc:5697] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 1 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.672199 21879 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:28.677745 22085 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.679911 22042 raft_consensus.cc:2804] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:28.680526 22042 raft_consensus.cc:697] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:28.680886 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:28.681080 21955 raft_consensus.cc:359] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.681775 21955 raft_consensus.cc:385] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.682072 21955 raft_consensus.cc:740] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
W20260709 13:07:28.682396 21877 leader_election.cc:343] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.682737 21955 consensus_queue.cc:260] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.684743 21955 ts_tablet_manager.cc:1434] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:07:28.685750 21955 tablet_bootstrap.cc:492] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:28.689595 22042 consensus_queue.cc:237] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.679508 22081 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:28.692828 21879 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:28.694231 22011 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:28.694764 22011 raft_consensus.cc:697] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:28.695654 22011 consensus_queue.cc:237] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.699604 21954 tablet_bootstrap.cc:492] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:28.700146 21954 ts_tablet_manager.cc:1403] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.153s	user 0.017s	sys 0.007s
I20260709 13:07:28.701782 21956 tablet_bootstrap.cc:654] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.709177 21662 catalog_manager.cc:5697] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.715026 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:28.715916 21911 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.716919 21954 raft_consensus.cc:359] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.717658 21954 raft_consensus.cc:385] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.717960 21954 raft_consensus.cc:740] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.719908 21962 consensus_queue.cc:1048] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:07:28.719525 22085 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:28.718639 21954 consensus_queue.cc:260] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.723520 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:28.724139 21761 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.730906 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:28.741539 21954 ts_tablet_manager.cc:1434] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 13:07:28.743196 21954 tablet_bootstrap.cc:492] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:28.738026 21758 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:28.774822 21954 tablet_bootstrap.cc:654] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.759238 21962 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:07:28.804006 21955 tablet_bootstrap.cc:654] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.822242 21954 tablet_bootstrap.cc:492] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:28.822808 21954 ts_tablet_manager.cc:1403] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.010s
W20260709 13:07:28.826963 21877 consensus_peers.cc:597] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:28.817828 21761 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:07:28.828994 21956 tablet_bootstrap.cc:492] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:28.829497 21956 ts_tablet_manager.cc:1403] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.156s	user 0.023s	sys 0.019s
I20260709 13:07:28.832304 21956 raft_consensus.cc:359] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.832971 21956 raft_consensus.cc:385] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.833241 21956 raft_consensus.cc:740] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.834987 21663 catalog_manager.cc:5697] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:28.833938 21956 consensus_queue.cc:260] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.847898 21962 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.848415 21962 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.851261 21962 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:28.838773 21758 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:28.843850 21961 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.874475 21961 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.876606 21961 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:28.873557 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:28.886653 21879 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:28.887503 22042 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:28.888042 22042 raft_consensus.cc:697] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:28.888103 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:28.888271 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:28.889011 22042 consensus_queue.cc:237] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.890080 21805 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:28.888899 21758 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:28.890578 21911 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:07:28.892738 21879 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:28.893858 22011 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:28.894220 22011 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.894723 22011 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:28.897811 21877 leader_election.cc:343] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.906875 22085 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:28.907387 21961 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:28.905606 21662 catalog_manager.cc:5697] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.916935 21662 catalog_manager.cc:5697] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:28.930034 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:28.933312 21804 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:28.935873 21961 raft_consensus.cc:697] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:07:28.937927 21961 consensus_queue.cc:237] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.939700 22085 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:28.942776 22083 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.943277 22083 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.945351 22083 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:28.950187 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:07:28.956782 21729 leader_election.cc:343] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:28.956652 21954 raft_consensus.cc:359] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.957593 21954 raft_consensus.cc:385] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:28.957898 21954 raft_consensus.cc:740] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:28.958617 21954 consensus_queue.cc:260] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:28.962936 21956 ts_tablet_manager.cc:1434] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.133s	user 0.003s	sys 0.004s
I20260709 13:07:28.963984 21956 tablet_bootstrap.cc:492] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:28.965303 21954 ts_tablet_manager.cc:1434] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.142s	user 0.008s	sys 0.000s
I20260709 13:07:28.966236 21954 tablet_bootstrap.cc:492] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:28.973372 21956 tablet_bootstrap.cc:654] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:28.991148 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:28.991847 21835 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:28.997169 21728 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:29.000073 22083 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:29.002554 22083 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.002877 22083 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.014297 22083 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.014325 21954 tablet_bootstrap.cc:654] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.011248 22011 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.030707 21661 catalog_manager.cc:5697] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.033772 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:07:29.035229 21877 leader_election.cc:343] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:29.040192 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:29.040836 21835 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.041219 22011 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:29.041673 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:29.042037 21955 tablet_bootstrap.cc:492] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:29.045145 21763 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.045614 21955 ts_tablet_manager.cc:1403] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.360s	user 0.035s	sys 0.026s
I20260709 13:07:29.046108 22083 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:29.042637 21662 catalog_manager.cc:5697] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 1 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.049237 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:07:29.055270 21729 leader_election.cc:343] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:29.058372 21763 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:29.058897 21954 tablet_bootstrap.cc:492] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:29.059322 21954 ts_tablet_manager.cc:1403] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.093s	user 0.023s	sys 0.004s
I20260709 13:07:29.062858 21879 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:29.063959 22011 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:29.064467 22011 raft_consensus.cc:697] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:29.065213 22011 consensus_queue.cc:237] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.066071 21835 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:07:29.067404 21728 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:29.067548 21954 raft_consensus.cc:359] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.068152 21954 raft_consensus.cc:385] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.068451 21954 raft_consensus.cc:740] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.068238 22083 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:29.069140 22083 raft_consensus.cc:697] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:07:29.069618 21955 raft_consensus.cc:359] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.070287 21955 raft_consensus.cc:385] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.070559 21955 raft_consensus.cc:740] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.070062 22083 consensus_queue.cc:237] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.071211 21955 consensus_queue.cc:260] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.073856 21955 ts_tablet_manager.cc:1434] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:07:29.073690 21954 consensus_queue.cc:260] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.075011 21955 tablet_bootstrap.cc:492] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:29.076174 21954 ts_tablet_manager.cc:1434] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 13:07:29.077728 21954 tablet_bootstrap.cc:492] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:29.079116 21956 tablet_bootstrap.cc:492] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:29.079703 21956 ts_tablet_manager.cc:1403] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.116s	user 0.013s	sys 0.011s
I20260709 13:07:29.091548 21956 raft_consensus.cc:359] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.092504 21956 raft_consensus.cc:385] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.092850 21956 raft_consensus.cc:740] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.093721 21956 consensus_queue.cc:260] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.096612 21956 ts_tablet_manager.cc:1434] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.006s
I20260709 13:07:29.098295 21962 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:29.101307 21956 tablet_bootstrap.cc:492] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:29.114679 22086 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:29.117938 21877 consensus_peers.cc:597] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:29.119175 22042 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.119902 22042 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.120986 21961 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.121513 21961 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.122457 22042 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:29.124188 21961 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:29.124866 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:29.125298 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:29.125578 21954 tablet_bootstrap.cc:654] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.125985 21764 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:29.127992 21955 tablet_bootstrap.cc:654] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:29.126171 21877 leader_election.cc:343] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:29.126204 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:29.130386 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:29.133136 21759 raft_consensus.cc:2393] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 1: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:07:29.136027 21805 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:29.137048 21961 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.150648 21661 catalog_manager.cc:5697] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.149880 21662 catalog_manager.cc:5697] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:29.159837 21835 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.159682 21879 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:07:29.178943 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 47268us
I20260709 13:07:29.178968 22011 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:29.182850 22011 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.183219 22011 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.168239 21961 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:29.199071 22011 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.208796 21956 tablet_bootstrap.cc:654] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.212078 22011 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:29.218402 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:07:29.220554 21877 leader_election.cc:343] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:29.222538 21955 tablet_bootstrap.cc:492] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:29.223182 21955 ts_tablet_manager.cc:1403] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.148s	user 0.019s	sys 0.004s
I20260709 13:07:29.222538 21954 tablet_bootstrap.cc:492] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:29.224653 21954 ts_tablet_manager.cc:1403] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.147s	user 0.012s	sys 0.018s
I20260709 13:07:29.228250 21955 raft_consensus.cc:359] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.229290 21955 raft_consensus.cc:385] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.229727 21955 raft_consensus.cc:740] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.230396 22083 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:29.230605 21955 consensus_queue.cc:260] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.236464 21954 raft_consensus.cc:359] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.237496 21954 raft_consensus.cc:385] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.237772 21954 raft_consensus.cc:740] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.238678 21954 consensus_queue.cc:260] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.245283 22120 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.245800 22120 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.247048 21955 ts_tablet_manager.cc:1434] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 13:07:29.249687 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:29.250408 21763 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 0.
I20260709 13:07:29.250490 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:29.250758 21955 tablet_bootstrap.cc:492] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:29.251118 21914 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 0.
I20260709 13:07:29.251690 21805 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:29.253000 21961 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:29.253357 21961 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.253775 21961 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.247824 22120 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:07:29.263150 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 57268.9us
I20260709 13:07:29.264614 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:29.265183 21763 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.266571 21954 ts_tablet_manager.cc:1434] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 13:07:29.273101 21954 tablet_bootstrap.cc:492] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:29.278344 21763 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:29.288122 21955 tablet_bootstrap.cc:654] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:29.294476 21877 consensus_peers.cc:597] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:29.307518 21956 tablet_bootstrap.cc:492] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:29.307686 21955 tablet_bootstrap.cc:492] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:29.308050 21956 ts_tablet_manager.cc:1403] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.207s	user 0.024s	sys 0.041s
I20260709 13:07:29.308166 21955 ts_tablet_manager.cc:1403] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.002s
I20260709 13:07:29.317881 21879 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:29.318538 22011 consensus_queue.cc:1048] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.319319 22081 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:29.319864 22081 raft_consensus.cc:697] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:29.321131 21954 tablet_bootstrap.cc:654] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.320714 22081 consensus_queue.cc:237] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.314064 21961 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.347277 21956 raft_consensus.cc:359] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.351265 21956 raft_consensus.cc:385] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.351563 21956 raft_consensus.cc:740] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.352154 21956 consensus_queue.cc:260] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.350608 21955 raft_consensus.cc:359] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.353035 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:29.353333 21955 raft_consensus.cc:385] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.353654 21955 raft_consensus.cc:740] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.353714 21763 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.354377 21956 ts_tablet_manager.cc:1434] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 13:07:29.355203 21956 tablet_bootstrap.cc:492] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:29.356577 21955 consensus_queue.cc:260] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.358872 21954 tablet_bootstrap.cc:492] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:29.359368 21954 ts_tablet_manager.cc:1403] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.087s	user 0.013s	sys 0.002s
I20260709 13:07:29.358799 21961 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:29.361915 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:29.362561 21911 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.363644 21955 ts_tablet_manager.cc:1434] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.001s
I20260709 13:07:29.364440 21955 tablet_bootstrap.cc:492] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:29.369549 21661 catalog_manager.cc:5697] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.373734 21961 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.374233 21961 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.376433 21961 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:29.378479 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:29.377354 21763 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:07:29.379722 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:29.378666 22140 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.380491 21954 raft_consensus.cc:359] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.380724 22140 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.380957 21805 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:29.381165 21954 raft_consensus.cc:385] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.381788 21954 raft_consensus.cc:740] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.381498 21804 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:29.383985 22140 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:29.384536 21961 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:29.382412 21954 consensus_queue.cc:260] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.384977 21961 raft_consensus.cc:697] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:07:29.387282 21961 consensus_queue.cc:237] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.388639 21954 ts_tablet_manager.cc:1434] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.001s
I20260709 13:07:29.389518 22120 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:29.389658 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:29.390457 21954 tablet_bootstrap.cc:492] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:29.385051 21911 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
W20260709 13:07:29.392180 21729 leader_election.cc:343] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:29.392791 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:07:29.394038 21728 leader_election.cc:343] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:29.394181 21956 tablet_bootstrap.cc:654] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.394529 21728 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:29.396099 22140 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:29.399622 21954 tablet_bootstrap.cc:654] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.413335 21660 catalog_manager.cc:5697] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 1 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:29.414790 21877 consensus_peers.cc:597] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:29.414837 21956 tablet_bootstrap.cc:492] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:29.416078 21956 ts_tablet_manager.cc:1403] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.005s
I20260709 13:07:29.417302 21955 tablet_bootstrap.cc:654] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.421023 22140 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.421586 22140 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.423898 22140 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:29.426928 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:29.427171 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:29.428167 22140 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:29.428457 21729 leader_election.cc:343] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:29.428962 21728 leader_election.cc:343] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:29.428683 22140 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.429389 21728 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:29.430558 22021 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:29.431800 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:29.432540 21836 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:29.434764 21728 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:29.435660 22021 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:29.436023 22021 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.436167 22140 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:29.436347 22021 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.437067 21954 tablet_bootstrap.cc:492] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:29.437252 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:29.437579 21954 ts_tablet_manager.cc:1403] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.000s
I20260709 13:07:29.437917 21911 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:29.440834 21956 raft_consensus.cc:359] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.441686 21956 raft_consensus.cc:385] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.441919 21956 raft_consensus.cc:740] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.443120 21956 consensus_queue.cc:260] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.446617 21956 ts_tablet_manager.cc:1434] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:07:29.448465 21956 tablet_bootstrap.cc:492] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:29.456475 21954 raft_consensus.cc:359] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.457314 21954 raft_consensus.cc:385] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.457656 21954 raft_consensus.cc:740] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.472738 21954 consensus_queue.cc:260] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.474417 21955 tablet_bootstrap.cc:492] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:29.474848 21954 ts_tablet_manager.cc:1434] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.002s
I20260709 13:07:29.475752 21954 tablet_bootstrap.cc:492] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:29.480414 21955 ts_tablet_manager.cc:1403] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.116s	user 0.014s	sys 0.011s
I20260709 13:07:29.483369 21955 raft_consensus.cc:359] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.484148 21955 raft_consensus.cc:385] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.484448 21955 raft_consensus.cc:740] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.484954 22021 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.488915 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:29.489575 21836 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.494056 21956 tablet_bootstrap.cc:654] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.485244 21955 consensus_queue.cc:260] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.504009 21961 consensus_queue.cc:1048] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.508585 21836 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:07:29.509613 22081 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.510425 22021 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:29.511510 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:29.512132 21911 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.513826 21728 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:29.515666 22140 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:29.516153 22140 raft_consensus.cc:697] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:07:29.517074 22140 consensus_queue.cc:237] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.522857 21911 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:07:29.536345 21836 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.523475 21954 tablet_bootstrap.cc:654] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.499217 21955 ts_tablet_manager.cc:1434] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:07:29.541842 22082 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.542354 21955 tablet_bootstrap.cc:492] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:29.552090 21955 tablet_bootstrap.cc:654] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:29.554826 21711 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:29.587760 21955 tablet_bootstrap.cc:492] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:29.588263 21955 ts_tablet_manager.cc:1403] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.004s
I20260709 13:07:29.598039 21955 raft_consensus.cc:359] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.598738 21955 raft_consensus.cc:385] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.599012 21955 raft_consensus.cc:740] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.599682 21955 consensus_queue.cc:260] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.601138 21955 ts_tablet_manager.cc:1434] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 13:07:29.611737 21955 tablet_bootstrap.cc:492] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:29.613590 21961 consensus_queue.cc:1048] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:29.627738 21955 tablet_bootstrap.cc:654] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.627532 22140 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:29.634287 21961 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.634862 21961 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.637096 21961 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:29.639160 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:29.647380 21961 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.648159 21961 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.651783 21961 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:29.652205 21955 tablet_bootstrap.cc:492] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:29.652349 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:29.652686 21955 ts_tablet_manager.cc:1403] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.000s
I20260709 13:07:29.652946 21914 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 0.
I20260709 13:07:29.654201 21804 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:29.655146 21961 raft_consensus.cc:2804] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:29.655476 21961 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.655817 21961 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.655756 21955 raft_consensus.cc:359] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.656582 21955 raft_consensus.cc:385] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.656836 21955 raft_consensus.cc:740] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.657586 21955 consensus_queue.cc:260] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.659861 21955 ts_tablet_manager.cc:1434] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260709 13:07:29.660135 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 141435us
I20260709 13:07:29.662061 21956 tablet_bootstrap.cc:492] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:29.662516 21956 ts_tablet_manager.cc:1403] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.214s	user 0.041s	sys 0.055s
I20260709 13:07:29.662647 21955 tablet_bootstrap.cc:492] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:29.666930 21956 raft_consensus.cc:359] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.667811 21956 raft_consensus.cc:385] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.668143 21956 raft_consensus.cc:740] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.669209 21956 consensus_queue.cc:260] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.688740 21954 tablet_bootstrap.cc:492] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:29.689221 21954 ts_tablet_manager.cc:1403] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.214s	user 0.016s	sys 0.028s
I20260709 13:07:29.690961 21956 ts_tablet_manager.cc:1434] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:07:29.691905 21956 tablet_bootstrap.cc:492] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:29.692919 21954 raft_consensus.cc:359] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.693655 21954 raft_consensus.cc:385] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.693902 21954 raft_consensus.cc:740] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.694660 21954 consensus_queue.cc:260] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.695891 21914 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.706382 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:29.826400 21954 ts_tablet_manager.cc:1434] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.137s	user 0.005s	sys 0.001s
I20260709 13:07:29.827675 21954 tablet_bootstrap.cc:492] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:29.829103 21956 tablet_bootstrap.cc:654] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.707507 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:29.742995 21961 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.834713 21840 raft_consensus.cc:3060] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.846045 22140 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.850715 22140 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.852586 22140 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:29.877290 21961 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:29.881037 21955 tablet_bootstrap.cc:654] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.886124 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:29.887323 22081 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.887838 22081 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:29.893043 21728 leader_election.cc:343] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:29.894526 21877 consensus_peers.cc:597] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:29.895737 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:29.896347 21911 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.901065 21911 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:07:29.909086 22021 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.909976 22021 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.916393 21956 tablet_bootstrap.cc:492] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:29.916872 21956 ts_tablet_manager.cc:1403] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.225s	user 0.041s	sys 0.076s
I20260709 13:07:29.917873 22140 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:29.917999 22081 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:29.918650 22021 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:29.920238 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:29.925347 21805 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:29.930258 21954 tablet_bootstrap.cc:654] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.929057 22082 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:29.930953 22122 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:29.931339 21956 raft_consensus.cc:359] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.933811 21956 raft_consensus.cc:385] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.934119 21956 raft_consensus.cc:740] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
W20260709 13:07:29.934415 21805 leader_election.cc:343] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:29.934769 21956 consensus_queue.cc:260] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.937001 21956 ts_tablet_manager.cc:1434] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.001s
I20260709 13:07:29.938454 21956 tablet_bootstrap.cc:492] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:29.944999 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:29.951937 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:29.952641 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:29.953259 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:29.953926 21914 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:29.956370 21956 tablet_bootstrap.cc:654] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:29.956681 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:29.958171 21729 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
W20260709 13:07:29.961205 21729 leader_election.cc:343] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:29.959713 22140 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:29.961752 21729 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:29.963850 22151 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:29.960417 21804 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:29.964392 21955 tablet_bootstrap.cc:492] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:29.964826 21955 ts_tablet_manager.cc:1403] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.302s	user 0.015s	sys 0.002s
I20260709 13:07:29.965981 22122 raft_consensus.cc:2804] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:29.966488 22122 raft_consensus.cc:697] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:07:29.967289 22122 consensus_queue.cc:237] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:29.965631 21805 leader_election.cc:343] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:29.970602 21879 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:29.961927 22140 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.972430 21955 raft_consensus.cc:359] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.973297 21955 raft_consensus.cc:385] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:29.973754 21955 raft_consensus.cc:740] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:29.976094 21954 tablet_bootstrap.cc:492] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:29.976545 21954 ts_tablet_manager.cc:1403] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.149s	user 0.010s	sys 0.007s
I20260709 13:07:29.974506 21955 consensus_queue.cc:260] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:29.977140 22042 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:29.987077 21955 ts_tablet_manager.cc:1434] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:07:29.988025 21955 tablet_bootstrap.cc:492] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
W20260709 13:07:29.989935 21728 leader_election.cc:343] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:29.973510 22140 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:29.998088 21961 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:29.999106 21954 raft_consensus.cc:359] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.000005 21954 raft_consensus.cc:385] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.000336 21954 raft_consensus.cc:740] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.005546 21660 catalog_manager.cc:5697] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:30.014178 22011 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:30.020597 22122 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.021099 22122 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.023118 22122 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:30.018263 21954 consensus_queue.cc:260] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.027793 22140 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.028388 21954 ts_tablet_manager.cc:1434] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.004s
I20260709 13:07:30.029585 21954 tablet_bootstrap.cc:492] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:30.029712 22140 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:30.030033 22122 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.031452 22122 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.031736 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:30.032406 21910 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:30.033962 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:30.034631 21764 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 0.
I20260709 13:07:30.039438 22122 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:30.040534 21910 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:07:30.040747 21955 tablet_bootstrap.cc:654] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.042798 21805 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:30.043655 22122 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:30.044070 22122 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.045280 22122 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:30.045272 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:30.046473 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:30.052707 21729 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:30.055634 22140 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:30.055063 21662 catalog_manager.cc:5697] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 1 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:30.056265 22140 raft_consensus.cc:697] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:07:30.057116 22140 consensus_queue.cc:237] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.049412 21954 tablet_bootstrap.cc:654] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.055617 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:30.064699 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:30.067368 22122 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:30.072856 21728 leader_election.cc:343] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.073413 22140 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:30.073834 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:30.074576 21763 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:30.075151 22122 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:30.077284 21956 tablet_bootstrap.cc:492] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
W20260709 13:07:30.079833 21804 leader_election.cc:343] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.081158 21956 ts_tablet_manager.cc:1403] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.143s	user 0.015s	sys 0.022s
I20260709 13:07:30.083776 21956 raft_consensus.cc:359] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.082122 21804 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:30.084460 21956 raft_consensus.cc:385] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.084399 21763 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:07:30.084930 21956 raft_consensus.cc:740] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.085095 22122 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:30.087013 21805 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:30.088166 22169 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:30.088143 22122 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:30.089082 22169 raft_consensus.cc:697] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:07:30.090401 22169 consensus_queue.cc:237] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.091698 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:30.093314 22140 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:30.097147 21956 consensus_queue.cc:260] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.102905 21954 tablet_bootstrap.cc:492] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:30.103411 21954 ts_tablet_manager.cc:1403] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.003s
I20260709 13:07:30.105954 21954 raft_consensus.cc:359] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.106585 21954 raft_consensus.cc:385] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.106832 21954 raft_consensus.cc:740] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.111831 21954 consensus_queue.cc:260] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.114420 21954 ts_tablet_manager.cc:1434] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:07:30.115520 21954 tablet_bootstrap.cc:492] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:30.121778 21954 tablet_bootstrap.cc:654] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.124285 21955 tablet_bootstrap.cc:492] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:30.124750 21955 ts_tablet_manager.cc:1403] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.137s	user 0.018s	sys 0.001s
W20260709 13:07:30.125842 21804 leader_election.cc:343] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.134554 21956 ts_tablet_manager.cc:1434] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 13:07:30.134322 21955 raft_consensus.cc:359] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.135150 21955 raft_consensus.cc:385] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.135430 21955 raft_consensus.cc:740] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.136458 21955 consensus_queue.cc:260] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.136901 21956 tablet_bootstrap.cc:492] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:30.141276 21840 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:30.145803 22082 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.146399 21956 tablet_bootstrap.cc:654] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.146286 22082 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.157754 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:07:30.161793 21877 leader_election.cc:343] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.166244 22082 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:30.171187 21955 ts_tablet_manager.cc:1434] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.002s
I20260709 13:07:30.172494 21955 tablet_bootstrap.cc:492] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:30.185961 21661 catalog_manager.cc:5697] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:30.198244 21838 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:30.222747 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:30.223585 21763 raft_consensus.cc:2468] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
W20260709 13:07:30.232560 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 46806.2us
I20260709 13:07:30.232616 21954 tablet_bootstrap.cc:492] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:30.239241 21954 ts_tablet_manager.cc:1403] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.124s	user 0.047s	sys 0.062s
I20260709 13:07:30.243430 21954 raft_consensus.cc:359] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.244205 21954 raft_consensus.cc:385] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.244513 21954 raft_consensus.cc:740] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.245230 21954 consensus_queue.cc:260] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.265537 21954 ts_tablet_manager.cc:1434] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260709 13:07:30.266669 21954 tablet_bootstrap.cc:492] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
W20260709 13:07:30.285295 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 55602.1us
I20260709 13:07:30.292382 21955 tablet_bootstrap.cc:654] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.295570 21954 tablet_bootstrap.cc:654] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.297230 21879 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:30.298821 22082 raft_consensus.cc:2804] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:30.299302 22082 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.299746 22082 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:30.313464 21954 tablet_bootstrap.cc:492] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:30.314069 21954 ts_tablet_manager.cc:1403] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.001s
I20260709 13:07:30.317494 22140 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.318002 22140 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.319972 22140 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:30.322431 21954 raft_consensus.cc:359] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.323228 21954 raft_consensus.cc:385] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.323603 21954 raft_consensus.cc:740] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.324318 21954 consensus_queue.cc:260] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.326805 21954 ts_tablet_manager.cc:1434] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:07:30.327916 21954 tablet_bootstrap.cc:492] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:30.332187 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:30.360925 21954 tablet_bootstrap.cc:654] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.375161 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:30.376026 21910 raft_consensus.cc:2393] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 1: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:07:30.380439 22082 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.283558 21661 catalog_manager.cc:5697] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 1 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:30.387676 21956 tablet_bootstrap.cc:492] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:30.388186 21956 ts_tablet_manager.cc:1403] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.251s	user 0.070s	sys 0.159s
I20260709 13:07:30.390797 21956 raft_consensus.cc:359] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.391537 21956 raft_consensus.cc:385] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.391853 21956 raft_consensus.cc:740] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.392758 21956 consensus_queue.cc:260] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.394990 21956 ts_tablet_manager.cc:1434] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:30.396020 21956 tablet_bootstrap.cc:492] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:30.402518 21956 tablet_bootstrap.cc:654] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.403034 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:30.405359 22082 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:07:30.405606 21877 leader_election.cc:343] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.432941 21956 tablet_bootstrap.cc:492] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:30.435019 21729 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:30.434731 21956 ts_tablet_manager.cc:1403] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.007s
I20260709 13:07:30.435784 22140 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:30.440398 22140 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:30.441785 21956 raft_consensus.cc:359] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.443336 21956 raft_consensus.cc:385] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.443621 21956 raft_consensus.cc:740] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.443897 21955 tablet_bootstrap.cc:492] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:30.444392 21955 ts_tablet_manager.cc:1403] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.272s	user 0.013s	sys 0.000s
I20260709 13:07:30.445320 21956 consensus_queue.cc:260] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.448586 21954 tablet_bootstrap.cc:492] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:30.448455 21955 raft_consensus.cc:359] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.449066 21954 ts_tablet_manager.cc:1403] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.121s	user 0.023s	sys 0.009s
I20260709 13:07:30.449245 21955 raft_consensus.cc:385] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:30.486752 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 51635.6us
I20260709 13:07:30.449604 21955 raft_consensus.cc:740] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.508082 22151 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.510540 21956 ts_tablet_manager.cc:1434] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.000s
I20260709 13:07:30.511938 21955 consensus_queue.cc:260] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.532999 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:30.534368 21763 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:30.509311 22151 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.546432 22122 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:30.548926 22121 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:30.554567 21956 tablet_bootstrap.cc:492] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:30.562265 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:30.564451 21955 ts_tablet_manager.cc:1434] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.120s	user 0.009s	sys 0.001s
I20260709 13:07:30.564220 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:30.566452 21955 tablet_bootstrap.cc:492] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:30.549158 22151 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:30.580783 22011 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.573333 21954 raft_consensus.cc:359] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.583487 21954 raft_consensus.cc:385] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.583866 21954 raft_consensus.cc:740] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.584684 21954 consensus_queue.cc:260] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.599220 22192 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:30.635274 21729 leader_election.cc:343] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.641911 22192 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.643812 21954 ts_tablet_manager.cc:1434] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.194s	user 0.007s	sys 0.005s
I20260709 13:07:30.644414 22192 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:30.645643 22011 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.645323 21954 tablet_bootstrap.cc:492] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:30.641981 21763 raft_consensus.cc:2468] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
W20260709 13:07:30.653044 21728 leader_election.cc:343] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.653602 21728 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:30.654441 22151 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:30.660527 22192 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:30.650406 22011 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:30.676819 21838 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:30.686789 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:07:30.689258 21729 leader_election.cc:343] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.662899 21879 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:30.698233 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:30.699074 21764 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:30.693331 22082 raft_consensus.cc:2804] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:30.702128 21955 tablet_bootstrap.cc:654] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.701969 22082 raft_consensus.cc:697] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:30.703737 22082 consensus_queue.cc:237] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.705168 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:30.706832 21956 tablet_bootstrap.cc:654] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.706780 21879 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:30.712247 22195 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:30.713064 22195 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:30.706800 21728 leader_election.cc:343] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.714555 22121 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:30.715103 21728 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:30.717306 22140 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:30.713591 22195 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:30.748064 22196 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.748647 22196 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.751919 22196 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:07:30.747532 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 104522us
I20260709 13:07:30.772014 22195 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.772492 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:30.773285 21762 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:30.774809 21879 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:30.775684 22011 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:30.776051 22011 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.776424 22011 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:30.778936 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:30.781342 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:30.791231 21955 tablet_bootstrap.cc:492] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:30.791765 21955 ts_tablet_manager.cc:1403] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.226s	user 0.015s	sys 0.006s
I20260709 13:07:30.788700 22140 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:07:30.796523 22121 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:30.799517 21877 leader_election.cc:343] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:30.800472 21877 leader_election.cc:343] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.801486 21954 tablet_bootstrap.cc:654] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.799202 21955 raft_consensus.cc:359] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.806161 21955 raft_consensus.cc:385] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.806524 21955 raft_consensus.cc:740] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.810947 22192 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.817581 21956 tablet_bootstrap.cc:492] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:30.818354 21956 ts_tablet_manager.cc:1403] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.300s	user 0.013s	sys 0.015s
I20260709 13:07:30.811537 22192 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.815954 21662 catalog_manager.cc:5697] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.811743 22195 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:30.831887 21955 consensus_queue.cc:260] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.797066 22121 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.836176 21956 raft_consensus.cc:359] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.840152 21956 raft_consensus.cc:385] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:30.840561 21956 raft_consensus.cc:740] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:30.842691 21956 consensus_queue.cc:260] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.852310 21956 ts_tablet_manager.cc:1434] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 13:07:30.853703 21956 tablet_bootstrap.cc:492] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:30.833304 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:30.864204 21762 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:30.880409 21804 consensus_peers.cc:597] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:30.885046 21956 tablet_bootstrap.cc:654] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:30.893771 22121 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:30.894261 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:07:30.896212 21729 leader_election.cc:343] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.896754 22192 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:30.882274 22081 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.917520 21955 ts_tablet_manager.cc:1434] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.124s	user 0.014s	sys 0.009s
I20260709 13:07:30.908468 22081 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.931638 21762 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:30.924420 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:30.944322 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:07:30.941084 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 58927.7us
I20260709 13:07:30.947006 21955 tablet_bootstrap.cc:492] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:30.954074 22011 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:30.957055 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:30.957332 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:30.957751 21759 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:30.972344 21837 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:30.972947 22081 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:30.975842 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:07:30.989974 21877 leader_election.cc:343] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:30.998399 21759 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:30.998723 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:30.998732 22196 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.000377 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:31.000634 22196 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.002758 22196 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:07:31.005507 21877 leader_election.cc:343] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:31.006207 21877 leader_election.cc:343] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:31.006515 21728 leader_election.cc:343] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.006956 21728 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:31.009238 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:31.009884 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:31.010282 22192 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:31.015094 21956 tablet_bootstrap.cc:492] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:31.015681 21956 ts_tablet_manager.cc:1403] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.162s	user 0.021s	sys 0.017s
I20260709 13:07:31.018117 21955 tablet_bootstrap.cc:654] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.021490 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:31.023324 21956 raft_consensus.cc:359] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.024372 21956 raft_consensus.cc:385] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.024816 21956 raft_consensus.cc:740] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
W20260709 13:07:31.026777 21711 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:07:31.030515 21877 leader_election.cc:343] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.031316 21804 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:31.032437 22205 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:31.032733 21954 tablet_bootstrap.cc:492] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:31.033192 21954 ts_tablet_manager.cc:1403] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.388s	user 0.021s	sys 0.030s
I20260709 13:07:31.041368 21879 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:07:31.044951 21879 leader_election.cc:343] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.045385 21879 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:31.046146 22195 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:31.046599 22195 raft_consensus.cc:697] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:31.039201 21956 consensus_queue.cc:260] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.047374 22195 consensus_queue.cc:237] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.053061 22082 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:31.063402 21879 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:07:31.064510 21879 leader_election.cc:343] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.064970 21879 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:31.065869 22011 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:31.072685 22082 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:31.079946 21955 tablet_bootstrap.cc:492] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:31.080430 21955 ts_tablet_manager.cc:1403] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.141s	user 0.015s	sys 0.003s
I20260709 13:07:31.081651 21954 raft_consensus.cc:359] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.083479 21954 raft_consensus.cc:385] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.083705 21954 raft_consensus.cc:740] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.088917 21954 consensus_queue.cc:260] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.095827 21955 raft_consensus.cc:359] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.096562 21955 raft_consensus.cc:385] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.096870 21955 raft_consensus.cc:740] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.097575 21955 consensus_queue.cc:260] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.100194 21955 ts_tablet_manager.cc:1434] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:07:31.102463 21662 catalog_manager.cc:5697] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.072885 22081 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:31.105603 21954 ts_tablet_manager.cc:1434] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 13:07:31.106352 22081 raft_consensus.cc:697] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:31.107888 22081 consensus_queue.cc:237] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.101356 21955 tablet_bootstrap.cc:492] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:31.117002 21956 ts_tablet_manager.cc:1434] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.101s	user 0.010s	sys 0.010s
W20260709 13:07:31.112589 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 46289us
I20260709 13:07:31.122637 21954 tablet_bootstrap.cc:492] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:31.122838 21956 tablet_bootstrap.cc:492] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:31.132069 21954 tablet_bootstrap.cc:654] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.136894 21956 tablet_bootstrap.cc:654] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.137818 21661 catalog_manager.cc:5697] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.140990 22081 consensus_queue.cc:1048] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:31.145985 21955 tablet_bootstrap.cc:654] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.151299 21956 tablet_bootstrap.cc:492] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:31.151765 21956 ts_tablet_manager.cc:1403] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.002s
I20260709 13:07:31.154503 21956 raft_consensus.cc:359] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.155203 21956 raft_consensus.cc:385] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.155478 21956 raft_consensus.cc:740] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.156107 21956 consensus_queue.cc:260] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.161479 21956 ts_tablet_manager.cc:1434] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:07:31.165477 21956 tablet_bootstrap.cc:492] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:31.168678 21955 tablet_bootstrap.cc:492] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:31.169159 21955 ts_tablet_manager.cc:1403] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.014s
I20260709 13:07:31.174396 21954 tablet_bootstrap.cc:492] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:31.174886 21954 ts_tablet_manager.cc:1403] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.008s
I20260709 13:07:31.175844 21837 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.177752 21954 raft_consensus.cc:359] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.179812 21954 raft_consensus.cc:385] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.180121 21954 raft_consensus.cc:740] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.179939 21955 raft_consensus.cc:359] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.180616 21955 raft_consensus.cc:385] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.180874 21955 raft_consensus.cc:740] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.181491 21955 consensus_queue.cc:260] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.182730 21954 consensus_queue.cc:260] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.183569 21955 ts_tablet_manager.cc:1434] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 13:07:31.185288 21955 tablet_bootstrap.cc:492] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:31.187901 21954 ts_tablet_manager.cc:1434] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:07:31.188931 21954 tablet_bootstrap.cc:492] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:31.188745 22081 consensus_queue.cc:1048] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:31.191861 21956 tablet_bootstrap.cc:654] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.195200 21955 tablet_bootstrap.cc:654] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.198259 21954 tablet_bootstrap.cc:654] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.224637 21955 tablet_bootstrap.cc:492] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:31.225092 21955 ts_tablet_manager.cc:1403] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.012s
I20260709 13:07:31.227645 21956 tablet_bootstrap.cc:492] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:31.228121 21956 ts_tablet_manager.cc:1403] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.001s
I20260709 13:07:31.227823 21955 raft_consensus.cc:359] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.228466 21955 raft_consensus.cc:385] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.228767 21955 raft_consensus.cc:740] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.231086 21956 raft_consensus.cc:359] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.231777 21956 raft_consensus.cc:385] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.232026 21956 raft_consensus.cc:740] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.232625 21955 consensus_queue.cc:260] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.232978 21956 consensus_queue.cc:260] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.234990 21955 ts_tablet_manager.cc:1434] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:07:31.235248 21956 ts_tablet_manager.cc:1434] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:31.235991 21955 tablet_bootstrap.cc:492] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:31.236964 21956 tablet_bootstrap.cc:492] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:31.240039 21954 tablet_bootstrap.cc:492] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:31.240486 21954 ts_tablet_manager.cc:1403] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.002s
I20260709 13:07:31.243327 21954 raft_consensus.cc:359] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.244050 21954 raft_consensus.cc:385] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.244349 21954 raft_consensus.cc:740] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.245062 21954 consensus_queue.cc:260] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.246395 21840 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.247560 21954 ts_tablet_manager.cc:1434] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:31.248553 21954 tablet_bootstrap.cc:492] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:31.254138 21954 tablet_bootstrap.cc:654] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.254312 21955 tablet_bootstrap.cc:654] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.263674 21956 tablet_bootstrap.cc:654] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.275764 21954 tablet_bootstrap.cc:492] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:31.284550 21954 ts_tablet_manager.cc:1403] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.013s
I20260709 13:07:31.290652 21954 raft_consensus.cc:359] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.291815 21954 raft_consensus.cc:385] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.292143 21954 raft_consensus.cc:740] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.292862 21954 consensus_queue.cc:260] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.300485 21955 tablet_bootstrap.cc:492] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:31.301081 21955 ts_tablet_manager.cc:1403] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.018s
I20260709 13:07:31.303997 21955 raft_consensus.cc:359] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.304742 21955 raft_consensus.cc:385] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.305075 21955 raft_consensus.cc:740] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.305125 21954 ts_tablet_manager.cc:1434] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.003s
I20260709 13:07:31.305907 21955 consensus_queue.cc:260] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.307439 21954 tablet_bootstrap.cc:492] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:31.308041 21955 ts_tablet_manager.cc:1434] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:31.309047 21955 tablet_bootstrap.cc:492] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:31.314425 21954 tablet_bootstrap.cc:654] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.314824 21955 tablet_bootstrap.cc:654] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.326290 21956 tablet_bootstrap.cc:492] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:31.326923 21956 ts_tablet_manager.cc:1403] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.090s	user 0.007s	sys 0.013s
I20260709 13:07:31.330379 21956 raft_consensus.cc:359] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.330684 22021 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.331060 21956 raft_consensus.cc:385] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.331375 21956 raft_consensus.cc:740] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.331238 22021 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.332211 21956 consensus_queue.cc:260] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.333613 22021 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:31.334319 21956 ts_tablet_manager.cc:1434] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:07:31.336062 21956 tablet_bootstrap.cc:492] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:31.337723 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:31.342501 21956 tablet_bootstrap.cc:654] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.343474 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:31.344257 21910 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:31.345500 21729 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
W20260709 13:07:31.346244 21728 leader_election.cc:343] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.346697 22021 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:31.347105 22021 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.347587 22021 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.363340 22021 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.366542 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:31.371230 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:07:31.371711 21728 leader_election.cc:343] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.372236 21910 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.372877 22021 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:31.376781 21954 tablet_bootstrap.cc:492] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:31.377275 21954 ts_tablet_manager.cc:1403] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.070s	user 0.018s	sys 0.013s
I20260709 13:07:31.383980 21955 tablet_bootstrap.cc:492] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:31.384706 21955 ts_tablet_manager.cc:1403] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.008s
I20260709 13:07:31.380069 21954 raft_consensus.cc:359] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.391105 21954 raft_consensus.cc:385] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.391429 21954 raft_consensus.cc:740] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.392400 21954 consensus_queue.cc:260] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.393631 21955 raft_consensus.cc:359] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.394273 21955 raft_consensus.cc:385] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.394497 21955 raft_consensus.cc:740] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.394804 21954 ts_tablet_manager.cc:1434] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:07:31.389223 21910 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:07:31.396263 21954 tablet_bootstrap.cc:492] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:31.419809 21955 consensus_queue.cc:260] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.421350 21956 tablet_bootstrap.cc:492] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:31.421859 21729 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:31.414673 22021 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.422642 22192 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:31.423291 22192 raft_consensus.cc:697] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:07:31.423151 22021 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.424104 22192 consensus_queue.cc:237] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.427116 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:07:31.428422 21728 leader_election.cc:343] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.430657 21954 tablet_bootstrap.cc:654] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.428421 22021 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:31.422022 21956 ts_tablet_manager.cc:1403] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.086s	user 0.029s	sys 0.043s
I20260709 13:07:31.434302 22196 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.434767 22196 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.436827 22121 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.436564 21956 raft_consensus.cc:359] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.437358 22121 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.437928 21956 raft_consensus.cc:385] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.438274 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:31.438664 21956 raft_consensus.cc:740] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.439465 22121 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:31.438936 21759 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:31.440272 21956 consensus_queue.cc:260] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.441998 21879 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:31.443011 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:31.443325 22219 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:31.443686 22219 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.444006 22219 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.444916 21956 ts_tablet_manager.cc:1434] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:07:31.447204 21956 tablet_bootstrap.cc:492] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:31.449483 22196 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:31.431893 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:31.449925 22140 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.450016 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:31.450515 22140 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:31.451840 21877 leader_election.cc:343] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:31.452306 21729 leader_election.cc:343] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.452636 22140 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:31.452708 21729 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:31.454327 22194 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:31.454823 21955 ts_tablet_manager.cc:1434] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.070s	user 0.003s	sys 0.005s
I20260709 13:07:31.453466 21840 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.455983 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:31.457067 22194 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.457579 22194 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.458114 21759 raft_consensus.cc:2393] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 1: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:07:31.458710 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:31.462025 22194 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:31.462368 21955 tablet_bootstrap.cc:492] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:31.463670 21805 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:07:31.465538 21728 leader_election.cc:343] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.466974 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:31.467599 21837 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:31.471029 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:31.471936 21910 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:31.472102 21728 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:31.473100 22140 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:31.473495 22140 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.473815 22140 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.477104 22121 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:31.479157 21729 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:31.478003 22196 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:31.480634 22081 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.481099 22081 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.483309 22081 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:31.466144 22219 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.484072 22021 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:31.486164 22021 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.486529 22021 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.486728 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:31.487356 21910 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:31.487887 22219 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:31.492215 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:31.492887 21759 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:31.494079 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:31.494639 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:07:31.495451 21877 leader_election.cc:343] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:31.496357 21877 leader_election.cc:343] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.497692 21879 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:31.501197 22081 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:31.501629 22081 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.501956 22081 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.502804 22140 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.523497 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:31.524799 22196 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.524684 21759 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.525276 22196 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.530594 21955 tablet_bootstrap.cc:654] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.542280 21913 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.541389 22196 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:31.548463 21956 tablet_bootstrap.cc:654] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.561200 22140 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:31.547276 21661 catalog_manager.cc:5697] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:31.566691 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:31.574023 21757 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:31.575515 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:31.576116 21836 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.577766 21879 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:31.582787 21759 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:31.578555 22082 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:31.583488 22082 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.583819 22082 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.564193 22021 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.588519 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:31.589087 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:07:31.592448 21877 leader_election.cc:343] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.598124 21879 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:31.596326 22082 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.589133 21912 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.599646 22196 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:31.600273 22195 consensus_queue.cc:1048] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:31.600195 22082 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:31.601944 22196 raft_consensus.cc:697] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:31.602885 22196 consensus_queue.cc:237] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.604334 21954 tablet_bootstrap.cc:492] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:31.604769 21954 ts_tablet_manager.cc:1403] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.209s	user 0.019s	sys 0.044s
I20260709 13:07:31.617914 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:31.618499 21763 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.618933 22021 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:31.620621 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:07:31.622054 21728 leader_election.cc:343] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.624449 22219 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:31.630523 21954 raft_consensus.cc:359] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.631418 21954 raft_consensus.cc:385] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.631748 21954 raft_consensus.cc:740] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.597369 21836 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:07:31.617621 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:31.625183 21912 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
W20260709 13:07:31.639117 21877 leader_election.cc:343] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.639201 21954 consensus_queue.cc:260] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.643092 21956 tablet_bootstrap.cc:492] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:31.644953 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:31.645677 21910 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.661908 21763 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:31.662828 21955 tablet_bootstrap.cc:492] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:31.663339 21955 ts_tablet_manager.cc:1403] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.201s	user 0.008s	sys 0.011s
I20260709 13:07:31.664505 21956 ts_tablet_manager.cc:1403] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.218s	user 0.014s	sys 0.013s
I20260709 13:07:31.664433 22011 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:07:31.665033 22011 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.666854 21879 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:31.674186 22220 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:31.677963 22011 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:31.686865 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:31.689605 21954 ts_tablet_manager.cc:1434] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.002s
I20260709 13:07:31.682142 22194 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.677783 21728 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:31.694984 22194 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.695611 22192 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:31.696082 22192 raft_consensus.cc:697] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:07:31.697150 22194 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:31.696889 22192 consensus_queue.cc:237] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.698871 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:31.703109 21955 raft_consensus.cc:359] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.707808 21955 raft_consensus.cc:385] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.708114 21955 raft_consensus.cc:740] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.706283 21910 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:07:31.708765 21955 consensus_queue.cc:260] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.711270 21955 ts_tablet_manager.cc:1434] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:07:31.684129 22220 raft_consensus.cc:697] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:31.715905 21956 raft_consensus.cc:359] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.716607 21956 raft_consensus.cc:385] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.716902 21956 raft_consensus.cc:740] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.718053 21954 tablet_bootstrap.cc:492] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
W20260709 13:07:31.715835 21728 leader_election.cc:343] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.722499 21955 tablet_bootstrap.cc:492] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:31.685097 22081 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.730347 22220 consensus_queue.cc:237] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.742537 22081 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:31.752660 21956 consensus_queue.cc:260] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.792604 21956 ts_tablet_manager.cc:1434] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.128s	user 0.009s	sys 0.001s
I20260709 13:07:31.793512 22209 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.808529 22209 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:31.809013 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 124254us
I20260709 13:07:31.814401 21838 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.816021 21956 tablet_bootstrap.cc:492] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:31.795430 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:31.818459 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:31.820926 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:31.821782 21910 raft_consensus.cc:2393] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 1: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:07:31.823868 22209 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:31.830500 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:31.847528 21729 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:31.848536 21877 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:07:31.849934 21729 leader_election.cc:343] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.850485 21729 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:31.851197 22243 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:31.850539 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:31.852417 22140 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:31.852612 21762 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.860083 21762 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:31.850646 22192 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:31.861116 22192 raft_consensus.cc:697] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:07:31.861944 22192 consensus_queue.cc:237] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.866950 21879 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:31.867744 22011 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:07:31.868295 21877 leader_election.cc:343] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:31.870141 22140 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:31.868398 22011 raft_consensus.cc:697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:31.871438 22011 consensus_queue.cc:237] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.870481 21954 tablet_bootstrap.cc:654] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.878034 21955 tablet_bootstrap.cc:654] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.881759 21662 catalog_manager.cc:5697] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.887466 21662 catalog_manager.cc:5697] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.888342 22243 consensus_queue.cc:1048] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:07:31.885299 22209 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.892376 22209 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.889647 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:31.897922 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:31.898449 21805 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:31.899819 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:31.901116 22121 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:31.897279 22209 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:31.919307 21805 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:31.913463 22121 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:31.923789 22121 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:31.924067 21956 tablet_bootstrap.cc:654] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.925475 21661 catalog_manager.cc:5697] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:31.929106 21661 catalog_manager.cc:5697] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:31.953140 22192 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:31.958467 21954 tablet_bootstrap.cc:492] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:31.959086 21954 ts_tablet_manager.cc:1403] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.241s	user 0.007s	sys 0.037s
I20260709 13:07:31.961936 21956 tablet_bootstrap.cc:492] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:31.962421 21956 ts_tablet_manager.cc:1403] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.157s	user 0.005s	sys 0.013s
I20260709 13:07:31.964552 21954 raft_consensus.cc:359] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.967671 21956 raft_consensus.cc:359] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.968315 21956 raft_consensus.cc:385] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.968557 21956 raft_consensus.cc:740] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.965267 21954 raft_consensus.cc:385] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.969239 21954 raft_consensus.cc:740] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.970039 21954 consensus_queue.cc:260] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.969635 21662 catalog_manager.cc:5697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:31.971081 21956 consensus_queue.cc:260] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.973640 21955 tablet_bootstrap.cc:492] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:31.974175 21955 ts_tablet_manager.cc:1403] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.259s	user 0.011s	sys 0.011s
I20260709 13:07:31.976040 21954 ts_tablet_manager.cc:1434] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:07:31.976850 21955 raft_consensus.cc:359] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.977587 21955 raft_consensus.cc:385] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:31.977923 21955 raft_consensus.cc:740] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:31.973317 21956 ts_tablet_manager.cc:1434] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 13:07:31.978699 21955 consensus_queue.cc:260] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:31.979252 21956 tablet_bootstrap.cc:492] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:31.977051 21954 tablet_bootstrap.cc:492] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:31.980974 21955 ts_tablet_manager.cc:1434] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:07:31.982015 21955 tablet_bootstrap.cc:492] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:31.991549 21955 tablet_bootstrap.cc:654] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.993131 21954 tablet_bootstrap.cc:654] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:31.998154 21956 tablet_bootstrap.cc:654] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.015164 21956 tablet_bootstrap.cc:492] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:32.015712 21956 ts_tablet_manager.cc:1403] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.004s
I20260709 13:07:32.017853 22011 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.018366 22011 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.020393 22011 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:32.026971 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:32.028162 22011 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:32.039109 21879 leader_election.cc:343] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.039994 22021 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.040606 22021 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.042856 22021 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:32.043845 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:32.046826 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:32.045522 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:07:32.046344 21877 leader_election.cc:343] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.048682 21877 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:07:32.050298 21728 leader_election.cc:343] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:32.051522 21729 leader_election.cc:343] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.051975 21729 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:32.052881 22021 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:32.053406 22220 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:32.061273 21955 tablet_bootstrap.cc:492] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:32.062484 21956 raft_consensus.cc:359] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.063365 21955 ts_tablet_manager.cc:1403] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.023s
I20260709 13:07:32.063742 21954 tablet_bootstrap.cc:492] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:32.064193 21954 ts_tablet_manager.cc:1403] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.087s	user 0.010s	sys 0.000s
I20260709 13:07:32.063589 21956 raft_consensus.cc:385] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.066087 21956 raft_consensus.cc:740] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.066226 21955 raft_consensus.cc:359] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.067050 21955 raft_consensus.cc:385] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.067399 21955 raft_consensus.cc:740] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.067943 21954 raft_consensus.cc:359] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.068049 21955 consensus_queue.cc:260] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.068650 21954 raft_consensus.cc:385] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.068987 21954 raft_consensus.cc:740] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.070393 21955 ts_tablet_manager.cc:1434] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:07:32.066879 21956 consensus_queue.cc:260] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.074803 21956 ts_tablet_manager.cc:1434] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.004s
I20260709 13:07:32.075922 21956 tablet_bootstrap.cc:492] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:32.081702 21954 consensus_queue.cc:260] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.082312 21956 tablet_bootstrap.cc:654] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.090891 21955 tablet_bootstrap.cc:492] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:32.094056 21954 ts_tablet_manager.cc:1434] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.001s
W20260709 13:07:32.098343 21877 consensus_peers.cc:597] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:32.102615 21954 tablet_bootstrap.cc:492] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:32.104897 22081 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.105473 22081 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.107506 22081 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:32.108479 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:32.110668 21840 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:32.113394 21954 tablet_bootstrap.cc:654] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.113885 21955 tablet_bootstrap.cc:654] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.114552 21877 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:32.119045 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:32.128587 21757 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:32.129719 22011 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:32.130117 22011 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.130398 22011 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.135847 21956 tablet_bootstrap.cc:492] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:32.136366 21956 ts_tablet_manager.cc:1403] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.003s
I20260709 13:07:32.137523 21954 tablet_bootstrap.cc:492] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:32.138025 21954 ts_tablet_manager.cc:1403] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.011s
I20260709 13:07:32.139266 21956 raft_consensus.cc:359] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.139657 22011 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.140986 21954 raft_consensus.cc:359] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.141768 21954 raft_consensus.cc:385] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.142083 21954 raft_consensus.cc:740] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.142146 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:32.142776 21757 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.142952 21954 consensus_queue.cc:260] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.145399 21954 ts_tablet_manager.cc:1434] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:07:32.146469 21954 tablet_bootstrap.cc:492] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:32.140023 21956 raft_consensus.cc:385] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.149369 21956 raft_consensus.cc:740] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.150218 21956 consensus_queue.cc:260] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.150698 22011 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:32.152251 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:32.152766 21840 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.153195 21956 ts_tablet_manager.cc:1434] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:07:32.159032 21955 tablet_bootstrap.cc:492] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:32.159500 21955 ts_tablet_manager.cc:1403] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.069s	user 0.003s	sys 0.012s
I20260709 13:07:32.162611 21840 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:32.171919 21956 tablet_bootstrap.cc:492] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:32.171875 21877 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:32.172557 22011 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:32.174000 21955 raft_consensus.cc:359] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.175047 22011 raft_consensus.cc:697] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:32.175261 21955 raft_consensus.cc:385] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.175841 22011 consensus_queue.cc:237] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.175570 21955 raft_consensus.cc:740] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.179240 21955 consensus_queue.cc:260] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.186574 21954 tablet_bootstrap.cc:654] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.188182 21955 ts_tablet_manager.cc:1434] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 13:07:32.189087 22021 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:32.167187 21757 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:32.192903 21956 tablet_bootstrap.cc:654] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.196859 21955 tablet_bootstrap.cc:492] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
W20260709 13:07:32.202709 21711 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:32.212121 21955 tablet_bootstrap.cc:654] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.230088 21661 catalog_manager.cc:5697] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:32.236320 22021 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:32.237313 21956 tablet_bootstrap.cc:492] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:32.237792 21956 ts_tablet_manager.cc:1403] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.006s
I20260709 13:07:32.240355 21956 raft_consensus.cc:359] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.241637 21956 raft_consensus.cc:385] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.241984 21956 raft_consensus.cc:740] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.242754 21956 consensus_queue.cc:260] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.250316 21954 tablet_bootstrap.cc:492] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:32.250855 21954 ts_tablet_manager.cc:1403] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.105s	user 0.010s	sys 0.005s
I20260709 13:07:32.245337 21956 ts_tablet_manager.cc:1434] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:32.252753 22081 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.253237 22081 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.254920 21954 raft_consensus.cc:359] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.255590 21954 raft_consensus.cc:385] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.255841 21954 raft_consensus.cc:740] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.256493 22081 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:32.256467 21954 consensus_queue.cc:260] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.257349 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:07:32.258692 21877 leader_election.cc:343] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.259443 21956 tablet_bootstrap.cc:492] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:32.259791 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:32.260421 21757 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:32.261693 21879 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:32.262694 22081 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:32.263037 22081 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.263370 22081 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.267551 22121 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.268064 22121 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.258698 21954 ts_tablet_manager.cc:1434] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:32.270551 22121 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:32.270943 21954 tablet_bootstrap.cc:492] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:32.271817 21955 tablet_bootstrap.cc:492] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:32.272262 21955 ts_tablet_manager.cc:1403] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.076s	user 0.008s	sys 0.010s
I20260709 13:07:32.272673 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:32.274811 21955 raft_consensus.cc:359] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.275482 21955 raft_consensus.cc:385] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.275714 21955 raft_consensus.cc:740] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.276070 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:32.276312 21955 consensus_queue.cc:260] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.278036 21805 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:32.278882 21955 ts_tablet_manager.cc:1434] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:07:32.279381 22209 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:32.280189 21956 tablet_bootstrap.cc:654] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.281735 21954 tablet_bootstrap.cc:654] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.280601 21955 tablet_bootstrap.cc:492] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:32.285945 22081 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.290169 21955 tablet_bootstrap.cc:654] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.299484 22081 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:32.295324 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:32.300833 21757 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:32.305841 21728 consensus_peers.cc:597] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:32.312191 21956 tablet_bootstrap.cc:492] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:32.314092 21956 ts_tablet_manager.cc:1403] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.001s
I20260709 13:07:32.314312 22209 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.314329 22220 consensus_queue.cc:1048] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:32.315076 22209 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.317322 22209 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:32.319087 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:32.320119 21840 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.322641 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:32.327394 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:32.328315 21805 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:32.327603 21956 raft_consensus.cc:359] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.330916 21956 raft_consensus.cc:385] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.331264 21956 raft_consensus.cc:740] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.331676 21954 tablet_bootstrap.cc:492] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:32.331595 22121 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:32.332218 21954 ts_tablet_manager.cc:1403] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.002s
I20260709 13:07:32.332347 21956 consensus_queue.cc:260] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.333650 22081 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:32.334383 21757 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:32.335611 21954 raft_consensus.cc:359] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.336613 21954 raft_consensus.cc:385] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.336992 21954 raft_consensus.cc:740] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.335809 21956 ts_tablet_manager.cc:1434] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:07:32.338061 21954 consensus_queue.cc:260] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.340070 21879 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:32.340968 22220 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:32.341544 22220 raft_consensus.cc:697] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:07:32.342110 21877 leader_election.cc:343] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.343119 21838 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.342731 22220 consensus_queue.cc:237] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.346367 21954 ts_tablet_manager.cc:1434] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:07:32.347056 21956 tablet_bootstrap.cc:492] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:32.348551 22140 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:32.351272 21955 tablet_bootstrap.cc:492] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:32.351876 21955 ts_tablet_manager.cc:1403] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.072s	user 0.007s	sys 0.008s
I20260709 13:07:32.347618 21954 tablet_bootstrap.cc:492] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:32.369704 22021 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.370201 22021 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.375844 21956 tablet_bootstrap.cc:654] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.367626 22140 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.384012 21955 raft_consensus.cc:359] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.384560 22011 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.384763 21955 raft_consensus.cc:385] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.384009 22021 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:32.385080 21955 raft_consensus.cc:740] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.385082 22011 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.386201 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:32.386291 21955 consensus_queue.cc:260] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.386919 21910 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:32.387485 22011 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:32.387852 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:07:32.389533 21728 leader_election.cc:343] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.390592 21729 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:32.391297 22021 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:32.391659 22021 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.391955 22021 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.391860 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:32.391067 22196 consensus_queue.cc:1048] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:32.387490 22140 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.396248 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:32.396853 22140 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:07:32.397413 21877 leader_election.cc:343] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.398032 21757 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:32.400375 22021 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.402410 21955 ts_tablet_manager.cc:1434] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 13:07:32.407539 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:32.407733 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:32.408104 21955 tablet_bootstrap.cc:492] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
W20260709 13:07:32.408972 21728 leader_election.cc:343] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.408579 21910 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:32.411753 21729 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:32.412750 22192 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:32.413208 22192 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.413636 22192 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.451443 21954 tablet_bootstrap.cc:654] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.455454 21662 catalog_manager.cc:5697] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:32.486042 22220 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.488601 21956 tablet_bootstrap.cc:492] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:32.489081 21956 ts_tablet_manager.cc:1403] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.142s	user 0.043s	sys 0.030s
I20260709 13:07:32.495389 22021 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:32.497502 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:32.498307 21956 raft_consensus.cc:359] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.498987 21956 raft_consensus.cc:385] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.490002 22220 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:32.499230 21728 leader_election.cc:343] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.499241 21956 raft_consensus.cc:740] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.501122 22220 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:32.500823 21956 consensus_queue.cc:260] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.502791 21956 ts_tablet_manager.cc:1434] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:07:32.504071 21956 tablet_bootstrap.cc:492] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:32.504815 22192 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.510193 21840 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.512861 22021 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.513218 22021 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:32.514549 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 102920us
I20260709 13:07:32.517943 21879 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:32.519345 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:32.519810 22021 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:07:32.520902 21728 leader_election.cc:343] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.521539 22220 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.522321 22011 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:32.522179 22220 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.522545 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:32.522825 22011 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.523249 22011 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.532387 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:32.533092 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:32.533092 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:07:32.534247 21728 leader_election.cc:343] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.535212 21954 tablet_bootstrap.cc:492] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:32.535713 21954 ts_tablet_manager.cc:1403] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.188s	user 0.013s	sys 0.010s
W20260709 13:07:32.536722 21877 leader_election.cc:343] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.534682 21913 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.546546 22209 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.547086 22209 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.549680 21955 tablet_bootstrap.cc:654] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.549237 22209 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:32.555526 22220 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:32.566349 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:32.554050 22192 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:32.560765 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:07:32.569548 21877 leader_election.cc:343] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.575531 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:32.563376 21913 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
W20260709 13:07:32.587281 21879 leader_election.cc:343] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.588951 21879 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:32.586211 22196 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:32.592824 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:32.595031 22246 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:32.597187 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 52408.6us
I20260709 13:07:32.597935 22011 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:32.600945 21879 leader_election.cc:343] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.601373 21879 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:32.603797 21912 raft_consensus.cc:2393] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 1: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:07:32.604322 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:32.603242 22243 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:32.605383 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:07:32.612676 21729 leader_election.cc:343] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.613299 21729 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:32.614210 22021 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:32.614403 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:32.615224 21764 raft_consensus.cc:2393] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 1: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:07:32.616320 21729 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:32.617079 22194 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:32.617642 22194 raft_consensus.cc:697] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:07:32.618521 22194 consensus_queue.cc:237] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.619604 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:32.623940 21729 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:32.624084 21956 tablet_bootstrap.cc:654] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.613888 22011 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:07:32.624982 21877 leader_election.cc:343] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.627502 21804 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:32.631631 22121 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:32.634155 22021 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:32.635355 21956 tablet_bootstrap.cc:492] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:32.635836 21956 ts_tablet_manager.cc:1403] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.132s	user 0.008s	sys 0.002s
I20260709 13:07:32.638406 21956 raft_consensus.cc:359] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.639228 21956 raft_consensus.cc:385] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.639484 21956 raft_consensus.cc:740] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.640779 21879 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:32.640228 21956 consensus_queue.cc:260] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.641505 21954 raft_consensus.cc:359] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.642273 21954 raft_consensus.cc:385] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.642642 21954 raft_consensus.cc:740] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.642657 22246 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:32.643060 21956 ts_tablet_manager.cc:1434] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:32.643522 21954 consensus_queue.cc:260] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.644165 21956 tablet_bootstrap.cc:492] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:32.652225 21956 tablet_bootstrap.cc:654] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.663065 21956 tablet_bootstrap.cc:492] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:32.663535 21956 ts_tablet_manager.cc:1403] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.002s
I20260709 13:07:32.666424 22021 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.666159 21956 raft_consensus.cc:359] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.666944 21956 raft_consensus.cc:385] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.666886 22021 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.667326 21956 raft_consensus.cc:740] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.669719 22021 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:32.668103 21956 consensus_queue.cc:260] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.671500 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:32.672224 22194 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.673012 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:32.672712 22194 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:32.674556 21728 leader_election.cc:343] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.675101 22194 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:32.676893 21955 tablet_bootstrap.cc:492] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:32.676954 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:32.678052 21955 ts_tablet_manager.cc:1403] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.270s	user 0.017s	sys 0.008s
I20260709 13:07:32.678342 21954 ts_tablet_manager.cc:1434] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.142s	user 0.003s	sys 0.004s
W20260709 13:07:32.678269 21728 leader_election.cc:343] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.679605 21954 tablet_bootstrap.cc:492] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:32.680306 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:32.680491 21955 raft_consensus.cc:359] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.681169 21955 raft_consensus.cc:385] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.681455 21955 raft_consensus.cc:740] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.682067 21955 consensus_queue.cc:260] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.683666 21956 ts_tablet_manager.cc:1434] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.002s
I20260709 13:07:32.684610 21956 tablet_bootstrap.cc:492] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
W20260709 13:07:32.683964 21729 leader_election.cc:343] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.690834 21729 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:32.692092 22140 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:32.693014 21729 leader_election.cc:343] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.684156 22011 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:07:32.695978 21729 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:32.697353 22021 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:32.686074 21955 ts_tablet_manager.cc:1434] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:07:32.709919 21955 tablet_bootstrap.cc:492] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:32.710224 21838 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.716972 21956 tablet_bootstrap.cc:654] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.718369 21954 tablet_bootstrap.cc:654] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.734198 21956 tablet_bootstrap.cc:492] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:32.734673 21956 ts_tablet_manager.cc:1403] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.002s
I20260709 13:07:32.737227 21956 raft_consensus.cc:359] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.737902 21956 raft_consensus.cc:385] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.738173 21956 raft_consensus.cc:740] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.738607 21955 tablet_bootstrap.cc:654] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.739485 21954 tablet_bootstrap.cc:492] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:32.744372 21954 ts_tablet_manager.cc:1403] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.065s	user 0.013s	sys 0.005s
I20260709 13:07:32.746982 21954 raft_consensus.cc:359] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.747668 21954 raft_consensus.cc:385] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.747929 21954 raft_consensus.cc:740] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
W20260709 13:07:32.748484 21729 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.20.40.62:38057, user_credentials={real_user=slave}} blocked reactor thread for 49620.6us
I20260709 13:07:32.748556 21954 consensus_queue.cc:260] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.750638 21954 ts_tablet_manager.cc:1434] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:32.751713 21954 tablet_bootstrap.cc:492] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:32.757710 21954 tablet_bootstrap.cc:654] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.738873 21956 consensus_queue.cc:260] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.762132 21956 ts_tablet_manager.cc:1434] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:07:32.763826 21956 tablet_bootstrap.cc:492] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:32.769654 21956 tablet_bootstrap.cc:654] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.778132 21956 tablet_bootstrap.cc:492] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:32.778827 21956 ts_tablet_manager.cc:1403] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.004s
I20260709 13:07:32.783416 21954 tablet_bootstrap.cc:492] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:32.783898 21954 ts_tablet_manager.cc:1403] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.032s	user 0.005s	sys 0.007s
I20260709 13:07:32.786496 21954 raft_consensus.cc:359] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.787328 21954 raft_consensus.cc:385] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.787601 21954 raft_consensus.cc:740] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.789287 21954 consensus_queue.cc:260] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.785351 21660 catalog_manager.cc:5697] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:32.793468 21954 ts_tablet_manager.cc:1434] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:07:32.791409 21956 raft_consensus.cc:359] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.795107 22246 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:32.803473 21954 tablet_bootstrap.cc:492] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:32.800384 22011 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:32.810202 21954 tablet_bootstrap.cc:654] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.803172 21956 raft_consensus.cc:385] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.813580 21956 raft_consensus.cc:740] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.814352 21956 consensus_queue.cc:260] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.816636 21956 ts_tablet_manager.cc:1434] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.037s	user 0.002s	sys 0.004s
I20260709 13:07:32.817731 21956 tablet_bootstrap.cc:492] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:32.824848 21956 tablet_bootstrap.cc:654] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.838065 21954 tablet_bootstrap.cc:492] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:32.838599 21954 ts_tablet_manager.cc:1403] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.004s
I20260709 13:07:32.841634 21956 tablet_bootstrap.cc:492] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:32.841521 21954 raft_consensus.cc:359] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.842196 21956 ts_tablet_manager.cc:1403] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.002s
I20260709 13:07:32.842391 21954 raft_consensus.cc:385] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.842833 21954 raft_consensus.cc:740] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.843513 21954 consensus_queue.cc:260] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.845072 21956 raft_consensus.cc:359] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.845841 21956 raft_consensus.cc:385] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.845920 21954 ts_tablet_manager.cc:1434] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:32.846190 21956 raft_consensus.cc:740] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.847064 21954 tablet_bootstrap.cc:492] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:32.846917 21956 consensus_queue.cc:260] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.848708 21838 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:32.849231 21956 ts_tablet_manager.cc:1434] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:07:32.850265 21956 tablet_bootstrap.cc:492] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:32.854243 21954 tablet_bootstrap.cc:654] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.856863 21956 tablet_bootstrap.cc:654] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.867801 22011 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:32.871984 21956 tablet_bootstrap.cc:492] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:32.872510 21956 ts_tablet_manager.cc:1403] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.006s
I20260709 13:07:32.875638 21954 tablet_bootstrap.cc:492] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:32.876117 21954 ts_tablet_manager.cc:1403] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.009s
I20260709 13:07:32.876505 21955 tablet_bootstrap.cc:492] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:32.876912 21955 ts_tablet_manager.cc:1403] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.167s	user 0.023s	sys 0.034s
I20260709 13:07:32.877285 21956 raft_consensus.cc:359] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.878070 21956 raft_consensus.cc:385] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.878377 21956 raft_consensus.cc:740] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.879238 21956 consensus_queue.cc:260] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.879467 21955 raft_consensus.cc:359] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.880193 21955 raft_consensus.cc:385] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.880472 21955 raft_consensus.cc:740] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.881178 21955 consensus_queue.cc:260] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.881603 21956 ts_tablet_manager.cc:1434] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:07:32.886765 21956 tablet_bootstrap.cc:492] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:32.878954 21954 raft_consensus.cc:359] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.887274 21954 raft_consensus.cc:385] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:32.887835 21954 raft_consensus.cc:740] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:32.888520 21954 consensus_queue.cc:260] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.890793 21954 ts_tablet_manager.cc:1434] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:07:32.891881 21955 ts_tablet_manager.cc:1434] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:07:32.892969 21955 tablet_bootstrap.cc:492] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:32.895032 21954 tablet_bootstrap.cc:492] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:32.895839 21956 tablet_bootstrap.cc:654] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.912585 22243 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.913111 22243 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.920079 22243 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:32.922353 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:32.923031 21762 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:32.923408 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:32.924284 21879 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:32.925490 22246 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:32.926023 22246 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.926519 22246 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:32.927750 21877 leader_election.cc:343] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:32.937640 22285 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.937997 21955 tablet_bootstrap.cc:654] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:32.938463 22285 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.972016 22011 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.972615 22011 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.974447 22243 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.975100 22243 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.965580 22196 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.980511 22196 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.983860 22021 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.984340 22021 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:32.992435 22011 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:32.993973 22021 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:32.996901 21956 tablet_bootstrap.cc:492] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:32.997349 21956 ts_tablet_manager.cc:1403] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.111s	user 0.010s	sys 0.021s
I20260709 13:07:33.002795 21954 tablet_bootstrap.cc:654] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.006345 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:33.006682 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:33.007175 21764 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:33.007550 21910 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:33.009073 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:33.009770 21758 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 0.
I20260709 13:07:33.010188 22196 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:33.011591 22243 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:33.012087 21956 raft_consensus.cc:359] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.013037 21956 raft_consensus.cc:385] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.013396 21956 raft_consensus.cc:740] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:33.015930 21879 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:32.998225 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:33.023957 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:33.025094 21956 consensus_queue.cc:260] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.025872 22081 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:33.030345 22081 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.030697 22081 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.034237 21956 ts_tablet_manager.cc:1434] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.000s
I20260709 13:07:33.035708 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:07:33.031960 21728 leader_election.cc:343] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.036378 21910 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 0.
I20260709 13:07:33.028024 21762 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:33.028357 21805 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:33.039852 21956 tablet_bootstrap.cc:492] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:33.029217 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:33.056586 21955 tablet_bootstrap.cc:492] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:33.057137 21955 ts_tablet_manager.cc:1403] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.164s	user 0.025s	sys 0.043s
I20260709 13:07:33.056499 21758 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:33.038926 21879 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:33.059288 22196 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:33.059675 22196 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.060012 22196 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.059834 21879 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:33.060874 22011 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:33.061281 22011 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.061138 21955 raft_consensus.cc:359] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.061743 22011 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.061923 21955 raft_consensus.cc:385] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.062279 21955 raft_consensus.cc:740] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
W20260709 13:07:33.052424 21940 tablet.cc:2406] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:07:33.062994 21955 consensus_queue.cc:260] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.045756 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:33.066442 21729 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:33.067262 22194 raft_consensus.cc:2804] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:33.067592 22194 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.067905 22194 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.068236 22280 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:33.071702 22121 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:33.072118 22121 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.035194 22285 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:33.073844 21954 tablet_bootstrap.cc:492] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:33.074337 21954 ts_tablet_manager.cc:1403] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.179s	user 0.020s	sys 0.020s
W20260709 13:07:33.077359 21877 leader_election.cc:343] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.074864 22121 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.112411 22243 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.114446 22243 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.116693 22243 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:07:33.118209 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 80570.2us
I20260709 13:07:33.119707 22140 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.119993 21954 raft_consensus.cc:359] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.120689 21954 raft_consensus.cc:385] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.120975 21954 raft_consensus.cc:740] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:33.073689 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:07:33.070065 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 44964.8us
I20260709 13:07:33.121999 21954 consensus_queue.cc:260] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.123041 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:33.123703 21838 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:33.120255 22140 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.129238 22140 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:33.132738 21954 ts_tablet_manager.cc:1434] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 13:07:33.133929 21954 tablet_bootstrap.cc:492] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
W20260709 13:07:33.137990 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 60671.8us
I20260709 13:07:33.139783 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:33.140425 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:33.140987 21955 ts_tablet_manager.cc:1434] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.000s
I20260709 13:07:33.142614 21955 tablet_bootstrap.cc:492] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:33.137296 22121 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.146030 21956 tablet_bootstrap.cc:654] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:33.155218 21728 leader_election.cc:343] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.151556 22194 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.156373 22121 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:33.156397 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:33.144971 22081 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.157157 21764 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.158002 22194 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:33.159078 21954 tablet_bootstrap.cc:654] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.158871 22081 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:33.173730 22011 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.176754 22011 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:33.162279 22246 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.176575 22194 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.185881 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:33.186173 22194 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.189076 22194 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:07:33.205420 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 91802.4us
I20260709 13:07:33.206965 22246 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:07:33.208843 21728 leader_election.cc:343] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.210246 21955 tablet_bootstrap.cc:654] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.214402 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:33.215052 21757 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.217568 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:33.218236 21911 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:33.221421 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:33.222062 21912 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.222642 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:33.223264 21759 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.224361 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:33.225663 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:07:33.228580 21877 leader_election.cc:343] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.230611 21764 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:07:33.230856 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:33.231510 21761 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.237619 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:07:33.243855 21877 leader_election.cc:343] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:33.249965 21879 leader_election.cc:343] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.250387 21879 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:33.259704 21729 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:07:33.263749 21729 leader_election.cc:343] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.270136 22243 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:33.275058 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:33.276018 21914 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:33.280714 21728 leader_election.cc:343] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.283313 21728 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:33.284881 22021 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:33.288487 21711 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:33.293138 22021 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.293931 22021 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.270658 22194 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:33.303819 22021 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:33.305433 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:33.257972 22196 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:33.306679 21728 consensus_peers.cc:597] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:33.307180 21728 leader_election.cc:343] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.310528 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:33.278225 21805 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:33.304092 22194 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.316505 21956 tablet_bootstrap.cc:492] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:33.317003 21956 ts_tablet_manager.cc:1403] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.277s	user 0.007s	sys 0.042s
W20260709 13:07:33.320381 22311 log.cc:927] Time spent T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:07:33.319796 22285 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:33.314428 22194 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.324875 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:07:33.318758 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 56261.6us
I20260709 13:07:33.327656 22285 raft_consensus.cc:697] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:07:33.329340 21912 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:07:33.327898 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:33.337206 21909 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:33.330979 22196 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:33.337296 22285 consensus_queue.cc:237] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.339658 21729 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:33.334002 21759 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:33.342664 21956 raft_consensus.cc:359] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.343413 21956 raft_consensus.cc:385] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.344165 21956 raft_consensus.cc:740] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:33.335991 21954 tablet_bootstrap.cc:492] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:33.345000 21956 consensus_queue.cc:260] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.345698 21954 ts_tablet_manager.cc:1403] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.212s	user 0.037s	sys 0.049s
I20260709 13:07:33.347221 21879 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:33.328130 22309 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.335492 21761 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:33.357982 21956 ts_tablet_manager.cc:1434] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.002s
I20260709 13:07:33.355698 22309 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.353729 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:33.360198 21914 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:07:33.364078 21762 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.364794 22309 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:33.365873 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:33.368752 21757 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:33.350405 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:07:33.371366 21879 leader_election.cc:343] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.351819 22196 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:33.372644 21879 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:33.375377 21879 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:33.376588 22011 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:33.376835 22315 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:33.381666 22315 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.382166 22315 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.379211 22220 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:33.385236 22011 raft_consensus.cc:697] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:33.386543 22011 consensus_queue.cc:237] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.401861 21955 tablet_bootstrap.cc:492] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:33.402570 21955 ts_tablet_manager.cc:1403] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.260s	user 0.006s	sys 0.009s
I20260709 13:07:33.390074 22220 raft_consensus.cc:697] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:33.416740 22220 consensus_queue.cc:237] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.428509 22192 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.429070 22192 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.431298 22192 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:33.383384 22196 raft_consensus.cc:697] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:33.433670 22196 consensus_queue.cc:237] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.437800 21956 tablet_bootstrap.cc:492] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:33.442405 21729 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:07:33.449010 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 72132.9us
I20260709 13:07:33.449787 22192 raft_consensus.cc:2804] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:33.455858 22192 raft_consensus.cc:697] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:07:33.453413 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:33.456815 22192 consensus_queue.cc:237] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.459543 21954 raft_consensus.cc:359] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.460377 21954 raft_consensus.cc:385] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.460671 21954 raft_consensus.cc:740] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:33.461462 21954 consensus_queue.cc:260] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:33.462337 21728 leader_election.cc:343] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.462998 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:33.464076 21954 ts_tablet_manager.cc:1434] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.118s	user 0.006s	sys 0.010s
I20260709 13:07:33.465274 21954 tablet_bootstrap.cc:492] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:33.468330 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:33.468853 21840 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.471405 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:33.472687 21762 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:33.475720 21840 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:33.478176 21879 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:33.480408 22319 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:33.481096 22319 raft_consensus.cc:697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:33.481874 21954 tablet_bootstrap.cc:654] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.482734 22319 consensus_queue.cc:237] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.497387 21955 raft_consensus.cc:359] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.498133 21955 raft_consensus.cc:385] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.498543 21955 raft_consensus.cc:740] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:33.499459 21955 consensus_queue.cc:260] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.496542 22315 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:33.516948 21729 leader_election.cc:343] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.517390 21729 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:33.518131 22140 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:33.519131 22140 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.519605 22140 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.521341 22140 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:33.524230 22194 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.524405 21660 catalog_manager.cc:5697] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 1 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.526521 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:33.527437 22194 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:07:33.528126 21728 leader_election.cc:343] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.528219 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:33.530324 22315 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:33.530778 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:33.515282 22220 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.532037 21955 ts_tablet_manager.cc:1434] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.129s	user 0.003s	sys 0.005s
W20260709 13:07:33.533119 21728 leader_election.cc:343] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:33.534046 21728 leader_election.cc:343] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.535430 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:33.535620 22220 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.535986 21912 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.549817 21955 tablet_bootstrap.cc:492] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:33.555473 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:33.551292 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:33.560060 21913 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:33.571931 21729 leader_election.cc:343] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.572568 21729 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:33.578706 21661 catalog_manager.cc:5697] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.580904 21661 catalog_manager.cc:5697] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.582901 21661 catalog_manager.cc:5697] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.585680 22192 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:33.573251 21956 tablet_bootstrap.cc:654] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.564685 21662 catalog_manager.cc:5697] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.601373 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:33.602128 21761 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:33.599316 22220 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:33.612054 21879 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:33.614626 22220 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:33.612309 21954 tablet_bootstrap.cc:492] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:33.616087 21954 ts_tablet_manager.cc:1403] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.151s	user 0.025s	sys 0.034s
I20260709 13:07:33.612820 21912 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:07:33.615653 22220 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.622056 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:33.620654 21729 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:07:33.629109 21877 leader_election.cc:343] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.629417 22315 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:33.617097 21913 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:07:33.629940 22315 raft_consensus.cc:697] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:07:33.630852 21877 leader_election.cc:343] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.617456 22220 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.642916 21955 tablet_bootstrap.cc:654] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.642829 21729 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:07:33.643397 21877 leader_election.cc:343] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.645993 22192 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:33.650486 22192 raft_consensus.cc:697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:07:33.651345 22192 consensus_queue.cc:237] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.630923 22315 consensus_queue.cc:237] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:33.655884 21877 leader_election.cc:343] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.656302 21877 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:33.661964 22196 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:33.662122 21954 raft_consensus.cc:359] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.663028 21954 raft_consensus.cc:385] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.663321 21954 raft_consensus.cc:740] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:33.664057 21954 consensus_queue.cc:260] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.668059 21956 tablet_bootstrap.cc:492] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:33.668923 21956 ts_tablet_manager.cc:1403] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.274s	user 0.013s	sys 0.009s
I20260709 13:07:33.674687 21954 ts_tablet_manager.cc:1434] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.058s	user 0.004s	sys 0.004s
I20260709 13:07:33.676213 21954 tablet_bootstrap.cc:492] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:33.673031 22220 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.683813 22220 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:33.685149 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:33.688236 21956 raft_consensus.cc:359] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.688858 21956 raft_consensus.cc:385] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.689086 21956 raft_consensus.cc:740] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:33.689960 21956 consensus_queue.cc:260] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.689682 21762 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:33.693962 21877 leader_election.cc:343] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.694478 21955 tablet_bootstrap.cc:492] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:33.694953 21955 ts_tablet_manager.cc:1403] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.152s	user 0.010s	sys 0.011s
I20260709 13:07:33.698757 21955 raft_consensus.cc:359] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.699565 21955 raft_consensus.cc:385] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.699859 21955 raft_consensus.cc:740] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:33.700585 21955 consensus_queue.cc:260] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.704596 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:33.706413 21955 ts_tablet_manager.cc:1434] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:07:33.707231 21955 tablet_bootstrap.cc:492] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:33.717181 21956 ts_tablet_manager.cc:1434] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:07:33.715799 21762 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
W20260709 13:07:33.720350 21877 leader_election.cc:343] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.722196 21956 tablet_bootstrap.cc:492] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:33.725019 21879 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:33.725544 21955 tablet_bootstrap.cc:654] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.726274 22196 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:33.728772 22196 raft_consensus.cc:697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:33.733415 21954 tablet_bootstrap.cc:654] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.738484 22209 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.739283 22285 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:33.740294 22209 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.744048 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:07:33.746289 21805 leader_election.cc:343] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.733753 22196 consensus_queue.cc:237] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.749922 22209 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:33.762038 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:33.762804 21913 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 0.
I20260709 13:07:33.759943 22140 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.767743 21955 tablet_bootstrap.cc:492] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:33.765730 22140 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.782487 21955 ts_tablet_manager.cc:1403] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.075s	user 0.005s	sys 0.018s
I20260709 13:07:33.786247 22140 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:33.787173 21956 tablet_bootstrap.cc:654] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.787318 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:33.787199 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:33.785562 21955 raft_consensus.cc:359] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.788467 21955 raft_consensus.cc:385] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.788961 21955 raft_consensus.cc:740] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
W20260709 13:07:33.789359 21728 leader_election.cc:343] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:33.790126 21729 leader_election.cc:343] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.790895 21729 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:33.791719 21955 consensus_queue.cc:260] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.794445 22140 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:33.801008 21804 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:07:33.803110 22209 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:33.803512 22209 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.803884 22209 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.805612 21954 tablet_bootstrap.cc:492] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:33.806222 21954 ts_tablet_manager.cc:1403] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.130s	user 0.021s	sys 0.028s
I20260709 13:07:33.809041 21955 ts_tablet_manager.cc:1434] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:07:33.811686 21954 raft_consensus.cc:359] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.812620 21954 raft_consensus.cc:385] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.812968 21954 raft_consensus.cc:740] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:33.814100 21954 consensus_queue.cc:260] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.817858 21954 ts_tablet_manager.cc:1434] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:07:33.818722 21954 tablet_bootstrap.cc:492] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:33.832628 21954 tablet_bootstrap.cc:654] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.833624 21955 tablet_bootstrap.cc:492] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:33.837889 22209 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.838981 21662 catalog_manager.cc:5697] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.844825 21662 catalog_manager.cc:5697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:33.867871 21956 tablet_bootstrap.cc:492] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:33.868386 21956 ts_tablet_manager.cc:1403] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.146s	user 0.022s	sys 0.013s
I20260709 13:07:33.880440 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:33.880944 22209 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:33.882555 21955 tablet_bootstrap.cc:654] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:33.883291 21805 leader_election.cc:343] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.895340 21661 catalog_manager.cc:5697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.907481 21661 catalog_manager.cc:5697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:33.911648 21954 tablet_bootstrap.cc:492] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:33.912158 21954 ts_tablet_manager.cc:1403] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.094s	user 0.015s	sys 0.029s
I20260709 13:07:33.912212 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:33.913024 21912 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.916359 21954 raft_consensus.cc:359] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.917663 21954 raft_consensus.cc:385] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.918010 21954 raft_consensus.cc:740] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:33.918792 21954 consensus_queue.cc:260] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.920521 21954 ts_tablet_manager.cc:1434] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:07:33.921638 21954 tablet_bootstrap.cc:492] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:33.922324 22209 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.922816 22209 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.925673 22209 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:33.928229 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:33.929101 21913 raft_consensus.cc:2393] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 1: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:07:33.929675 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:33.934100 22194 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.934644 22194 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.937602 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:07:33.939085 21728 leader_election.cc:343] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.940052 22194 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:33.940975 21912 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:07:33.942469 21956 raft_consensus.cc:359] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.943133 21956 raft_consensus.cc:385] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:33.943401 21956 raft_consensus.cc:740] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:33.944063 21956 consensus_queue.cc:260] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:33.947049 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:33.949633 21954 tablet_bootstrap.cc:654] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:33.951213 21805 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:07:33.951800 21729 leader_election.cc:343] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:33.952406 21729 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:33.952891 22121 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:33.954577 22243 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:33.956144 22243 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:33.957631 21804 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:07:33.957964 22140 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:33.958226 21956 ts_tablet_manager.cc:1434] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.090s	user 0.005s	sys 0.003s
I20260709 13:07:33.959267 21956 tablet_bootstrap.cc:492] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:33.969597 21955 tablet_bootstrap.cc:492] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:33.970266 21955 ts_tablet_manager.cc:1403] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.148s	user 0.011s	sys 0.003s
I20260709 13:07:33.964066 22209 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:07:33.983371 21877 consensus_peers.cc:597] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:33.970726 22285 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.009328 21956 tablet_bootstrap.cc:654] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.009833 22121 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:34.020342 22209 raft_consensus.cc:697] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:07:33.989512 22285 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.023306 22315 consensus_queue.cc:1048] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
W20260709 13:07:34.032164 21728 consensus_peers.cc:597] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:34.027976 22285 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:07:34.042485 21877 consensus_peers.cc:597] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:34.043107 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 54491.5us
W20260709 13:07:34.051306 21877 consensus_peers.cc:597] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:34.054981 21955 raft_consensus.cc:359] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.055527 21955 raft_consensus.cc:385] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.055797 21955 raft_consensus.cc:740] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.056388 21955 consensus_queue.cc:260] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.054533 22343 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:07:34.041280 22246 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:07:34.065685 21955 ts_tablet_manager.cc:1434] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.000s
I20260709 13:07:34.066819 21955 tablet_bootstrap.cc:492] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:34.061811 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:34.069053 21912 raft_consensus.cc:2393] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 1: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:07:34.021520 22209 consensus_queue.cc:237] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.077229 21954 tablet_bootstrap.cc:492] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:34.079120 21954 ts_tablet_manager.cc:1403] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.158s	user 0.035s	sys 0.016s
I20260709 13:07:34.093067 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:34.093940 21761 raft_consensus.cc:2393] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 1: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:07:34.133229 21956 tablet_bootstrap.cc:492] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:34.133886 21956 ts_tablet_manager.cc:1403] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.175s	user 0.020s	sys 0.016s
I20260709 13:07:34.137277 21954 raft_consensus.cc:359] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.136626 21839 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.138115 21955 tablet_bootstrap.cc:654] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.138273 21954 raft_consensus.cc:385] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.138595 21954 raft_consensus.cc:740] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.144778 21805 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:34.149341 22121 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.154691 21954 consensus_queue.cc:260] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.173894 22246 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:07:34.175416 21660 catalog_manager.cc:5697] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 1 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:34.191166 22196 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.191660 22196 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.205258 21954 ts_tablet_manager.cc:1434] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.126s	user 0.010s	sys 0.001s
I20260709 13:07:34.206776 22196 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:34.206650 22246 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:34.207275 22243 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:34.209065 21956 raft_consensus.cc:359] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.205768 22319 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.211328 21956 raft_consensus.cc:385] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.211670 21956 raft_consensus.cc:740] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.213146 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:34.213994 22315 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:34.214157 21956 consensus_queue.cc:260] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.222915 21954 tablet_bootstrap.cc:492] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239: Bootstrap starting.
I20260709 13:07:34.221794 22319 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.229481 22121 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:34.230278 21835 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:34.236932 21955 tablet_bootstrap.cc:492] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:34.237421 21955 ts_tablet_manager.cc:1403] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.171s	user 0.019s	sys 0.017s
I20260709 13:07:34.238749 21877 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:34.227959 22319 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:34.241694 22246 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:34.242090 22246 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.242585 22246 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:34.249487 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:34.250222 21757 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:34.253919 21955 raft_consensus.cc:359] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.255520 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:34.241127 21956 ts_tablet_manager.cc:1434] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.107s	user 0.008s	sys 0.002s
I20260709 13:07:34.259142 21956 tablet_bootstrap.cc:492] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
W20260709 13:07:34.263569 21877 consensus_peers.cc:597] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:34.266101 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:34.266795 21762 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
W20260709 13:07:34.266795 21877 leader_election.cc:343] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.267830 22246 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.257185 21954 tablet_bootstrap.cc:654] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.265884 21956 tablet_bootstrap.cc:654] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.265532 21955 raft_consensus.cc:385] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.283051 21955 raft_consensus.cc:740] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.286603 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:34.287341 21761 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:34.288244 21955 consensus_queue.cc:260] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.293735 21879 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:34.295441 22308 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:34.302332 21955 ts_tablet_manager.cc:1434] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 13:07:34.303551 21955 tablet_bootstrap.cc:492] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:34.296532 22308 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:34.334576 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 120892us
I20260709 13:07:34.341570 22309 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.342343 22309 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.308121 22308 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.335351 22280 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:07:34.345568 22309 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:34.346709 22280 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:34.335378 22246 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:34.349553 21955 tablet_bootstrap.cc:654] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.349871 21761 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:07:34.350878 22194 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.351358 22194 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.353375 22194 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:34.360512 22308 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:34.366602 21728 consensus_peers.cc:597] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:34.371215 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:34.371886 21835 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:34.369095 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:34.375074 22318 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.376024 22318 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:34.392976 21877 leader_election.cc:343] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.393308 21954 tablet_bootstrap.cc:492] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239: No bootstrap required, opened a new log
I20260709 13:07:34.393879 21954 ts_tablet_manager.cc:1403] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239: Time spent bootstrapping tablet: real 0.171s	user 0.011s	sys 0.006s
I20260709 13:07:34.398620 22318 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:07:34.401750 21711 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:34.410408 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:07:34.419092 21877 leader_election.cc:343] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.422101 22308 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:34.423197 21956 tablet_bootstrap.cc:492] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:34.423170 21954 raft_consensus.cc:359] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.423839 21956 ts_tablet_manager.cc:1403] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.165s	user 0.008s	sys 0.011s
I20260709 13:07:34.424067 21954 raft_consensus.cc:385] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.424387 21954 raft_consensus.cc:740] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Initialized, Role: FOLLOWER
W20260709 13:07:34.425670 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 57809.4us
W20260709 13:07:34.428448 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 60713.3us
I20260709 13:07:34.428094 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:07:34.434571 21877 leader_election.cc:343] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.436105 21954 consensus_queue.cc:260] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.425686 21835 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:07:34.443059 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:34.443730 21758 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.444239 21956 raft_consensus.cc:359] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.444972 21956 raft_consensus.cc:385] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.445276 21956 raft_consensus.cc:740] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.446974 21956 consensus_queue.cc:260] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.450106 21956 ts_tablet_manager.cc:1434] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:07:34.462383 21955 tablet_bootstrap.cc:492] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:34.463081 21955 ts_tablet_manager.cc:1403] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.160s	user 0.008s	sys 0.014s
I20260709 13:07:34.463096 21956 tablet_bootstrap.cc:492] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:34.471048 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:34.475973 21879 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:34.489959 21954 ts_tablet_manager.cc:1434] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239: Time spent starting tablet: real 0.096s	user 0.008s	sys 0.000s
I20260709 13:07:34.489354 21908 raft_consensus.cc:2393] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 1: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:07:34.493747 22308 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:34.504177 22308 raft_consensus.cc:697] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 2 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:34.488076 21758 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:34.530464 21879 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:34.533849 22308 consensus_queue.cc:237] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.534402 22196 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:34.534808 22365 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.535495 21762 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.541409 21833 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.545584 21955 raft_consensus.cc:359] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.576494 21955 raft_consensus.cc:385] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.576889 21955 raft_consensus.cc:740] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.594538 21955 consensus_queue.cc:260] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.546955 22343 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.051s
I20260709 13:07:34.547278 22365 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.601588 21955 ts_tablet_manager.cc:1434] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.138s	user 0.009s	sys 0.003s
I20260709 13:07:34.608702 22365 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:34.614277 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:07:34.620249 21728 leader_election.cc:343] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.665266 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:34.666306 21756 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
W20260709 13:07:34.666440 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 122148us
I20260709 13:07:34.668092 21956 tablet_bootstrap.cc:654] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.670945 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:34.672612 21728 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:34.673628 22365 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:34.682677 22209 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:34.688457 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:34.689581 21757 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:34.698323 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:34.702121 21911 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:34.703680 21956 tablet_bootstrap.cc:492] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:34.704454 21956 ts_tablet_manager.cc:1403] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.242s	user 0.014s	sys 0.005s
W20260709 13:07:34.710178 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 165197us
I20260709 13:07:34.711402 21956 raft_consensus.cc:359] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.712090 21956 raft_consensus.cc:385] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:34.712360 21956 raft_consensus.cc:740] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:34.712949 21956 consensus_queue.cc:260] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.726861 21955 tablet_bootstrap.cc:492] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:34.730705 21956 ts_tablet_manager.cc:1434] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:07:34.711149 22196 raft_consensus.cc:697] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:34.770442 21729 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:34.771201 21956 tablet_bootstrap.cc:492] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb: Bootstrap starting.
I20260709 13:07:34.776686 22367 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.776826 22365 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:34.777269 22365 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.776950 22196 consensus_queue.cc:237] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.777215 22367 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.777721 22365 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.779230 22367 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:34.784287 22365 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.787217 22365 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:34.788650 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:07:34.796888 21728 leader_election.cc:343] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.797726 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:34.802229 21879 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:34.803392 22319 raft_consensus.cc:2804] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:34.803784 22319 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.804131 22319 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.805121 21661 catalog_manager.cc:5697] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 2, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 2 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:34.806176 21728 leader_election.cc:343] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:34.812000 21879 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:34.814047 22377 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:34.814647 22377 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.816011 22319 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.814993 22377 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.817169 21956 tablet_bootstrap.cc:654] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:34.811981 21955 tablet_bootstrap.cc:654] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:34.907697 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 55864us
I20260709 13:07:34.879199 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:34.913544 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:34.929988 22121 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:07:34.935484 21910 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:34.935611 22121 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:34.923231 21908 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:34.937937 22366 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:35.013607 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 105275us
I20260709 13:07:35.014560 22366 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.093675 21956 tablet_bootstrap.cc:492] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb: No bootstrap required, opened a new log
I20260709 13:07:35.094152 21956 ts_tablet_manager.cc:1403] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb: Time spent bootstrapping tablet: real 0.325s	user 0.005s	sys 0.019s
I20260709 13:07:35.107165 22377 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.109045 22366 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:35.110936 22377 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:35.113000 21910 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
W20260709 13:07:35.113605 22384 log.cc:927] Time spent T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.066s	user 0.001s	sys 0.002s
I20260709 13:07:35.117357 22121 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:35.118669 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:35.126919 21955 tablet_bootstrap.cc:492] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:35.127684 21955 ts_tablet_manager.cc:1403] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.401s	user 0.022s	sys 0.034s
I20260709 13:07:35.131584 21955 raft_consensus.cc:359] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.132645 21955 raft_consensus.cc:385] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.133064 21955 raft_consensus.cc:740] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.133848 21955 consensus_queue.cc:260] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.159945 21955 ts_tablet_manager.cc:1434] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:07:35.161033 21955 tablet_bootstrap.cc:492] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
W20260709 13:07:35.168015 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 251794us
I20260709 13:07:35.173132 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:35.183140 21956 raft_consensus.cc:359] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.183879 21956 raft_consensus.cc:385] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.184144 21956 raft_consensus.cc:740] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.184201 22319 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:35.184789 21956 consensus_queue.cc:260] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.186554 21956 ts_tablet_manager.cc:1434] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.000s
I20260709 13:07:35.187482 21729 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:35.189045 22280 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:35.189415 22280 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.189849 22280 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.192546 22308 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.189128 21729 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:35.195580 22358 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.196051 22358 raft_consensus.cc:697] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:07:35.196815 22358 consensus_queue.cc:237] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.203423 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:35.212863 21804 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:35.192988 22308 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.219159 22393 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:35.221522 21877 leader_election.cc:343] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.205633 22121 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.220628 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:35.228111 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:35.235872 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:35.228315 22121 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.226213 22280 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.248942 21914 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 0.
I20260709 13:07:35.264468 21757 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:35.268573 22308 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:35.269043 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:35.269739 21765 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.271554 21955 tablet_bootstrap.cc:654] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.277004 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:35.277917 21763 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.280624 21835 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.272154 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:07:35.331550 21728 leader_election.cc:343] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.352674 21729 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:35.353516 22366 raft_consensus.cc:2804] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:35.353927 22366 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.354362 22366 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.356662 21763 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:35.359026 22280 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:35.365929 21840 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.369715 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:35.370473 21757 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 0.
I20260709 13:07:35.358170 22121 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:35.371485 21838 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:35.372107 22372 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:35.377931 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:07:35.387244 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:35.388077 21906 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.357942 21835 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:35.400007 22220 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:35.414140 21879 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:35.415134 21879 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
W20260709 13:07:35.426268 21877 leader_election.cc:343] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.433647 22377 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:35.432811 22308 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.436407 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:35.439638 22377 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.426578 22366 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:35.456895 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 81609.8us
I20260709 13:07:35.459223 21765 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:35.462188 21879 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:35.465516 22366 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:35.466194 21955 tablet_bootstrap.cc:492] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:35.466651 21955 ts_tablet_manager.cc:1403] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.306s	user 0.019s	sys 0.015s
I20260709 13:07:35.470520 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:35.471331 21955 raft_consensus.cc:359] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.471861 21955 raft_consensus.cc:385] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.472078 21955 raft_consensus.cc:740] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.472759 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:35.472659 21955 consensus_queue.cc:260] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.473266 21910 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.474946 21955 ts_tablet_manager.cc:1434] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:35.479693 21909 raft_consensus.cc:2393] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 1: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:07:35.455976 22308 raft_consensus.cc:697] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:35.457921 22377 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.481223 22308 consensus_queue.cc:237] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.479717 21906 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
W20260709 13:07:35.493022 21877 consensus_peers.cc:597] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:35.493253 22362 raft_consensus.cc:2804] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.493830 22362 raft_consensus.cc:697] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:35.494664 22362 consensus_queue.cc:237] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.495141 21910 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:07:35.498366 21804 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:35.498687 21955 tablet_bootstrap.cc:492] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:35.499855 21729 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:35.500864 21729 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:07:35.502617 22343 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:35.513357 21728 leader_election.cc:343] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.526957 22369 raft_consensus.cc:2804] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.527664 22369 raft_consensus.cc:697] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:07:35.515508 22358 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.528905 22358 raft_consensus.cc:697] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:07:35.529390 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:35.535965 22389 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:07:35.542804 22377 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.528565 22369 consensus_queue.cc:237] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.546516 21955 tablet_bootstrap.cc:654] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.545184 22377 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:07:35.558883 21728 leader_election.cc:343] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.557461 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:07:35.564644 21877 leader_election.cc:343] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:35.534706 22358 consensus_queue.cc:237] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.570421 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:35.571357 21758 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.595818 21661 catalog_manager.cc:5697] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:35.602756 21711 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:35.610519 21758 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:07:35.612079 21879 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:35.613348 22375 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:35.624173 22375 raft_consensus.cc:697] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:35.625095 22375 consensus_queue.cc:237] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.638748 21955 tablet_bootstrap.cc:492] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:35.639256 21955 ts_tablet_manager.cc:1403] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.141s	user 0.008s	sys 0.010s
I20260709 13:07:35.638542 21662 catalog_manager.cc:5697] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.720520 22391 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.721056 22391 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.723137 22391 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:35.724397 21955 raft_consensus.cc:359] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.734563 21955 raft_consensus.cc:385] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:35.733894 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 90744.5us
I20260709 13:07:35.725342 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:35.737795 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:35.751150 21805 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:35.753232 22209 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:35.754933 21834 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.796446 21955 raft_consensus.cc:740] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.797219 21955 consensus_queue.cc:260] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:07:35.798739 21728 consensus_peers.cc:597] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:35.801193 21955 ts_tablet_manager.cc:1434] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.162s	user 0.009s	sys 0.000s
I20260709 13:07:35.802142 21955 tablet_bootstrap.cc:492] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:35.809846 21955 tablet_bootstrap.cc:654] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.832271 21955 tablet_bootstrap.cc:492] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:35.833007 21955 ts_tablet_manager.cc:1403] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.014s
I20260709 13:07:35.835754 21955 raft_consensus.cc:359] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.836525 21955 raft_consensus.cc:385] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.836800 21955 raft_consensus.cc:740] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.837571 21955 consensus_queue.cc:260] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.840155 21955 ts_tablet_manager.cc:1434] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:35.841113 21955 tablet_bootstrap.cc:492] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:35.835675 21661 catalog_manager.cc:5697] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.846707 21661 catalog_manager.cc:5697] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.849714 21661 catalog_manager.cc:5697] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.851365 21955 tablet_bootstrap.cc:654] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.853555 22121 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.856559 22121 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.856781 22358 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:35.859454 22121 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:35.861749 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:35.865128 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:35.866600 21804 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:35.873571 22121 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:35.875247 21832 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.877170 21660 catalog_manager.cc:5697] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.879027 21660 catalog_manager.cc:5697] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.916348 21955 tablet_bootstrap.cc:492] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:35.917207 21955 ts_tablet_manager.cc:1403] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.014s
I20260709 13:07:35.917057 22376 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:35.940333 22375 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:35.920248 21955 raft_consensus.cc:359] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.952955 21955 raft_consensus.cc:385] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:35.953333 21955 raft_consensus.cc:740] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:35.957090 21955 consensus_queue.cc:260] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:35.959460 21955 ts_tablet_manager.cc:1434] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.000s
I20260709 13:07:35.960523 21955 tablet_bootstrap.cc:492] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:35.972714 22367 consensus_queue.cc:1048] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:35.983603 21955 tablet_bootstrap.cc:654] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:35.984555 21832 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:35.992647 22375 consensus_queue.cc:1048] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:36.003309 22194 consensus_queue.cc:1048] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:07:36.020732 21832 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.039304 21955 tablet_bootstrap.cc:492] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:36.039799 21955 ts_tablet_manager.cc:1403] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.080s	user 0.017s	sys 0.007s
I20260709 13:07:36.042383 21955 raft_consensus.cc:359] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:36.043167 21955 raft_consensus.cc:385] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.043432 21955 raft_consensus.cc:740] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.044013 21955 consensus_queue.cc:260] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:36.046089 21955 ts_tablet_manager.cc:1434] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:36.047039 21955 tablet_bootstrap.cc:492] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:36.053642 22375 consensus_queue.cc:1048] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:36.059417 21955 tablet_bootstrap.cc:654] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:36.060295 21728 consensus_peers.cc:597] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:36.090176 21728 consensus_peers.cc:597] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:36.098138 21955 tablet_bootstrap.cc:492] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:36.098697 21955 ts_tablet_manager.cc:1403] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.005s
W20260709 13:07:36.101871 21877 consensus_peers.cc:597] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:36.106283 21955 raft_consensus.cc:359] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:36.106978 21955 raft_consensus.cc:385] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.107224 21955 raft_consensus.cc:740] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.110430 21955 consensus_queue.cc:260] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:36.112695 21955 ts_tablet_manager.cc:1434] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:07:36.113602 21955 tablet_bootstrap.cc:492] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:36.119340 21955 tablet_bootstrap.cc:654] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.152072 21955 tablet_bootstrap.cc:492] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:36.152529 21955 ts_tablet_manager.cc:1403] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.015s
I20260709 13:07:36.162837 21955 raft_consensus.cc:359] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:36.163507 21955 raft_consensus.cc:385] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.163793 21955 raft_consensus.cc:740] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.164605 21955 consensus_queue.cc:260] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:36.166589 21955 ts_tablet_manager.cc:1434] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:07:36.168179 21955 tablet_bootstrap.cc:492] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:36.170889 22308 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:36.174917 21955 tablet_bootstrap.cc:654] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.200750 21955 tablet_bootstrap.cc:492] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:36.201200 21955 ts_tablet_manager.cc:1403] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.004s
I20260709 13:07:36.214636 21955 raft_consensus.cc:359] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:36.215328 21955 raft_consensus.cc:385] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.215598 21955 raft_consensus.cc:740] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.216208 21955 consensus_queue.cc:260] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:36.218251 21955 ts_tablet_manager.cc:1434] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:07:36.219399 21955 tablet_bootstrap.cc:492] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:36.219709 22121 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.220168 22121 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:36.225943 21955 tablet_bootstrap.cc:654] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.226359 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:36.227731 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:36.230275 21805 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:36.231564 22347 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:36.233321 22121 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:36.255489 22347 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.256108 22347 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:36.258176 22347 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:36.261847 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:36.264778 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:36.266964 21955 tablet_bootstrap.cc:492] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:36.267886 21955 ts_tablet_manager.cc:1403] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.049s	user 0.030s	sys 0.008s
I20260709 13:07:36.269022 21804 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:36.270136 22347 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:36.270759 21955 raft_consensus.cc:359] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:36.271473 21955 raft_consensus.cc:385] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.271760 21955 raft_consensus.cc:740] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.272416 21955 consensus_queue.cc:260] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:36.274660 21955 ts_tablet_manager.cc:1434] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:36.276394 21955 tablet_bootstrap.cc:492] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d: Bootstrap starting.
I20260709 13:07:36.282935 21955 tablet_bootstrap.cc:654] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:36.293282 21834 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.299510 21955 tablet_bootstrap.cc:492] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d: No bootstrap required, opened a new log
I20260709 13:07:36.300045 21955 ts_tablet_manager.cc:1403] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.007s
I20260709 13:07:36.302863 21955 raft_consensus.cc:359] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:36.303581 21955 raft_consensus.cc:385] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:36.304095 21955 raft_consensus.cc:740] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Initialized, Role: FOLLOWER
I20260709 13:07:36.304756 21955 consensus_queue.cc:260] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:36.307045 21955 ts_tablet_manager.cc:1434] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:07:36.402547 21834 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.413058 22347 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.413861 22347 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:36.416671 22347 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:36.417373 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:36.417948 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:36.419412 21805 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:36.420892 22347 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:36.457706 22347 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.458138 22347 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:36.459833 22347 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:36.460677 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:07:36.461786 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:07:36.463421 21804 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:07:36.464502 22347 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:36.512291 21832 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.625355 21832 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.659729 21832 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:36.713604 21834 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:37.038416 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:37.071774 22439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:37.073031 22440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:37.112062 22442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:37.113564 20640 server_base.cc:1061] running on GCE node
I20260709 13:07:37.117182 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:37.117570 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:37.117867 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602457117846 us; error 0 us; skew 500 ppm
I20260709 13:07:37.118610 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:37.123034 20640 webserver.cc:533] Webserver started at http://127.20.40.4:35001/ using document root <none> and password file <none>
I20260709 13:07:37.123754 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:37.124003 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:37.124490 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:37.126236 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-3-root/instance:
uuid: "8c6c2207af3d47b3acf352d81959f4dd"
format_stamp: "Formatted at 2026-07-09 13:07:37 on dist-test-slave-rnv4"
I20260709 13:07:37.131810 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:07:37.135568 22447 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:37.136772 20640 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:07:37.137172 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-3-root
uuid: "8c6c2207af3d47b3acf352d81959f4dd"
format_stamp: "Formatted at 2026-07-09 13:07:37 on dist-test-slave-rnv4"
I20260709 13:07:37.137614 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:37.182518 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:37.184937 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:37.189181 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:37.197149 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:37.197474 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:37.197796 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:37.198022 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:37.298269 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.4:37983
I20260709 13:07:37.298410 22509 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.4:37983 every 8 connection(s)
I20260709 13:07:37.325475 20640 auto_leader_rebalancer-test.cc:384] add a tserver: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:37.341960 22510 heartbeater.cc:344] Connected to a master server at 127.20.40.62:38057
I20260709 13:07:37.342445 22510 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:37.343334 22510 heartbeater.cc:507] Master 127.20.40.62:38057 requested a full tablet report, sending...
I20260709 13:07:37.345393 21662 ts_manager.cc:194] Registered new tserver with Master: 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:07:37.347040 21662 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52326
I20260709 13:07:37.822320 21764 consensus_queue.cc:237] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:37.831343 21906 raft_consensus.cc:1275] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:37.832068 21832 raft_consensus.cc:1275] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:37.833478 22194 consensus_queue.cc:1048] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:37.836287 22514 consensus_queue.cc:1048] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:37.861356 22194 raft_consensus.cc:2955] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:37.864652 21912 raft_consensus.cc:2955] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
W20260709 13:07:37.868040 21731 consensus_peers.cc:597] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 46dafcc946c640c6a029dd71c387264e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:37.875763 21836 raft_consensus.cc:2955] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:37.880980 21662 catalog_manager.cc:5697] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.936110 21833 consensus_queue.cc:237] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:37.954253 21906 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:37.955379 21764 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:37.956884 22522 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:37.961650 22121 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:37.984042 22522 raft_consensus.cc:2955] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
W20260709 13:07:37.991820 21806 consensus_peers.cc:597] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: af88ee4a85a24987b0c1513dd7ce39ed. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:37.992030 21906 raft_consensus.cc:2955] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:37.993487 21764 raft_consensus.cc:2955] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:38.011282 21660 catalog_manager.cc:5697] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:38.073030 21906 consensus_queue.cc:237] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:38.084549 21833 raft_consensus.cc:1275] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:38.086187 22308 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:38.089847 21764 raft_consensus.cc:1275] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:38.092038 22246 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:38.116791 21880 consensus_peers.cc:597] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5871b64f4d9b45f99140a286177ff44f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:38.117569 22246 raft_consensus.cc:2955] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:38.122216 21832 raft_consensus.cc:2955] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:38.138407 21906 consensus_queue.cc:237] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:38.139734 21660 catalog_manager.cc:5697] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:38.147002 21764 raft_consensus.cc:2955] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:38.160737 21833 raft_consensus.cc:1275] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:07:38.160907 21880 consensus_peers.cc:597] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9911866d06f94adfb20f8f0e0890dcd9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:38.162396 22308 consensus_queue.cc:1048] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:38.166795 21760 raft_consensus.cc:1275] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:38.171882 22538 consensus_queue.cc:1048] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:38.183288 22538 raft_consensus.cc:2955] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:38.188508 21832 raft_consensus.cc:2955] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:38.214005 21660 catalog_manager.cc:5697] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:38.216248 21764 raft_consensus.cc:2955] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:38.350601 22510 heartbeater.cc:499] Master 127.20.40.62:38057 was elected leader, sending a full tablet report...
I20260709 13:07:38.376163 22543 ts_tablet_manager.cc:933] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:38.420528 22545 ts_tablet_manager.cc:933] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645)
I20260709 13:07:38.423467 22543 tablet_copy_client.cc:323] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.2:34765
I20260709 13:07:38.473881 22545 tablet_copy_client.cc:323] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.1:46645
I20260709 13:07:38.502743 21850 tablet_copy_service.cc:140] P 6fadfd81c5a645f1806a284ddbb6bf0d: Received BeginTabletCopySession request for tablet af88ee4a85a24987b0c1513dd7ce39ed from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:56424)
I20260709 13:07:38.503361 21850 tablet_copy_service.cc:161] P 6fadfd81c5a645f1806a284ddbb6bf0d: Beginning new tablet copy session on tablet af88ee4a85a24987b0c1513dd7ce39ed from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:56424: session id = 8c6c2207af3d47b3acf352d81959f4dd-af88ee4a85a24987b0c1513dd7ce39ed
I20260709 13:07:38.511546 21850 tablet_copy_source_session.cc:215] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:38.515873 22543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af88ee4a85a24987b0c1513dd7ce39ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.530616 22550 ts_tablet_manager.cc:933] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:38.536903 22550 tablet_copy_client.cc:323] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:07:38.548679 21924 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet 5871b64f4d9b45f99140a286177ff44f from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:07:38.549376 21924 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet 5871b64f4d9b45f99140a286177ff44f from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-5871b64f4d9b45f99140a286177ff44f
I20260709 13:07:38.557351 21924 tablet_copy_source_session.cc:215] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:38.560674 22550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5871b64f4d9b45f99140a286177ff44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.583628 22543 tablet_copy_client.cc:806] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:38.584569 22543 tablet_copy_client.cc:670] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:38.589442 21775 tablet_copy_service.cc:140] P 3843e9b794a245dd8608e04ec7915239: Received BeginTabletCopySession request for tablet 46dafcc946c640c6a029dd71c387264e from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:44772)
I20260709 13:07:38.590020 21775 tablet_copy_service.cc:161] P 3843e9b794a245dd8608e04ec7915239: Beginning new tablet copy session on tablet 46dafcc946c640c6a029dd71c387264e from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:44772: session id = 8c6c2207af3d47b3acf352d81959f4dd-46dafcc946c640c6a029dd71c387264e
I20260709 13:07:38.598671 21775 tablet_copy_source_session.cc:215] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:38.599757 22543 tablet_copy_client.cc:538] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:38.607542 22545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46dafcc946c640c6a029dd71c387264e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:38.612574 22550 tablet_copy_client.cc:806] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:38.613173 22550 tablet_copy_client.cc:670] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:38.619875 22543 tablet_bootstrap.cc:492] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:38.617729 22550 tablet_copy_client.cc:538] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:38.625839 22545 tablet_copy_client.cc:806] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:38.626400 22545 tablet_copy_client.cc:670] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:38.635824 22545 tablet_copy_client.cc:538] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:38.643265 22550 tablet_bootstrap.cc:492] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:38.656081 22543 tablet_bootstrap.cc:492] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:38.659210 22543 tablet_bootstrap.cc:492] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:38.659904 22543 ts_tablet_manager.cc:1403] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.040s	user 0.025s	sys 0.006s
I20260709 13:07:38.664119 22545 tablet_bootstrap.cc:492] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:38.664985 22543 raft_consensus.cc:359] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:38.666100 22543 raft_consensus.cc:740] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:38.667804 22543 consensus_queue.cc:260] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:38.695688 22543 ts_tablet_manager.cc:1434] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.014s
I20260709 13:07:38.699755 21850 tablet_copy_service.cc:342] P 6fadfd81c5a645f1806a284ddbb6bf0d: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-af88ee4a85a24987b0c1513dd7ce39ed received from {username='slave'} at 127.0.0.1:56424
I20260709 13:07:38.700263 21850 tablet_copy_service.cc:434] P 6fadfd81c5a645f1806a284ddbb6bf0d: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-af88ee4a85a24987b0c1513dd7ce39ed on tablet af88ee4a85a24987b0c1513dd7ce39ed with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:38.709462 22550 tablet_bootstrap.cc:492] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:38.717890 22550 tablet_bootstrap.cc:492] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:38.718618 22550 ts_tablet_manager.cc:1403] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.076s	user 0.020s	sys 0.005s
I20260709 13:07:38.722226 22550 raft_consensus.cc:359] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:38.723165 22550 raft_consensus.cc:740] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:38.723850 22550 consensus_queue.cc:260] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:38.728885 22550 ts_tablet_manager.cc:1434] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:07:38.731276 21924 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-5871b64f4d9b45f99140a286177ff44f received from {username='slave'} at 127.0.0.1:45202
I20260709 13:07:38.731750 21924 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-5871b64f4d9b45f99140a286177ff44f on tablet 5871b64f4d9b45f99140a286177ff44f with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:38.747366 22545 tablet_bootstrap.cc:492] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:38.749351 22545 tablet_bootstrap.cc:492] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:38.750283 22545 ts_tablet_manager.cc:1403] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.086s	user 0.033s	sys 0.015s
I20260709 13:07:38.753762 22545 raft_consensus.cc:359] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:38.754819 22545 raft_consensus.cc:740] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:38.755594 22545 consensus_queue.cc:260] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:38.758625 22545 ts_tablet_manager.cc:1434] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:07:38.760848 21775 tablet_copy_service.cc:342] P 3843e9b794a245dd8608e04ec7915239: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-46dafcc946c640c6a029dd71c387264e received from {username='slave'} at 127.0.0.1:44772
I20260709 13:07:38.761328 21775 tablet_copy_service.cc:434] P 3843e9b794a245dd8608e04ec7915239: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-46dafcc946c640c6a029dd71c387264e on tablet 46dafcc946c640c6a029dd71c387264e with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:38.781082 22545 ts_tablet_manager.cc:933] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:38.791833 22485 raft_consensus.cc:1217] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:38.955559 22485 raft_consensus.cc:1217] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:07:38.995517 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 51459.8us
W20260709 13:07:39.006145 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 65397.5us
I20260709 13:07:38.995568 22545 tablet_copy_client.cc:323] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
W20260709 13:07:39.016490 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 234088us
I20260709 13:07:39.018986 21924 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet 9911866d06f94adfb20f8f0e0890dcd9 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:07:39.019539 21924 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet 9911866d06f94adfb20f8f0e0890dcd9 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-9911866d06f94adfb20f8f0e0890dcd9
I20260709 13:07:39.028517 22485 raft_consensus.cc:1217] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:07:39.074185 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 66207.6us
I20260709 13:07:39.094343 21924 tablet_copy_source_session.cc:215] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:39.118232 22545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9911866d06f94adfb20f8f0e0890dcd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:39.185259 22545 tablet_copy_client.cc:806] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:39.185983 22545 tablet_copy_client.cc:670] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:39.191180 22545 tablet_copy_client.cc:538] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:39.210881 22545 tablet_bootstrap.cc:492] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:39.264649 22566 raft_consensus.cc:1064] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:39.273090 22566 consensus_queue.cc:237] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:39.293959 22485 raft_consensus.cc:1275] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:39.295835 22560 consensus_queue.cc:1048] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:39.303601 21834 raft_consensus.cc:1275] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:39.305330 22567 consensus_queue.cc:1048] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:39.308337 21906 raft_consensus.cc:1275] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:39.315858 22545 tablet_bootstrap.cc:492] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:39.316728 22566 consensus_queue.cc:1048] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:39.317019 22545 tablet_bootstrap.cc:492] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:39.319958 22545 ts_tablet_manager.cc:1403] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.109s	user 0.027s	sys 0.033s
I20260709 13:07:39.325671 22545 raft_consensus.cc:359] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:39.327134 22545 raft_consensus.cc:740] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:39.328029 22545 consensus_queue.cc:260] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:39.333657 22545 ts_tablet_manager.cc:1434] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:07:39.339753 22568 raft_consensus.cc:1064] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:39.343729 22568 consensus_queue.cc:237] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:39.346000 21924 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-9911866d06f94adfb20f8f0e0890dcd9 received from {username='slave'} at 127.0.0.1:45202
I20260709 13:07:39.346467 21924 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-9911866d06f94adfb20f8f0e0890dcd9 on tablet 9911866d06f94adfb20f8f0e0890dcd9 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:39.375450 22484 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:39.378893 22522 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:39.385951 21912 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:39.387804 22562 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:39.461573 22362 raft_consensus.cc:1064] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:39.463810 22362 consensus_queue.cc:237] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:07:39.502281 22576 log.cc:927] Time spent T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:07:39.559726 21761 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:39.559748 22194 raft_consensus.cc:2955] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:39.578215 21911 raft_consensus.cc:2955] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:39.606849 21834 raft_consensus.cc:2955] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:39.586164 22522 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:07:39.628366 21833 raft_consensus.cc:1275] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:39.633502 22558 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:39.634135 22484 raft_consensus.cc:1275] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:39.637768 22308 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:39.640177 22568 raft_consensus.cc:2955] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:07:39.659552 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 81626.7us
I20260709 13:07:39.666184 21758 raft_consensus.cc:1275] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:39.678426 22558 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:39.677912 21660 catalog_manager.cc:5697] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:39.706104 22485 raft_consensus.cc:2955] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:39.706377 22483 raft_consensus.cc:2955] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:39.722546 21911 raft_consensus.cc:2955] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:39.730435 22558 raft_consensus.cc:2955] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:39.740110 22484 raft_consensus.cc:2955] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:39.773162 21760 raft_consensus.cc:2955] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:39.785907 21833 raft_consensus.cc:2955] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:39.825527 22485 raft_consensus.cc:1217] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:39.830710 21757 raft_consensus.cc:2955] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:39.877044 21662 catalog_manager.cc:5697] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.901476 21660 catalog_manager.cc:5697] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.947016 21911 consensus_queue.cc:237] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:39.954773 22483 raft_consensus.cc:1275] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:39.954939 21757 raft_consensus.cc:1275] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:39.957506 22308 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:39.958304 21758 consensus_queue.cc:237] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:39.964737 22483 raft_consensus.cc:1275] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:39.966344 22560 consensus_queue.cc:1048] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:39.967115 22557 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:39.974211 21834 raft_consensus.cc:1275] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:39.975463 22558 raft_consensus.cc:2955] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:39.977720 22566 consensus_queue.cc:1048] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:39.983281 22483 raft_consensus.cc:2955] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:39.983453 22194 raft_consensus.cc:2955] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:39.991130 22484 raft_consensus.cc:2955] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:40.007999 21834 raft_consensus.cc:2955] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:40.011258 21758 raft_consensus.cc:2955] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:40.013410 21649 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 46dafcc946c640c6a029dd71c387264e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:40.018092 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5871b64f4d9b45f99140a286177ff44f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:40.030318 21661 catalog_manager.cc:5697] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:40.031354 21663 catalog_manager.cc:5697] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:40.051728 21833 consensus_queue.cc:237] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:40.064411 21897 tablet_service.cc:1558] Processing DeleteTablet for tablet 46dafcc946c640c6a029dd71c387264e with delete_type TABLET_DATA_TOMBSTONED (TS 6d698a5544b946939790e7a3972db9fb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49532
I20260709 13:07:40.070158 21826 tablet_service.cc:1558] Processing DeleteTablet for tablet 5871b64f4d9b45f99140a286177ff44f with delete_type TABLET_DATA_TOMBSTONED (TS 6fadfd81c5a645f1806a284ddbb6bf0d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38332
I20260709 13:07:40.079342 22592 tablet_replica.cc:333] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:07:40.080425 21911 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:40.080492 22592 raft_consensus.cc:2243] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.081456 22592 raft_consensus.cc:2272] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.080544 22484 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:40.083176 22561 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:40.086282 22561 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:40.093703 22568 raft_consensus.cc:2955] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:40.095829 22592 ts_tablet_manager.cc:1916] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:40.097853 22591 tablet_replica.cc:333] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:07:40.105520 22591 raft_consensus.cc:2243] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.106396 22591 raft_consensus.cc:2272] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.102306 21911 raft_consensus.cc:2955] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:40.109541 21647 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet af88ee4a85a24987b0c1513dd7ce39ed with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:40.109899 22591 ts_tablet_manager.cc:1916] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:40.129503 22592 ts_tablet_manager.cc:1929] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:40.130053 22592 log.cc:1199] T 5871b64f4d9b45f99140a286177ff44f P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-1-root/wals/5871b64f4d9b45f99140a286177ff44f
I20260709 13:07:40.131462 22484 raft_consensus.cc:2955] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:40.140599 21647 catalog_manager.cc:5028] TS 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): tablet 5871b64f4d9b45f99140a286177ff44f (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:40.154645 22591 ts_tablet_manager.cc:1929] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:40.155320 22591 log.cc:1199] T 46dafcc946c640c6a029dd71c387264e P 6d698a5544b946939790e7a3972db9fb: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-2-root/wals/46dafcc946c640c6a029dd71c387264e
I20260709 13:07:40.157191 21648 catalog_manager.cc:5028] TS 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): tablet 46dafcc946c640c6a029dd71c387264e (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:40.176808 21662 catalog_manager.cc:5697] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New cstate: current_term: 1 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:40.192823 21749 tablet_service.cc:1558] Processing DeleteTablet for tablet af88ee4a85a24987b0c1513dd7ce39ed with delete_type TABLET_DATA_TOMBSTONED (TS 3843e9b794a245dd8608e04ec7915239 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59090
I20260709 13:07:40.206846 22593 tablet_replica.cc:333] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:07:40.207962 22593 raft_consensus.cc:2243] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.208779 22593 raft_consensus.cc:2272] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.212579 22593 ts_tablet_manager.cc:1916] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:40.225000 22593 ts_tablet_manager.cc:1929] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:40.225392 22593 log.cc:1199] T af88ee4a85a24987b0c1513dd7ce39ed P 3843e9b794a245dd8608e04ec7915239: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-0-root/wals/af88ee4a85a24987b0c1513dd7ce39ed
I20260709 13:07:40.228024 21649 catalog_manager.cc:5028] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): tablet af88ee4a85a24987b0c1513dd7ce39ed (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:40.341558 22558 raft_consensus.cc:1064] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:40.344285 22558 consensus_queue.cc:237] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:40.355723 22484 raft_consensus.cc:1275] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:40.357446 21833 raft_consensus.cc:1275] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:40.360327 21757 raft_consensus.cc:1275] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:40.362803 22590 consensus_queue.cc:1048] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:40.364024 22570 consensus_queue.cc:1048] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:40.366519 22570 consensus_queue.cc:1048] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:07:40.495579 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 99043.4us
I20260709 13:07:40.555343 22601 raft_consensus.cc:2955] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:40.566763 22484 raft_consensus.cc:2955] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:40.569517 21757 raft_consensus.cc:2955] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:40.584422 21662 catalog_manager.cc:5697] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:40.604278 21834 raft_consensus.cc:2955] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:40.734356 21910 consensus_queue.cc:237] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:40.772687 22484 raft_consensus.cc:1275] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:40.774587 22601 consensus_queue.cc:1048] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:40.784260 22308 raft_consensus.cc:2955] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:40.806793 21764 raft_consensus.cc:1275] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:40.814437 22570 consensus_queue.cc:1048] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:40.792644 22484 raft_consensus.cc:2955] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:40.849494 21764 raft_consensus.cc:2955] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:40.859274 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9911866d06f94adfb20f8f0e0890dcd9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:40.856870 21661 catalog_manager.cc:5697] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:40.885721 21826 tablet_service.cc:1558] Processing DeleteTablet for tablet 9911866d06f94adfb20f8f0e0890dcd9 with delete_type TABLET_DATA_TOMBSTONED (TS 6fadfd81c5a645f1806a284ddbb6bf0d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38332
I20260709 13:07:40.895144 22605 tablet_replica.cc:333] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:07:40.930733 22605 raft_consensus.cc:2243] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.931859 22605 raft_consensus.cc:2272] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.935842 22605 ts_tablet_manager.cc:1916] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:40.959415 22605 ts_tablet_manager.cc:1929] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:40.959923 22605 log.cc:1199] T 9911866d06f94adfb20f8f0e0890dcd9 P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-1-root/wals/9911866d06f94adfb20f8f0e0890dcd9
I20260709 13:07:40.962383 21647 catalog_manager.cc:5028] TS 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): tablet 9911866d06f94adfb20f8f0e0890dcd9 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:41.982874 21759 consensus_queue.cc:237] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:07:42.042151 21731 consensus_peers.cc:597] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2141d5426fcc4d348541c5ff6e33b6e1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:42.043262 21833 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:42.043642 21912 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:42.044961 22602 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:42.045950 22608 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:42.054464 22602 raft_consensus.cc:2955] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:42.056617 21912 raft_consensus.cc:2955] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:42.057315 21833 raft_consensus.cc:2955] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:42.074951 21661 catalog_manager.cc:5697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:42.076138 21912 consensus_queue.cc:237] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:07:42.088461 21880 consensus_peers.cc:597] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3b27c43ce1954bb1ad1f8a4e30f76005. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:42.089061 21833 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:42.091948 22598 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:42.092412 21758 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:42.096668 22609 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:42.112185 22598 raft_consensus.cc:2955] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:42.114462 21758 raft_consensus.cc:2955] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:42.119395 21833 raft_consensus.cc:2955] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:42.133795 21912 consensus_queue.cc:237] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:42.139351 21660 catalog_manager.cc:5697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:42.152743 21758 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:42.154345 21833 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:42.154568 22598 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:42.155529 21880 consensus_peers.cc:597] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 667c64e212614c7ca822788e9d37fc29. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:42.155782 22609 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:42.169579 22609 raft_consensus.cc:2955] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:42.171207 21833 raft_consensus.cc:2955] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:42.173308 21758 raft_consensus.cc:2955] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:42.186601 21663 catalog_manager.cc:5697] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 2 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:42.186795 21759 consensus_queue.cc:237] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:07:42.204679 21731 consensus_peers.cc:597] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2da934436fc940e6abc7519a767e11a7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:42.206981 21912 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:42.207356 21833 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:42.208359 22602 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:42.210397 22607 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:42.220289 22608 raft_consensus.cc:2955] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:42.222383 21833 raft_consensus.cc:2955] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:42.222389 21912 raft_consensus.cc:2955] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:42.241015 21660 catalog_manager.cc:5697] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:42.642369 22627 ts_tablet_manager.cc:933] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645)
I20260709 13:07:42.645532 22627 tablet_copy_client.cc:323] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.1:46645
I20260709 13:07:42.648483 21775 tablet_copy_service.cc:140] P 3843e9b794a245dd8608e04ec7915239: Received BeginTabletCopySession request for tablet 2141d5426fcc4d348541c5ff6e33b6e1 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:44772)
I20260709 13:07:42.649003 21775 tablet_copy_service.cc:161] P 3843e9b794a245dd8608e04ec7915239: Beginning new tablet copy session on tablet 2141d5426fcc4d348541c5ff6e33b6e1 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:44772: session id = 8c6c2207af3d47b3acf352d81959f4dd-2141d5426fcc4d348541c5ff6e33b6e1
I20260709 13:07:42.654161 21775 tablet_copy_source_session.cc:215] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:42.658164 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2141d5426fcc4d348541c5ff6e33b6e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.666968 22629 ts_tablet_manager.cc:933] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:42.675498 22627 tablet_copy_client.cc:806] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:42.676225 22627 tablet_copy_client.cc:670] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:42.677012 22629 tablet_copy_client.cc:323] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:07:42.679257 21924 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet 3b27c43ce1954bb1ad1f8a4e30f76005 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:07:42.679804 21924 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet 3b27c43ce1954bb1ad1f8a4e30f76005 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-3b27c43ce1954bb1ad1f8a4e30f76005
I20260709 13:07:42.681352 22627 tablet_copy_client.cc:538] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:42.687789 22627 tablet_bootstrap.cc:492] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:42.687892 21924 tablet_copy_source_session.cc:215] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:42.691303 22629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b27c43ce1954bb1ad1f8a4e30f76005. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.710355 22627 tablet_bootstrap.cc:492] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:42.711397 22627 tablet_bootstrap.cc:492] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:42.712836 22629 tablet_copy_client.cc:806] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:42.712670 22627 ts_tablet_manager.cc:1403] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.025s	user 0.021s	sys 0.005s
I20260709 13:07:42.713519 22629 tablet_copy_client.cc:670] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:42.716863 22627 raft_consensus.cc:359] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:42.717653 22629 tablet_copy_client.cc:538] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:42.718016 22627 raft_consensus.cc:740] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:42.718828 22627 consensus_queue.cc:260] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:42.722293 22627 ts_tablet_manager.cc:1434] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:07:42.724004 21775 tablet_copy_service.cc:342] P 3843e9b794a245dd8608e04ec7915239: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-2141d5426fcc4d348541c5ff6e33b6e1 received from {username='slave'} at 127.0.0.1:44772
I20260709 13:07:42.724462 21775 tablet_copy_service.cc:434] P 3843e9b794a245dd8608e04ec7915239: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-2141d5426fcc4d348541c5ff6e33b6e1 on tablet 2141d5426fcc4d348541c5ff6e33b6e1 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:42.729027 22629 tablet_bootstrap.cc:492] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:42.750030 22629 tablet_bootstrap.cc:492] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:42.750758 22629 tablet_bootstrap.cc:492] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:42.751300 22629 ts_tablet_manager.cc:1403] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.012s
I20260709 13:07:42.753594 22629 raft_consensus.cc:359] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:42.754693 22629 raft_consensus.cc:740] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:42.755308 22629 consensus_queue.cc:260] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:42.757720 22629 ts_tablet_manager.cc:1434] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.005s
I20260709 13:07:42.762087 21924 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-3b27c43ce1954bb1ad1f8a4e30f76005 received from {username='slave'} at 127.0.0.1:45202
I20260709 13:07:42.762511 21924 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-3b27c43ce1954bb1ad1f8a4e30f76005 on tablet 3b27c43ce1954bb1ad1f8a4e30f76005 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:42.772891 22634 ts_tablet_manager.cc:933] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:42.776997 22627 ts_tablet_manager.cc:933] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645)
I20260709 13:07:42.786785 22627 tablet_copy_client.cc:323] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.1:46645
I20260709 13:07:42.788843 21775 tablet_copy_service.cc:140] P 3843e9b794a245dd8608e04ec7915239: Received BeginTabletCopySession request for tablet 2da934436fc940e6abc7519a767e11a7 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:44772)
I20260709 13:07:42.789300 21775 tablet_copy_service.cc:161] P 3843e9b794a245dd8608e04ec7915239: Beginning new tablet copy session on tablet 2da934436fc940e6abc7519a767e11a7 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:44772: session id = 8c6c2207af3d47b3acf352d81959f4dd-2da934436fc940e6abc7519a767e11a7
I20260709 13:07:42.796671 21775 tablet_copy_source_session.cc:215] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:42.802328 22627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2da934436fc940e6abc7519a767e11a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.803625 22634 tablet_copy_client.cc:323] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:07:42.805543 21924 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet 667c64e212614c7ca822788e9d37fc29 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:07:42.806102 21924 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet 667c64e212614c7ca822788e9d37fc29 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-667c64e212614c7ca822788e9d37fc29
I20260709 13:07:42.814751 21924 tablet_copy_source_session.cc:215] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:42.818573 22627 tablet_copy_client.cc:806] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:42.819162 22627 tablet_copy_client.cc:670] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:42.828171 22634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 667c64e212614c7ca822788e9d37fc29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:42.835045 22627 tablet_copy_client.cc:538] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:42.851588 22634 tablet_copy_client.cc:806] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:42.852312 22634 tablet_copy_client.cc:670] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:42.854228 22627 tablet_bootstrap.cc:492] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:42.856302 22634 tablet_copy_client.cc:538] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:42.866541 22634 tablet_bootstrap.cc:492] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:42.873338 22627 tablet_bootstrap.cc:492] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:42.874280 22627 tablet_bootstrap.cc:492] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:42.874939 22627 ts_tablet_manager.cc:1403] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:07:42.877961 22627 raft_consensus.cc:359] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:42.878814 22627 raft_consensus.cc:740] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:42.879436 22627 consensus_queue.cc:260] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:42.881733 22627 ts_tablet_manager.cc:1434] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:07:42.886900 21775 tablet_copy_service.cc:342] P 3843e9b794a245dd8608e04ec7915239: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-2da934436fc940e6abc7519a767e11a7 received from {username='slave'} at 127.0.0.1:44772
I20260709 13:07:42.887377 21775 tablet_copy_service.cc:434] P 3843e9b794a245dd8608e04ec7915239: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-2da934436fc940e6abc7519a767e11a7 on tablet 2da934436fc940e6abc7519a767e11a7 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:42.904870 22634 tablet_bootstrap.cc:492] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:42.905820 22634 tablet_bootstrap.cc:492] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:42.906522 22634 ts_tablet_manager.cc:1403] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.010s
I20260709 13:07:42.909545 22634 raft_consensus.cc:359] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:42.910252 22634 raft_consensus.cc:740] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:42.910768 22634 consensus_queue.cc:260] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:42.912709 22634 ts_tablet_manager.cc:1434] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:42.914510 21924 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-667c64e212614c7ca822788e9d37fc29 received from {username='slave'} at 127.0.0.1:45202
I20260709 13:07:42.914934 21924 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-667c64e212614c7ca822788e9d37fc29 on tablet 667c64e212614c7ca822788e9d37fc29 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:43.149865 22484 raft_consensus.cc:1217] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:43.155797 22484 raft_consensus.cc:1217] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:43.285496 22484 raft_consensus.cc:1217] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:43.380560 22484 raft_consensus.cc:1217] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:07:43.669400 22566 raft_consensus.cc:1064] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:43.671977 22566 consensus_queue.cc:237] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:43.678836 22484 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:43.679159 21833 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:43.680063 21911 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:43.680414 22566 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:43.681402 22608 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:43.682327 22607 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:43.702657 22608 raft_consensus.cc:2955] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:43.706884 22483 raft_consensus.cc:2955] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:43.715708 21911 raft_consensus.cc:2955] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:43.718497 21833 raft_consensus.cc:2955] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:43.725358 21663 catalog_manager.cc:5697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:43.758818 22590 raft_consensus.cc:1064] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:43.761056 22590 consensus_queue.cc:237] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:43.782038 22484 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:43.787343 22590 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:43.789373 21764 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:43.795622 22639 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:43.810318 21833 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:43.815729 22609 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:43.833204 22566 raft_consensus.cc:1064] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:43.844784 22590 raft_consensus.cc:1064] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:43.836287 22566 consensus_queue.cc:237] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:43.857084 22590 consensus_queue.cc:237] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:43.875363 22484 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:43.881088 21910 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:07:43.882432 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 59373.1us
I20260709 13:07:43.877388 22607 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:07:43.899714 22649 raft_consensus.cc:2955] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:43.908090 21833 raft_consensus.cc:2955] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:43.912833 22653 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:43.924038 21833 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:43.935359 22608 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:43.948975 22484 raft_consensus.cc:2955] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:07:43.967163 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 50203.6us
I20260709 13:07:44.011734 21757 consensus_queue.cc:237] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:44.012377 22653 raft_consensus.cc:2955] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.014070 21834 raft_consensus.cc:2955] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.022742 21663 catalog_manager.cc:5697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.031590 21834 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:44.031894 22484 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:44.033409 22566 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:44.034438 22608 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:07:44.037539 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 67366.2us
I20260709 13:07:44.041181 21759 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:07:44.050558 22566 raft_consensus.cc:2955] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.054543 22639 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:44.053928 21764 raft_consensus.cc:2955] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.056360 22483 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:07:44.056612 21835 raft_consensus.cc:2955] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.064817 22660 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:44.080440 21649 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2141d5426fcc4d348541c5ff6e33b6e1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:44.085676 21912 raft_consensus.cc:2955] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.089569 22483 raft_consensus.cc:2955] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:07:44.094237 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 119263us
I20260709 13:07:44.101985 21834 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:07:44.108238 21910 consensus_queue.cc:237] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:44.117910 22482 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:44.116587 22485 raft_consensus.cc:2955] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.120236 22660 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:44.125218 21834 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:44.143262 21663 catalog_manager.cc:5697] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.145090 21663 catalog_manager.cc:5697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.151664 22639 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:44.152392 22660 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:07:44.156232 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 46136.8us
W20260709 13:07:44.161088 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 78599.8us
I20260709 13:07:44.171741 22663 raft_consensus.cc:2955] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.178366 21897 tablet_service.cc:1558] Processing DeleteTablet for tablet 2141d5426fcc4d348541c5ff6e33b6e1 with delete_type TABLET_DATA_TOMBSTONED (TS 6d698a5544b946939790e7a3972db9fb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49532
I20260709 13:07:44.178707 22482 raft_consensus.cc:2955] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.197255 21835 raft_consensus.cc:2955] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:07:44.223824 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 66870.4us
I20260709 13:07:44.232316 22674 tablet_replica.cc:333] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:07:44.235097 22674 raft_consensus.cc:2243] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.250473 22674 raft_consensus.cc:2272] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.254751 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3b27c43ce1954bb1ad1f8a4e30f76005 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:44.260159 22674 ts_tablet_manager.cc:1916] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:44.268738 22639 raft_consensus.cc:2955] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.271395 21662 catalog_manager.cc:5697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.272320 21757 consensus_queue.cc:237] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:44.282563 21835 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:44.301762 22482 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:44.307018 22672 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:44.307727 22482 raft_consensus.cc:2955] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.309557 22674 ts_tablet_manager.cc:1929] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:44.316396 21764 raft_consensus.cc:2955] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.323732 21749 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b27c43ce1954bb1ad1f8a4e30f76005 with delete_type TABLET_DATA_TOMBSTONED (TS 3843e9b794a245dd8608e04ec7915239 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59090
I20260709 13:07:44.326980 22607 raft_consensus.cc:2955] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.329457 22674 log.cc:1199] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6d698a5544b946939790e7a3972db9fb: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-2-root/wals/2141d5426fcc4d348541c5ff6e33b6e1
I20260709 13:07:44.332199 22485 raft_consensus.cc:2955] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.334067 22671 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:44.334404 21648 catalog_manager.cc:5028] TS 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): tablet 2141d5426fcc4d348541c5ff6e33b6e1 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:44.338627 21662 catalog_manager.cc:5697] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.339275 21839 raft_consensus.cc:2955] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:07:44.354406 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 50586.9us
I20260709 13:07:44.365753 21663 catalog_manager.cc:5697] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.373885 22676 tablet_replica.cc:333] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:07:44.376272 21834 raft_consensus.cc:2955] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.378249 21649 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2da934436fc940e6abc7519a767e11a7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:44.386656 21897 tablet_service.cc:1558] Processing DeleteTablet for tablet 2da934436fc940e6abc7519a767e11a7 with delete_type TABLET_DATA_TOMBSTONED (TS 6d698a5544b946939790e7a3972db9fb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49532
I20260709 13:07:44.387432 22676 raft_consensus.cc:2243] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.387760 22674 tablet_replica.cc:333] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:07:44.388232 22676 raft_consensus.cc:2272] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.388911 22674 raft_consensus.cc:2243] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.389766 22674 raft_consensus.cc:2272] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.396407 22674 ts_tablet_manager.cc:1916] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:44.419049 21912 consensus_queue.cc:237] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:44.408036 22676 ts_tablet_manager.cc:1916] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:44.429422 22482 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:07:44.431344 22590 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:44.432593 22674 ts_tablet_manager.cc:1929] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:44.433398 22674 log.cc:1199] T 2da934436fc940e6abc7519a767e11a7 P 6d698a5544b946939790e7a3972db9fb: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-2-root/wals/2da934436fc940e6abc7519a767e11a7
I20260709 13:07:44.433876 21834 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:07:44.435233 21648 catalog_manager.cc:5028] TS 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): tablet 2da934436fc940e6abc7519a767e11a7 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:44.435659 22663 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:44.437325 22676 ts_tablet_manager.cc:1929] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:44.437817 22676 log.cc:1199] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 3843e9b794a245dd8608e04ec7915239: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-0-root/wals/3b27c43ce1954bb1ad1f8a4e30f76005
I20260709 13:07:44.439674 21649 catalog_manager.cc:5028] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): tablet 3b27c43ce1954bb1ad1f8a4e30f76005 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:44.442425 22639 raft_consensus.cc:2955] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.446046 21834 raft_consensus.cc:2955] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.456316 22482 raft_consensus.cc:2955] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.459817 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 667c64e212614c7ca822788e9d37fc29 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:44.467723 21663 catalog_manager.cc:5697] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New cstate: current_term: 2 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:44.489702 21749 tablet_service.cc:1558] Processing DeleteTablet for tablet 667c64e212614c7ca822788e9d37fc29 with delete_type TABLET_DATA_TOMBSTONED (TS 3843e9b794a245dd8608e04ec7915239 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59090
I20260709 13:07:44.493693 22676 tablet_replica.cc:333] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:07:44.494787 22676 raft_consensus.cc:2243] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:44.501302 22676 raft_consensus.cc:2272] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:44.504886 22676 ts_tablet_manager.cc:1916] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:44.518639 22676 ts_tablet_manager.cc:1929] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:07:44.519017 22676 log.cc:1199] T 667c64e212614c7ca822788e9d37fc29 P 3843e9b794a245dd8608e04ec7915239: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-0-root/wals/667c64e212614c7ca822788e9d37fc29
I20260709 13:07:44.520890 21649 catalog_manager.cc:5028] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): tablet 667c64e212614c7ca822788e9d37fc29 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:45.570942 21910 consensus_queue.cc:237] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:45.577344 21834 raft_consensus.cc:1275] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:07:45.577527 21880 consensus_peers.cc:597] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3b18a570f5764b538a612ae89ef0327c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:45.578694 22649 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:45.578989 21757 raft_consensus.cc:1275] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:45.580224 22679 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:45.585940 22649 raft_consensus.cc:2955] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:45.587586 21834 raft_consensus.cc:2955] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:45.591542 21757 raft_consensus.cc:2955] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:45.603127 21662 catalog_manager.cc:5697] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.607102 21910 consensus_queue.cc:237] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:07:45.616902 21880 consensus_peers.cc:597] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f7cb5d9283d4cf7969db82011d35ed9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:45.617187 21835 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:45.617686 21757 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:45.618484 22679 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:45.619397 22662 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:45.628412 22649 raft_consensus.cc:2955] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:45.630435 21835 raft_consensus.cc:2955] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:45.638054 21757 raft_consensus.cc:2955] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:45.649537 21662 catalog_manager.cc:5697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:45.657306 21757 consensus_queue.cc:237] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:07:45.671612 21731 consensus_peers.cc:597] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7fc47e7b4534569b3d46ad6ddc619d5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:45.677521 21910 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:45.683079 22607 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:45.682513 21835 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:45.686178 22690 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:45.690908 22672 raft_consensus.cc:2955] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:45.692979 21912 raft_consensus.cc:2955] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:45.698688 21834 raft_consensus.cc:2955] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:45.711668 21663 catalog_manager.cc:5697] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:45.711346 21910 consensus_queue.cc:237] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:07:45.742478 21880 consensus_peers.cc:597] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0b8098340ee849cfae4a080cc2544e82. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:45.743554 21757 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:45.743804 21834 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:45.744793 22649 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:45.745771 22679 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:45.755147 22639 raft_consensus.cc:2955] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:45.756695 21835 raft_consensus.cc:2955] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:45.756822 21757 raft_consensus.cc:2955] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:45.777014 21660 catalog_manager.cc:5697] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:45.968668 22696 ts_tablet_manager.cc:933] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:45.970799 22696 tablet_copy_client.cc:323] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:07:45.972352 21924 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet 3b18a570f5764b538a612ae89ef0327c from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:07:45.972811 21924 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet 3b18a570f5764b538a612ae89ef0327c from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-3b18a570f5764b538a612ae89ef0327c
I20260709 13:07:45.979254 21924 tablet_copy_source_session.cc:215] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:45.981999 22696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b18a570f5764b538a612ae89ef0327c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:45.994108 22696 tablet_copy_client.cc:806] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:45.994683 22696 tablet_copy_client.cc:670] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:45.999591 22696 tablet_copy_client.cc:538] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:46.006855 22696 tablet_bootstrap.cc:492] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:46.024963 22696 tablet_bootstrap.cc:492] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:46.025877 22696 tablet_bootstrap.cc:492] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:46.026525 22696 ts_tablet_manager.cc:1403] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 13:07:46.029162 22696 raft_consensus.cc:359] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:46.029903 22696 raft_consensus.cc:740] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:46.030449 22696 consensus_queue.cc:260] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:46.033155 22696 ts_tablet_manager.cc:1434] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:46.035130 21924 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-3b18a570f5764b538a612ae89ef0327c received from {username='slave'} at 127.0.0.1:45202
I20260709 13:07:46.035567 21924 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-3b18a570f5764b538a612ae89ef0327c on tablet 3b18a570f5764b538a612ae89ef0327c with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:46.148334 22696 ts_tablet_manager.cc:933] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:46.150794 22696 tablet_copy_client.cc:323] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:07:46.152266 21924 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet 0b8098340ee849cfae4a080cc2544e82 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:07:46.152768 21924 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet 0b8098340ee849cfae4a080cc2544e82 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-0b8098340ee849cfae4a080cc2544e82
I20260709 13:07:46.160254 21924 tablet_copy_source_session.cc:215] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:46.163422 22696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b8098340ee849cfae4a080cc2544e82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.178890 22696 tablet_copy_client.cc:806] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:46.179450 22696 tablet_copy_client.cc:670] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:46.183014 22696 tablet_copy_client.cc:538] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:46.192203 22696 tablet_bootstrap.cc:492] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:46.230654 22703 ts_tablet_manager.cc:933] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:46.233472 22701 ts_tablet_manager.cc:933] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645)
I20260709 13:07:46.235170 22703 tablet_copy_client.cc:323] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:07:46.237023 21924 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet 3f7cb5d9283d4cf7969db82011d35ed9 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:07:46.237363 22701 tablet_copy_client.cc:323] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.1:46645
I20260709 13:07:46.237619 21924 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet 3f7cb5d9283d4cf7969db82011d35ed9 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-3f7cb5d9283d4cf7969db82011d35ed9
I20260709 13:07:46.239106 21775 tablet_copy_service.cc:140] P 3843e9b794a245dd8608e04ec7915239: Received BeginTabletCopySession request for tablet c7fc47e7b4534569b3d46ad6ddc619d5 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:44772)
I20260709 13:07:46.239614 21775 tablet_copy_service.cc:161] P 3843e9b794a245dd8608e04ec7915239: Beginning new tablet copy session on tablet c7fc47e7b4534569b3d46ad6ddc619d5 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:44772: session id = 8c6c2207af3d47b3acf352d81959f4dd-c7fc47e7b4534569b3d46ad6ddc619d5
I20260709 13:07:46.243536 22696 tablet_bootstrap.cc:492] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:46.244836 22696 tablet_bootstrap.cc:492] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:46.245488 22696 ts_tablet_manager.cc:1403] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.054s	user 0.031s	sys 0.022s
I20260709 13:07:46.248420 22696 raft_consensus.cc:359] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:46.249306 22696 raft_consensus.cc:740] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:46.249943 22696 consensus_queue.cc:260] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:46.252313 22696 ts_tablet_manager.cc:1434] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:46.256038 21923 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-0b8098340ee849cfae4a080cc2544e82 received from {username='slave'} at 127.0.0.1:45202
I20260709 13:07:46.256469 21923 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-0b8098340ee849cfae4a080cc2544e82 on tablet 0b8098340ee849cfae4a080cc2544e82 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:46.256556 21924 tablet_copy_source_session.cc:215] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:46.267261 21775 tablet_copy_source_session.cc:215] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:46.269685 22703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f7cb5d9283d4cf7969db82011d35ed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.270323 22701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7fc47e7b4534569b3d46ad6ddc619d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:46.285976 22703 tablet_copy_client.cc:806] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:46.286788 22703 tablet_copy_client.cc:670] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:46.289994 22701 tablet_copy_client.cc:806] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:46.290649 22701 tablet_copy_client.cc:670] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:46.295171 22703 tablet_copy_client.cc:538] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:46.300894 22701 tablet_copy_client.cc:538] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:46.307016 22703 tablet_bootstrap.cc:492] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:46.310767 22701 tablet_bootstrap.cc:492] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:46.342221 22701 tablet_bootstrap.cc:492] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:46.343096 22701 tablet_bootstrap.cc:492] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:46.343762 22701 ts_tablet_manager.cc:1403] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.005s
I20260709 13:07:46.348165 22701 raft_consensus.cc:359] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:46.349113 22701 raft_consensus.cc:740] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:46.353545 22701 consensus_queue.cc:260] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:46.351804 22703 tablet_bootstrap.cc:492] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:46.355228 22703 tablet_bootstrap.cc:492] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:46.355906 22703 ts_tablet_manager.cc:1403] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.049s	user 0.022s	sys 0.004s
I20260709 13:07:46.358347 22701 ts_tablet_manager.cc:1434] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 13:07:46.361590 22703 raft_consensus.cc:359] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:46.362978 22703 raft_consensus.cc:740] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:46.363651 22703 consensus_queue.cc:260] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:46.366516 22703 ts_tablet_manager.cc:1434] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:07:46.368294 21775 tablet_copy_service.cc:342] P 3843e9b794a245dd8608e04ec7915239: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-c7fc47e7b4534569b3d46ad6ddc619d5 received from {username='slave'} at 127.0.0.1:44772
I20260709 13:07:46.368752 21775 tablet_copy_service.cc:434] P 3843e9b794a245dd8608e04ec7915239: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-c7fc47e7b4534569b3d46ad6ddc619d5 on tablet c7fc47e7b4534569b3d46ad6ddc619d5 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:46.369833 21924 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-3f7cb5d9283d4cf7969db82011d35ed9 received from {username='slave'} at 127.0.0.1:45202
I20260709 13:07:46.370285 21924 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-3f7cb5d9283d4cf7969db82011d35ed9 on tablet 3f7cb5d9283d4cf7969db82011d35ed9 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:46.555766 22485 raft_consensus.cc:1217] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:46.630244 22485 raft_consensus.cc:1217] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:46.676431 22485 raft_consensus.cc:1217] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:46.948519 22485 raft_consensus.cc:1217] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:47.126485 22679 raft_consensus.cc:1064] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:47.128856 22679 consensus_queue.cc:237] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:47.136369 22708 raft_consensus.cc:1064] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:47.139015 22708 consensus_queue.cc:237] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:47.157219 21835 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:47.160320 22662 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:47.163558 22485 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:47.165385 22709 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:47.175330 21760 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:47.181227 21833 raft_consensus.cc:1275] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:47.183847 22662 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:47.187939 22709 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:47.194298 22482 raft_consensus.cc:1275] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:47.198364 22709 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:47.202809 21765 raft_consensus.cc:1275] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:47.209566 22715 raft_consensus.cc:1064] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:47.210036 22639 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:47.212191 22715 consensus_queue.cc:237] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:47.211915 22639 raft_consensus.cc:2955] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.215515 22482 raft_consensus.cc:2955] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.226483 21833 raft_consensus.cc:2955] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.236415 21662 catalog_manager.cc:5697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:47.241940 22679 raft_consensus.cc:2955] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.249652 21761 raft_consensus.cc:2955] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.262228 21833 raft_consensus.cc:2955] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.270074 22484 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:47.272660 21835 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:47.276240 21765 raft_consensus.cc:2955] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.279914 22607 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:47.294538 22690 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:47.299640 21914 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:47.305835 22607 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:47.310765 22483 raft_consensus.cc:2955] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.323984 21661 catalog_manager.cc:5697] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.333185 22672 raft_consensus.cc:2955] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.337651 22484 raft_consensus.cc:2955] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.345724 21914 raft_consensus.cc:2955] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.367664 21909 consensus_queue.cc:237] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:47.375763 21910 consensus_queue.cc:237] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:47.384907 21835 raft_consensus.cc:2955] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.392294 21660 catalog_manager.cc:5697] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.400889 22482 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:47.402487 22649 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:47.408241 21765 raft_consensus.cc:1275] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:47.408603 21761 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:47.412914 22484 raft_consensus.cc:1275] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:47.415197 21764 consensus_queue.cc:237] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:47.417132 22662 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:47.414183 22717 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:07:47.423385 22639 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:47.426069 21835 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:47.431197 22482 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:47.433605 22713 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:47.433676 22639 raft_consensus.cc:2955] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.437580 22713 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:47.439193 22483 raft_consensus.cc:2955] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.449708 22649 raft_consensus.cc:2955] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.454233 22711 raft_consensus.cc:2955] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.459419 22481 raft_consensus.cc:2955] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.467089 21761 raft_consensus.cc:2955] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.475265 21660 catalog_manager.cc:5697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.478061 21764 raft_consensus.cc:2955] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.482223 21835 raft_consensus.cc:2955] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.490061 21826 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f7cb5d9283d4cf7969db82011d35ed9 with delete_type TABLET_DATA_TOMBSTONED (TS 6fadfd81c5a645f1806a284ddbb6bf0d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38332
I20260709 13:07:47.494421 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3f7cb5d9283d4cf7969db82011d35ed9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:47.495223 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3b18a570f5764b538a612ae89ef0327c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:47.496918 21649 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c7fc47e7b4534569b3d46ad6ddc619d5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:47.503682 21663 catalog_manager.cc:5697] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.514530 22733 tablet_replica.cc:333] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:07:47.513813 21660 catalog_manager.cc:5697] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:47.518208 22481 raft_consensus.cc:2955] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.522640 22733 raft_consensus.cc:2243] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:47.524755 22733 raft_consensus.cc:2272] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:47.531430 21897 tablet_service.cc:1558] Processing DeleteTablet for tablet c7fc47e7b4534569b3d46ad6ddc619d5 with delete_type TABLET_DATA_TOMBSTONED (TS 6d698a5544b946939790e7a3972db9fb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49532
I20260709 13:07:47.531886 22733 ts_tablet_manager.cc:1916] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:47.538727 21826 tablet_service.cc:1558] Processing DeleteTablet for tablet 3b18a570f5764b538a612ae89ef0327c with delete_type TABLET_DATA_TOMBSTONED (TS 6fadfd81c5a645f1806a284ddbb6bf0d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38332
I20260709 13:07:47.556876 22733 ts_tablet_manager.cc:1929] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:47.557593 22733 log.cc:1199] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-1-root/wals/3f7cb5d9283d4cf7969db82011d35ed9
I20260709 13:07:47.559399 22733 tablet_replica.cc:333] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:07:47.559381 21647 catalog_manager.cc:5028] TS 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): tablet 3f7cb5d9283d4cf7969db82011d35ed9 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:47.560846 22733 raft_consensus.cc:2243] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:47.561659 22733 raft_consensus.cc:2272] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:47.565021 22733 ts_tablet_manager.cc:1916] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:47.565744 22734 tablet_replica.cc:333] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:07:47.566761 22734 raft_consensus.cc:2243] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:47.568293 22734 raft_consensus.cc:2272] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:47.570894 22649 raft_consensus.cc:1064] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:47.573211 22649 consensus_queue.cc:237] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:47.575524 22734 ts_tablet_manager.cc:1916] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:47.595789 22733 ts_tablet_manager.cc:1929] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:47.596223 22733 log.cc:1199] T 3b18a570f5764b538a612ae89ef0327c P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-1-root/wals/3b18a570f5764b538a612ae89ef0327c
I20260709 13:07:47.598521 21647 catalog_manager.cc:5028] TS 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): tablet 3b18a570f5764b538a612ae89ef0327c (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:47.600719 21764 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:47.601054 21838 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:47.603241 22662 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:47.604795 22717 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:47.605013 22481 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:47.606849 22709 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:47.626732 22734 ts_tablet_manager.cc:1929] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:47.627197 22734 log.cc:1199] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6d698a5544b946939790e7a3972db9fb: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-2-root/wals/c7fc47e7b4534569b3d46ad6ddc619d5
I20260709 13:07:47.629220 21648 catalog_manager.cc:5028] TS 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): tablet c7fc47e7b4534569b3d46ad6ddc619d5 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:47.628340 22709 raft_consensus.cc:2955] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.630195 21761 raft_consensus.cc:2955] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.638208 22481 raft_consensus.cc:2955] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.642921 21838 raft_consensus.cc:2955] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.645567 21660 catalog_manager.cc:5697] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.668457 21910 consensus_queue.cc:237] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:47.677188 22481 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:47.678194 21833 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:47.680259 22709 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:47.681823 22662 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:47.686833 22709 raft_consensus.cc:2955] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.690587 21833 raft_consensus.cc:2955] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.690233 22481 raft_consensus.cc:2955] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:47.697901 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0b8098340ee849cfae4a080cc2544e82 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:47.708693 21660 catalog_manager.cc:5697] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:47.718899 21749 tablet_service.cc:1558] Processing DeleteTablet for tablet 0b8098340ee849cfae4a080cc2544e82 with delete_type TABLET_DATA_TOMBSTONED (TS 3843e9b794a245dd8608e04ec7915239 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59090
I20260709 13:07:47.721175 22739 tablet_replica.cc:333] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:07:47.722276 22739 raft_consensus.cc:2243] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:47.722886 22739 raft_consensus.cc:2272] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:47.725821 22739 ts_tablet_manager.cc:1916] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:07:47.730567 21786 debug-util.cc:398] Leaking SignalData structure 0x7b0800096e80 after lost signal to thread 20643
W20260709 13:07:47.731654 21786 debug-util.cc:398] Leaking SignalData structure 0x7b08001f6560 after lost signal to thread 21697
W20260709 13:07:47.732795 21786 debug-util.cc:398] Leaking SignalData structure 0x7b080030c4e0 after lost signal to thread 21789
W20260709 13:07:47.734016 21786 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef120 after lost signal to thread 21864
W20260709 13:07:47.735219 21786 debug-util.cc:398] Leaking SignalData structure 0x7b08002cdca0 after lost signal to thread 21938
W20260709 13:07:47.736198 21786 debug-util.cc:398] Leaking SignalData structure 0x7b0800316ee0 after lost signal to thread 22509
I20260709 13:07:47.739450 22739 ts_tablet_manager.cc:1929] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:47.739914 22739 log.cc:1199] T 0b8098340ee849cfae4a080cc2544e82 P 3843e9b794a245dd8608e04ec7915239: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-0-root/wals/0b8098340ee849cfae4a080cc2544e82
I20260709 13:07:47.741317 21649 catalog_manager.cc:5028] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): tablet 0b8098340ee849cfae4a080cc2544e82 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:48.797147 21765 consensus_queue.cc:237] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:07:48.805881 21731 consensus_peers.cc:597] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 772d060b63de449b996b0ddc91936bcd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:48.807540 21910 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:48.812495 22713 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:48.813580 21835 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:48.815457 22607 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:48.841475 21833 raft_consensus.cc:2955] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:48.839524 22743 raft_consensus.cc:2955] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:48.866568 21914 consensus_queue.cc:237] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:48.876350 21660 catalog_manager.cc:5697] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:48.893401 21835 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:48.898298 22709 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:07:48.905277 21880 consensus_peers.cc:597] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7f2b8ba156604362aecf8501bef61de4. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:48.845938 21910 raft_consensus.cc:2955] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:48.911387 21764 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:48.917951 22649 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:48.994175 22748 raft_consensus.cc:2955] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:48.996088 21835 raft_consensus.cc:2955] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:49.015034 21661 catalog_manager.cc:5697] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:49.030205 21914 consensus_queue.cc:237] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:49.051205 21834 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:49.053412 22749 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:49.057209 21880 consensus_peers.cc:597] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 71a084e9c0014661925a846711e7a18f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:49.067857 21765 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:49.078362 22649 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:49.081925 21765 raft_consensus.cc:2955] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:49.098709 22709 raft_consensus.cc:2955] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:49.103629 21765 raft_consensus.cc:2955] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:49.103345 21833 raft_consensus.cc:2955] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:49.116519 21914 consensus_queue.cc:237] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:49.130746 21661 catalog_manager.cc:5697] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:49.180110 21880 consensus_peers.cc:597] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8f23d2bb6e7e4e44b828b7f7ede73841. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:49.186264 21765 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:49.187811 21833 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:49.188582 22649 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:49.190114 22709 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:49.218904 22749 raft_consensus.cc:2955] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:49.223642 21835 raft_consensus.cc:2955] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:49.227173 21762 raft_consensus.cc:2955] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:49.250839 21661 catalog_manager.cc:5697] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:49.325861 22762 ts_tablet_manager.cc:933] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:49.329087 22762 tablet_copy_client.cc:323] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:07:49.330978 21924 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet 7f2b8ba156604362aecf8501bef61de4 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:07:49.331640 21924 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet 7f2b8ba156604362aecf8501bef61de4 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-7f2b8ba156604362aecf8501bef61de4
I20260709 13:07:49.340803 21924 tablet_copy_source_session.cc:215] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:49.344849 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f2b8ba156604362aecf8501bef61de4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.365674 22762 tablet_copy_client.cc:806] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:49.366466 22762 tablet_copy_client.cc:670] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:49.371424 22762 tablet_copy_client.cc:538] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:49.388705 22762 tablet_bootstrap.cc:492] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:49.421749 22762 tablet_bootstrap.cc:492] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:49.423054 22762 tablet_bootstrap.cc:492] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:49.423833 22762 ts_tablet_manager.cc:1403] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.015s
I20260709 13:07:49.434676 22762 raft_consensus.cc:359] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:49.439339 22762 raft_consensus.cc:740] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:49.440766 22762 consensus_queue.cc:260] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:49.490023 22765 ts_tablet_manager.cc:933] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645)
I20260709 13:07:49.515085 22762 ts_tablet_manager.cc:1434] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.000s
I20260709 13:07:49.521082 22765 tablet_copy_client.cc:323] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.1:46645
I20260709 13:07:49.524367 21775 tablet_copy_service.cc:140] P 3843e9b794a245dd8608e04ec7915239: Received BeginTabletCopySession request for tablet 772d060b63de449b996b0ddc91936bcd from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:44772)
I20260709 13:07:49.524917 21775 tablet_copy_service.cc:161] P 3843e9b794a245dd8608e04ec7915239: Beginning new tablet copy session on tablet 772d060b63de449b996b0ddc91936bcd from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:44772: session id = 8c6c2207af3d47b3acf352d81959f4dd-772d060b63de449b996b0ddc91936bcd
I20260709 13:07:49.536577 21924 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-7f2b8ba156604362aecf8501bef61de4 received from {username='slave'} at 127.0.0.1:45202
I20260709 13:07:49.537096 21924 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-7f2b8ba156604362aecf8501bef61de4 on tablet 7f2b8ba156604362aecf8501bef61de4 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:49.546459 21775 tablet_copy_source_session.cc:215] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:49.591535 22765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 772d060b63de449b996b0ddc91936bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.612607 22765 tablet_copy_client.cc:806] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:49.613216 22765 tablet_copy_client.cc:670] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:49.618172 22765 tablet_copy_client.cc:538] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:49.626989 22765 tablet_bootstrap.cc:492] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:49.645386 22765 tablet_bootstrap.cc:492] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:49.646167 22765 tablet_bootstrap.cc:492] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:49.646728 22765 ts_tablet_manager.cc:1403] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.001s
I20260709 13:07:49.648839 22765 raft_consensus.cc:359] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:49.649495 22765 raft_consensus.cc:740] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:49.650015 22765 consensus_queue.cc:260] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:49.653962 22765 ts_tablet_manager.cc:1434] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:49.655354 22762 ts_tablet_manager.cc:933] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:49.656876 21775 tablet_copy_service.cc:342] P 3843e9b794a245dd8608e04ec7915239: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-772d060b63de449b996b0ddc91936bcd received from {username='slave'} at 127.0.0.1:44772
I20260709 13:07:49.657318 21775 tablet_copy_service.cc:434] P 3843e9b794a245dd8608e04ec7915239: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-772d060b63de449b996b0ddc91936bcd on tablet 772d060b63de449b996b0ddc91936bcd with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:49.658239 22762 tablet_copy_client.cc:323] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:07:49.659927 21924 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet 71a084e9c0014661925a846711e7a18f from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:07:49.660418 21924 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet 71a084e9c0014661925a846711e7a18f from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-71a084e9c0014661925a846711e7a18f
I20260709 13:07:49.671816 21924 tablet_copy_source_session.cc:215] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:49.674691 22762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71a084e9c0014661925a846711e7a18f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.696805 22762 tablet_copy_client.cc:806] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:49.697535 22762 tablet_copy_client.cc:670] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:49.702869 22762 tablet_copy_client.cc:538] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:49.721527 22762 tablet_bootstrap.cc:492] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:49.724184 22765 ts_tablet_manager.cc:933] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:49.754390 22765 tablet_copy_client.cc:323] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:07:49.756481 21924 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet 8f23d2bb6e7e4e44b828b7f7ede73841 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:07:49.757061 21924 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet 8f23d2bb6e7e4e44b828b7f7ede73841 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-8f23d2bb6e7e4e44b828b7f7ede73841
I20260709 13:07:49.775256 21924 tablet_copy_source_session.cc:215] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:49.778906 22765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f23d2bb6e7e4e44b828b7f7ede73841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:49.779808 22762 tablet_bootstrap.cc:492] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:49.780856 22762 tablet_bootstrap.cc:492] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:49.781680 22762 ts_tablet_manager.cc:1403] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.060s	user 0.024s	sys 0.009s
I20260709 13:07:49.785982 22762 raft_consensus.cc:359] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:49.787554 22762 raft_consensus.cc:740] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:49.788465 22762 consensus_queue.cc:260] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:49.792565 22762 ts_tablet_manager.cc:1434] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:07:49.795074 21923 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-71a084e9c0014661925a846711e7a18f received from {username='slave'} at 127.0.0.1:45202
I20260709 13:07:49.795619 21923 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-71a084e9c0014661925a846711e7a18f on tablet 71a084e9c0014661925a846711e7a18f with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:49.832340 22765 tablet_copy_client.cc:806] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:49.833153 22765 tablet_copy_client.cc:670] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:49.837513 22765 tablet_copy_client.cc:538] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:49.847339 22765 tablet_bootstrap.cc:492] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:49.858943 22481 raft_consensus.cc:1217] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:49.892562 22765 tablet_bootstrap.cc:492] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:49.893604 22765 tablet_bootstrap.cc:492] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:49.894382 22765 ts_tablet_manager.cc:1403] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.000s
I20260709 13:07:49.897557 22765 raft_consensus.cc:359] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:49.898557 22765 raft_consensus.cc:740] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:49.899246 22765 consensus_queue.cc:260] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:49.901993 22765 ts_tablet_manager.cc:1434] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:07:49.903995 21924 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-8f23d2bb6e7e4e44b828b7f7ede73841 received from {username='slave'} at 127.0.0.1:45202
I20260709 13:07:49.904479 21924 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-8f23d2bb6e7e4e44b828b7f7ede73841 on tablet 8f23d2bb6e7e4e44b828b7f7ede73841 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:49.936599 22481 raft_consensus.cc:1217] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:50.084985 22481 raft_consensus.cc:1217] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:50.297806 22481 raft_consensus.cc:1217] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:50.333840 22713 raft_consensus.cc:1064] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:50.336427 22713 consensus_queue.cc:237] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:50.364493 22481 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:50.365711 22749 raft_consensus.cc:1064] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:50.366267 22743 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:50.379874 21910 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:50.381656 21835 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:50.381994 22741 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:50.384075 22741 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:50.368748 22749 consensus_queue.cc:237] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:07:50.413596 22774 log.cc:927] Time spent T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:07:50.425176 22482 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:50.428280 22649 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:50.439934 21835 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:50.444474 22709 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:50.449259 21764 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:50.451979 22748 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:07:50.469957 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 86987.7us
I20260709 13:07:50.482128 22709 raft_consensus.cc:2955] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:50.484653 21764 raft_consensus.cc:2955] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:50.489639 21835 raft_consensus.cc:2955] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:50.542619 21661 catalog_manager.cc:5697] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:50.593420 22743 raft_consensus.cc:2955] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:50.616464 21834 raft_consensus.cc:2955] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:50.620371 21910 raft_consensus.cc:2955] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:50.632905 22482 raft_consensus.cc:2955] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:50.653688 22481 raft_consensus.cc:2955] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:50.687296 22768 raft_consensus.cc:1064] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:50.692531 22768 consensus_queue.cc:237] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:50.715749 21662 catalog_manager.cc:5697] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:50.739813 21761 consensus_queue.cc:237] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:50.747896 21910 consensus_queue.cc:237] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:50.751801 22482 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:50.755016 21764 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:50.761446 21838 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:50.764278 21838 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:50.766579 22713 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:50.767526 22787 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:50.770852 22787 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:50.773047 22482 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:50.773350 22481 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:50.775326 22749 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:50.776234 22788 raft_consensus.cc:1064] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:50.777977 22713 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:50.780131 22768 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:50.783092 22788 consensus_queue.cc:237] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:50.790481 22709 raft_consensus.cc:2955] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:50.796109 22482 raft_consensus.cc:2955] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:50.800302 22713 raft_consensus.cc:2955] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:50.808465 22483 raft_consensus.cc:2955] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:07:50.858146 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 66814.9us
I20260709 13:07:50.866108 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7f2b8ba156604362aecf8501bef61de4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:50.883122 22481 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:50.885195 21649 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 772d060b63de449b996b0ddc91936bcd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:50.925271 21838 raft_consensus.cc:2955] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:50.926998 21764 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:50.976138 21836 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:07:50.987731 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 46982us
I20260709 13:07:50.990974 21663 catalog_manager.cc:5697] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:51.001540 22788 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:51.021395 21661 catalog_manager.cc:5697] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:51.024185 21897 tablet_service.cc:1558] Processing DeleteTablet for tablet 772d060b63de449b996b0ddc91936bcd with delete_type TABLET_DATA_TOMBSTONED (TS 6d698a5544b946939790e7a3972db9fb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49532
I20260709 13:07:51.038465 21765 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:51.017210 22800 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:07:51.049911 21826 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f2b8ba156604362aecf8501bef61de4 with delete_type TABLET_DATA_TOMBSTONED (TS 6fadfd81c5a645f1806a284ddbb6bf0d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38332
I20260709 13:07:51.090168 22800 raft_consensus.cc:2955] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:07:51.095305 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 43577.7us
I20260709 13:07:51.098124 22802 tablet_replica.cc:333] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:07:51.098619 22804 tablet_replica.cc:333] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:07:51.096922 22788 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:07:51.107583 21762 raft_consensus.cc:2955] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:51.125479 22649 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:51.140244 21836 raft_consensus.cc:2955] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:51.151494 22802 raft_consensus.cc:2243] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:51.155646 22802 raft_consensus.cc:2272] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:51.164921 22802 ts_tablet_manager.cc:1916] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:51.221150 22481 raft_consensus.cc:2955] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:51.230711 21661 catalog_manager.cc:5697] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:51.247097 22804 raft_consensus.cc:2243] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:51.248100 22804 raft_consensus.cc:2272] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:51.189626 21764 raft_consensus.cc:2955] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:51.255962 22804 ts_tablet_manager.cc:1916] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:51.279398 21914 consensus_queue.cc:237] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:51.289060 21836 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:51.289858 22798 raft_consensus.cc:2955] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:51.291988 22649 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:51.293751 22483 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:51.303159 21833 raft_consensus.cc:2955] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:51.304313 22709 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:51.306540 22483 raft_consensus.cc:2955] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:51.306646 21835 raft_consensus.cc:2955] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:51.300779 22787 raft_consensus.cc:2955] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:51.320737 22485 raft_consensus.cc:2955] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:51.327739 21661 catalog_manager.cc:5697] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:51.333076 22802 ts_tablet_manager.cc:1929] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:51.333812 22802 log.cc:1199] T 772d060b63de449b996b0ddc91936bcd P 6d698a5544b946939790e7a3972db9fb: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-2-root/wals/772d060b63de449b996b0ddc91936bcd
I20260709 13:07:51.339479 21762 raft_consensus.cc:2955] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:51.345752 21648 catalog_manager.cc:5028] TS 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): tablet 772d060b63de449b996b0ddc91936bcd (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:51.353974 22804 ts_tablet_manager.cc:1929] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:51.354563 22804 log.cc:1199] T 7f2b8ba156604362aecf8501bef61de4 P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-1-root/wals/7f2b8ba156604362aecf8501bef61de4
I20260709 13:07:51.357293 21647 catalog_manager.cc:5028] TS 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): tablet 7f2b8ba156604362aecf8501bef61de4 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:51.362977 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 71a084e9c0014661925a846711e7a18f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:51.370733 21663 catalog_manager.cc:5697] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:51.385946 21749 tablet_service.cc:1558] Processing DeleteTablet for tablet 71a084e9c0014661925a846711e7a18f with delete_type TABLET_DATA_TOMBSTONED (TS 3843e9b794a245dd8608e04ec7915239 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59090
I20260709 13:07:51.388032 21914 consensus_queue.cc:237] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:51.400053 22485 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:51.406117 22788 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:51.414042 22798 raft_consensus.cc:2955] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:51.400012 21835 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:51.421880 22796 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:51.422853 22485 raft_consensus.cc:2955] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:51.435937 22809 tablet_replica.cc:333] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:07:51.437388 22809 raft_consensus.cc:2243] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:51.438216 22809 raft_consensus.cc:2272] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:51.434919 21833 raft_consensus.cc:2955] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:51.448901 22809 ts_tablet_manager.cc:1916] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:51.454011 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8f23d2bb6e7e4e44b828b7f7ede73841 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:51.471673 21662 catalog_manager.cc:5697] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:51.505375 21749 tablet_service.cc:1558] Processing DeleteTablet for tablet 8f23d2bb6e7e4e44b828b7f7ede73841 with delete_type TABLET_DATA_TOMBSTONED (TS 3843e9b794a245dd8608e04ec7915239 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59090
I20260709 13:07:51.516477 22809 ts_tablet_manager.cc:1929] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:51.517055 22809 log.cc:1199] T 71a084e9c0014661925a846711e7a18f P 3843e9b794a245dd8608e04ec7915239: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-0-root/wals/71a084e9c0014661925a846711e7a18f
I20260709 13:07:51.519852 21649 catalog_manager.cc:5028] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): tablet 71a084e9c0014661925a846711e7a18f (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:51.520393 22809 tablet_replica.cc:333] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:07:51.529991 22809 raft_consensus.cc:2243] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:51.530979 22809 raft_consensus.cc:2272] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:51.536067 22809 ts_tablet_manager.cc:1916] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:51.549957 22809 ts_tablet_manager.cc:1929] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:51.550314 22809 log.cc:1199] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 3843e9b794a245dd8608e04ec7915239: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-0-root/wals/8f23d2bb6e7e4e44b828b7f7ede73841
I20260709 13:07:51.551856 21649 catalog_manager.cc:5028] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): tablet 8f23d2bb6e7e4e44b828b7f7ede73841 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:52.633567 21835 consensus_queue.cc:237] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:52.643518 21764 raft_consensus.cc:1275] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:07:52.646278 21806 consensus_peers.cc:597] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7b32fdbf1d5847cb8bb918426813576d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.646309 21909 raft_consensus.cc:1275] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:52.647055 22810 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:52.650861 22810 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:52.666558 22803 raft_consensus.cc:2955] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:52.669906 21764 raft_consensus.cc:2955] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:52.673574 21909 raft_consensus.cc:2955] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:52.688647 21663 catalog_manager.cc:5697] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:52.692273 21914 consensus_queue.cc:237] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:07:52.714071 21880 consensus_peers.cc:597] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9d0d92d0fde44e8b0697570a1c2024e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.717468 21762 raft_consensus.cc:1275] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:52.719262 21834 raft_consensus.cc:1275] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:52.720686 22768 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:52.721562 22649 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:52.748284 21835 raft_consensus.cc:2955] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:52.737619 22768 raft_consensus.cc:2955] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:52.760484 21764 raft_consensus.cc:2955] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:52.802263 21914 consensus_queue.cc:237] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:52.816866 21659 catalog_manager.cc:5697] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
W20260709 13:07:52.830806 21880 consensus_peers.cc:597] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0ec128cbd4ca4f3daa63f2db9749837f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.832481 21834 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:52.835282 21764 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:52.835135 22823 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:52.842772 22768 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:52.859334 22649 raft_consensus.cc:2955] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:52.875689 21835 raft_consensus.cc:2955] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
W20260709 13:07:52.893988 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 53442.9us
I20260709 13:07:52.905004 21662 catalog_manager.cc:5697] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.914798 21914 consensus_queue.cc:237] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:52.930512 21764 raft_consensus.cc:2955] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
W20260709 13:07:52.935523 21880 consensus_peers.cc:597] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6dd623bab71d4824b1463c6a5d774292. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:52.936704 21835 raft_consensus.cc:1275] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:52.938562 21762 raft_consensus.cc:1275] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:52.940081 22825 consensus_queue.cc:1048] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:52.956199 22826 consensus_queue.cc:1048] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:52.955533 22825 raft_consensus.cc:2955] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:52.968218 21835 raft_consensus.cc:2955] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:52.986073 21662 catalog_manager.cc:5697] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:53.005590 21764 raft_consensus.cc:2955] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:53.042856 22832 ts_tablet_manager.cc:933] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:07:53.045382 22832 tablet_copy_client.cc:323] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.2:34765
I20260709 13:07:53.047937 21850 tablet_copy_service.cc:140] P 6fadfd81c5a645f1806a284ddbb6bf0d: Received BeginTabletCopySession request for tablet 7b32fdbf1d5847cb8bb918426813576d from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:56424)
I20260709 13:07:53.048664 21850 tablet_copy_service.cc:161] P 6fadfd81c5a645f1806a284ddbb6bf0d: Beginning new tablet copy session on tablet 7b32fdbf1d5847cb8bb918426813576d from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:56424: session id = 8c6c2207af3d47b3acf352d81959f4dd-7b32fdbf1d5847cb8bb918426813576d
I20260709 13:07:53.058990 21850 tablet_copy_source_session.cc:215] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:53.064298 22832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b32fdbf1d5847cb8bb918426813576d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.083487 22832 tablet_copy_client.cc:806] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:53.084517 22832 tablet_copy_client.cc:670] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:53.089723 22832 tablet_copy_client.cc:538] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:53.100291 22832 tablet_bootstrap.cc:492] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:53.120925 22832 tablet_bootstrap.cc:492] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:53.121909 22832 tablet_bootstrap.cc:492] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:53.122596 22832 ts_tablet_manager.cc:1403] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 13:07:53.125777 22832 raft_consensus.cc:359] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:53.126751 22832 raft_consensus.cc:740] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:53.127466 22832 consensus_queue.cc:260] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:53.141410 22832 ts_tablet_manager.cc:1434] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.019s	user 0.015s	sys 0.004s
I20260709 13:07:53.144768 21850 tablet_copy_service.cc:342] P 6fadfd81c5a645f1806a284ddbb6bf0d: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-7b32fdbf1d5847cb8bb918426813576d received from {username='slave'} at 127.0.0.1:56424
I20260709 13:07:53.145296 21850 tablet_copy_service.cc:434] P 6fadfd81c5a645f1806a284ddbb6bf0d: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-7b32fdbf1d5847cb8bb918426813576d on tablet 7b32fdbf1d5847cb8bb918426813576d with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:53.317652 22832 ts_tablet_manager.cc:933] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:53.339267 22832 tablet_copy_client.cc:323] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:07:53.341953 21924 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet b9d0d92d0fde44e8b0697570a1c2024e from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:07:53.342576 21924 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet b9d0d92d0fde44e8b0697570a1c2024e from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-b9d0d92d0fde44e8b0697570a1c2024e
I20260709 13:07:53.358105 22837 ts_tablet_manager.cc:933] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:53.359311 21924 tablet_copy_source_session.cc:215] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:53.359957 22837 tablet_copy_client.cc:323] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:07:53.361888 21924 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet 0ec128cbd4ca4f3daa63f2db9749837f from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:07:53.362383 21924 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet 0ec128cbd4ca4f3daa63f2db9749837f from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-0ec128cbd4ca4f3daa63f2db9749837f
I20260709 13:07:53.363054 22832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d0d92d0fde44e8b0697570a1c2024e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.370188 21924 tablet_copy_source_session.cc:215] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:53.385196 22837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ec128cbd4ca4f3daa63f2db9749837f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.395874 22839 ts_tablet_manager.cc:933] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:53.398576 22832 tablet_copy_client.cc:806] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:53.399360 22832 tablet_copy_client.cc:670] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:53.400712 22839 tablet_copy_client.cc:323] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:07:53.402921 21923 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet 6dd623bab71d4824b1463c6a5d774292 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:07:53.403494 21923 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet 6dd623bab71d4824b1463c6a5d774292 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-6dd623bab71d4824b1463c6a5d774292
I20260709 13:07:53.407470 22837 tablet_copy_client.cc:806] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:53.408099 22837 tablet_copy_client.cc:670] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:53.411947 21923 tablet_copy_source_session.cc:215] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:53.413656 22832 tablet_copy_client.cc:538] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:53.415205 22837 tablet_copy_client.cc:538] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:53.423216 22832 tablet_bootstrap.cc:492] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:53.427351 22839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd623bab71d4824b1463c6a5d774292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:53.433710 22837 tablet_bootstrap.cc:492] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:53.486383 22839 tablet_copy_client.cc:806] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:53.487210 22839 tablet_copy_client.cc:670] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:53.491014 22839 tablet_copy_client.cc:538] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:53.491178 22832 tablet_bootstrap.cc:492] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:53.494505 22837 tablet_bootstrap.cc:492] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:53.495338 22832 tablet_bootstrap.cc:492] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:53.495988 22832 ts_tablet_manager.cc:1403] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.073s	user 0.031s	sys 0.011s
I20260709 13:07:53.495380 22837 tablet_bootstrap.cc:492] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:53.498708 22837 ts_tablet_manager.cc:1403] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.065s	user 0.027s	sys 0.029s
I20260709 13:07:53.500592 22832 raft_consensus.cc:359] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:53.501510 22832 raft_consensus.cc:740] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:53.502170 22832 consensus_queue.cc:260] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:53.501788 22837 raft_consensus.cc:359] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:53.503743 22837 raft_consensus.cc:740] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:53.504594 22837 consensus_queue.cc:260] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:53.507316 22832 ts_tablet_manager.cc:1434] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:07:53.510481 21923 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-b9d0d92d0fde44e8b0697570a1c2024e received from {username='slave'} at 127.0.0.1:45202
I20260709 13:07:53.511066 21923 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-b9d0d92d0fde44e8b0697570a1c2024e on tablet b9d0d92d0fde44e8b0697570a1c2024e with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:53.536105 22839 tablet_bootstrap.cc:492] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:53.546969 22837 ts_tablet_manager.cc:1434] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.048s	user 0.026s	sys 0.020s
I20260709 13:07:53.548705 21923 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-0ec128cbd4ca4f3daa63f2db9749837f received from {username='slave'} at 127.0.0.1:45202
I20260709 13:07:53.549111 21923 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-0ec128cbd4ca4f3daa63f2db9749837f on tablet 0ec128cbd4ca4f3daa63f2db9749837f with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:53.565858 22839 tablet_bootstrap.cc:492] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:53.566870 22839 tablet_bootstrap.cc:492] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:53.567615 22839 ts_tablet_manager.cc:1403] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.004s
I20260709 13:07:53.570784 22839 raft_consensus.cc:359] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:53.571691 22839 raft_consensus.cc:740] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:53.572557 22839 consensus_queue.cc:260] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:53.575212 22839 ts_tablet_manager.cc:1434] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.008s
I20260709 13:07:53.577004 21923 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-6dd623bab71d4824b1463c6a5d774292 received from {username='slave'} at 127.0.0.1:45202
I20260709 13:07:53.577448 21923 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-6dd623bab71d4824b1463c6a5d774292 on tablet 6dd623bab71d4824b1463c6a5d774292 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:53.647747 22485 raft_consensus.cc:1217] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:53.830363 22485 raft_consensus.cc:1217] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:53.857306 22485 raft_consensus.cc:1217] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:53.864415 22483 raft_consensus.cc:1217] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:54.216789 22846 raft_consensus.cc:1064] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:54.219177 22846 consensus_queue.cc:237] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:54.238927 22483 raft_consensus.cc:1275] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:54.240051 21833 raft_consensus.cc:1275] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:54.241914 22768 consensus_queue.cc:1048] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:54.242707 22826 consensus_queue.cc:1048] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:54.247802 21765 raft_consensus.cc:1275] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:54.249460 22825 consensus_queue.cc:1048] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:54.279569 22849 raft_consensus.cc:1064] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:54.284471 22849 consensus_queue.cc:237] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:54.295516 22768 raft_consensus.cc:2955] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.304886 22485 raft_consensus.cc:2955] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.334002 21765 raft_consensus.cc:2955] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.343367 21662 catalog_manager.cc:5697] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.354609 21835 raft_consensus.cc:2955] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.363397 22826 raft_consensus.cc:1064] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:54.366031 22826 consensus_queue.cc:237] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:54.399519 21765 raft_consensus.cc:1275] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:54.401609 21834 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:54.401744 22851 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:54.402257 21909 raft_consensus.cc:1275] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:54.403218 22649 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:54.404348 21765 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:54.403643 22483 raft_consensus.cc:1275] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:54.407889 22768 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:54.421645 22483 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:54.423205 22849 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:54.423851 22768 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:54.426096 22846 raft_consensus.cc:1064] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:54.440477 21909 consensus_queue.cc:237] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:54.448662 21762 raft_consensus.cc:1275] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:54.451453 22825 consensus_queue.cc:1048] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:07:54.452464 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 49463us
I20260709 13:07:54.452919 22482 raft_consensus.cc:1275] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:54.455559 22849 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:54.428860 22846 consensus_queue.cc:237] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:54.475982 22768 consensus_queue.cc:1048] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:54.487365 22649 raft_consensus.cc:2955] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.492748 22483 raft_consensus.cc:2955] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.507814 21762 raft_consensus.cc:2955] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.518656 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6dd623bab71d4824b1463c6a5d774292 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:54.518639 22825 raft_consensus.cc:2955] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.520933 22481 raft_consensus.cc:2955] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.540362 21663 catalog_manager.cc:5697] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.546082 22849 raft_consensus.cc:2955] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.556064 22482 raft_consensus.cc:2955] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.559029 21826 tablet_service.cc:1558] Processing DeleteTablet for tablet 6dd623bab71d4824b1463c6a5d774292 with delete_type TABLET_DATA_TOMBSTONED (TS 6fadfd81c5a645f1806a284ddbb6bf0d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38332
I20260709 13:07:54.609228 21663 catalog_manager.cc:5697] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.623225 22869 tablet_replica.cc:333] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:07:54.624370 22869 raft_consensus.cc:2243] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:54.624413 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 91563.6us
I20260709 13:07:54.627261 22869 raft_consensus.cc:2272] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:54.637334 21762 raft_consensus.cc:2955] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.640736 21663 catalog_manager.cc:5697] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.656967 22869 ts_tablet_manager.cc:1916] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:54.665952 21762 raft_consensus.cc:1275] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:54.667604 22482 raft_consensus.cc:1275] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:54.669854 22867 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:54.672865 22649 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:54.676219 21831 consensus_queue.cc:237] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:54.682459 21762 raft_consensus.cc:2955] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.688650 22481 raft_consensus.cc:1275] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:54.689999 22849 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:54.705374 22851 raft_consensus.cc:2955] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.709311 22869 ts_tablet_manager.cc:1929] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:54.709820 22869 log.cc:1199] T 6dd623bab71d4824b1463c6a5d774292 P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-1-root/wals/6dd623bab71d4824b1463c6a5d774292
I20260709 13:07:54.711164 21840 raft_consensus.cc:2955] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.714275 21832 raft_consensus.cc:1275] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:54.720459 21647 catalog_manager.cc:5028] TS 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): tablet 6dd623bab71d4824b1463c6a5d774292 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:54.721107 21757 raft_consensus.cc:1275] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:54.723233 22803 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:54.731536 21909 consensus_queue.cc:237] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:54.735481 21764 raft_consensus.cc:2955] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.750703 22825 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:54.732952 22481 raft_consensus.cc:2955] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.742318 22826 raft_consensus.cc:2955] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.768824 21832 raft_consensus.cc:2955] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.771661 22482 raft_consensus.cc:2955] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.783954 22483 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:54.786208 22825 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:54.817786 22872 raft_consensus.cc:2955] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.819453 21659 catalog_manager.cc:5697] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New cstate: current_term: 1 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.828950 21647 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7b32fdbf1d5847cb8bb918426813576d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:54.835005 21897 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b32fdbf1d5847cb8bb918426813576d with delete_type TABLET_DATA_TOMBSTONED (TS 6d698a5544b946939790e7a3972db9fb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49532
I20260709 13:07:54.842463 22483 raft_consensus.cc:2955] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.847551 22877 tablet_replica.cc:333] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:07:54.848259 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0ec128cbd4ca4f3daa63f2db9749837f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:54.851743 22877 raft_consensus.cc:2243] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:54.855443 22877 pending_rounds.cc:70] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb: Trying to abort 1 pending ops.
I20260709 13:07:54.857569 22877 pending_rounds.cc:77] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305635734662127616 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "7b32fdbf1d5847cb8bb918426813576d" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } } }
I20260709 13:07:54.862488 22877 raft_consensus.cc:2917] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:07:54.863374 22877 raft_consensus.cc:2889] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:07:54.864228 22877 raft_consensus.cc:2272] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:54.867007 21659 catalog_manager.cc:5697] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.870889 22877 ts_tablet_manager.cc:1916] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:54.873394 21831 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:54.873268 21757 raft_consensus.cc:2955] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.891974 22825 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:54.898087 22877 ts_tablet_manager.cc:1929] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:54.898707 22877 log.cc:1199] T 7b32fdbf1d5847cb8bb918426813576d P 6d698a5544b946939790e7a3972db9fb: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-2-root/wals/7b32fdbf1d5847cb8bb918426813576d
I20260709 13:07:54.905181 21648 catalog_manager.cc:5028] TS 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): tablet 7b32fdbf1d5847cb8bb918426813576d (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:54.905498 21660 catalog_manager.cc:5697] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.925310 21831 raft_consensus.cc:2955] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.934268 21749 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ec128cbd4ca4f3daa63f2db9749837f with delete_type TABLET_DATA_TOMBSTONED (TS 3843e9b794a245dd8608e04ec7915239 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59090
I20260709 13:07:54.938952 22878 tablet_replica.cc:333] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:07:54.940225 22878 raft_consensus.cc:2243] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:54.941756 22878 raft_consensus.cc:2272] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:54.946199 22878 ts_tablet_manager.cc:1916] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:54.954084 21914 consensus_queue.cc:237] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:54.961252 22481 raft_consensus.cc:1275] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:54.966756 22872 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:07:54.973603 22878 ts_tablet_manager.cc:1929] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:54.974146 22878 log.cc:1199] T 0ec128cbd4ca4f3daa63f2db9749837f P 3843e9b794a245dd8608e04ec7915239: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-0-root/wals/0ec128cbd4ca4f3daa63f2db9749837f
I20260709 13:07:54.977254 21649 catalog_manager.cc:5028] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): tablet 0ec128cbd4ca4f3daa63f2db9749837f (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:54.978533 22867 raft_consensus.cc:2955] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.986793 21757 raft_consensus.cc:1275] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:54.989814 22872 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:54.994925 21757 raft_consensus.cc:2955] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:54.995973 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b9d0d92d0fde44e8b0697570a1c2024e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:54.994525 22483 raft_consensus.cc:2955] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:55.018383 21663 catalog_manager.cc:5697] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.030321 21826 tablet_service.cc:1558] Processing DeleteTablet for tablet b9d0d92d0fde44e8b0697570a1c2024e with delete_type TABLET_DATA_TOMBSTONED (TS 6fadfd81c5a645f1806a284ddbb6bf0d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38332
I20260709 13:07:55.031345 22869 tablet_replica.cc:333] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:07:55.032285 22869 raft_consensus.cc:2243] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:55.033057 22869 raft_consensus.cc:2272] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:55.041673 22869 ts_tablet_manager.cc:1916] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:55.055083 22869 ts_tablet_manager.cc:1929] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:55.055433 22869 log.cc:1199] T b9d0d92d0fde44e8b0697570a1c2024e P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-1-root/wals/b9d0d92d0fde44e8b0697570a1c2024e
I20260709 13:07:55.056879 21647 catalog_manager.cc:5028] TS 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): tablet b9d0d92d0fde44e8b0697570a1c2024e (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:56.110013 21757 consensus_queue.cc:237] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:07:56.116619 21731 consensus_peers.cc:597] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab7de8b45d37410487e1759ba66727e1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:56.117074 21909 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:56.117921 21840 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:56.118641 22883 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:56.119648 22880 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:56.128463 22776 raft_consensus.cc:2955] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:56.130131 21909 raft_consensus.cc:2955] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:56.131175 21840 raft_consensus.cc:2955] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:56.146349 21660 catalog_manager.cc:5697] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:56.150759 21909 consensus_queue.cc:237] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:07:56.161955 21880 consensus_peers.cc:597] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b50256b3ab294021ae20aa34053b59e1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:56.164572 21840 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:56.166664 22826 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:56.176117 21764 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:56.179378 22867 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:56.186930 21831 raft_consensus.cc:2955] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:56.197597 22867 raft_consensus.cc:2955] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:56.212877 21764 raft_consensus.cc:2955] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:56.213910 21757 consensus_queue.cc:237] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:56.212790 21659 catalog_manager.cc:5697] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:56.228128 21909 raft_consensus.cc:1275] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:56.228296 21831 raft_consensus.cc:1275] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:56.229753 22776 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:56.232004 22883 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:56.232306 21731 consensus_peers.cc:597] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e7bb11958aa45b0a1f77b20c2e9a6e5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:56.244390 21909 raft_consensus.cc:2955] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:56.241567 22776 raft_consensus.cc:2955] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:56.252569 21831 raft_consensus.cc:2955] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:56.262339 21909 consensus_queue.cc:237] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:56.262662 21659 catalog_manager.cc:5697] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:56.272898 21757 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:07:56.272897 21831 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:07:56.274832 21880 consensus_peers.cc:597] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a0e492aa4394405bb48ed3b957dd8f23. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:56.275847 22881 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:56.276795 22867 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:56.290753 22872 raft_consensus.cc:2955] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:56.292810 21840 raft_consensus.cc:2955] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:56.294462 21764 raft_consensus.cc:2955] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:56.310518 21659 catalog_manager.cc:5697] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:07:56.538632 22900 ts_tablet_manager.cc:933] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645)
I20260709 13:07:56.541201 22900 tablet_copy_client.cc:323] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.1:46645
I20260709 13:07:56.543180 21775 tablet_copy_service.cc:140] P 3843e9b794a245dd8608e04ec7915239: Received BeginTabletCopySession request for tablet ab7de8b45d37410487e1759ba66727e1 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:44772)
I20260709 13:07:56.543740 21775 tablet_copy_service.cc:161] P 3843e9b794a245dd8608e04ec7915239: Beginning new tablet copy session on tablet ab7de8b45d37410487e1759ba66727e1 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:44772: session id = 8c6c2207af3d47b3acf352d81959f4dd-ab7de8b45d37410487e1759ba66727e1
I20260709 13:07:56.551483 21775 tablet_copy_source_session.cc:215] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:56.554739 22900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab7de8b45d37410487e1759ba66727e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:56.568148 22900 tablet_copy_client.cc:806] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:56.568780 22900 tablet_copy_client.cc:670] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:56.573030 22900 tablet_copy_client.cc:538] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:56.580989 22900 tablet_bootstrap.cc:492] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:56.599802 22902 ts_tablet_manager.cc:933] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:56.602737 22902 tablet_copy_client.cc:323] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:07:56.604234 21923 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet b50256b3ab294021ae20aa34053b59e1 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:07:56.604760 21923 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet b50256b3ab294021ae20aa34053b59e1 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-b50256b3ab294021ae20aa34053b59e1
I20260709 13:07:56.609469 22900 tablet_bootstrap.cc:492] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:56.610561 22900 tablet_bootstrap.cc:492] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:56.611322 22900 ts_tablet_manager.cc:1403] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.010s
I20260709 13:07:56.614632 22900 raft_consensus.cc:359] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:56.616055 21923 tablet_copy_source_session.cc:215] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:56.615612 22900 raft_consensus.cc:740] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:56.617067 22900 consensus_queue.cc:260] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:56.622525 22902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b50256b3ab294021ae20aa34053b59e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:56.626943 22900 ts_tablet_manager.cc:1434] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.008s
I20260709 13:07:56.631065 21775 tablet_copy_service.cc:342] P 3843e9b794a245dd8608e04ec7915239: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-ab7de8b45d37410487e1759ba66727e1 received from {username='slave'} at 127.0.0.1:44772
I20260709 13:07:56.631558 21775 tablet_copy_service.cc:434] P 3843e9b794a245dd8608e04ec7915239: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-ab7de8b45d37410487e1759ba66727e1 on tablet ab7de8b45d37410487e1759ba66727e1 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:56.646020 22902 tablet_copy_client.cc:806] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:56.646684 22902 tablet_copy_client.cc:670] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:56.649959 22902 tablet_copy_client.cc:538] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:56.657220 22902 tablet_bootstrap.cc:492] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:56.680150 22902 tablet_bootstrap.cc:492] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:56.680879 22902 tablet_bootstrap.cc:492] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:56.681532 22902 ts_tablet_manager.cc:1403] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.007s
I20260709 13:07:56.683717 22902 raft_consensus.cc:359] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:56.684372 22902 raft_consensus.cc:740] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:56.684973 22902 consensus_queue.cc:260] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:56.687106 22902 ts_tablet_manager.cc:1434] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:56.688925 21923 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-b50256b3ab294021ae20aa34053b59e1 received from {username='slave'} at 127.0.0.1:45202
I20260709 13:07:56.689330 21923 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-b50256b3ab294021ae20aa34053b59e1 on tablet b50256b3ab294021ae20aa34053b59e1 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:56.809401 22902 ts_tablet_manager.cc:933] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645)
I20260709 13:07:56.811291 22902 tablet_copy_client.cc:323] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.1:46645
I20260709 13:07:56.814333 21775 tablet_copy_service.cc:140] P 3843e9b794a245dd8608e04ec7915239: Received BeginTabletCopySession request for tablet 7e7bb11958aa45b0a1f77b20c2e9a6e5 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:44772)
I20260709 13:07:56.815325 21775 tablet_copy_service.cc:161] P 3843e9b794a245dd8608e04ec7915239: Beginning new tablet copy session on tablet 7e7bb11958aa45b0a1f77b20c2e9a6e5 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:44772: session id = 8c6c2207af3d47b3acf352d81959f4dd-7e7bb11958aa45b0a1f77b20c2e9a6e5
I20260709 13:07:56.821647 21775 tablet_copy_source_session.cc:215] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:56.824606 22902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e7bb11958aa45b0a1f77b20c2e9a6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:56.841361 22902 tablet_copy_client.cc:806] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:56.842087 22902 tablet_copy_client.cc:670] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:56.845626 22902 tablet_copy_client.cc:538] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:56.858423 22902 tablet_bootstrap.cc:492] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:56.894752 22900 ts_tablet_manager.cc:933] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:56.905185 22900 tablet_copy_client.cc:323] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:07:56.906988 21923 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet a0e492aa4394405bb48ed3b957dd8f23 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:07:56.907658 21923 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet a0e492aa4394405bb48ed3b957dd8f23 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-a0e492aa4394405bb48ed3b957dd8f23
I20260709 13:07:56.924659 21923 tablet_copy_source_session.cc:215] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:56.936757 22900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0e492aa4394405bb48ed3b957dd8f23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:56.955857 22902 tablet_bootstrap.cc:492] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:56.956954 22902 tablet_bootstrap.cc:492] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:56.957736 22902 ts_tablet_manager.cc:1403] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.100s	user 0.038s	sys 0.050s
I20260709 13:07:56.961357 22902 raft_consensus.cc:359] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:56.962849 22900 tablet_copy_client.cc:806] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:56.962275 22902 raft_consensus.cc:740] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:56.963568 22900 tablet_copy_client.cc:670] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:56.964121 22902 consensus_queue.cc:260] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:56.967237 22902 ts_tablet_manager.cc:1434] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:07:56.970155 21775 tablet_copy_service.cc:342] P 3843e9b794a245dd8608e04ec7915239: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-7e7bb11958aa45b0a1f77b20c2e9a6e5 received from {username='slave'} at 127.0.0.1:44772
I20260709 13:07:56.970162 22900 tablet_copy_client.cc:538] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:56.970628 21775 tablet_copy_service.cc:434] P 3843e9b794a245dd8608e04ec7915239: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-7e7bb11958aa45b0a1f77b20c2e9a6e5 on tablet 7e7bb11958aa45b0a1f77b20c2e9a6e5 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:56.986550 22900 tablet_bootstrap.cc:492] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:07:57.007126 22900 tablet_bootstrap.cc:492] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:57.007920 22900 tablet_bootstrap.cc:492] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:07:57.008473 22900 ts_tablet_manager.cc:1403] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 13:07:57.010730 22900 raft_consensus.cc:359] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:57.011543 22900 raft_consensus.cc:740] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:07:57.012197 22900 consensus_queue.cc:260] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:07:57.018100 22900 ts_tablet_manager.cc:1434] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:07:57.023393 21923 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-a0e492aa4394405bb48ed3b957dd8f23 received from {username='slave'} at 127.0.0.1:45202
I20260709 13:07:57.023823 21923 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-a0e492aa4394405bb48ed3b957dd8f23 on tablet a0e492aa4394405bb48ed3b957dd8f23 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:57.056557 22483 raft_consensus.cc:1217] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:57.096447 22481 raft_consensus.cc:1217] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:57.262976 22481 raft_consensus.cc:1217] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:57.353338 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:57.421104 22481 raft_consensus.cc:1217] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:07:57.426772 21909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:07:57.427484 21909 raft_consensus.cc:606] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:57.449299 21764 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:35914
I20260709 13:07:57.449914 21764 raft_consensus.cc:606] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:57.452853 21909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:07:57.453389 21909 raft_consensus.cc:606] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:57.456532 21757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a740500460ba465faaeb007be4b83108"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:35914
I20260709 13:07:57.456919 21757 raft_consensus.cc:606] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:57.459054 21757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:35914
I20260709 13:07:57.459473 21757 raft_consensus.cc:606] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:57.460343 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:57.461604 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:57.475592 22913 raft_consensus.cc:1064] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:57.478870 22913 consensus_queue.cc:237] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:57.487915 22481 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.489622 22776 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:57.495282 21840 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.496939 22883 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:57.497951 21909 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.500459 22776 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:57.503237 22776 raft_consensus.cc:993] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:07:57.509862 22776 raft_consensus.cc:1081] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:07:57.512188 21832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a740500460ba465faaeb007be4b83108"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38348
I20260709 13:07:57.512769 21832 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:57.513104 21832 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.520213 21832 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:57.538484 21832 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:57.547923 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:57.549292 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:57.550050 21914 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.549340 21757 raft_consensus.cc:3055] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:57.555096 21757 raft_consensus.cc:740] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:07:57.556264 21757 consensus_queue.cc:260] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:57.561286 21757 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.580029 22867 raft_consensus.cc:993] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:07:57.580497 22867 raft_consensus.cc:1081] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:07:57.581024 21914 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:07:57.588455 21804 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:57.589669 22849 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:57.590189 22849 raft_consensus.cc:697] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:07:57.590992 22849 consensus_queue.cc:237] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:57.582477 21840 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38352
W20260709 13:07:57.582998 22919 log.cc:927] Time spent T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:07:57.591995 21840 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:57.592387 21840 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.594727 22776 raft_consensus.cc:2955] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:57.595836 21909 raft_consensus.cc:2955] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:57.594190 21757 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:07:57.623893 21831 raft_consensus.cc:2955] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:57.630833 22483 raft_consensus.cc:2955] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:57.632288 21840 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:57.634438 21840 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:57.635129 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:57.635725 21757 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.637127 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:57.637663 21910 raft_consensus.cc:3055] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:57.637930 21910 raft_consensus.cc:740] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:57.638633 21910 consensus_queue.cc:260] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:57.639593 21910 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.640386 21663 catalog_manager.cc:5697] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 1 to 2, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 2 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.636335 21660 catalog_manager.cc:5697] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:57.660285 21757 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:07:57.667793 21805 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:57.668983 22911 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:57.669678 22883 raft_consensus.cc:1064] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:57.672163 22883 consensus_queue.cc:237] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:57.680562 21910 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:07:57.681977 22911 raft_consensus.cc:697] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:07:57.686087 22911 consensus_queue.cc:237] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:57.688695 22872 raft_consensus.cc:1064] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:57.692062 22872 consensus_queue.cc:237] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:57.706301 22481 raft_consensus.cc:1275] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.708699 22776 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:57.709019 21910 raft_consensus.cc:1275] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.704373 21831 raft_consensus.cc:1275] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.712357 22883 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:57.713585 22913 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:57.720541 21832 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.721172 21757 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.722710 22482 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:57.722810 22899 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:07:57.725584 22872 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:57.725610 22880 raft_consensus.cc:993] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:07:57.727348 22880 raft_consensus.cc:1081] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:07:57.729555 21831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38348
I20260709 13:07:57.730137 21831 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:57.730571 21831 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.746649 21831 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:57.755895 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:57.756515 21762 raft_consensus.cc:3055] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:57.756803 21762 raft_consensus.cc:740] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:07:57.757589 21762 consensus_queue.cc:260] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:57.758579 21762 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.753547 22899 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:07:57.776242 22913 raft_consensus.cc:993] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:07:57.802753 21663 catalog_manager.cc:5697] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 2 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.777103 22913 raft_consensus.cc:1081] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:07:57.767061 21831 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:57.825709 21839 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38348
I20260709 13:07:57.826568 21839 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:57.827061 21839 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.851411 21762 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:07:57.852805 21805 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:57.853729 22849 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:57.854260 22849 raft_consensus.cc:697] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:07:57.855141 22849 consensus_queue.cc:237] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:57.858772 21839 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:57.861156 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:57.866331 21914 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.870741 22826 raft_consensus.cc:2955] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:57.875577 21914 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:07:57.878862 21839 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:57.879549 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:57.881136 21762 raft_consensus.cc:3055] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:57.881507 21762 raft_consensus.cc:740] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:07:57.882138 21762 consensus_queue.cc:260] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:57.886152 22776 raft_consensus.cc:2955] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:57.893702 21909 raft_consensus.cc:2955] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:57.896450 21762 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.897713 21764 consensus_queue.cc:237] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:57.909230 22483 raft_consensus.cc:2955] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:57.914721 21663 catalog_manager.cc:5697] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 1 to 2, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 2 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.916432 21762 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
W20260709 13:07:57.930644 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 48987us
I20260709 13:07:57.930258 21805 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:57.937057 22911 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:57.973783 21839 raft_consensus.cc:2955] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:57.968196 22940 raft_consensus.cc:993] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:07:57.976696 22940 raft_consensus.cc:1081] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:07:57.968080 22911 raft_consensus.cc:697] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:07:57.979947 22911 consensus_queue.cc:237] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:57.984910 22483 raft_consensus.cc:2955] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:07:57.988478 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 56016.7us
I20260709 13:07:57.999253 21832 raft_consensus.cc:2955] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:07:58.002362 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 82205.4us
I20260709 13:07:57.991519 21661 catalog_manager.cc:5697] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:58.006747 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:58.007401 21909 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:58.015087 21831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38352
I20260709 13:07:58.015971 21831 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:58.016453 21831 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:58.022099 21909 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:07:58.033725 21757 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:58.036170 22923 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:07:58.040341 22483 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:58.056618 21831 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:58.080487 21831 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:58.086534 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:58.087214 21762 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:58.087957 21660 catalog_manager.cc:5697] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.098096 21762 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:07:58.106058 22940 raft_consensus.cc:1064] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:07:58.101092 22880 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:07:58.111517 22940 consensus_queue.cc:237] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:58.151908 22942 raft_consensus.cc:2955] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:58.154963 22482 raft_consensus.cc:2955] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:58.183588 21805 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:58.188020 22954 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:07:58.185191 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 143381us
I20260709 13:07:58.188787 22954 raft_consensus.cc:697] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:07:58.190011 22954 consensus_queue.cc:237] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:58.196290 21649 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ab7de8b45d37410487e1759ba66727e1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:07:58.197046 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 125304us
I20260709 13:07:58.199009 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:58.199576 21909 raft_consensus.cc:3055] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:58.199877 21909 raft_consensus.cc:740] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:58.200592 21909 consensus_queue.cc:260] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:58.202095 21912 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:58.202958 21909 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:58.210197 21840 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:07:58.214979 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 180502us
I20260709 13:07:58.225243 21764 raft_consensus.cc:2955] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:58.248873 21662 catalog_manager.cc:5697] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:58.256682 21757 consensus_queue.cc:237] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:58.271256 21909 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:07:58.275128 22952 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:58.283485 21832 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:58.284452 21660 catalog_manager.cc:5697] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 1 to 2, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 2 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.285687 22482 raft_consensus.cc:1275] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:58.287631 22880 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:58.287846 22958 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:58.288905 21897 tablet_service.cc:1558] Processing DeleteTablet for tablet ab7de8b45d37410487e1759ba66727e1 with delete_type TABLET_DATA_TOMBSTONED (TS 6d698a5544b946939790e7a3972db9fb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49532
I20260709 13:07:58.286227 21660 catalog_manager.cc:5697] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 2 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:58.291256 21912 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:58.294265 21909 consensus_queue.cc:237] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:58.300498 22485 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:58.305469 21832 raft_consensus.cc:2955] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:58.315343 22940 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:58.317406 21757 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:58.321102 22899 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:58.321496 21761 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:07:58.343725 21839 raft_consensus.cc:1275] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:58.343986 22963 tablet_replica.cc:333] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:07:58.345836 22880 raft_consensus.cc:2955] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:58.347100 21912 raft_consensus.cc:1275] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:58.351125 22911 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:58.352002 22954 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:58.355647 22485 raft_consensus.cc:2955] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:58.358433 22911 consensus_queue.cc:1048] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:58.361527 21649 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7e7bb11958aa45b0a1f77b20c2e9a6e5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:58.368124 22952 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:58.368767 22482 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:58.370427 22951 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:58.374326 21831 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:58.381131 22951 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:07:58.381764 21662 catalog_manager.cc:5697] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:58.392076 22963 raft_consensus.cc:2243] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.388666 22951 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:07:58.408270 22963 raft_consensus.cc:2272] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.395172 22955 raft_consensus.cc:2955] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:58.401031 21897 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e7bb11958aa45b0a1f77b20c2e9a6e5 with delete_type TABLET_DATA_TOMBSTONED (TS 6d698a5544b946939790e7a3972db9fb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49532
I20260709 13:07:58.403391 22483 raft_consensus.cc:2955] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:58.409317 21912 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:58.424507 22963 ts_tablet_manager.cc:1916] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:58.410501 22940 raft_consensus.cc:2955] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:58.394241 21831 raft_consensus.cc:2955] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:58.426729 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b50256b3ab294021ae20aa34053b59e1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:58.409714 21832 raft_consensus.cc:2955] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:58.444765 21764 raft_consensus.cc:1275] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:58.424589 21840 raft_consensus.cc:2955] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:58.456487 22958 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:07:58.464684 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:58.514508 21661 catalog_manager.cc:5697] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:58.515066 22483 raft_consensus.cc:2955] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:58.523581 21764 raft_consensus.cc:2955] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:58.545035 22963 ts_tablet_manager.cc:1929] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:58.545603 22963 log.cc:1199] T ab7de8b45d37410487e1759ba66727e1 P 6d698a5544b946939790e7a3972db9fb: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-2-root/wals/ab7de8b45d37410487e1759ba66727e1
I20260709 13:07:58.549809 21648 catalog_manager.cc:5028] TS 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): tablet ab7de8b45d37410487e1759ba66727e1 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:58.552558 22963 tablet_replica.cc:333] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:07:58.554102 22958 consensus_queue.cc:1048] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:58.561537 21660 catalog_manager.cc:5697] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.562950 21749 tablet_service.cc:1558] Processing DeleteTablet for tablet b50256b3ab294021ae20aa34053b59e1 with delete_type TABLET_DATA_TOMBSTONED (TS 3843e9b794a245dd8608e04ec7915239 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59090
I20260709 13:07:58.567247 21764 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:58.568516 22963 raft_consensus.cc:2243] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.569366 22963 raft_consensus.cc:2272] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.576470 22963 ts_tablet_manager.cc:1916] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:58.602418 22911 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:58.602418 22963 ts_tablet_manager.cc:1929] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:58.604727 22963 log.cc:1199] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6d698a5544b946939790e7a3972db9fb: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-2-root/wals/7e7bb11958aa45b0a1f77b20c2e9a6e5
I20260709 13:07:58.607954 21648 catalog_manager.cc:5028] TS 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): tablet 7e7bb11958aa45b0a1f77b20c2e9a6e5 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:58.650228 22974 tablet_replica.cc:333] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:07:58.653761 22974 raft_consensus.cc:2243] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.654691 22974 raft_consensus.cc:2272] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.660436 22974 ts_tablet_manager.cc:1916] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:58.659029 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:58.686324 22974 ts_tablet_manager.cc:1929] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:58.686830 22974 log.cc:1199] T b50256b3ab294021ae20aa34053b59e1 P 3843e9b794a245dd8608e04ec7915239: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-0-root/wals/b50256b3ab294021ae20aa34053b59e1
I20260709 13:07:58.688580 21649 catalog_manager.cc:5028] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): tablet b50256b3ab294021ae20aa34053b59e1 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:58.700781 21909 raft_consensus.cc:1275] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:58.702512 22911 consensus_queue.cc:1048] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:58.737202 21762 raft_consensus.cc:1275] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:58.739593 22958 consensus_queue.cc:1048] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:58.749109 21909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:07:58.749761 21909 raft_consensus.cc:606] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Received request to transfer leadership to TS 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:58.760231 21909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:07:58.760718 21909 raft_consensus.cc:606] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Received request to transfer leadership to TS 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:58.764611 21909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:07:58.765129 21909 raft_consensus.cc:606] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:58.768024 21909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:07:58.768465 21909 raft_consensus.cc:606] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Received request to transfer leadership to TS 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:58.772708 21909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:07:58.773201 21909 raft_consensus.cc:606] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:58.778656 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:58.780377 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:07:58.906080 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 107870us
I20260709 13:07:58.953743 22826 raft_consensus.cc:993] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:07:58.954248 22826 raft_consensus.cc:1081] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:07:58.960301 21832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38352
I20260709 13:07:58.960858 21832 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:58.961200 21832 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:58.972815 21832 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:58.979525 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:58.980122 21914 raft_consensus.cc:3055] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:58.980417 21914 raft_consensus.cc:740] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:58.981168 21914 consensus_queue.cc:260] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:58.981541 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:58.982100 21757 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:58.982225 21914 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:58.988662 21757 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:07:58.995328 21832 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:58.988662 21914 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:07:58.999671 21804 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:59.000468 22957 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:59.000973 22957 raft_consensus.cc:697] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:07:59.001863 22945 raft_consensus.cc:993] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:07:59.002136 22867 raft_consensus.cc:993] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:07:59.002452 22955 raft_consensus.cc:1081] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Signalling peer 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:07:59.002666 22867 raft_consensus.cc:1081] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Signalling peer 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:07:59.001875 22957 consensus_queue.cc:237] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:59.004881 22482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:36290
I20260709 13:07:59.005455 22482 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:59.005807 22482 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.009990 22483 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:36290
I20260709 13:07:59.010586 22483 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:59.010926 22483 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.025039 22482 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:59.034117 22483 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:59.037607 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:59.038316 21909 raft_consensus.cc:3055] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:59.038676 21909 raft_consensus.cc:740] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:59.039052 21914 consensus_queue.cc:237] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:59.039453 21909 consensus_queue.cc:260] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:59.040556 21909 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.042757 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:59.043553 21761 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.044819 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:59.037664 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:59.045467 21912 raft_consensus.cc:3055] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:59.045535 21832 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.045826 21912 raft_consensus.cc:740] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:59.046620 21912 consensus_queue.cc:260] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:59.047679 21912 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.053257 22482 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:59.057000 22899 raft_consensus.cc:993] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:07:59.063642 22899 raft_consensus.cc:1081] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Signalling peer 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:07:59.066851 22483 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:59.061283 21761 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:07:59.074640 22450 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:07:59.062959 21909 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:07:59.071838 22482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:36290
I20260709 13:07:59.078634 22482 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:59.078895 22449 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:07:59.079080 22482 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.060259 21912 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:07:59.084510 21832 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:07:59.091120 22483 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:59.093760 22899 raft_consensus.cc:993] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:07:59.094285 22899 raft_consensus.cc:1081] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:07:59.098487 21831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38352
I20260709 13:07:59.099054 21831 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:59.099376 21831 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.102135 21761 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:07:59.102721 22951 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:59.106827 22985 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:59.108014 22899 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:07:59.122324 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 43536.6us
I20260709 13:07:59.124928 22985 raft_consensus.cc:697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:07:59.126116 22985 consensus_queue.cc:237] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:59.126360 21661 catalog_manager.cc:5697] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 2 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.122400 22986 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:59.130178 22986 raft_consensus.cc:697] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:07:59.131040 22986 consensus_queue.cc:237] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:59.133283 22951 raft_consensus.cc:2955] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:59.136180 22481 raft_consensus.cc:2955] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:59.137598 21761 raft_consensus.cc:2955] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:07:59.144353 22482 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:59.155133 22482 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:59.155730 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:07:59.156314 21832 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.156229 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:59.156843 21912 raft_consensus.cc:3055] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:59.157130 21912 raft_consensus.cc:740] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:59.157882 21912 consensus_queue.cc:260] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:59.159057 21912 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.132211 21831 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:59.161520 21831 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:59.162143 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:59.162741 21757 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.169751 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:59.170415 21909 raft_consensus.cc:3055] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:59.170724 21909 raft_consensus.cc:740] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:07:59.171427 21909 consensus_queue.cc:260] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:59.172561 21909 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.169903 21832 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:07:59.180564 21909 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:07:59.181804 21804 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:07:59.182793 22958 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:59.181694 21660 catalog_manager.cc:5697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 2 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.183261 22958 raft_consensus.cc:697] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:07:59.184870 22448 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:07:59.189030 22958 consensus_queue.cc:237] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:59.190609 22985 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:59.195711 22985 raft_consensus.cc:697] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:07:59.196627 22985 consensus_queue.cc:237] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:07:59.202478 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a0e492aa4394405bb48ed3b957dd8f23 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:59.212651 21663 catalog_manager.cc:5697] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.184123 21660 catalog_manager.cc:5697] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 2 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.233134 21826 tablet_service.cc:1558] Processing DeleteTablet for tablet a0e492aa4394405bb48ed3b957dd8f23 with delete_type TABLET_DATA_TOMBSTONED (TS 6fadfd81c5a645f1806a284ddbb6bf0d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38332
I20260709 13:07:59.245038 22994 tablet_replica.cc:333] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:07:59.246119 22994 raft_consensus.cc:2243] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:59.247048 22994 raft_consensus.cc:2272] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:59.250162 22994 ts_tablet_manager.cc:1916] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:59.224464 21757 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:07:59.253062 21912 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:07:59.271835 22994 ts_tablet_manager.cc:1929] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:07:59.272361 22994 log.cc:1199] T a0e492aa4394405bb48ed3b957dd8f23 P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-1-root/wals/a0e492aa4394405bb48ed3b957dd8f23
I20260709 13:07:59.274366 21647 catalog_manager.cc:5028] TS 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): tablet a0e492aa4394405bb48ed3b957dd8f23 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:07:59.280215 21663 catalog_manager.cc:5697] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 2 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.283214 21660 catalog_manager.cc:5697] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 2 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.391765 21912 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:59.392966 22958 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.406139 21757 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:59.407258 22958 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:59.516094 21912 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:59.517388 22985 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:59.528558 21757 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:59.529881 22985 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:59.559674 21912 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:59.561002 22985 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:59.570711 21831 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:59.572113 22986 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:59.630257 21912 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:59.631510 22923 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:59.647943 21757 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:59.654471 22957 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:59.684051 21912 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:59.685389 22986 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:59.702417 21831 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:07:59.704674 22985 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:59.781289 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:59.823623 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:59.860262 21909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:07:59.860718 21909 raft_consensus.cc:606] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Received request to transfer leadership to TS 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:59.863591 21909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:07:59.864152 21909 raft_consensus.cc:606] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Received request to transfer leadership to TS 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:59.866621 21909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:07:59.867251 21909 raft_consensus.cc:606] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Received request to transfer leadership to TS 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:07:59.870240 21909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:07:59.870836 21909 raft_consensus.cc:606] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:07:59.873363 21912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:07:59.873909 21912 raft_consensus.cc:606] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:07:59.875204 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:59.876467 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:59.981895 22946 raft_consensus.cc:993] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:07:59.982404 22899 raft_consensus.cc:1081] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:07:59.983760 21832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38352
I20260709 13:07:59.984220 21832 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:59.984544 21832 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.989328 21832 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:07:59.991037 21832 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:07:59.992022 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:07:59.992671 21757 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:59.998104 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:07:59.999435 21912 raft_consensus.cc:3055] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:59.999765 21912 raft_consensus.cc:740] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:00.000519 21912 consensus_queue.cc:260] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:00.001480 21757 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:00.001711 21912 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.004684 21805 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:00.005484 22958 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:00.005990 22958 raft_consensus.cc:697] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:00.006845 22958 consensus_queue.cc:237] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:00.011936 21912 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:00.021124 22946 raft_consensus.cc:993] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:08:00.021661 22946 raft_consensus.cc:1081] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Signalling peer 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:08:00.023203 22481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:36290
I20260709 13:08:00.023746 22481 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:00.024078 22481 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.024523 21663 catalog_manager.cc:5697] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 2 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.030005 22481 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:00.031850 22481 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:00.032809 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:00.033000 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:00.033564 21757 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.033797 21909 raft_consensus.cc:3055] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:00.034394 21909 raft_consensus.cc:740] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:00.035229 21909 consensus_queue.cc:260] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:00.036576 21909 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.039711 21757 raft_consensus.cc:2468] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:00.041374 22450 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:00.042289 22985 raft_consensus.cc:2804] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:00.042726 22985 raft_consensus.cc:697] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:00.043926 21909 raft_consensus.cc:2468] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:00.043802 22985 consensus_queue.cc:237] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:00.052958 21663 catalog_manager.cc:5697] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 2 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.071071 22899 raft_consensus.cc:993] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:08:00.071681 22899 raft_consensus.cc:1081] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Signalling peer 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:08:00.073096 22481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:36290
I20260709 13:08:00.073596 22481 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:00.073889 22481 raft_consensus.cc:3060] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.079316 22481 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:00.081935 22481 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:00.082791 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:00.083364 21909 raft_consensus.cc:3055] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:00.083611 21909 raft_consensus.cc:740] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:00.084285 21909 consensus_queue.cc:260] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:00.085389 21909 raft_consensus.cc:3060] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.090416 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:00.091102 21757 raft_consensus.cc:3060] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.091481 21909 raft_consensus.cc:2468] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:00.092573 22449 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:00.093267 22985 raft_consensus.cc:2804] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:00.093765 22985 raft_consensus.cc:697] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:00.094527 22985 consensus_queue.cc:237] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:00.096662 21757 raft_consensus.cc:2468] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:00.103648 21663 catalog_manager.cc:5697] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 2 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.227849 22946 raft_consensus.cc:993] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:08:00.228470 22899 raft_consensus.cc:1081] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Signalling peer 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:08:00.230118 22482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:36290
I20260709 13:08:00.230626 22482 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:00.230950 22482 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.236228 22482 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:00.238870 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:00.239434 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:00.239766 21757 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.240036 21912 raft_consensus.cc:3055] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:00.240384 21912 raft_consensus.cc:740] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:00.241070 21912 consensus_queue.cc:260] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:00.241684 22482 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:00.242211 21912 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.247185 21757 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:00.248289 22450 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:00.249212 22985 raft_consensus.cc:2804] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:00.249784 22985 raft_consensus.cc:697] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:00.250536 22985 consensus_queue.cc:237] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:00.253201 21912 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:00.259418 21663 catalog_manager.cc:5697] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 2 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.310331 23019 raft_consensus.cc:993] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:08:00.310870 22899 raft_consensus.cc:1081] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:08:00.312392 21762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:08:00.312928 21762 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:00.313253 21762 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.319620 21762 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:00.321498 21762 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:00.322225 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:00.322786 21831 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.327263 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:00.328800 21912 raft_consensus.cc:3055] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:00.329120 21912 raft_consensus.cc:740] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:00.329888 21912 consensus_queue.cc:260] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:00.330902 21912 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.339445 21912 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:00.341614 21729 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:00.342337 22979 raft_consensus.cc:2804] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:00.342811 22979 raft_consensus.cc:697] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:00.343658 22979 consensus_queue.cc:237] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:00.345253 21912 consensus_queue.cc:237] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:08:00.350699 21831 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:00.351496 21832 raft_consensus.cc:1240] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:00.358421 21831 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:00.359683 21880 consensus_peers.cc:597] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bfdda4b9a4f14b5c90c55134ebfd6303. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:00.359817 23019 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:00.360569 21762 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:00.362233 23019 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:00.365315 21663 catalog_manager.cc:5697] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.368732 22899 raft_consensus.cc:2955] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:08:00.370348 21831 raft_consensus.cc:2955] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:08:00.385908 21831 consensus_queue.cc:237] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:08:00.388662 21660 catalog_manager.cc:5697] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:00.396373 21806 consensus_peers.cc:597] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b0e72cc3f09a4d549ebd824be85955a3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:00.396648 21762 raft_consensus.cc:2955] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:08:00.399510 21912 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:00.405580 21757 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:00.405114 22923 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:08:00.409907 22958 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:00.414268 21909 raft_consensus.cc:1275] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:00.415768 23006 consensus_queue.cc:1048] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:00.425812 22958 raft_consensus.cc:2955] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:08:00.431849 21757 raft_consensus.cc:2955] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:08:00.436062 21909 raft_consensus.cc:2955] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:08:00.445742 21762 consensus_queue.cc:237] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:08:00.449568 21761 raft_consensus.cc:1275] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:00.451083 22923 consensus_queue.cc:1048] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:00.463107 21663 catalog_manager.cc:5697] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:08:00.480824 21909 raft_consensus.cc:1275] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:08:00.493865 21731 consensus_peers.cc:597] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a218be1e72294b138c21b46dfa317d11. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:00.492759 21762 raft_consensus.cc:1275] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:00.496621 22942 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:00.497532 22985 consensus_queue.cc:1048] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:00.509068 21831 raft_consensus.cc:1275] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:00.509387 21909 raft_consensus.cc:1275] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:00.511559 22985 consensus_queue.cc:1048] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:00.516083 23016 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:00.521548 22979 raft_consensus.cc:2955] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:08:00.527529 21914 raft_consensus.cc:2955] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:08:00.548337 21662 catalog_manager.cc:5697] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:08:00.589548 21761 consensus_queue.cc:237] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:08:00.591953 21831 raft_consensus.cc:2955] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:08:00.594350 21762 raft_consensus.cc:1275] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:00.595546 22987 consensus_queue.cc:1048] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:08:00.606706 21731 consensus_peers.cc:597] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 291227c6f9914476b4363d40f7cfebb8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:00.607812 21838 raft_consensus.cc:1275] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:00.609345 21912 raft_consensus.cc:1275] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:08:00.609557 22979 consensus_queue.cc:1048] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:00.611954 23016 consensus_queue.cc:1048] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:00.627413 21914 raft_consensus.cc:1275] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:00.633562 22987 consensus_queue.cc:1048] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:00.635054 22942 raft_consensus.cc:2955] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:08:00.638334 21838 raft_consensus.cc:2955] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:08:00.648674 21912 raft_consensus.cc:2955] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:08:00.665349 21663 catalog_manager.cc:5697] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index -1 to 2, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:08:00.680658 21762 raft_consensus.cc:1275] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:00.682127 22986 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:00.705499 21912 raft_consensus.cc:1275] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:00.707837 22985 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:00.877355 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:00.884298 21912 raft_consensus.cc:1275] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:00.885059 23047 ts_tablet_manager.cc:933] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:00.888127 22942 consensus_queue.cc:1048] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:00.941370 21831 raft_consensus.cc:1275] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:00.948218 22979 consensus_queue.cc:1048] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:00.956221 23047 tablet_copy_client.cc:323] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:08:00.961508 21923 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet bfdda4b9a4f14b5c90c55134ebfd6303 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:08:00.962097 21923 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet bfdda4b9a4f14b5c90c55134ebfd6303 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-bfdda4b9a4f14b5c90c55134ebfd6303
I20260709 13:08:00.969758 21923 tablet_copy_source_session.cc:215] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:00.979007 23047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfdda4b9a4f14b5c90c55134ebfd6303. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.015931 23053 ts_tablet_manager.cc:933] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:01.018023 23053 tablet_copy_client.cc:323] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.2:34765
I20260709 13:08:01.027537 23047 tablet_copy_client.cc:806] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:01.028153 23047 tablet_copy_client.cc:670] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:01.059994 21850 tablet_copy_service.cc:140] P 6fadfd81c5a645f1806a284ddbb6bf0d: Received BeginTabletCopySession request for tablet b0e72cc3f09a4d549ebd824be85955a3 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:56424)
I20260709 13:08:01.062569 21850 tablet_copy_service.cc:161] P 6fadfd81c5a645f1806a284ddbb6bf0d: Beginning new tablet copy session on tablet b0e72cc3f09a4d549ebd824be85955a3 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:56424: session id = 8c6c2207af3d47b3acf352d81959f4dd-b0e72cc3f09a4d549ebd824be85955a3
I20260709 13:08:01.109508 23047 tablet_copy_client.cc:538] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:01.358825 21850 tablet_copy_source_session.cc:215] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:08:01.411393 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 107835us
I20260709 13:08:01.415208 23053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0e72cc3f09a4d549ebd824be85955a3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:01.417913 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 52456.4us
I20260709 13:08:01.419082 23047 tablet_bootstrap.cc:492] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:08:01.480139 23067 ts_tablet_manager.cc:933] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645)
I20260709 13:08:01.490053 23070 ts_tablet_manager.cc:933] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645)
W20260709 13:08:01.512148 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 293600us
I20260709 13:08:01.565231 23070 tablet_copy_client.cc:323] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.1:46645
I20260709 13:08:01.576193 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:01.581076 23053 tablet_copy_client.cc:806] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:01.581835 23053 tablet_copy_client.cc:670] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:01.610737 23067 tablet_copy_client.cc:323] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.1:46645
I20260709 13:08:01.637861 21775 tablet_copy_service.cc:140] P 3843e9b794a245dd8608e04ec7915239: Received BeginTabletCopySession request for tablet 291227c6f9914476b4363d40f7cfebb8 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:44772)
I20260709 13:08:01.638521 21775 tablet_copy_service.cc:161] P 3843e9b794a245dd8608e04ec7915239: Beginning new tablet copy session on tablet 291227c6f9914476b4363d40f7cfebb8 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:44772: session id = 8c6c2207af3d47b3acf352d81959f4dd-291227c6f9914476b4363d40f7cfebb8
W20260709 13:08:01.676789 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 52289.3us
I20260709 13:08:01.680101 21774 tablet_copy_service.cc:140] P 3843e9b794a245dd8608e04ec7915239: Received BeginTabletCopySession request for tablet a218be1e72294b138c21b46dfa317d11 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:44772)
I20260709 13:08:01.684424 21774 tablet_copy_service.cc:161] P 3843e9b794a245dd8608e04ec7915239: Beginning new tablet copy session on tablet a218be1e72294b138c21b46dfa317d11 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:44772: session id = 8c6c2207af3d47b3acf352d81959f4dd-a218be1e72294b138c21b46dfa317d11
I20260709 13:08:01.684755 21775 tablet_copy_source_session.cc:215] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:01.724630 21774 tablet_copy_source_session.cc:215] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:01.732403 23070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 291227c6f9914476b4363d40f7cfebb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.734359 23067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a218be1e72294b138c21b46dfa317d11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:01.766013 23047 tablet_bootstrap.cc:492] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:01.786562 23047 tablet_bootstrap.cc:492] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:08:01.802865 23067 tablet_copy_client.cc:806] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:01.815867 23067 tablet_copy_client.cc:670] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:01.821545 23047 ts_tablet_manager.cc:1403] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.403s	user 0.032s	sys 0.019s
I20260709 13:08:01.822273 23067 tablet_copy_client.cc:538] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:01.838541 23070 tablet_copy_client.cc:806] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:01.842761 23070 tablet_copy_client.cc:670] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:01.825309 23047 raft_consensus.cc:359] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:08:01.843330 23047 raft_consensus.cc:740] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:08:01.827723 23053 tablet_copy_client.cc:538] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:01.844152 23047 consensus_queue.cc:260] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:08:01.851393 23047 ts_tablet_manager.cc:1434] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.003s
I20260709 13:08:01.851258 21906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:08:01.852129 21906 raft_consensus.cc:606] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:01.851521 23067 tablet_bootstrap.cc:492] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:08:01.853109 23070 tablet_copy_client.cc:538] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:01.856600 21906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:08:01.857260 21906 raft_consensus.cc:606] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:01.862071 21906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:08:01.862782 21923 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-bfdda4b9a4f14b5c90c55134ebfd6303 received from {username='slave'} at 127.0.0.1:45202
I20260709 13:08:01.863463 21906 raft_consensus.cc:606] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Received request to transfer leadership to TS 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:01.863543 21923 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-bfdda4b9a4f14b5c90c55134ebfd6303 on tablet bfdda4b9a4f14b5c90c55134ebfd6303 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:01.867230 21763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
new_leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:35914
I20260709 13:08:01.867867 21763 raft_consensus.cc:606] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Received request to transfer leadership to TS 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:01.868779 23053 tablet_bootstrap.cc:492] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:08:01.888720 23070 tablet_bootstrap.cc:492] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:08:01.916437 23067 tablet_bootstrap.cc:492] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:01.921273 23067 tablet_bootstrap.cc:492] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:08:01.930006 23067 ts_tablet_manager.cc:1403] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.079s	user 0.024s	sys 0.004s
I20260709 13:08:01.931946 21833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:08:01.932585 21833 raft_consensus.cc:606] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:01.935668 21906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:08:01.936213 21906 raft_consensus.cc:606] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:01.940281 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:01.941962 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:01.943969 23070 tablet_bootstrap.cc:492] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:01.944180 23067 raft_consensus.cc:359] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:08:01.945025 23067 raft_consensus.cc:740] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:08:01.949975 23053 tablet_bootstrap.cc:492] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:01.952798 23053 tablet_bootstrap.cc:492] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:08:01.953663 23053 ts_tablet_manager.cc:1403] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.041s
I20260709 13:08:01.945694 23067 consensus_queue.cc:260] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:08:01.957072 23067 ts_tablet_manager.cc:1434] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 13:08:01.959693 23070 tablet_bootstrap.cc:492] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:08:01.961745 23070 ts_tablet_manager.cc:1403] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.073s	user 0.024s	sys 0.010s
I20260709 13:08:01.964685 21774 tablet_copy_service.cc:342] P 3843e9b794a245dd8608e04ec7915239: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-a218be1e72294b138c21b46dfa317d11 received from {username='slave'} at 127.0.0.1:44772
I20260709 13:08:01.965386 21774 tablet_copy_service.cc:434] P 3843e9b794a245dd8608e04ec7915239: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-a218be1e72294b138c21b46dfa317d11 on tablet a218be1e72294b138c21b46dfa317d11 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:01.966467 23070 raft_consensus.cc:359] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:08:01.960620 23053 raft_consensus.cc:359] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:08:01.967403 23070 raft_consensus.cc:740] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:08:01.967667 23053 raft_consensus.cc:740] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:08:01.968215 23070 consensus_queue.cc:260] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:08:01.968359 23053 consensus_queue.cc:260] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:08:01.972966 23053 ts_tablet_manager.cc:1434] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.004s
I20260709 13:08:01.977558 21850 tablet_copy_service.cc:342] P 6fadfd81c5a645f1806a284ddbb6bf0d: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-b0e72cc3f09a4d549ebd824be85955a3 received from {username='slave'} at 127.0.0.1:56424
I20260709 13:08:01.978051 21850 tablet_copy_service.cc:434] P 6fadfd81c5a645f1806a284ddbb6bf0d: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-b0e72cc3f09a4d549ebd824be85955a3 on tablet b0e72cc3f09a4d549ebd824be85955a3 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:01.980130 22942 raft_consensus.cc:993] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239: : Instructing follower 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:08:01.980628 22942 raft_consensus.cc:1081] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Signalling peer 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:08:01.982858 22482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:36270
I20260709 13:08:01.983389 22482 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:01.983814 22482 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:01.983938 23070 ts_tablet_manager.cc:1434] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:08:01.986215 21774 tablet_copy_service.cc:342] P 3843e9b794a245dd8608e04ec7915239: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-291227c6f9914476b4363d40f7cfebb8 received from {username='slave'} at 127.0.0.1:44772
I20260709 13:08:01.986629 21774 tablet_copy_service.cc:434] P 3843e9b794a245dd8608e04ec7915239: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-291227c6f9914476b4363d40f7cfebb8 on tablet 291227c6f9914476b4363d40f7cfebb8 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:02.000211 23064 raft_consensus.cc:993] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:08:02.000715 23064 raft_consensus.cc:1081] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Signalling peer 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:08:02.002913 22482 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:02.005162 22481 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:36290
I20260709 13:08:02.005752 22481 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:02.006086 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:02.006772 21762 raft_consensus.cc:3055] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:02.007063 21762 raft_consensus.cc:740] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:02.007820 21762 consensus_queue.cc:260] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:02.008912 21762 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:02.006091 22481 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:02.016387 21762 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:02.017813 22450 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:02.019064 23057 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:02.019511 23057 raft_consensus.cc:697] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:02.019610 22482 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:02.020474 23057 consensus_queue.cc:237] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:02.069358 22482 raft_consensus.cc:1217] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:02.079473 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:02.079922 22485 raft_consensus.cc:1217] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:02.080140 21833 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:02.081727 23019 raft_consensus.cc:993] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:08:02.082361 23068 raft_consensus.cc:1081] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:08:02.090911 21762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:08:02.091877 21762 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:02.096160 21762 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:02.106565 21762 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:02.109813 21833 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:02.113070 21762 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:02.115417 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:02.118000 21906 raft_consensus.cc:3055] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:02.118429 21906 raft_consensus.cc:740] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:02.119287 21906 consensus_queue.cc:260] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:02.123271 21906 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:02.125228 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:02.125804 21833 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:02.129945 22481 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:02.142752 21833 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:02.143728 22481 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:02.144110 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:02.144835 21840 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:02.146260 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:02.146873 21909 raft_consensus.cc:3055] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:02.147171 21909 raft_consensus.cc:740] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:02.147994 21909 consensus_queue.cc:260] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:02.149307 21909 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:02.158428 21728 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:02.158802 23068 raft_consensus.cc:993] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:08:02.159293 23068 raft_consensus.cc:1081] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:08:02.160712 23062 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:02.161545 23062 raft_consensus.cc:697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:02.162457 23062 consensus_queue.cc:237] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:02.166757 21661 catalog_manager.cc:5697] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 1 to 2, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 2 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:02.171082 22481 raft_consensus.cc:1217] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:02.180616 21906 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:02.180923 21840 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:02.182685 21909 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:02.182996 22448 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:02.185156 22481 raft_consensus.cc:1217] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:08:02.185503 23068 raft_consensus.cc:993] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:08:02.186599 23057 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:02.187598 23057 raft_consensus.cc:697] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:02.188486 23057 consensus_queue.cc:237] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:02.189982 23068 raft_consensus.cc:1081] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:08:02.181339 21833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38352
I20260709 13:08:02.195122 21833 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:02.195712 21833 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:02.203145 21762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:08:02.203795 21762 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:02.204180 21762 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:02.243381 23058 raft_consensus.cc:993] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:08:02.243949 23058 raft_consensus.cc:1081] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:08:02.245730 21759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59108
I20260709 13:08:02.246373 21759 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:02.246867 21759 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:02.269706 21762 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:02.268507 21759 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:02.281862 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:02.282451 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:02.283170 21831 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:02.282478 21835 raft_consensus.cc:3055] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:02.286491 21835 raft_consensus.cc:740] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:02.287439 21835 consensus_queue.cc:260] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:02.288738 21835 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:02.291703 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:02.292407 21906 raft_consensus.cc:3055] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:02.292719 21906 raft_consensus.cc:740] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:02.293766 21906 consensus_queue.cc:260] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:02.294886 21906 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:02.299289 21762 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:02.300251 21759 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:02.303033 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:02.303619 21909 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:02.309109 21833 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:02.309664 21906 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:02.311908 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:02.312459 21762 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:02.313841 21729 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:02.316125 23060 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:02.316586 23060 raft_consensus.cc:697] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:02.319013 21762 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:02.320169 21805 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:02.321115 23061 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:02.321576 23061 raft_consensus.cc:697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:02.322475 23061 consensus_queue.cc:237] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:02.329185 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:02.334429 21906 raft_consensus.cc:3055] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:02.336580 21833 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:02.335670 21906 raft_consensus.cc:740] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:02.343147 21835 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:02.344677 21728 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:02.340184 21906 consensus_queue.cc:260] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:02.346928 23059 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:02.353308 23059 raft_consensus.cc:697] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:02.353461 21906 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:02.354193 23059 consensus_queue.cc:237] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:02.355775 21831 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:02.358556 21909 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:02.362427 21660 catalog_manager.cc:5697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:02.317375 23060 consensus_queue.cc:237] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:02.384316 21906 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:02.397212 21662 catalog_manager.cc:5697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 2 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:02.423189 21662 catalog_manager.cc:5697] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:02.424868 21662 catalog_manager.cc:5697] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 1 to 2, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:02.432179 21660 catalog_manager.cc:5697] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 2 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:02.561252 23030 raft_consensus.cc:1064] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:08:02.562471 23059 raft_consensus.cc:1064] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:08:02.563797 23030 consensus_queue.cc:237] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:02.565097 23059 consensus_queue.cc:237] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:02.573482 22481 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:02.575212 23063 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:02.584013 22482 raft_consensus.cc:1275] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:02.585464 22942 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:02.588487 21906 raft_consensus.cc:1275] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:02.590227 21762 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:02.591574 22942 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:02.592324 21835 raft_consensus.cc:1275] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:02.592820 21906 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:02.593876 22942 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:02.595453 23006 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:02.599211 23006 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:08:02.609159 21761 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:02.611083 23057 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:02.629022 23060 raft_consensus.cc:2955] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:02.638609 22482 raft_consensus.cc:2955] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:02.650179 23074 raft_consensus.cc:1064] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:08:02.653139 21831 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:02.655040 23074 consensus_queue.cc:237] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:02.655428 21831 raft_consensus.cc:2955] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:02.663393 21906 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:02.665023 23057 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:02.688014 23057 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:02.703984 21906 raft_consensus.cc:1275] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:02.706313 22483 raft_consensus.cc:1275] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:02.707579 23069 raft_consensus.cc:1064] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:08:02.710245 23069 consensus_queue.cc:237] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:02.716014 23105 consensus_queue.cc:1048] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:02.730144 21912 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:02.747059 21660 catalog_manager.cc:5697] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:02.756138 21912 raft_consensus.cc:2955] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:02.771554 21833 raft_consensus.cc:1275] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:02.775247 21833 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:02.799364 23030 raft_consensus.cc:2955] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:02.832629 23060 consensus_queue.cc:1048] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:08:02.839898 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 58858.2us
I20260709 13:08:02.844296 23060 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:02.935325 22483 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:02.938570 23069 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:02.946986 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:03.008976 21840 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:03.011229 22483 raft_consensus.cc:2955] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:03.012781 23019 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:08:03.012809 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 214466us
I20260709 13:08:03.031144 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:03.083103 21835 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:03.088481 21910 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:03.094614 21910 raft_consensus.cc:2955] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:03.100700 22987 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:03.105633 21835 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:03.118391 21909 raft_consensus.cc:1275] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:03.120087 21912 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:03.122848 21762 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:08:03.130978 21660 catalog_manager.cc:5697] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:03.135205 23066 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:03.150876 23019 raft_consensus.cc:2955] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:03.162590 22942 consensus_queue.cc:1048] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:03.193745 21837 raft_consensus.cc:2955] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:03.201582 22942 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:03.196668 21831 raft_consensus.cc:1275] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:03.208443 22942 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:03.214030 23105 consensus_queue.cc:1048] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:03.214257 21831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:08:03.214986 21831 raft_consensus.cc:606] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:03.226332 21762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:35914
I20260709 13:08:03.226902 21762 raft_consensus.cc:606] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:03.256048 21762 raft_consensus.cc:2955] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:03.268409 21765 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:03.423908 23123 log.cc:927] Time spent T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 13:08:03.657325 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 367806us
W20260709 13:08:03.628307 23101 log.cc:927] Time spent T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:08:03.702853 23122 consensus_queue.cc:1048] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:08:03.729712 23125 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:08:03.731562 23125 raft_consensus.cc:2955] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:03.835356 23126 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:08:03.840736 21835 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.009s	sys 0.035s
W20260709 13:08:03.842650 21835 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.009s	sys 0.035s
W20260709 13:08:03.856932 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 198373us
I20260709 13:08:03.995308 23119 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.996050 23119 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.095383 23132 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.096138 23132 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:08:04.188637 21805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.020s	sys 0.070s
W20260709 13:08:04.189198 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 594798us
I20260709 13:08:04.207918 23133 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.208782 23133 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.211566 23133 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:04.214238 23060 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:04.326397 21861 debug-util.cc:398] Leaking SignalData structure 0x7b08000cf7c0 after lost signal to thread 20643
I20260709 13:08:04.326555 23144 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:08:04.328367 21861 debug-util.cc:398] Leaking SignalData structure 0x7b08000c8080 after lost signal to thread 21697
W20260709 13:08:04.330297 21861 debug-util.cc:398] Leaking SignalData structure 0x7b08001c1320 after lost signal to thread 21789
W20260709 13:08:04.331890 21861 debug-util.cc:398] Leaking SignalData structure 0x7b08001fe0c0 after lost signal to thread 21864
I20260709 13:08:04.342522 23127 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.349447 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:04.250308 23136 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.358516 23130 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.356825 23133 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:04.335930 23018 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:04.361088 23136 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.364305 23142 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:04.365016 23018 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.371002 23018 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:04.371726 23018 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:04.343259 23127 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.374276 23127 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:04.367127 23133 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.376765 23133 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:04.379139 23136 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:04.380347 23142 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.383569 23142 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:04.384457 23145 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:04.385777 23130 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.390491 23130 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:04.327656 23144 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.342051 23060 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.395061 23060 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:04.385175 23145 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.403900 23145 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:04.405598 23132 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:04.410521 23144 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:04.411166 23018 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.439643 23130 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.424912 23143 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:04.459594 23147 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.459102 23130 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.459175 23143 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.460119 23147 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.461738 23130 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:04.442204 21835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.108s	sys 0.155s
I20260709 13:08:04.462244 23143 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:04.462395 23147 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:04.463315 21835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.108s	sys 0.155s
I20260709 13:08:04.464452 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:04.465296 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:04.462327 23130 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.466646 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:04.467662 23143 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:04.467795 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:04.468335 23143 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.469259 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:04.469864 21763 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:08:04.429072 23018 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:04.423228 23125 consensus_meta.cc:287] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.000s
I20260709 13:08:04.465313 21662 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45746 (request call id 223) took 1264 ms. Trace:
I20260709 13:08:04.471784 23125 raft_consensus.cc:993] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:08:04.472304 23125 raft_consensus.cc:1081] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:08:04.471850 21662 rpcz_store.cc:276] 0709 13:08:03.200533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.200678 (+   145us) service_pool.cc:224] Handling call
0709 13:08:04.460577 (+1259899us) spinlock_profiling.cc:243] Waited 38.8 ms on lock 0x7b54002ae254. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c1090 00007fc6ae35ff3a 00007fc6b41161cc 00007fc6b421437e 00007fc6b26d52a4 00007fc6b26d5232 00007fc6b26d5161 00007fc6b26d50dc 00007fc6b26d4392 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:04.465183 (+  4606us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":89126784}
I20260709 13:08:04.441028 23145 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:04.475224 23145 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.477795 23145 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:04.464093 21835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1240) took 1206 ms. Trace:
I20260709 13:08:04.478523 21835 rpcz_store.cc:276] 0709 13:08:03.257838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.258303 (+   465us) service_pool.cc:224] Handling call
0709 13:08:03.258686 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:03.843362 (+584676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:03.843423 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:03.844070 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 13:08:04.463741 (+619671us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:04.463778 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.463841 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:04.463897 (+    56us) raft_consensus.cc:1685] finished
0709 13:08:04.463909 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.464016 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7740,"raft.queue_time_us":340898,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":46328,"thread_start_us":1175474,"threads_started":2,"wal-append.queue_time_us":598023}
W20260709 13:08:04.479874 20645 debug-util.cc:398] Leaking SignalData structure 0x7b080000fd40 after lost signal to thread 22449
I20260709 13:08:04.470616 23143 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:04.480361 20645 kernel_stack_watchdog.cc:198] Thread 22449 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 277ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:08:04.466646 23130 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.489207 23149 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.490514 23130 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:04.491755 23149 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.494202 23149 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:04.501242 21805 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:04.502146 23148 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:04.502638 23148 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.503217 23148 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:04.503908 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:04.507230 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:04.507512 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:04.507498 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 1.30686e+06us
I20260709 13:08:04.512396 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:04.513723 23063 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.514331 23063 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.515461 23148 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.515703 23150 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:04.516533 23150 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.517549 23063 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:04.520181 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:04.520422 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:04.520921 21763 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:04.522279 23150 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:04.517566 23148 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:04.537214 21763 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:04.539137 23145 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.540122 23145 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.540866 21805 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:04.541932 23148 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:04.542443 23148 raft_consensus.cc:697] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:04.543185 23145 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:04.543324 23148 consensus_queue.cc:237] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.547694 23151 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:04.548779 23151 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.551191 21910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 645) took 1457 ms. Trace:
I20260709 13:08:04.551887 23151 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:04.551779 21910 rpcz_store.cc:276] 0709 13:08:03.093961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.094081 (+   120us) service_pool.cc:224] Handling call
0709 13:08:03.094340 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.094509 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:03.104463 (+  9954us) log.cc:844] Serialized 14 byte log entry
0709 13:08:04.550680 (+1446217us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:04.550764 (+    84us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:04.550823 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.550913 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.551089 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:04.552701 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:04.555333 23153 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:04.556063 23153 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.556988 23151 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:04.571411 23150 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:04.575924 23152 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:04.584700 23150 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.585744 23152 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.580641 23156 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.589359 23150 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:04.589668 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:04.582862 23019 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.590565 23019 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.592871 23019 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:04.589463 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:04.594676 23152 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:04.590179 23156 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.598026 23018 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.598565 23151 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.598615 23018 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.602241 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:04.603796 23156 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:04.604440 23018 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:04.605162 23144 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:04.605782 23144 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.606765 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:04.607514 23018 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:04.607801 23144 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:04.608377 23144 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:04.608193 23018 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.609177 23151 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:04.610893 23018 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:04.611102 23153 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:04.611573 23018 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:04.612213 23018 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.582896 23157 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.617226 23151 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.616580 23156 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.615984 23152 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.618250 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 107) took 1453 ms. Trace:
I20260709 13:08:04.618041 23156 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.618590 23152 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.618712 21906 rpcz_store.cc:276] 0709 13:08:03.165198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.617374 (+1452176us) service_pool.cc:224] Handling call
0709 13:08:04.617707 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:04.617879 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:04.617909 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:04.617948 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:04.617997 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.618054 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.618194 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:04.608927 23144 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.617796 23157 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.620941 23156 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:04.623392 23139 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.634832 23164 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:04.635079 23139 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.635417 23164 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.625216 23119 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:04.623245 23152 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:04.638233 23119 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.638523 23069 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:04.638830 23119 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.639029 23069 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.639573 23018 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:04.640122 23018 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:04.624070 23142 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.640583 23018 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.631896 22942 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:04.627166 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:04.641062 23119 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:04.624192 23132 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.631533 23074 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:04.633535 23157 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:04.623054 23144 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:04.624306 23122 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.643198 23066 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:04.709522 23160 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:04.643501 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:04.718554 21763 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:08:04.643066 22942 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.738432 21805 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:04.649741 23066 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.629747 23019 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:04.643858 23120 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:04.617820 23151 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.631398 23105 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.623965 23059 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.644407 23139 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:04.634167 23158 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.743268 23162 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:04.756486 22942 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:04.649523 23122 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.645213 23142 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.736486 23060 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:04.702642 23157 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:04.749790 23137 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:04.736791 23152 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:04.740713 23030 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.646909 23069 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:04.643589 23132 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.754216 23119 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:04.758425 23126 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:04.765733 23006 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:04.759774 23125 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.767000 23144 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:04.767526 23164 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:04.766892 23061 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.760672 23058 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:04.770191 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:04.771538 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:04.763363 23145 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.762763 23127 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:04.644980 23074 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.775061 23069 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:04.760849 23148 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:04.767905 23161 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:04.759276 23019 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.765107 23105 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.763175 23059 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.744292 23160 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.771246 23162 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:05.117725 21831 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 1.
I20260709 13:08:05.118536 21835 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 1.
I20260709 13:08:04.776221 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:04.917588 23147 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:05.123167 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:04.769838 23063 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:05.115664 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:04.830399 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:04.831640 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:04.965921 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:04.831187 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:05.144336 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:04.776060 23066 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:05.144196 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:05.143726 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:05.155980 21757 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 1.
I20260709 13:08:05.157744 21839 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 1.
I20260709 13:08:05.161938 21831 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:04.767390 23060 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.777933 23126 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:05.122787 23143 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:04.937690 23139 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:05.175210 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:05.212678 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:05.143533 23151 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:05.127152 23061 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:05.143411 23121 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:05.127872 23164 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:05.144516 23006 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:05.227322 23164 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.773216 23157 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.831960 23030 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.833945 23152 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:05.126179 23144 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:05.206844 23018 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:05.151237 23145 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:04.768229 23120 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:05.206558 23126 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:05.125365 23161 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:04.778354 23137 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:05.129874 23058 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:05.161908 23069 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:05.154459 23125 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:05.085745 23165 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:04.831799 23119 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:05.268105 22484 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:08:04.769387 23158 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:05.265867 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:05.277544 21833 raft_consensus.cc:2410] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:08:05.161755 23127 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:05.269541 23059 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:05.270707 23060 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:05.271260 23074 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:05.161558 23148 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:05.275418 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:05.205365 23147 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:05.277945 21909 raft_consensus.cc:2955] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:05.243434 23122 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:05.296605 22482 raft_consensus.cc:2955] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:05.225268 23139 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:05.286809 23006 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:05.250411 23121 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:05.223335 23143 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:05.291663 23030 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:05.309983 21835 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 1.
I20260709 13:08:05.319936 21840 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 1.
I20260709 13:08:05.169314 23063 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:05.329514 23006 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:05.295030 23132 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:05.317757 22448 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:05.342118 21834 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 1.
I20260709 13:08:05.308890 23142 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:05.355212 23162 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:05.355856 23162 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:05.356365 23162 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:05.352766 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:05.365324 23170 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:05.366174 23170 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:05.363051 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:05.357766 23057 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:05.377082 23057 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:05.379158 23057 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:05.340081 23006 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:05.342120 23105 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:05.385318 23160 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:05.372535 23066 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:05.285099 23165 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:05.458680 21877 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.107s	sys 0.194s
I20260709 13:08:05.376070 22448 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
W20260709 13:08:05.511998 21877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.107s	sys 0.201s
I20260709 13:08:05.387816 23019 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:05.469558 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 89171.2us
I20260709 13:08:05.384160 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:05.527999 21806 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:05.388063 23058 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:05.509871 23137 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:05.476277 23120 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:05.475425 23152 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:05.509752 23030 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:05.511107 23069 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:05.509048 23166 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:05.498970 23018 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:05.476008 23144 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:05.458456 23160 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:05.500582 23125 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:05.475804 23145 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:05.515471 23119 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:05.458773 23061 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:05.459331 23066 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:05.499107 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:05.517079 23170 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:05.517766 23127 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:05.677838 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:05.679032 23030 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:05.682727 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:05.686545 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:05.687280 21911 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:05.686545 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:05.688292 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:05.688709 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:05.691224 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:05.595299 23139 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:05.542887 22987 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:05.690938 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:05.654702 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:05.707320 22942 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.018s	sys 0.028s
I20260709 13:08:05.595963 23162 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:05.599673 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 236910us
I20260709 13:08:05.710615 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:05.711548 22481 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:08:05.682940 23158 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:05.683266 23137 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:05.707191 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:05.652014 23157 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:05.707943 22942 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.018s	sys 0.028s
I20260709 13:08:05.717556 23180 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:05.717672 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:05.661113 23161 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:05.679978 23182 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:05.707060 22987 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:05.678247 23018 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:05.685370 23160 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:05.678285 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:05.714864 23006 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:05.791567 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 264942us
I20260709 13:08:05.793881 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:05.543394 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:05.810357 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:05.772557 22987 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:05.813367 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 285518us
I20260709 13:08:05.820441 23160 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:05.820712 23018 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:05.715704 23166 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:05.721414 23147 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:05.827224 21909 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.038s	sys 0.041s
I20260709 13:08:05.720737 23137 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:05.801537 23019 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:05.812651 23144 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:05.785266 22448 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:05.832970 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:05.801327 23161 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:05.817796 23167 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:05.839892 21839 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
W20260709 13:08:05.827569 21909 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.038s	sys 0.041s
I20260709 13:08:05.854413 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:05.855310 21838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56424 (request call id 39) took 1058 ms. Trace:
I20260709 13:08:05.855633 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56424 (request call id 38) took 1083 ms. Trace:
I20260709 13:08:05.856053 21834 rpcz_store.cc:276] 0709 13:08:04.771984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.772111 (+   127us) service_pool.cc:224] Handling call
0709 13:08:05.855456 (+1083345us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5400402754. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:05.855557 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":422323968}
I20260709 13:08:05.855770 21838 rpcz_store.cc:276] 0709 13:08:04.772259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.772374 (+   115us) service_pool.cc:224] Handling call
0709 13:08:04.829900 (+ 57526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.290443 (+460543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.290473 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:05.290530 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:05.290559 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.830123 (+539564us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b54002e6b54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:05.830167 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.830278 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1058811648}
I20260709 13:08:05.857759 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:05.858683 21838 raft_consensus.cc:2410] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:05.858881 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:05.800861 23182 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:05.832711 21908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:08:05.869203 21908 raft_consensus.cc:606] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:05.859234 23157 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:05.882126 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:05.885648 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:05.886982 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:05.888118 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:05.888451 23148 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:05.891027 23137 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:05.851862 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 130136us
I20260709 13:08:05.862500 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:05.893155 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:05.894136 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:05.889282 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:05.864770 23162 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:08:05.849795 23019 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:05.898231 23066 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:05.852582 23167 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:05.852016 23144 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:05.852427 23161 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:06.070290 23164 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:06.160095 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.106443 21661 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45762 (request call id 239) took 2839 ms. Trace:
I20260709 13:08:06.162930 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.038831 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1252) took 1023 ms. Trace:
I20260709 13:08:06.118301 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.064656 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:06.164078 21910 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
W20260709 13:08:06.039579 21861 debug-util.cc:398] Leaking SignalData structure 0x7b08002a5340 after lost signal to thread 21938
I20260709 13:08:06.164213 22481 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
W20260709 13:08:06.164726 21861 debug-util.cc:398] Leaking SignalData structure 0x7b080026e000 after lost signal to thread 21939
I20260709 13:08:06.164885 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.131522 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.165158 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:06.165817 21861 debug-util.cc:398] Leaking SignalData structure 0x7b08002c5a80 after lost signal to thread 22509
I20260709 13:08:06.115269 23127 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:06.166285 21861 debug-util.cc:398] Leaking SignalData structure 0x7b080028e700 after lost signal to thread 23062
I20260709 13:08:06.166468 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.169711 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.166625 23127 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:06.171212 21839 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:08:06.171481 21838 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:08:06.068709 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.172909 23127 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:06.113766 21840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56424 (request call id 41) took 1338 ms. Trace:
I20260709 13:08:06.173491 23127 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:06.172762 21839 raft_consensus.cc:2955] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:06.061901 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.135942 23158 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:06.102807 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1254) took 1080 ms. Trace:
I20260709 13:08:06.066320 23134 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:06.066669 22942 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:06.141352 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:06.174502 23158 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:06.174877 22942 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:06.174530 21832 rpcz_store.cc:276] 0709 13:08:05.022821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.101930 (+1079109us) service_pool.cc:224] Handling call
0709 13:08:06.102232 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.102421 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.102457 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.102511 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:06.102552 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.102621 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.102737 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.062742 22450 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:06.176496 21832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38348
I20260709 13:08:06.176714 23158 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:06.176789 23152 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:06.176990 22942 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:05.868535 23030 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:06.177343 23152 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:06.177788 23152 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.114457 23139 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:06.180217 22478 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:08:06.029590 21837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56424 (request call id 37) took 1258 ms. Trace:
I20260709 13:08:06.102188 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:05.908035 23063 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:05.892494 23157 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:06.054118 23106 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:06.069573 23166 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:06.067957 21836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1253) took 1052 ms. Trace:
I20260709 13:08:06.174108 23127 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:06.170794 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.171142 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:05.903977 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:05.903234 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.114048 23133 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:06.179322 23139 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:06.173532 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.169793 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.034998 21835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56424 (request call id 44) took 1204 ms. Trace:
I20260709 13:08:06.092029 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.170367 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.118043 23125 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:06.066617 23173 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:06.173622 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.098961 23176 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:06.119669 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:05.900499 23182 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:05.906556 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.104959 21662 catalog_manager.cc:5697] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:06.054947 21804 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:06.009298 23143 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:06.008323 23126 consensus_meta.cc:287] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.733s	user 0.010s	sys 0.002s
W20260709 13:08:06.009024 23178 log.cc:927] Time spent T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:08:06.059835 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.158092 22987 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:05.910147 22449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.328s	user 0.015s	sys 0.030s
I20260709 13:08:06.161890 23121 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:06.174472 21757 raft_consensus.cc:2468] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:06.115062 23165 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:06.035746 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.181392 23167 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:06.203974 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.183276 21762 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:06.132184 21765 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:06.206221 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.182268 21880 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:06.182904 23144 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:06.207036 21728 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:06.207203 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.207341 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.207521 23165 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:06.207798 21758 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:06.207926 23165 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:06.208350 23165 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.208453 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.209021 21912 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:06.174742 23134 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:06.209460 23195 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:06.209842 23195 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:06.210180 23195 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.210852 23134 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:06.184496 23157 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:05.912919 23057 consensus_meta.cc:287] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.003s
I20260709 13:08:06.213413 23057 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:06.214689 22485 raft_consensus.cc:2393] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 2: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:06.214931 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:06.183248 22448 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:06.215539 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.215756 22483 raft_consensus.cc:1240] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:06.189800 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 135807us
I20260709 13:08:06.216711 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.217747 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.173897 21840 rpcz_store.cc:276] 0709 13:08:04.775815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.775968 (+   153us) service_pool.cc:224] Handling call
0709 13:08:06.113561 (+1337593us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54000370d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:06.113691 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":460504448}
I20260709 13:08:06.218624 23158 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:06.218801 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.219007 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.219864 21840 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:08:06.221205 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.222419 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.197321 23125 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:06.228130 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.228894 23125 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:06.222986 23144 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:06.223790 23166 consensus_queue.cc:1059] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:06.162540 21661 rpcz_store.cc:276] 0709 13:08:03.267170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.267307 (+   137us) service_pool.cc:224] Handling call
0709 13:08:06.106346 (+2839039us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2088,"reported_tablets":3}
I20260709 13:08:06.184993 23161 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:06.195163 23133 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:06.195638 21759 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:08:06.225545 23165 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:06.192535 22942 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:06.218048 22448 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:06.197373 23173 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:06.223855 23157 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:06.229229 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.197532 21910 raft_consensus.cc:2468] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:06.197813 21908 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:06.185997 21836 rpcz_store.cc:276] 0709 13:08:05.015244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.038282 (+1023038us) service_pool.cc:224] Handling call
0709 13:08:06.067435 (+ 29153us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.067629 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.067655 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.067697 (+    42us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:06.067729 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.067785 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.067897 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.339253 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.219913 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.379689 21763 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:08:06.379921 23166 raft_consensus.cc:3055] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:06.380355 23166 raft_consensus.cc:740] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:06.313233 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.380893 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.181893 21837 rpcz_store.cc:276] 0709 13:08:04.771654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.771801 (+   147us) service_pool.cc:224] Handling call
0709 13:08:04.772073 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.281853 (+509780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.281892 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:05.281942 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:05.281973 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.029192 (+747219us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b54003c05d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:06.029264 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.029504 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1168252800}
I20260709 13:08:06.382371 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.382643 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.196774 21806 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:06.198472 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.383809 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.384038 23121 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:06.199602 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:06.384804 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 188099us
I20260709 13:08:06.195971 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.378720 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.189040 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.163878 21834 rpcz_store.cc:276] 0709 13:08:05.014933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.938563 (+923630us) service_pool.cc:224] Handling call
0709 13:08:06.037936 (+ 99373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.038410 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.038449 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.038503 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:06.038550 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.038623 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.038759 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.229874 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.220196 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:06.330214 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.196869 21838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1256) took 1168 ms. Trace:
I20260709 13:08:06.337808 21839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1255) took 1314 ms. Trace:
I20260709 13:08:06.194402 21833 raft_consensus.cc:2410] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:08:06.203099 22449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.621s	user 0.015s	sys 0.038s
I20260709 13:08:06.337389 21832 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:06.386941 21911 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
W20260709 13:08:06.388900 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 1.8067e+06us
I20260709 13:08:06.389601 21832 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:06.389930 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 181812us
I20260709 13:08:06.385068 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.388013 22483 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:08:06.385991 22942 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:06.379156 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.305195 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.392699 21764 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:06.393006 21762 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:06.196421 21835 rpcz_store.cc:276] 0709 13:08:04.830412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.143957 (+313545us) service_pool.cc:224] Handling call
0709 13:08:06.034780 (+890823us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b540005fad4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:06.034911 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":347372288}
I20260709 13:08:06.387188 21758 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
W20260709 13:08:06.229135 21731 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.40.4:37983 timed out after 1.633s (SENT) [suppressed 1 similar messages]
I20260709 13:08:06.378623 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.197103 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:06.199626 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 144779us
I20260709 13:08:06.396427 21804 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:06.199779 23176 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:06.381304 23166 consensus_queue.cc:260] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:06.197702 23127 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:06.385320 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.410717 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.412984 21804 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:06.434103 22942 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:06.388075 21838 rpcz_store.cc:276] 0709 13:08:05.023498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.172225 (+1148727us) service_pool.cc:224] Handling call
0709 13:08:06.191098 (+ 18873us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b5800005498. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232eee 0000000000375939 00007fc6b32a61e0 00007fc6b336f0c4 00007fc6b336f131 00007fc6b3330fc0 00007fc6b331b929 00007fc6b331b3d2 00007fc6ac892bd4
0709 13:08:06.191227 (+   129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.191379 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.191403 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.191441 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:06.191477 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.191528 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.191622 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41980416}
I20260709 13:08:06.396960 21759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
new_leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:35914
I20260709 13:08:06.435041 21759 raft_consensus.cc:606] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Received request to transfer leadership to TS 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:06.199767 23182 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:06.388629 21839 rpcz_store.cc:276] 0709 13:08:05.023199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.172211 (+1149012us) service_pool.cc:224] Handling call
0709 13:08:06.172498 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.172667 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:06.314355 (+141688us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.337114 (+ 22759us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.337182 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:06.337235 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.337565 (+   330us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.337740 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":138,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"spinlock_wait_cycles":7936,"thread_start_us":21993,"threads_started":1,"wal-append.queue_time_us":20622}
I20260709 13:08:06.190286 23019 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:06.423357 21912 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:06.438534 21804 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:06.438933 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.200730 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.194612 23193 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:06.424654 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.196820 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.440516 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.487550 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.376272 23057 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:06.378808 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.440886 21906 raft_consensus.cc:3055] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:06.442452 21758 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:06.439503 23143 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:06.443065 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:06.491966 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 100878us
I20260709 13:08:06.445169 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.445915 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:06.464491 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.494756 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.495731 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:06.496059 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:06.497170 21838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1262) took 1200 ms. Trace:
I20260709 13:08:06.465755 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.499987 21839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1264) took 1185 ms. Trace:
I20260709 13:08:06.500330 21839 rpcz_store.cc:276] 0709 13:08:05.314250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.499350 (+1185100us) service_pool.cc:224] Handling call
0709 13:08:06.499574 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.499717 (+   143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.499741 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.499777 (+    36us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:06.499804 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.499851 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.499939 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.501838 21839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1265) took 1187 ms. Trace:
I20260709 13:08:06.502116 21839 rpcz_store.cc:276] 0709 13:08:05.314601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.501178 (+1186577us) service_pool.cc:224] Handling call
0709 13:08:06.501419 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.501571 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.501594 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.501629 (+    35us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:06.501656 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.501703 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.501792 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.503516 21839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1266) took 1188 ms. Trace:
I20260709 13:08:06.503786 21839 rpcz_store.cc:276] 0709 13:08:05.314936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.502902 (+1187966us) service_pool.cc:224] Handling call
0709 13:08:06.503117 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.503262 (+   145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.503284 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.503317 (+    33us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:06.503344 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.503389 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.503475 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.468971 23173 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:06.469302 22480 raft_consensus.cc:1240] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:06.474071 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:06.520720 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.521595 21912 raft_consensus.cc:2393] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 2: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:06.475037 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.488354 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:06.488361 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 259342us
I20260709 13:08:06.379230 23144 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:06.199601 23139 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:06.489951 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 51479.3us
I20260709 13:08:06.490006 21877 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:06.493479 23165 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:06.491432 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:06.435797 23066 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:06.200151 23126 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:06.542119 21831 raft_consensus.cc:2393] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 2: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:06.202685 22987 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:06.465102 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.543040 23126 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:06.498097 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1263) took 1184 ms. Trace:
I20260709 13:08:06.543256 23144 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:06.467576 23133 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:06.505155 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.544023 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.506410 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.185002 23106 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:06.546806 21914 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 1.
I20260709 13:08:06.547008 23157 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:06.548413 23106 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:06.507697 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.508213 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:06.518764 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.550414 21757 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:06.492873 23180 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:06.528088 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:06.551335 23195 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:06.487020 23063 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:06.552327 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.552641 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.513067 21838 rpcz_store.cc:276] 0709 13:08:05.297149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.496506 (+1199357us) service_pool.cc:224] Handling call
0709 13:08:06.496742 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.496890 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.496913 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.496951 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:06.496978 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.497026 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.497112 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.490420 21906 raft_consensus.cc:740] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:06.527498 21804 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:06.489494 23193 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:06.527611 21877 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:06.527799 21840 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:06.507532 23166 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.506855 23158 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:06.534760 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:06.535898 23161 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:06.189525 23152 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:06.551674 22479 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:08:06.519646 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.537925 22485 raft_consensus.cc:2955] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:06.554244 21764 raft_consensus.cc:1240] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:06.555230 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:06.557014 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.561045 21759 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:06.578830 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:06.579257 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.565141 21835 raft_consensus.cc:1240] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:06.556702 21906 consensus_queue.cc:260] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:06.570659 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:06.571771 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.581561 21806 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:06.581882 21761 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:06.571792 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:06.571597 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:06.522704 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 302730us
I20260709 13:08:06.573779 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:06.560684 21877 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:06.570075 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:06.571468 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.579855 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:06.566349 21758 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:06.570001 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:06.564322 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38348 (request call id 1257) took 1478 ms. Trace:
I20260709 13:08:06.572140 21839 consensus_queue.cc:237] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:06.570348 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.571254 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.591523 21877 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:06.561831 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:06.543700 21833 rpcz_store.cc:276] 0709 13:08:05.313791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.497187 (+1183396us) service_pool.cc:224] Handling call
0709 13:08:06.497582 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.497760 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.497801 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.497852 (+    51us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:06.497889 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.497946 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.498048 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:06.576262 21832 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:06.559188 21804 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:06.603765 21906 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.592280 21831 rpcz_store.cc:276] 0709 13:08:05.086500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.174832 (+ 88332us) service_pool.cc:224] Handling call
0709 13:08:06.564148 (+1389316us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400186d54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:06.564269 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3063945600}
I20260709 13:08:06.579867 21757 raft_consensus.cc:2468] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:06.605563 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:06.601765 21877 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:06.562247 23161 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:06.565383 22478 raft_consensus.cc:1240] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:06.557585 23183 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:06.608718 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 49617us
I20260709 13:08:06.630872 21804 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:06.553393 23195 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:06.575322 22449 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:06.567324 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:06.568921 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:06.561609 23158 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:06.567746 23019 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:06.585563 23126 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:06.623335 23161 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.610327 21729 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:06.571779 23165 consensus_queue.cc:1059] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:08:06.634939 21762 raft_consensus.cc:2955] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:06.628206 23160 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:06.640012 23204 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:06.640093 21837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1270) took 1323 ms. Trace:
I20260709 13:08:06.648149 23180 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:06.634744 21804 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:06.676678 21804 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:06.556567 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.656587 23158 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.562186 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.559964 23193 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:06.602916 23162 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:06.696255 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 46827.4us
I20260709 13:08:06.559942 23176 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:06.568603 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:06.648945 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 120084us
I20260709 13:08:06.565589 23066 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:06.705355 22476 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:06.706871 23066 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:06.656179 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.657536 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 47294.9us
I20260709 13:08:06.707960 21729 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:06.608180 23018 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:06.621979 23121 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:06.660956 23127 raft_consensus.cc:2804] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:06.669945 21837 rpcz_store.cc:276] 0709 13:08:05.316315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.510331 (+1194016us) service_pool.cc:224] Handling call
0709 13:08:06.510685 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.510952 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:08:06.581773 (+ 70821us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.639715 (+ 57942us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.639778 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:06.639832 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.639896 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.640029 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":141871,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":111,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":114776,"threads_started":2}
W20260709 13:08:06.640743 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 65479.1us
I20260709 13:08:06.643752 23197 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:06.682526 21804 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:06.563745 23152 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:06.655499 23019 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:06.657262 23126 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:06.737247 21729 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:06.739224 23195 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:06.739639 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.651944 22448 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:06.675935 23180 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:06.701623 23058 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:06.761070 21832 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:06.774030 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 67525.3us
W20260709 13:08:06.779971 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 97550.9us
I20260709 13:08:06.757292 23197 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:06.743301 21729 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:06.752628 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.739219 22449 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:06.738014 23019 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.819658 23058 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:06.739979 23167 consensus_queue.cc:1059] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:08:06.842013 23167 raft_consensus.cc:3055] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:06.842185 21804 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:06.842562 23167 raft_consensus.cc:740] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:06.756172 23195 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:06.710548 23127 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:06.845597 23127 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:06.821389 21906 raft_consensus.cc:1275] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:06.831053 23209 log.cc:927] Time spent T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:08:06.783576 23180 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:06.694506 23135 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:06.837044 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 97906.6us
I20260709 13:08:06.837541 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:06.840094 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 96848.8us
I20260709 13:08:06.854421 21729 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:06.825879 23121 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:06.843279 23157 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.856491 21729 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:06.841149 23058 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:06.844442 23167 consensus_queue.cc:260] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:06.783268 23066 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:08:06.833244 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:38348 (request call id 1261) took 1533 ms. Trace:
I20260709 13:08:06.740341 23018 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:06.843468 23194 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:06.861208 21804 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:06.859916 21729 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:06.859764 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:06.858285 21832 rpcz_store.cc:276] 0709 13:08:05.278943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.176364 (+897421us) service_pool.cc:224] Handling call
0709 13:08:06.671603 (+495239us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54000370d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae34ea3d 00007fc6b331ecd0 00007fc6ac8a3254 00007fc6ac8a31e2 00007fc6ac8a3111 00007fc6ac8a308c 00007fc6ac8a2342 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:06.760950 (+ 89347us) spinlock_profiling.cc:243] Waited 6.94 ms on lock 0x7b4c00300cc0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ac623a20 00007fc6ac634a29 00007fc6ac63513f 00007fc6ac5f92ab 00007fc6ac626f3c 00007fc6ac6273fe 00007fc6ac8b488b 00007fc6ae2b3495 00007fc6ae30430f 00007fc6ae34ea55 00007fc6b331ecd0
0709 13:08:06.783414 (+ 22464us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384568448}
W20260709 13:08:06.850451 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 219540us
I20260709 13:08:06.841966 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:06.740792 23126 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.863636 23195 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:06.843560 23150 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:06.836272 23197 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:06.866262 21729 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:06.865126 23167 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.870056 21731 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:06.864529 23152 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:06.870275 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:06.848242 21905 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:06.848037 23184 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:06.872789 23176 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:06.873159 23161 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:06.874737 23133 raft_consensus.cc:2804] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:06.876725 21728 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:06.885855 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.890110 22942 raft_consensus.cc:993] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239: : Instructing follower 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:08:06.892027 21762 raft_consensus.cc:1275] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:06.875559 23173 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:06.895838 21731 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:06.897164 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.897701 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.897749 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.898818 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.899675 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.875308 23143 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:08:06.908998 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 142925us
I20260709 13:08:06.915197 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.864337 23018 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:06.936080 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.932391 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.924978 21731 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:06.938374 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.920807 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.939733 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:06.916064 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.932642 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.917925 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.894971 22479 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.894927 23186 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:06.912489 23106 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:06.935191 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.936148 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.947634 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.950584 21765 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:06.919025 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.951359 21831 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:06.931785 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.976428 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.959035 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.977061 21906 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:06.977545 21837 raft_consensus.cc:2393] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 2: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:06.977674 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:06.979183 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:06.918605 23195 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:06.979735 21910 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:06.979667 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:06.933405 23134 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:06.978749 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.989992 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.990449 21831 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:06.914479 23173 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:06.994926 23193 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:06.995466 23193 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:06.995946 23019 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:06.996381 23218 raft_consensus.cc:1081] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Signalling peer 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:08:06.997321 23218 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:06.997500 23214 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:06.997993 23218 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:06.998389 23019 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:06.998077 23214 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:06.930553 22448 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:06.998564 23158 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:06.984380 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:06.999356 21909 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:07.002315 21877 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:06.912573 23133 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:06.895273 23152 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.003515 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.014847 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.017014 21910 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:06.915166 23176 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:07.015372 21804 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:07.020149 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:06.953408 23106 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:08:07.056190 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 53947.7us
I20260709 13:08:07.056367 21804 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:07.058902 23216 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:07.059543 23216 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:07.060014 23216 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:06.985008 23134 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:06.946817 23165 consensus_queue.cc:1059] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:08:06.948216 23143 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.063302 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:07.062778 22484 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:07.073904 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 97582.9us
I20260709 13:08:07.010550 23193 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:07.017724 23183 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 13:08:07.013711 23133 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.078208 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:07.018280 23157 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.084127 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.062045 22987 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:07.061717 23106 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.075984 23134 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.088929 21728 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.071738 23066 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:07.003351 23173 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:07.075647 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 165633us
I20260709 13:08:07.102288 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.094770 22987 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:08:07.125984 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 62626.9us
I20260709 13:08:07.017792 23184 consensus_queue.cc:1059] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 13:08:07.128989 22987 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.125541 23161 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:07.137614 22476 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:07.151980 23172 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:07.152406 23158 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:07.130486 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.168736 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.132968 23182 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:08:07.152858 23214 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:07.179601 23143 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:07.169833 23152 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:07.191337 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 252261us
I20260709 13:08:07.193045 21731 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:07.181783 23219 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.200191 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:07.201260 23162 raft_consensus.cc:3055] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:07.212424 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:07.236186 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.207523 23193 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:07.238255 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 149365us
I20260709 13:08:07.238651 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.241745 21728 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.242767 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.243948 23058 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.243835 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.211699 22448 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:07.245513 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.245791 23219 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.247227 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:07.248433 21728 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.249442 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:07.249688 23127 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.250557 23219 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.250664 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 675) took 1363 ms. Trace:
I20260709 13:08:07.251096 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:07.251163 21905 rpcz_store.cc:276] 0709 13:08:05.887694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.199331 (+311637us) service_pool.cc:224] Handling call
0709 13:08:07.250467 (+1051136us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b5400219654. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:07.250580 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1055380864}
I20260709 13:08:07.252449 21728 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.253448 23195 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.254889 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:07.256198 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:07.256417 21728 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:07.256745 21839 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.257913 21728 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:07.258818 21728 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.212723 23162 raft_consensus.cc:740] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:07.269801 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:07.271276 23225 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.265367 23195 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:07.273762 23195 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:07.273303 23134 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:07.274159 23195 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.274612 23180 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.276937 23184 consensus_queue.cc:1059] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:07.286132 23134 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:07.257526 22477 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:36270
I20260709 13:08:07.288969 22477 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:07.289392 22477 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.291293 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:07.300606 23211 log.cc:927] Time spent T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.445s	user 0.007s	sys 0.001s
I20260709 13:08:07.271320 23216 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.306900 21839 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:07.308542 23216 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:07.298099 23157 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:07.310349 22479 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:07.311189 23058 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:07.310851 23162 consensus_queue.cc:260] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.312729 23172 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:07.313180 23172 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.314236 21806 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:07.318130 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 59333us
I20260709 13:08:07.318359 23058 raft_consensus.cc:2804] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:07.319020 23058 raft_consensus.cc:697] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:07.309361 22987 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.321565 22483 raft_consensus.cc:1240] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:07.324712 23227 raft_consensus.cc:3055] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:07.325129 23227 raft_consensus.cc:740] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:07.329854 23177 raft_consensus.cc:3055] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:07.330302 23177 raft_consensus.cc:740] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:07.322348 23126 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.331319 23177 consensus_queue.cc:260] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:07.332352 23126 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:07.332620 23177 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.321883 23206 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.330319 23133 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.327028 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:07.341676 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:07.341423 23227 consensus_queue.cc:260] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.343215 23227 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.347705 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:07.386220 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.432092 23133 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:07.323125 23058 consensus_queue.cc:237] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.454267 22987 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:07.459203 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:07.458976 23106 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.460410 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:07.460685 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.460963 21760 raft_consensus.cc:3055] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:07.461370 21760 raft_consensus.cc:740] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:07.462122 21760 consensus_queue.cc:260] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.462859 23106 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:07.463348 21760 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.448547 23195 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.464578 21762 raft_consensus.cc:1240] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:07.460791 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.470961 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.462124 21759 raft_consensus.cc:1240] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:07.472769 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:07.473378 23229 log.cc:927] Time spent T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:08:07.475095 21757 raft_consensus.cc:1240] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:07.464653 23018 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:07.479709 21759 raft_consensus.cc:1240] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:07.476758 23121 raft_consensus.cc:2955] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:07.484051 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.487102 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.490877 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:07.493287 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:07.493718 21760 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:07.494570 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:07.495793 23127 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:07.496289 22478 raft_consensus.cc:1240] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:07.497990 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:07.504628 23180 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:07.504787 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:07.506057 23176 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:07.506973 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:07.511989 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.515442 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:07.518141 23157 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:07.518612 23157 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.521811 21880 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:07.523222 23018 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.528144 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:07.529237 23218 consensus_queue.cc:1059] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:07.530122 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:07.530340 23218 raft_consensus.cc:3055] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:07.530675 23218 raft_consensus.cc:740] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:07.531344 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:07.531541 23218 consensus_queue.cc:260] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.532845 23218 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.533473 21877 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:07.534353 23018 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:07.538760 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:07.540189 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.541960 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.542302 21909 raft_consensus.cc:1240] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:07.544603 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.538691 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:07.550506 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:07.552177 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:07.553481 21831 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:07.556579 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.559535 22484 raft_consensus.cc:1240] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:07.561452 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:07.563687 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:07.564881 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:07.565505 21914 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:07.565922 21831 raft_consensus.cc:1240] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:07.568770 21662 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45746 (request call id 224) took 3081 ms. Trace:
I20260709 13:08:07.570196 22448 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.571660 22448 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.571341 23172 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:07.572744 22448 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.567028 23152 consensus_queue.cc:1059] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:08:07.577112 23158 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.577525 23057 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.569124 21662 rpcz_store.cc:276] 0709 13:08:04.487468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.487616 (+   148us) service_pool.cc:224] Handling call
0709 13:08:07.568715 (+3081099us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:06.513237 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:06.566240 (+ 53003us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:06.566272 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:08:06.566288 (+    16us) tablet.cc:662] Decoding operations
0709 13:08:06.566645 (+   357us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:06.566709 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:06.566734 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:06.566914 (+   180us) tablet.cc:701] Row locks acquired
0709 13:08:06.566932 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:08:06.567065 (+   133us) write_op.cc:270] Start()
0709 13:08:06.567161 (+    96us) write_op.cc:276] Timestamp: P: 1783602486567019 usec, L: 0
0709 13:08:06.567181 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:08:06.567790 (+   609us) log.cc:844] Serialized 591 byte log entry
0709 13:08:06.740126 (+172336us) op_driver.cc:464] REPLICATION: finished
0709 13:08:06.994878 (+254752us) write_op.cc:301] APPLY: starting
0709 13:08:06.994992 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:06.995093 (+   101us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:06.995219 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:06.995429 (+   210us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:06.995581 (+   152us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:06.995621 (+    40us) write_op.cc:312] APPLY: finished
0709 13:08:06.995832 (+   211us) log.cc:844] Serialized 23 byte log entry
0709 13:08:06.996007 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:06.996093 (+    86us) write_op.cc:454] Released schema lock
0709 13:08:06.996134 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:06.996485 (+   351us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:06.996518 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":733126,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":209626,"apply.run_cpu_time_us":1615,"apply.run_wall_time_us":14773,"num_ops":1,"prepare.queue_time_us":279614,"prepare.run_cpu_time_us":31041,"prepare.run_wall_time_us":147218,"raft.queue_time_us":34220,"raft.run_cpu_time_us":69602,"raft.run_wall_time_us":125169,"replication_time_us":172793,"thread_start_us":467884,"threads_started":4,"wal-append.queue_time_us":97821}]]}
I20260709 13:08:07.584239 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:07.498318 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:07.503384 22478 raft_consensus.cc:2955] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:07.586380 21661 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52326 (request call id 148) took 1068 ms. Trace:
I20260709 13:08:07.586768 21661 rpcz_store.cc:276] 0709 13:08:06.533226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.544589 (+ 11363us) service_pool.cc:224] Handling call
0709 13:08:07.586326 (+1041737us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":303568,"reported_tablets":1}
I20260709 13:08:07.591485 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:07.596401 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:07.597469 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:07.611088 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:07.610988 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:07.609648 21805 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:07.616688 23173 consensus_meta.cc:287] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.000s
I20260709 13:08:07.592916 23182 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:08:07.618800 23135 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.617121 23173 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:07.620620 21765 raft_consensus.cc:1240] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:07.622025 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.591425 23195 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:07.623132 21879 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.626070 21805 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:07.627321 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:07.628734 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:07.628811 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:07.635824 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:07.636215 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:07.639158 21879 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.638327 21805 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:07.641603 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.639048 23143 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.642601 21879 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.645479 21879 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.646457 21805 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:07.625692 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:07.651190 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.652750 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:07.653964 21759 raft_consensus.cc:2393] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:07.652537 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.652034 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.655608 21760 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:07.656131 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.658174 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.658257 21879 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.638763 23206 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.656810 21762 raft_consensus.cc:2376] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2. Re-sending same reply.
I20260709 13:08:07.659796 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.656821 23164 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:07.648556 23226 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.662024 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:07.664273 23152 raft_consensus.cc:3055] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:07.664754 23152 raft_consensus.cc:740] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:07.665086 22450 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.644861 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:07.656037 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.641518 23233 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:07.668323 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.669337 21879 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.643682 23212 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:07.643968 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:07.679055 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.681257 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:07.648407 23066 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.625512 22448 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:07.647886 23167 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.670444 21805 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:07.684686 21879 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:07.678701 23019 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.688035 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:07.671833 22987 consensus_queue.cc:1059] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:08:07.689853 22477 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.691027 23157 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.680521 23173 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:07.693800 21913 raft_consensus.cc:1240] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:07.694228 23158 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.687175 23214 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.695488 23135 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.682188 23057 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.696537 23238 consensus_queue.cc:1059] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:07.697149 22480 raft_consensus.cc:1240] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:07.692859 22477 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:07.696707 23152 consensus_queue.cc:260] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.706310 21879 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.710050 21879 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.698251 21805 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:07.708107 22987 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:07.714138 22987 raft_consensus.cc:697] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:07.715121 22987 consensus_queue.cc:237] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:07.707234 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 93668.7us
I20260709 13:08:07.718257 23202 raft_consensus.cc:3055] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:07.718665 23202 raft_consensus.cc:740] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:07.718953 22448 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.719444 23202 consensus_queue.cc:260] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.720743 23202 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.721481 23227 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.722402 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:07.723170 21907 raft_consensus.cc:2393] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 2: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:07.724145 23217 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:07.724545 23217 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:07.724882 23217 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.732714 21660 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45778 (request call id 280) took 4571 ms. Trace:
I20260709 13:08:07.709224 23057 raft_consensus.cc:3055] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:07.733328 23057 raft_consensus.cc:740] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:07.734151 23057 consensus_queue.cc:260] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.734406 23206 consensus_queue.cc:1059] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:07.735430 23206 raft_consensus.cc:3055] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:07.735721 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:07.735864 23206 raft_consensus.cc:740] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:07.737277 23206 consensus_queue.cc:260] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.706207 23019 raft_consensus.cc:2804] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:07.733196 21660 rpcz_store.cc:276] 0709 13:08:03.161180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.189829 (+ 28649us) service_pool.cc:224] Handling call
0709 13:08:07.732616 (+4542787us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":334817,"reported_tablets":3}
I20260709 13:08:07.738526 23019 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:07.738672 23206 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.739037 23019 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.739171 23172 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:07.741882 23224 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:07.742127 21879 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.742233 23158 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:07.742674 23157 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:07.743336 21879 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.743808 23144 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:07.744170 23144 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:07.744521 21879 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.744675 23018 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.745311 23212 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:07.745446 23162 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.745725 23212 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:07.746866 21879 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:07.747743 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:07.747996 21879 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.742380 23224 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:07.750389 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:07.737174 23152 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:07.697585 21649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 56307.8us
I20260709 13:08:07.754570 21879 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.746191 23212 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:07.771498 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.744518 23144 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:07.760417 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 46790.4us
I20260709 13:08:07.753080 23233 raft_consensus.cc:2804] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:07.752830 23224 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.752942 23214 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.773905 21879 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.779716 21805 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:07.787593 21914 raft_consensus.cc:1240] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:07.795083 21879 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.797919 21879 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:07.798451 21910 raft_consensus.cc:1240] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:07.773288 23166 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:07.812237 21805 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:07.818290 21804 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:07.794101 23018 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:07.785921 23233 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:07.823316 21805 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:07.785820 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 96503.2us
I20260709 13:08:07.822793 21804 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:07.824622 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:07.809687 23167 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:07.794893 23121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:38332 (request call id 69) took 1672 ms. Trace:
I20260709 13:08:07.812453 23164 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:07.817760 23143 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:07.812638 23166 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:07.825933 23186 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:07.817900 23227 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.833858 23183 consensus_queue.cc:1059] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:08:07.832650 23121 rpcz_store.cc:276] 0709 13:08:06.106844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.532399 (+425555us) service_pool.cc:224] Handling call
0709 13:08:06.567593 (+ 35194us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b54004329a0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae2d4520 00007fc6ae35db42 00007fc6ae35c800 00007fc6ae3559fa 00007fc6b331d4c9 00007fc6ac899c54 00007fc6ac899be2 00007fc6ac899b11 00007fc6ac899a8c 00007fc6ac898d42
0709 13:08:06.606620 (+ 39027us) log.cc:844] Serialized 487 byte log entry
0709 13:08:07.778905 (+1172285us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6534,"raft.queue_time_us":6318,"raft.run_cpu_time_us":10268,"raft.run_wall_time_us":108662,"spinlock_wait_cycles":58539904,"thread_start_us":68994,"threads_started":1,"wal-append.queue_time_us":143601}
I20260709 13:08:07.841243 23239 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:07.843340 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:07.844079 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:07.826890 23018 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:07.826766 23233 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:07.866458 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.836397 23057 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.833216 23167 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:07.838330 23172 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.876847 21729 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.836675 23164 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:07.889345 23164 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:07.834856 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 115991us
I20260709 13:08:07.879142 21729 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.880795 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:07.846712 23166 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.847618 23186 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:07.893760 21729 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.900988 21729 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.902758 21729 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.910463 23134 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.913810 23164 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.912514 21729 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.872716 23018 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:07.845350 21649 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 291227c6f9914476b4363d40f7cfebb8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3843e9b794a245dd8608e04ec7915239 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:07.877068 23167 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:07.892010 23127 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:07.887521 23212 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:07.923655 21729 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:07.925704 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 108426us
W20260709 13:08:07.925729 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 103037us
I20260709 13:08:07.899469 23218 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:07.870127 23216 consensus_queue.cc:1059] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:08:07.930907 21804 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:07.905192 23186 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:07.932204 21729 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:07.934603 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 111366us
I20260709 13:08:07.920653 23106 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:07.922729 23177 consensus_meta.cc:287] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.590s	user 0.004s	sys 0.009s
I20260709 13:08:07.920524 23193 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:07.923122 23134 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:07.937064 21729 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.941959 21805 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:07.947645 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.923072 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 50405.3us
I20260709 13:08:07.933647 23197 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:07.947319 23195 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:07.890899 23242 consensus_queue.cc:1059] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:08:07.936113 23126 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:08:07.933674 21649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 98448.2us
I20260709 13:08:07.937968 23194 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:07.949873 21729 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.959672 22478 raft_consensus.cc:1240] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:07.960291 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:07.960543 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:07.960973 21836 raft_consensus.cc:1240] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:07.967303 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:07.983050 23212 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:07.984579 21831 raft_consensus.cc:1240] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:07.987390 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:07.989794 23197 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:07.979007 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:07.993570 21729 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:07.996973 21879 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.006558 21729 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:08.007335 23197 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:08.008450 21729 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:08.008368 23197 consensus_queue.cc:1059] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:08.009227 23125 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:07.952303 21647 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b0e72cc3f09a4d549ebd824be85955a3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:07.978992 23164 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:07.951802 23217 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:08.021237 21647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 90289.8us
I20260709 13:08:07.994212 23058 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:08.000926 23216 raft_consensus.cc:3055] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:08.014182 23194 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:08.000975 22450 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:08.045925 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 65420.9us
I20260709 13:08:08.088310 21879 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.038729 23019 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:07.948989 22448 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.083407 22480 raft_consensus.cc:1240] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:08.076988 23214 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:08.102708 23248 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:08.102869 23214 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:08.103168 23248 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:08.103384 23214 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.103637 23248 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.085157 23217 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:08.092034 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 85111.3us
W20260709 13:08:08.098356 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 156458us
I20260709 13:08:08.099555 21833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:08:08.107208 21833 raft_consensus.cc:606] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:08.100579 21879 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.098022 23194 consensus_queue.cc:1059] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:08:08.102054 23245 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:08.108326 21805 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:08.109411 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:08.109572 21805 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:08.111194 21805 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:08.111272 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:08.101995 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:08.114610 21832 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:08.078953 23216 raft_consensus.cc:740] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:08.117116 21805 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:08.127409 21729 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:08.129745 23233 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.131417 23018 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.132455 21914 raft_consensus.cc:1240] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:08.132557 23233 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:08.096305 23135 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:08.136354 21879 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.079619 23127 consensus_queue.cc:1059] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:08:08.140210 21805 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:08.143707 21805 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:08.133756 23258 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:08.117015 23238 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:08.118853 23184 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:08.119026 23121 raft_consensus.cc:2764] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:08:08.119184 23239 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:08.082082 23186 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.160626 21879 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.140811 23183 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:08.163269 21728 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:08.135730 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 161271us
I20260709 13:08:08.146885 21908 raft_consensus.cc:1240] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:08.176460 21879 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:08.145459 23135 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.183468 23172 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:08.154920 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:08.178063 21879 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.185187 21728 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.185087 21832 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:08.171476 23264 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:08.187893 21728 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:08.189230 21728 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.172717 23216 consensus_queue.cc:260] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.174474 23227 raft_consensus.cc:3055] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:08:08.141803 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 202894us
I20260709 13:08:08.153743 23258 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.153947 23066 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:08.206693 21879 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.208844 23260 raft_consensus.cc:2804] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:08.178727 23255 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:08.179113 23176 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:08.179649 23166 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.182318 22450 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:08.156299 23263 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:08.208129 21879 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.209455 23255 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:08.156594 23177 consensus_queue.cc:1059] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:08:08.187098 23139 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:08.209275 23260 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:08.199484 23227 raft_consensus.cc:740] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:08.207605 23218 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:08.197867 23202 consensus_queue.cc:1059] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:08:08.197883 23197 consensus_queue.cc:1059] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:08:08.214753 23127 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:08.239607 23260 raft_consensus.cc:3060] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.224110 23057 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:08.239831 23195 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:08.252277 23216 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:08.267807 23266 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:08.262743 23233 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:08.277973 23106 raft_consensus.cc:3055] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:08.278416 23106 raft_consensus.cc:740] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:08.244218 23255 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.252740 23152 consensus_queue.cc:1059] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:08:08.267472 23167 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:08.249691 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 67459.4us
I20260709 13:08:08.281340 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:08.257668 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:08.283488 23019 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:08.283344 23106 consensus_queue.cc:260] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.284649 22450 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:08.285817 21914 raft_consensus.cc:1240] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:08.287895 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 196194us
I20260709 13:08:08.263628 23176 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:08.252113 23183 consensus_queue.cc:1059] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:08:08.256222 23158 consensus_queue.cc:1059] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:08:08.268476 23164 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:08.282670 23134 raft_consensus.cc:3055] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:08.239836 22987 raft_consensus.cc:3055] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:08.282469 23018 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:08.304910 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:08.265353 23238 consensus_queue.cc:1059] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:08:08.295691 23266 raft_consensus.cc:3055] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:08:08.302055 23206 consensus_meta.cc:287] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.001s
I20260709 13:08:08.278558 23227 consensus_queue.cc:260] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.315477 23241 raft_consensus.cc:3055] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:08.315945 23241 raft_consensus.cc:740] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:08.302989 23134 raft_consensus.cc:740] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:08.310623 23106 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:08.314221 23202 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:08.322542 23224 consensus_meta.cc:287] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 13:08:08.312920 23266 raft_consensus.cc:740] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:08.331584 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:08.310163 22987 raft_consensus.cc:740] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
W20260709 13:08:08.337006 23144 consensus_meta.cc:287] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.003s
I20260709 13:08:08.321076 23240 consensus_queue.cc:1059] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 13:08:08.351491 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 224179us
I20260709 13:08:08.354068 23144 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.355042 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:08.356184 23144 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:08.359603 21832 raft_consensus.cc:1275] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:08:08.350802 23261 log.cc:927] Time spent T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:08:08.316815 23241 consensus_queue.cc:260] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:08.378597 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.309469 21905 raft_consensus.cc:2955] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:08.358740 22480 raft_consensus.cc:2393] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 3: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:08.379392 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:08.386637 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 165776us
I20260709 13:08:08.339579 23224 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.390329 23224 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:08.371563 21913 raft_consensus.cc:1240] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:08.359078 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:08.392112 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:08.352698 23267 consensus_queue.cc:1059] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:08:08.337464 22450 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.359411 23166 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:08.377938 23162 consensus_meta.cc:287] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.629s	user 0.010s	sys 0.002s
I20260709 13:08:08.396237 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:08.399564 21765 raft_consensus.cc:1275] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:08.400122 21906 raft_consensus.cc:1240] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:08.404759 23258 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:08.405297 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:08.426412 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 100154us
I20260709 13:08:08.432785 22450 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.427143 21908 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:08.429374 21832 raft_consensus.cc:1240] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:08.430413 22480 raft_consensus.cc:1275] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:08.414422 23057 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:08.438356 23267 consensus_queue.cc:1243] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer 8c6c2207af3d47b3acf352d81959f4dd log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:08.439394 23238 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:08.439857 23217 raft_consensus.cc:3055] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:08.440339 23217 raft_consensus.cc:740] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:08.439934 23238 raft_consensus.cc:697] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:08.441375 23217 consensus_queue.cc:260] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.406440 22987 consensus_queue.cc:260] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.445083 22987 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.407927 23167 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:08.395830 23134 consensus_queue.cc:260] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.448735 21758 raft_consensus.cc:3055] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:08.448321 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:08.449123 21758 raft_consensus.cc:740] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:08.450870 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:08.448810 23239 consensus_queue.cc:1048] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:08:08.453034 21758 consensus_queue.cc:260] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.455802 21758 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:08.456949 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.448997 23241 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.466250 21832 raft_consensus.cc:1240] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:08.479951 21761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:35914
I20260709 13:08:08.480548 21761 raft_consensus.cc:606] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.466429 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:08:08.490411 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 282361us
I20260709 13:08:08.491163 21879 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.441545 23238 consensus_queue.cc:237] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.493916 21760 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:08.499042 21763 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:08.531734 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:08.500099 21804 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:08.513921 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:08.533970 22483 raft_consensus.cc:2393] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 2: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:08.523216 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:08.497002 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:08.531174 21805 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:08.510004 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:08.535987 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:08.536430 21759 raft_consensus.cc:2393] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:08.536518 21764 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.527140 21758 raft_consensus.cc:1275] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:08.539755 22450 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:08.540550 23057 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:08.544279 21879 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.545235 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:08.547622 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:08.548604 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:08.549182 21758 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:08:08.550540 21805 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:08.540961 23245 raft_consensus.cc:3055] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:08.552327 23242 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:08.552610 23245 raft_consensus.cc:740] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:08.552704 23180 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:08.545959 23167 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.495452 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:08.545818 23057 raft_consensus.cc:697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:08.510484 23158 raft_consensus.cc:3055] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:08.553570 23167 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.554176 23158 raft_consensus.cc:740] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:08.554495 23057 consensus_queue.cc:237] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.555084 23158 consensus_queue.cc:260] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.555696 23167 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:08.556342 23158 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.556272 23166 consensus_queue.cc:1059] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:08.556900 23217 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:08.557420 23166 raft_consensus.cc:3055] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:08.557849 23166 raft_consensus.cc:740] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:08:08.558831 23125 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:08:08.558784 23166 consensus_queue.cc:260] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.560264 23166 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:08.552810 23135 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:08.563686 21759 raft_consensus.cc:2393] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:08.550359 21765 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:08.567855 21879 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.554078 21756 raft_consensus.cc:2393] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:08.569084 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:08.561153 23245 consensus_queue.cc:260] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:08.570658 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 70639.1us
I20260709 13:08:08.541039 21660 catalog_manager.cc:5697] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 1 to 2, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 2 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:08.529096 23186 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:08.577822 21660 catalog_manager.cc:5697] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index 2 to 3, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:08.583389 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:08.583334 21660 catalog_manager.cc:5697] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index 3 to 4, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New cstate: current_term: 1 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:08.584117 21760 raft_consensus.cc:2393] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
W20260709 13:08:08.578660 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.579107 21761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
new_leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:35914
I20260709 13:08:08.505664 23172 raft_consensus.cc:3055] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:08.576581 23250 consensus_queue.cc:1048] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:08:08.503516 23270 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:08.581337 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:08.595914 22483 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:08.597150 21880 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:08.596760 21660 catalog_manager.cc:5697] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 2 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:08.598367 23162 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:08.598754 23162 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.569538 23248 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.599074 23162 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.600637 23248 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:08.600886 21912 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:08.584959 21761 raft_consensus.cc:606] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Received request to transfer leadership to TS 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:08.483141 23214 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.577392 23183 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:08.496310 23266 consensus_queue.cc:260] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.592759 23239 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:08.621167 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:08.621634 23239 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:08.622041 23239 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:08.589466 23167 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:08.591207 22450 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:08.575591 23177 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:08.602185 21761 raft_consensus.cc:614] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:08.602694 21764 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:08.604066 21906 raft_consensus.cc:1240] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:08.540408 23255 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.631003 21757 raft_consensus.cc:1240] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:08.589061 21879 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.612262 21914 raft_consensus.cc:1240] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:08.616859 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:08.586455 23172 raft_consensus.cc:740] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:08.607568 23183 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:08.605878 23264 consensus_queue.cc:1059] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:08:08.638558 23183 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.619880 23242 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:08:08.446795 23273 consensus_queue.cc:1175] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6d698a5544b946939790e7a3972db9fb" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:08.626453 21909 raft_consensus.cc:1240] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:08.606534 23245 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.633656 21911 raft_consensus.cc:1240] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:08.635105 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 46100.3us
I20260709 13:08:08.637998 23214 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:08.639657 21910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:08:08.640952 21912 raft_consensus.cc:1240] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:08.617702 21907 raft_consensus.cc:1240] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:08.625458 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:08.638021 23172 consensus_queue.cc:260] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.660409 21910 raft_consensus.cc:606] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:08.643671 23266 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.637068 23167 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:08.638657 23202 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:08.650031 23135 consensus_queue.cc:1059] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:08:08.661583 21879 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.683712 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:08.688007 21879 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:08.688710 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:08.664281 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 79491.7us
I20260709 13:08:08.702034 21879 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.689817 23202 raft_consensus.cc:697] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:08.691030 23214 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:08.682911 23172 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.642647 23260 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.692341 23224 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:08.725306 23180 raft_consensus.cc:993] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d: : Instructing follower 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:08:08.725924 23226 raft_consensus.cc:3055] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:08.733573 21879 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.733765 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:08.740314 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:08.741037 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:08.717742 23177 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:08.741703 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:08.741062 21761 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:08:08.718061 23248 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.743670 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:08.746258 23248 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.748883 23248 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:08.750231 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:08.751284 22480 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:08.752627 23162 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.729368 22478 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:08.753383 21880 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:08.735016 23226 raft_consensus.cc:740] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:08.760145 21879 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.760915 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:08.732074 23227 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.761885 21835 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:08.768497 21879 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.744388 23250 raft_consensus.cc:1081] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Signalling peer 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:08:08.744546 23144 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:08.771047 21880 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:08.772635 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:08.767867 23018 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:08.775888 23260 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:08.779886 21877 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:08.778806 23224 raft_consensus.cc:2804] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:08.784263 23240 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:08.763033 23248 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.764074 23255 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:08.771353 23214 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:08.784776 23240 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.793550 23126 raft_consensus.cc:3055] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:08.795706 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:08.777855 23177 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:08.781124 23134 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:08.817582 23126 raft_consensus.cc:740] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:08.781713 23018 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.773470 22479 raft_consensus.cc:2468] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:08.769243 23202 consensus_queue.cc:237] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.836776 23267 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:08:08.838491 23282 log.cc:927] Time spent T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:08:08.811759 23224 raft_consensus.cc:697] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:08.813499 23167 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:08.814906 23144 raft_consensus.cc:697] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:08.838624 23267 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.811779 23248 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.841440 21880 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:08.820606 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:08.755698 23226 consensus_queue.cc:260] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.793787 23183 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.843557 23239 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.853863 23126 consensus_queue.cc:260] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.855907 21912 raft_consensus.cc:1240] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:08.835237 23018 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:08.864961 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 220173us
I20260709 13:08:08.866140 23180 consensus_queue.cc:1059] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:08.866753 23249 consensus_queue.cc:1059] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:08.867405 23283 raft_consensus.cc:3055] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:08.867738 23180 raft_consensus.cc:3055] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:08.867841 23283 raft_consensus.cc:740] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:08.868177 23180 raft_consensus.cc:740] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:08.868773 23249 consensus_queue.cc:1059] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:08.869007 23180 consensus_queue.cc:260] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.869736 23250 raft_consensus.cc:3055] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:08.870174 23250 raft_consensus.cc:740] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:08.870430 23180 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.870932 23250 consensus_queue.cc:260] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.899039 21836 raft_consensus.cc:1240] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:08.864738 23214 raft_consensus.cc:2804] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:08.898838 21908 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:08.909960 21912 raft_consensus.cc:1275] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:08.898909 23126 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.868930 23283 consensus_queue.cc:260] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.923769 21912 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:49554
I20260709 13:08:08.929728 21912 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:08.930120 21912 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:08.892999 23158 consensus_queue.cc:1059] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:08:08.893554 23058 consensus_queue.cc:1059] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:08:08.942317 21804 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:08.902312 23227 consensus_queue.cc:1059] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:08:08.913169 23214 raft_consensus.cc:697] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:08.944219 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:08.950867 21833 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:08.951994 21760 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.953568 23273 raft_consensus.cc:993] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:08:08.954149 23239 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:08.954759 23271 raft_consensus.cc:1081] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:08:08.956264 23267 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:08.957401 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:08.907199 23121 consensus_queue.cc:1059] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:08:08.961287 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:08.962832 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:08.963462 21762 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:08.964067 21759 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:08.963263 21835 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:08.965945 21877 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:08.968788 21912 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:08.937975 23162 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:08.974999 21911 raft_consensus.cc:1240] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:08.957476 23248 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:08.946426 23066 consensus_queue.cc:1048] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:08:08.903643 23224 consensus_queue.cc:237] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.981048 23214 consensus_queue.cc:237] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.976207 23260 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:09.024748 23260 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.025143 23260 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:09.026887 23018 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:08.987285 23250 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.994136 23183 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:08.995532 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:08.997184 21879 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:09.043195 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 46089.5us
I20260709 13:08:08.999594 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:08.999392 23057 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:09.000288 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:09.048199 21763 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:09.000720 23226 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:09.003937 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:08.935362 23144 consensus_queue.cc:237] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:09.008440 21756 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:09.010840 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:09.015507 21912 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:09.018782 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:09.021082 21760 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:09.021867 23239 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:09.023262 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:08:08.985890 23286 log.cc:927] Time spent T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:08:09.033731 23143 raft_consensus.cc:3055] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:09.075166 23143 raft_consensus.cc:740] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:09.044314 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:09.077385 22483 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:09.056866 21835 raft_consensus.cc:3055] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:09.058192 21840 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38348
I20260709 13:08:09.077915 21835 raft_consensus.cc:740] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:09.078176 21840 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:09.078552 21840 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:09.047261 23240 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:09.045812 23263 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:09.062799 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:09.042569 23176 consensus_queue.cc:1059] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:08:09.066871 21763 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:09.072002 22479 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:09.073065 23018 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:09.126845 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 44844.1us
I20260709 13:08:09.045288 21877 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:09.079471 21806 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:09.058944 22480 raft_consensus.cc:2393] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 3: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:09.080608 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:09.121708 21840 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:09.128592 22483 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:09.072968 23182 consensus_queue.cc:1059] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:09.076026 23239 raft_consensus.cc:697] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:08:09.130497 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 51119.2us
I20260709 13:08:09.124966 21905 raft_consensus.cc:2393] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:08:09.138069 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 92857.5us
I20260709 13:08:09.139874 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:09.140460 21838 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:09.140508 21649 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 291227c6f9914476b4363d40f7cfebb8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3843e9b794a245dd8608e04ec7915239 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:09.147897 23018 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:09.148535 23018 raft_consensus.cc:697] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:09.148681 21838 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:09.149466 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:09.149591 23018 consensus_queue.cc:237] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:09.151852 23263 raft_consensus.cc:3055] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:09.152292 23263 raft_consensus.cc:740] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:09.153278 23263 consensus_queue.cc:260] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:09.136834 23121 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:09.154619 23121 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:09.155092 23121 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:09.156075 23268 raft_consensus.cc:993] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:08:09.156591 23268 raft_consensus.cc:1081] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:08:09.118422 23276 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.211721 21838 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:08:09.211998 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 72200.7us
I20260709 13:08:09.131843 23214 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:09.213362 23214 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:09.215735 22479 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:09.215950 23263 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:09.132004 23066 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:09.217885 23066 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:09.218731 22987 raft_consensus.cc:3055] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:09.219110 22987 raft_consensus.cc:740] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:09.220060 23184 raft_consensus.cc:3055] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:09.220412 23184 raft_consensus.cc:740] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:09.221120 23184 consensus_queue.cc:260] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:09.222242 23184 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:09.153321 23239 consensus_queue.cc:237] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:09.215795 23214 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:09.229856 21877 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:09.230841 23284 raft_consensus.cc:3055] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:09.231237 23284 raft_consensus.cc:740] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:09.231981 23284 consensus_queue.cc:260] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:09.233125 23284 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:09.235813 23212 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:09.236465 23212 raft_consensus.cc:697] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:08:09.209378 23287 log.cc:927] Time spent T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:08:09.262979 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:09.265276 21834 raft_consensus.cc:2393] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:08:09.266038 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 107684us
I20260709 13:08:09.266131 22483 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:09.268527 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:09.268949 21836 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:09.269109 21912 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:09.275094 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:09.279824 22987 consensus_queue.cc:260] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:09.225612 23276 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:09.157238 23143 consensus_queue.cc:260] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:09.241616 23212 consensus_queue.cc:237] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:09.322062 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 48170.4us
I20260709 13:08:09.321969 21879 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:09.329879 21805 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:09.346331 21879 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:09.345480 23158 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:08:09.349570 23268 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:09.349997 22987 raft_consensus.cc:3060] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:09.350162 23268 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:09.352494 23268 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:09.353648 21907 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:09.354015 23166 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:09.354086 23176 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:09.354761 23166 raft_consensus.cc:697] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:09.354804 23176 raft_consensus.cc:697] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 2 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:09.355846 23166 consensus_queue.cc:237] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:09.356585 23176 consensus_queue.cc:237] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:09.358560 23240 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:09.361776 21911 raft_consensus.cc:1275] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:09.362483 23260 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:09.363565 23121 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:09.364863 23260 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:09.366595 23276 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:09.369572 23195 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:09.370369 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:09.381796 21759 raft_consensus.cc:3055] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:09.382153 21759 raft_consensus.cc:740] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:09.371835 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:09.382848 21834 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:09.374745 21761 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:08:09.383786 21761 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:09.384258 21761 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:09.386675 21836 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:09.347996 21912 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:09.375489 21804 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:09.376722 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:09.377763 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:09.401422 21758 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:09.378911 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:09.401492 21762 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:09.402261 21765 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:09.403681 21804 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:09.378809 21729 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:09.405025 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:09.406138 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:09.407243 21833 raft_consensus.cc:2393] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:09.411396 23240 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:09.411959 23226 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:09.412020 23240 raft_consensus.cc:697] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:08:09.328542 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 52943.4us
I20260709 13:08:09.410107 21759 consensus_queue.cc:260] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:09.423413 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 44683.3us
W20260709 13:08:09.428995 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.373975 21905 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:09.442739 21879 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:09.454190 21762 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:09.465867 21879 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:09.491375 23233 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:09.491921 23233 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:09.492017 23167 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:09.492372 23233 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:09.492564 23167 raft_consensus.cc:697] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:09.493616 23135 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:09.493464 23167 consensus_queue.cc:237] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:09.494088 23135 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:09.496088 23135 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:09.500242 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:09.412698 23226 raft_consensus.cc:697] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:09.423163 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:09.503564 21912 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 2: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:09.518230 21804 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:09.501637 21833 raft_consensus.cc:1275] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:09.506021 21761 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:09.510445 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.515882 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 54729.4us
I20260709 13:08:09.436144 23134 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.526007 21761 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:09.412952 23158 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:08:09.441974 23177 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.404392 23195 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:09.550571 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 101129us
W20260709 13:08:09.551170 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 52528.4us
I20260709 13:08:09.522022 23271 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:09.535115 23172 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.526204 23227 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:09.506155 23245 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:08:09.602778 21835 consensus_queue.cc:260] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:09.604038 21835 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:09.638403 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.689802 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:09.696856 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:09.697752 21761 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:09.535353 23134 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:09.707804 21834 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:09.553027 23177 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:09.572896 23227 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:08:09.692008 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 127586us
W20260709 13:08:09.759378 23295 log.cc:927] Time spent T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.185s	user 0.000s	sys 0.000s
I20260709 13:08:09.760085 23177 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:09.760957 23296 log.cc:927] Time spent T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 13:08:09.761104 21907 raft_consensus.cc:2393] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:08:09.763729 23300 log.cc:927] Time spent T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:08:09.574426 23172 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:09.764724 23121 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:09.766688 23172 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:09.722651 23227 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:09.773392 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:09.774053 21832 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:09.776789 21877 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:09.777722 21832 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:09.730396 23226 consensus_queue.cc:237] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:09.782955 21757 raft_consensus.cc:1240] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:09.559994 23240 consensus_queue.cc:237] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:09.719903 23183 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.815100 21835 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:09.716398 23309 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 13:08:09.799050 23158 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.785213 23273 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.806895 23270 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:09.822978 21759 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:09.818713 23195 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:09.817718 23066 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:09.830853 23134 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:09.827998 23283 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:09.818058 23158 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:09.854492 23158 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:09.810745 23255 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:08:09.817375 23162 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:09.869184 23162 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:09.871109 22987 consensus_meta.cc:287] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.521s	user 0.006s	sys 0.014s
I20260709 13:08:09.808485 23183 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:09.873073 23233 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:09.875064 23183 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:09.875816 23233 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:09.876675 23184 consensus_meta.cc:287] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.654s	user 0.005s	sys 0.006s
I20260709 13:08:09.821956 23273 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:09.885954 23273 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:09.862040 23270 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.889142 23270 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:09.871286 23162 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:09.903484 21840 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:09.908591 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:09.936894 21759 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:09.941846 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:09.943198 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.944128 21805 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:09.954458 21757 raft_consensus.cc:1275] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:08:09.969976 23180 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:09.942656 23264 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.953527 23183 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.954672 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:09.951391 23184 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:09.962735 23273 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.973392 23180 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:10.008038 23238 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.009897 23180 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:10.030007 23271 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.030762 23271 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.031996 23238 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.034931 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:10.003472 23183 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.000741 23264 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.035818 22480 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:10.044837 23183 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:10.045555 23238 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:10.046239 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:10.047077 22479 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:10.054811 23271 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:10.057374 23162 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:10.058328 23162 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.058642 23180 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.060896 23180 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.061003 23162 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:10.006783 23227 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.062342 21731 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:10.063622 23227 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:10.007829 22477 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:10.042685 23264 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:10.072218 21728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.006s	sys 0.024s
W20260709 13:08:10.072575 21728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.006s	sys 0.024s
W20260709 13:08:10.072840 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 519317us
I20260709 13:08:10.007275 23184 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.079926 23212 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:10.080588 23212 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.082613 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:10.082757 23212 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:10.083287 21906 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:10.085741 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:10.086299 21909 raft_consensus.cc:3055] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:10.086563 21909 raft_consensus.cc:740] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:10.086601 23238 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.087322 21909 consensus_queue.cc:260] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.087400 23238 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.088195 23245 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:10.088445 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:10.088981 21914 raft_consensus.cc:1813] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Handling vote request from an unknown peer 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:10.088745 23245 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.089542 21914 raft_consensus.cc:2410] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:08:10.090855 23245 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.090893 23238 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.092804 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:10.093492 22478 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:10.095270 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:10.096844 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:10.097491 22476 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:10.099565 23206 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.100051 23206 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.102324 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:10.106703 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:10.107859 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:10.108844 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:10.109342 22482 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:10.110105 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:10.110606 22482 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:10.110998 23206 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.111356 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:10.112051 22482 raft_consensus.cc:2393] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 2: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:10.111374 21880 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:10.112938 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:10.113672 22481 raft_consensus.cc:2393] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 2: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:10.114089 23212 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:10.114495 23212 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:10.114748 22481 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:10.114908 23212 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:10.112610 21806 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:10.124714 21806 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:10.125499 21806 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:10.125599 21729 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:10.126484 23312 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:10.126912 23264 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:10.126962 23312 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.127751 23264 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:10.128118 23264 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.128463 23264 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:10.129598 23240 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:10.130028 23240 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.129742 23238 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:10.130295 21729 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:10.130436 23240 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:10.132587 23274 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:10.132988 23274 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.133325 23274 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:10.135070 23308 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:10.129416 23312 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.138911 21749 tablet_service.cc:1558] Processing DeleteTablet for tablet b0e72cc3f09a4d549ebd824be85955a3 with delete_type TABLET_DATA_TOMBSTONED (TS 3843e9b794a245dd8608e04ec7915239 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59090
I20260709 13:08:10.139294 21660 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45762 (request call id 240) took 1820 ms. Trace:
I20260709 13:08:10.139703 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:10.142350 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:10.147146 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:10.147276 21760 raft_consensus.cc:1275] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:10.148414 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:10.148589 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:10.150018 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:10.151422 23134 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:10.151932 23134 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.153600 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:10.114513 21880 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:10.155184 23312 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:10.155644 23312 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.157591 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:10.140399 22483 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:10.011359 23273 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:10.157603 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 356737us
I20260709 13:08:10.153997 23134 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.160284 21764 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:10.168913 21765 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:10.169394 21662 catalog_manager.cc:5697] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 1 to 2, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 2 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:10.069895 23271 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:10.172991 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 442106us
W20260709 13:08:10.174260 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.168206 21806 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:10.154089 23240 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.191010 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:10.139655 21660 rpcz_store.cc:276] 0709 13:08:08.318976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.319127 (+   151us) service_pool.cc:224] Handling call
0709 13:08:10.139239 (+1820112us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:08.702242 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:08.720223 (+ 17981us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:08.720265 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:08:08.720294 (+    29us) tablet.cc:662] Decoding operations
0709 13:08:08.721195 (+   901us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:08.721272 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:08.721307 (+    35us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:08:08.721747 (+   440us) tablet.cc:701] Row locks acquired
0709 13:08:08.721764 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:08:08.721911 (+   147us) write_op.cc:270] Start()
0709 13:08:08.722019 (+   108us) write_op.cc:276] Timestamp: P: 1783602488721867 usec, L: 0
0709 13:08:08.722041 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:08:08.806887 (+ 84846us) log.cc:844] Serialized 1789 byte log entry
0709 13:08:09.494725 (+687838us) op_driver.cc:464] REPLICATION: finished
0709 13:08:09.728131 (+233406us) write_op.cc:301] APPLY: starting
0709 13:08:09.728547 (+   416us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:09.729272 (+   725us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:09.731468 (+  2196us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:09.865547 (+134079us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:09.865802 (+   255us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:08:09.865869 (+    67us) write_op.cc:312] APPLY: finished
0709 13:08:09.866147 (+   278us) log.cc:844] Serialized 41 byte log entry
0709 13:08:09.866365 (+   218us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:09.866497 (+   132us) write_op.cc:454] Released schema lock
0709 13:08:09.866554 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:09.866988 (+   434us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:09.867024 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"spinlock_wait_cycles":1280,"child_traces":[["op",{"apply.queue_time_us":231978,"apply.run_cpu_time_us":3391,"apply.run_wall_time_us":139544,"num_ops":4,"prepare.queue_time_us":93830,"prepare.run_cpu_time_us":34884,"prepare.run_wall_time_us":162382,"raft.queue_time_us":140722,"raft.run_cpu_time_us":11114,"raft.run_wall_time_us":75750,"replication_time_us":772538,"thread_start_us":289536,"threads_started":4,"wal-append.queue_time_us":131148}]]}
W20260709 13:08:10.191001 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 76642.7us
I20260709 13:08:10.157068 23307 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:10.078541 23248 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:10.156913 23162 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.197857 21836 raft_consensus.cc:1240] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:10.197932 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.212669 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.213127 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.198763 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.213725 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.214370 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:10.198946 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.199399 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.197857 21838 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:10.200368 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.269217 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:10.220466 21805 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:10.265810 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.281339 21831 raft_consensus.cc:2393] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:10.182042 23271 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.282449 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.291528 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.292237 21831 raft_consensus.cc:2393] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:10.287047 23292 raft_consensus.cc:476] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 13:08:10.189976 23134 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.292796 22484 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:10.194916 23268 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:10.296190 21831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38332
I20260709 13:08:10.220175 21879 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:10.192773 23290 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.300673 21806 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:10.194180 23183 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:10.170647 23058 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.116s
I20260709 13:08:10.311533 23290 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.301666 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.277297 23206 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.211614 23284 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:10.303303 21831 raft_consensus.cc:606] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Received request to transfer leadership
W20260709 13:08:10.303401 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 83324.5us
I20260709 13:08:10.267027 23321 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.278539 23267 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:10.201923 23176 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:08:10.295138 23271 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:10.329123 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 108761us
I20260709 13:08:10.286720 23162 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.285746 23212 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.215265 23307 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.278301 23248 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.324486 23126 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.322901 23284 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.343529 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:10.345970 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.302748 23134 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.331267 23135 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:10.300510 23317 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:10.306332 23274 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.314699 23183 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.389668 23249 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.328293 23206 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.370826 23284 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:10.349381 23332 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:10.380919 23126 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.407161 21759 raft_consensus.cc:2393] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 2: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:10.332588 23267 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.405783 23176 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.386869 23135 raft_consensus.cc:697] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:10.390695 23227 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:10.412410 23326 tablet_replica.cc:333] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:08:10.412346 23176 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.412884 23312 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.433622 23248 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:10.434021 23326 raft_consensus.cc:2243] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:10.413108 23275 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:10.413662 23329 log.cc:927] Time spent T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:08:10.414767 23311 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:10.401041 23058 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.390203 23249 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.436937 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:10.449306 22483 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:10.434504 23240 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:10.434731 23326 raft_consensus.cc:2272] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.447764 23272 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:10.419298 23184 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.419533 23332 raft_consensus.cc:697] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:10.370605 23321 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.435103 23273 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.434417 23267 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:10.435693 23227 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.399431 23317 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.462570 21877 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:10.485671 21877 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:10.490936 23323 log.cc:927] Time spent T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:08:10.493907 21838 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:10.495472 23321 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:10.496034 23321 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:10.448437 23058 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.498481 23248 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:10.480744 23250 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.452687 23275 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.482806 22987 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.504878 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:10.500479 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.507681 22483 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:10.485467 23311 raft_consensus.cc:697] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:10.482226 23272 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.517972 21806 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:10.489210 23274 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:10.511775 23177 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:08:10.518157 23193 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:10.528671 23249 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.490584 23245 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:10.518393 23307 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.522773 23058 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.510123 23135 consensus_queue.cc:237] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.523077 22479 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:10.523658 23134 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:10.526414 23121 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:10.529081 23193 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.524686 22987 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.519855 23212 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:10.519028 23162 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:10.517195 23250 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.551445 23326 ts_tablet_manager.cc:1916] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:10.537542 23245 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.538988 23183 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.560657 23317 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.561002 22479 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:10.561560 23193 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.562950 23245 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.563109 23184 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.563483 23245 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.563581 23184 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.563915 23245 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.565613 23176 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:10.542297 23206 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.567982 22987 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.547899 23121 raft_consensus.cc:697] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:10.575340 23206 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:10.535492 23311 consensus_queue.cc:237] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.517319 23332 consensus_queue.cc:237] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.580843 23206 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:10.547631 21649 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a218be1e72294b138c21b46dfa317d11 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3843e9b794a245dd8608e04ec7915239 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:10.576478 23143 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:10.578356 23184 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:10.591974 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 398373us
I20260709 13:08:10.576045 23183 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:08:10.595844 23121 consensus_queue.cc:237] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:10.589995 21649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 44805.9us
W20260709 13:08:10.597543 23270 consensus_meta.cc:287] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.707s	user 0.007s	sys 0.005s
I20260709 13:08:10.592542 23245 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.609131 23206 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:10.593811 21880 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:10.622417 23255 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:10.626015 23271 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.630335 21731 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:10.635270 21761 raft_consensus.cc:2393] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 4: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:10.637178 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:10.640762 23206 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:10.619820 23183 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.643465 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:10.647029 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:10.647711 22483 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:10.649317 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:10.650831 22485 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:10.647800 22482 raft_consensus.cc:2468] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:10.652879 22481 raft_consensus.cc:1275] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:10.654452 21731 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:10.656234 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:10.642004 23264 consensus_meta.cc:287] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.000s
I20260709 13:08:10.649777 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:10.641404 23272 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:10.679894 21764 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:10.668464 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:10.680896 21758 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:08:10.681063 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:10.681735 21764 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:10.667614 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:10.682380 21762 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:10.667886 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:10.684048 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:10.684718 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:10.683995 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:10.685310 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:10.620371 23270 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.686069 21764 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:10.687191 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:10.687851 21831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38332
I20260709 13:08:10.688398 21762 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:10.688620 21831 raft_consensus.cc:606] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Received request to transfer leadership
I20260709 13:08:10.687803 21758 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:10.690948 23270 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:10.641449 23206 raft_consensus.cc:697] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:10.651958 23182 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.696552 23182 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.699025 23182 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.702090 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:10.652182 21907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 756) took 1275 ms (client timeout 1548 ms). Trace:
I20260709 13:08:10.702118 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:10.656258 23317 raft_consensus.cc:2804] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:10.661692 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:10.706516 21763 raft_consensus.cc:2393] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 2: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:10.707160 21805 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:10.707406 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:10.710659 21911 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:10.710892 21805 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:10.709157 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:10.712284 21759 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:10.710994 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.645928 23275 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.713229 21840 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:10.713943 21805 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:10.723268 21805 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:10.719452 23193 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.708940 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:10.704541 23250 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.726660 21805 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:10.708765 23317 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.679229 23264 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.720407 23182 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:08:10.725643 23258 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:10.725404 23186 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:10.743574 23186 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.743933 23186 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:10.744350 22483 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:10.746137 21731 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:10.729564 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:10.732585 23193 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.749078 22476 raft_consensus.cc:1275] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:10.749670 23193 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.750177 23266 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:10.750978 23266 raft_consensus.cc:697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:10.751194 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:10.751811 22477 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:10.722563 23058 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:10.705457 23206 consensus_queue.cc:237] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.756982 22449 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:10.735268 23180 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.653352 23183 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.739596 23317 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:10.740242 21838 raft_consensus.cc:2368] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4.
I20260709 13:08:10.740505 23250 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:10.741194 23264 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:10.752234 23266 consensus_queue.cc:237] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.755734 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:10.755983 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:10.807101 21910 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:10.757764 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:10.758579 22449 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:10.808867 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 50394.5us
W20260709 13:08:10.706158 21907 rpcz_store.cc:269] 0709 13:08:09.374804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.378286 (+  3482us) service_pool.cc:224] Handling call
0709 13:08:10.635480 (+1257194us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54002d8f54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:10.650389 (+ 14909us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522295040}
W20260709 13:08:10.760509 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 442453us
I20260709 13:08:10.752331 23058 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.759773 23180 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.790277 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:10.816265 21758 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:10.791314 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:10.817509 21762 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:10.792804 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:10.761034 22987 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:08:10.822484 23271 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:10.797303 23250 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.825685 23250 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:10.811772 23264 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.826725 23264 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:10.796169 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:10.820750 21728 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:10.829365 21879 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:10.832203 23264 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.834146 21879 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:10.844767 22449 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:10.847580 23162 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:10.853956 21834 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:10.856422 22449 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:10.815689 23058 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:10.864615 22987 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:10.872068 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.872375 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.872614 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.872838 21836 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:10.873556 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.874290 21835 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:08:10.875382 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.876107 21833 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:08:10.878564 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.879698 21836 raft_consensus.cc:2393] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 2: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:10.880688 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.833554 23245 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:10.832208 23176 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.880901 23284 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:10.968201 23126 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:10.966094 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:10.971930 21838 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:10.972599 21763 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:10.878569 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:11.024515 21760 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.049s	sys 0.043s
W20260709 13:08:11.025027 21760 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.049s	sys 0.043s
I20260709 13:08:11.026598 23341 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.027201 23341 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:11.030694 23341 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:11.030737 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:10.866884 23162 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.858814 23340 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:10.969039 23193 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.035861 21832 raft_consensus.cc:2368] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4.
I20260709 13:08:10.969226 23292 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:10.866662 23268 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:10.881513 23270 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:10.922924 22987 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:11.012243 23158 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.005s	sys 0.000s
I20260709 13:08:10.853402 21905 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:10.968479 23186 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:11.003726 23218 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:10.935298 23310 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:10.920648 23317 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:11.011824 23260 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:08:11.083348 21840 raft_consensus.cc:2368] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:11.041491 23162 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:11.052362 23158 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.005s	sys 0.000s
I20260709 13:08:11.049108 22987 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.045799 23268 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.011912 23176 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:11.095722 21757 raft_consensus.cc:2393] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 4: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:11.054679 22477 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:11.044562 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:08:11.072329 21647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 381305us
I20260709 13:08:11.086951 23172 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:11.053880 23270 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:11.093079 23287 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.022s	sys 0.031s
I20260709 13:08:11.092825 23183 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:11.047946 23193 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:11.114714 22484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.024s	sys 0.038s
I20260709 13:08:11.077304 23218 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:11.120627 22484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.024s	sys 0.038s
I20260709 13:08:11.097373 23268 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:11.098588 22987 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:11.115680 23287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.022s	sys 0.031s
I20260709 13:08:11.127442 21806 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:11.048911 23292 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:11.144833 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 220572us
I20260709 13:08:11.133553 22478 raft_consensus.cc:2393] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:11.091287 23310 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:11.152952 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:11.153939 21763 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:11.153059 23310 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:11.129797 23238 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:11.160003 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:11.160847 21838 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:11.165027 21728 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:11.134734 23343 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.137255 23183 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:11.183156 21838 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:08:11.183845 21838 raft_consensus.cc:606] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:11.184267 21838 raft_consensus.cc:614] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:11.192921 23180 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:11.193449 21759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:35914
I20260709 13:08:11.193738 23126 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.194502 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:11.160511 23290 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:11.197837 23183 raft_consensus.cc:697] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:11.155181 23264 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:08:11.246294 21837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.003s	sys 0.033s
W20260709 13:08:11.307823 21837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.017s	sys 0.039s
I20260709 13:08:11.172536 23310 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:11.200984 22479 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.017s	sys 0.019s
I20260709 13:08:11.243659 21759 raft_consensus.cc:606] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:11.243927 21835 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
W20260709 13:08:11.200659 23339 log.cc:927] Time spent T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:08:11.239187 21728 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:11.313060 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 74007us
I20260709 13:08:11.313725 21759 raft_consensus.cc:614] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:11.314270 21728 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:11.308928 21805 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.015s	sys 0.040s
W20260709 13:08:11.241649 23347 log.cc:927] Time spent T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:08:11.319438 21728 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:11.242255 23245 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:11.356032 21805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.015s	sys 0.040s
I20260709 13:08:11.244269 23284 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:11.181247 23343 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:11.498574 22449 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:11.495811 21837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56424 (request call id 73) took 1282 ms. Trace:
I20260709 13:08:11.627444 21837 rpcz_store.cc:276] 0709 13:08:10.213295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.295223 (+ 81928us) service_pool.cc:224] Handling call
0709 13:08:10.309528 (+ 14305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.333682 (+ 24154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.333728 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:10.334281 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:08:10.619097 (+284816us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b180017e1e0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab24ce07 00007fc6b40a7ab9 00007fc6ab26969b 00007fc6ab26793f 00007fc6ab269c02 00007fc6adef120b 00007fc6adef6d23 00007fc6adef70d1 00007fc6ae312a0f
0709 13:08:11.308278 (+689181us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:11.308323 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.308394 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.456470 (+148076us) raft_consensus.cc:1685] finished
0709 13:08:11.456492 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.495730 (+ 39238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26313,"raft.queue_time_us":23971,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":5184,"spinlock_wait_cycles":7673728,"thread_start_us":688991,"threads_started":1,"wal-append.queue_time_us":1120337}
W20260709 13:08:11.318229 22479 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.017s	sys 0.019s
I20260709 13:08:11.322736 23332 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:11.455366 23346 log.cc:927] Time spent T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.255s	user 0.000s	sys 0.000s
I20260709 13:08:11.358217 23186 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:11.616989 23255 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:11.403945 23206 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:11.465508 23345 log.cc:927] Time spent T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 13:08:11.482295 23250 consensus_meta.cc:287] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.656s	user 0.008s	sys 0.002s
I20260709 13:08:11.656154 23316 raft_consensus.cc:993] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d: : Instructing follower 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:08:11.656399 23250 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:11.657792 23172 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:11.658313 23172 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:11.321677 23308 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:11.310354 23310 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.354245 23273 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:11.318497 23264 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:11.322052 23126 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:11.628985 23193 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:11.456171 23350 log.cc:927] Time spent T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.210s	user 0.000s	sys 0.000s
I20260709 13:08:11.668092 23224 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.448424 23307 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:11.668671 23224 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:11.597183 23162 consensus_meta.cc:287] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.001s
I20260709 13:08:11.623519 23245 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:11.586423 23335 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:11.322111 23270 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:11.457396 23338 log.cc:927] Time spent T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
I20260709 13:08:11.541725 23326 ts_tablet_manager.cc:1929] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:11.497334 23176 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:11.473515 23183 consensus_queue.cc:237] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:11.757745 23352 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:11.758993 23352 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:11.385502 23180 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:11.688491 23224 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:11.762272 23180 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:11.763145 23224 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.763787 23352 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:11.764246 23264 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:11.764096 23224 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:11.764472 23352 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:11.359175 21728 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:11.732769 21764 raft_consensus.cc:1240] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:11.402575 23227 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:11.733366 21835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38332
I20260709 13:08:11.735145 21839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2098) took 1247 ms. Trace:
I20260709 13:08:11.736531 21760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 743) took 1503 ms. Trace:
I20260709 13:08:11.402647 22450 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:11.498236 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:11.785147 22477 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:11.773381 21839 rpcz_store.cc:276] 0709 13:08:10.488052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.488227 (+   175us) service_pool.cc:224] Handling call
0709 13:08:10.488517 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.574976 (+ 86459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.575004 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:10.575442 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:08:11.080313 (+504871us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:11.080359 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.734271 (+653912us) spinlock_profiling.cc:243] Waited 86.1 ms on lock 0x7b540033a9d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:11.734360 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.734476 (+   116us) raft_consensus.cc:1685] finished
0709 13:08:11.734492 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.734921 (+   429us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1785,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":1894,"spinlock_wait_cycles":198030592,"thread_start_us":498234,"threads_started":1,"wal-append.queue_time_us":584645}
W20260709 13:08:11.552423 22480 consensus_meta.cc:287] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.890s	user 0.008s	sys 0.004s
I20260709 13:08:11.786837 23172 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:11.788570 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:11.788901 22480 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:11.789762 22480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36290 (request call id 578) took 1140 ms. Trace:
I20260709 13:08:11.790208 22480 rpcz_store.cc:276] 0709 13:08:10.649384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.649530 (+   146us) service_pool.cc:224] Handling call
0709 13:08:11.789654 (+1140124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.790599 23224 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:11.792373 23135 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:11.773847 23180 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:11.793581 23180 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:11.793367 23135 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:11.654119 22481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 579) took 1004 ms. Trace:
W20260709 13:08:11.741070 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 242743us
W20260709 13:08:11.741981 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 263681us
I20260709 13:08:11.796700 23368 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:11.743404 23126 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:11.743979 22479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36278 (request call id 150) took 1131 ms. Trace:
I20260709 13:08:11.401950 23158 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.745388 22484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36278 (request call id 146) took 1348 ms. Trace:
W20260709 13:08:11.544196 23058 consensus_meta.cc:287] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.644s	user 0.010s	sys 0.000s
I20260709 13:08:11.803429 22481 rpcz_store.cc:276] 0709 13:08:10.649795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.649963 (+   168us) service_pool.cc:224] Handling call
0709 13:08:10.652523 (+  2560us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.653336 (+   813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.646472 (+993136us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b5400511650. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:11.654050 (+  7578us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5218176}
I20260709 13:08:11.671552 23162 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:11.805190 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:11.800990 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:11.806190 21910 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:11.794327 23180 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:11.807699 23162 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:11.585695 22987 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:11.808360 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:11.809525 23180 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:11.807698 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:11.810607 23292 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:11.811111 22987 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:11.811276 22485 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:11.803642 21907 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:11.812932 23358 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:08:11.747364 21649 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet a218be1e72294b138c21b46dfa317d11 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 3843e9b794a245dd8608e04ec7915239 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:11.586148 23233 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:08:11.814038 21649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 66942us
I20260709 13:08:11.813855 23358 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:11.814929 23233 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:11.815352 23058 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:11.816476 23358 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:11.689518 23238 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:11.817746 23341 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.817907 23238 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:11.818537 23341 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:11.821017 23341 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:11.821271 21831 raft_consensus.cc:2368] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3.
I20260709 13:08:11.804337 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:11.536505 23268 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:11.664850 23273 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:11.831881 23273 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:11.833742 23134 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.834434 23058 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:11.731878 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 1.00511e+06us
I20260709 13:08:11.465025 23218 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:11.669184 23307 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:11.652397 23255 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:11.664652 23310 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:11.664680 23316 raft_consensus.cc:1081] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Signalling peer 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:08:11.834677 23134 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:11.386986 23317 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:11.847255 23317 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:11.679836 23326 log.cc:1199] T b0e72cc3f09a4d549ebd824be85955a3 P 3843e9b794a245dd8608e04ec7915239: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-0-root/wals/b0e72cc3f09a4d549ebd824be85955a3
I20260709 13:08:11.642117 23332 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:11.678179 23335 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:11.681283 23343 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:11.510249 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38348 (request call id 1346) took 1308 ms. Trace:
I20260709 13:08:11.615975 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:11.691272 23364 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.653188 23206 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.730592 21757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44772 (request call id 111) took 1063 ms. Trace:
I20260709 13:08:11.765359 23352 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:11.770699 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 406643us
I20260709 13:08:11.761116 23193 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:11.781077 23275 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:11.781584 23312 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:11.797133 22476 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:11.804503 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:11.690304 23245 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:11.804765 22484 rpcz_store.cc:276] 0709 13:08:10.397036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.397204 (+   168us) service_pool.cc:224] Handling call
0709 13:08:10.397589 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.402418 (+  4829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.402684 (+   266us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:10.403200 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:08:11.126125 (+722925us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:11.126187 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.126305 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.744748 (+618443us) raft_consensus.cc:1685] finished
0709 13:08:11.744797 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.745165 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4365,"raft.queue_time_us":4502,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":7599,"thread_start_us":685586,"threads_started":1,"wal-append.queue_time_us":790841}
I20260709 13:08:11.826512 23158 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:11.494603 23276 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.797374 23227 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:11.909857 23275 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.950981 23275 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:11.951382 23172 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:11.950937 23364 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:11.953663 23364 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:11.926095 23370 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:11.928779 23274 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.847725 22480 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:11.803880 22479 rpcz_store.cc:276] 0709 13:08:10.611882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.612031 (+   149us) service_pool.cc:224] Handling call
0709 13:08:10.612452 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.612916 (+   464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.612962 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:10.613711 (+   749us) log.cc:844] Serialized 26 byte log entry
0709 13:08:11.642284 (+1028573us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:11.645916 (+  3632us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.743138 (+ 97222us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.743296 (+   158us) raft_consensus.cc:1685] finished
0709 13:08:11.743316 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.743656 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8783,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":11240,"thread_start_us":1018780,"threads_started":1,"wal-append.queue_time_us":1007015}
I20260709 13:08:11.927201 23266 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:11.855468 21805 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:11.979553 21647 catalog_manager.cc:4755] TS 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): ChangeConfig:REMOVE_PEER RPC failed for tablet 291227c6f9914476b4363d40f7cfebb8: Remote error: Service unavailable: leader transfer in progress
I20260709 13:08:11.979873 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:11.951195 21840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38348 (request call id 1353) took 1078 ms. Trace:
I20260709 13:08:11.980371 23058 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:11.797312 23368 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:11.981184 23368 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:11.938162 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:11.862001 23270 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:11.979987 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 124846us
I20260709 13:08:11.859922 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:11.940331 23227 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:11.930101 21806 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:11.849331 23135 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:11.920887 23312 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:11.969931 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:11.922523 21905 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:11.939232 23276 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:11.848094 23317 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:11.948410 23206 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:11.949363 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38348 (request call id 1358) took 1069 ms. Trace:
I20260709 13:08:11.924602 23193 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:11.928926 23218 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:11.949797 21834 rpcz_store.cc:276] 0709 13:08:10.202186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.212889 (+ 10703us) service_pool.cc:224] Handling call
0709 13:08:11.510002 (+1297113us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54003f0f54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:11.510165 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1472242048}
I20260709 13:08:11.928418 23308 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:11.956096 23332 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:11.958580 23335 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:11.861974 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:11.861156 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:11.959288 21879 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:11.960280 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:11.854439 23268 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:11.960796 23255 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:11.961246 23250 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:11.967365 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:11.968231 21728 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:11.980917 23058 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.943754 23158 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:11.863471 21835 raft_consensus.cc:606] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Received request to transfer leadership
I20260709 13:08:11.939016 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:11.773456 21760 rpcz_store.cc:276] 0709 13:08:10.232637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.232815 (+   178us) service_pool.cc:224] Handling call
0709 13:08:10.298888 (+ 66073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.415590 (+116702us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:10.453757 (+ 38167us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.025831 (+572074us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:11.025922 (+    91us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:11.025988 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.735851 (+709863us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b540028e954. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:11.735933 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.736292 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34454,"prepare.queue_time_us":38657,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":117,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":3770,"spinlock_wait_cycles":267951360,"thread_start_us":571506,"threads_started":1,"wal-append.queue_time_us":717136}
I20260709 13:08:11.983322 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.052027 21914 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:11.982493 21911 raft_consensus.cc:2393] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:11.859081 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.045166 22481 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:12.019585 21662 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45746 (request call id 225) took 2673 ms. Trace:
W20260709 13:08:11.982982 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 153593us
I20260709 13:08:12.046030 21833 rpcz_store.cc:276] 0709 13:08:10.879372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.615634 (+736262us) service_pool.cc:224] Handling call
0709 13:08:11.949171 (+333537us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:11.982594 21805 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:11.908594 21757 rpcz_store.cc:276] 0709 13:08:10.666802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.666964 (+   162us) service_pool.cc:224] Handling call
0709 13:08:11.729923 (+1062959us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b540017c354. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:11.730334 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":897219584}
I20260709 13:08:12.051052 23058 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:11.980609 21840 rpcz_store.cc:276] 0709 13:08:10.872816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.878244 (+  5428us) service_pool.cc:224] Handling call
0709 13:08:11.950791 (+1072547us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b540045b5d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:11.951026 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251846400}
I20260709 13:08:11.984591 22476 raft_consensus.cc:2393] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 4: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:12.028021 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:12.034785 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:11.981410 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.013005 22480 raft_consensus.cc:1275] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:11.848094 23134 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.086910 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:11.983299 21909 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:11.985152 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:11.911069 23233 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:11.983747 23316 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:12.085158 21912 raft_consensus.cc:2393] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 2: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:12.013022 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:12.021168 23317 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:11.984433 23227 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.037513 23326 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:59090 (request call id 88) took 1898 ms. Trace:
I20260709 13:08:12.011883 23276 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:12.013149 23307 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:12.032764 23275 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:11.848544 23333 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:11.857120 23366 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:11.982383 23270 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:12.093976 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 776266us
W20260709 13:08:12.061576 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 264026us
I20260709 13:08:12.097641 22479 raft_consensus.cc:1275] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:12.097848 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:12.141971 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:11.971371 23172 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:12.102314 23352 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.116106 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:12.149876 22483 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
W20260709 13:08:12.116859 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 105375us
I20260709 13:08:12.150389 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.151189 21912 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:12.151315 21880 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:12.152527 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.119367 21762 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:08:12.153505 21905 raft_consensus.cc:2393] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:12.154021 23276 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:12.154467 23276 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:12.115242 23134 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:12.154881 23276 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:12.155562 21908 raft_consensus.cc:2393] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 2: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:12.156531 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:11.972837 23310 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.142495 22484 raft_consensus.cc:2468] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:12.157860 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.158655 23268 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:12.159415 23310 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.121106 21910 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:08:12.161019 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.115367 21761 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:08:12.161846 21910 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:11.984884 23266 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.163100 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.092785 23308 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.086861 23167 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:12.130213 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:11.972541 21661 catalog_manager.cc:5697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 1 to 2, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 2 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:11.981738 23274 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.134481 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.100872 23316 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:12.129160 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 146731us
I20260709 13:08:12.147629 21907 raft_consensus.cc:2368] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3.
I20260709 13:08:12.148546 23172 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:12.148887 21914 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:12.124748 22477 raft_consensus.cc:2468] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:12.154655 21912 raft_consensus.cc:2468] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:12.193575 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.194205 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.194850 21912 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:12.195175 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.195708 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.196108 21907 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:12.196468 23273 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.197003 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.161751 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:12.184003 23167 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.154888 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.207482 22449 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:12.200340 21661 catalog_manager.cc:5697] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 1 to 2, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 2 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:12.113198 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 154207us
I20260709 13:08:12.168291 21880 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:12.168506 23332 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:12.177836 21731 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:12.199137 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.177654 23333 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.178768 23276 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:12.189599 23316 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:12.220937 23318 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.187341 21906 raft_consensus.cc:2393] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:12.225791 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:12.225744 23318 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.227356 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.227723 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:12.228012 21906 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:12.228157 23318 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:12.228793 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 64942.8us
I20260709 13:08:12.228940 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.229161 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:11.987690 23018 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:12.206187 21757 raft_consensus.cc:1275] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:12.206661 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.215977 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:12.221354 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:12.202989 23266 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.234241 21760 raft_consensus.cc:2393] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:12.178915 23366 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.187750 23312 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:12.199707 23308 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.221848 23332 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.233997 21910 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:12.199748 23270 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:12.201442 23172 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:12.197386 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.202210 23167 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:12.236707 21906 raft_consensus.cc:2393] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:12.201555 23274 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.251396 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:12.251888 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:12.252424 21906 raft_consensus.cc:2368] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 3. Current term is 4.
I20260709 13:08:12.252748 21765 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:12.253650 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.240258 22481 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:12.210565 23250 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:12.241453 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.205864 23275 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.248262 21661 catalog_manager.cc:5697] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 1 to 2, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 2 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.245290 23332 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:12.247576 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.192073 23227 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:08:12.248373 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.229625 23268 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:12.250799 23343 raft_consensus.cc:2804] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:12.251314 23308 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:12.283154 23308 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.283615 23308 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:12.285562 21758 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:12.229954 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:12.287770 21756 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:12.244253 23276 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:12.249850 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 86303.8us
I20260709 13:08:12.290910 21731 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:12.261741 23018 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:12.202212 23193 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:12.244145 21805 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:12.291985 21913 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:12.293555 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.254518 22450 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:12.302274 21913 raft_consensus.cc:2368] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3.
I20260709 13:08:12.123068 23326 rpcz_store.cc:276] 0709 13:08:10.138479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.138640 (+   161us) service_pool.cc:224] Handling call
0709 13:08:10.283614 (+144974us) ts_tablet_manager.cc:1151] Deleting tablet b0e72cc3f09a4d549ebd824be85955a3
0709 13:08:10.283713 (+    99us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:08:11.448914 (+1165201us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:11.541544 (+ 92630us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:12.037070 (+495526us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":144061,"thread_start_us":144283,"threads_started":1}
I20260709 13:08:12.244952 21911 raft_consensus.cc:2393] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:12.142413 23218 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:12.306386 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 62425.9us
W20260709 13:08:12.261534 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 293445us
I20260709 13:08:12.236148 21905 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:08:12.270592 21909 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:12.271708 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.272411 23058 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:12.319375 21729 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.40.3:43881 timed out after 1.551s (SENT) [suppressed 17 similar messages]
W20260709 13:08:12.320329 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 65929.9us
I20260709 13:08:12.322083 23058 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.273774 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:12.277583 21914 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:12.324047 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.325369 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.305965 23268 raft_consensus.cc:697] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:12.326454 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:12.262266 21907 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:12.327167 23268 consensus_queue.cc:237] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:12.328454 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:12.329109 21907 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:12.329658 23233 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:12.278558 23333 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.327623 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.280149 23366 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:12.282693 23343 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:12.311172 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 49764.3us
I20260709 13:08:12.053171 21662 rpcz_store.cc:276] 0709 13:08:09.345952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.346289 (+   337us) service_pool.cc:224] Handling call
0709 13:08:12.019304 (+2673015us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:10.495885 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:10.496462 (+   577us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:10.496490 (+    28us) write_op.cc:435] Acquired schema lock
0709 13:08:10.496507 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:10.498428 (+  1921us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:10.498497 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:10.498529 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:10.498720 (+   191us) tablet.cc:701] Row locks acquired
0709 13:08:10.498748 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:08:10.498878 (+   130us) write_op.cc:270] Start()
0709 13:08:10.498981 (+   103us) write_op.cc:276] Timestamp: P: 1783602490498838 usec, L: 0
0709 13:08:10.499001 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:08:10.530609 (+ 31608us) log.cc:844] Serialized 530 byte log entry
0709 13:08:11.168917 (+638308us) op_driver.cc:464] REPLICATION: finished
0709 13:08:11.666116 (+497199us) write_op.cc:301] APPLY: starting
0709 13:08:11.666209 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:11.666320 (+   111us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:11.666426 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:11.666665 (+   239us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:11.666841 (+   176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:08:11.666907 (+    66us) write_op.cc:312] APPLY: finished
0709 13:08:11.667252 (+   345us) log.cc:844] Serialized 23 byte log entry
0709 13:08:11.668860 (+  1608us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:11.668958 (+    98us) write_op.cc:454] Released schema lock
0709 13:08:11.668994 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:11.669355 (+   361us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:11.669386 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31850,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":483870,"apply.run_cpu_time_us":1678,"apply.run_wall_time_us":4562,"num_ops":1,"prepare.queue_time_us":298509,"prepare.run_cpu_time_us":3283,"prepare.run_wall_time_us":41553,"replication_time_us":669726,"thread_start_us":489683,"threads_started":2}]]}
I20260709 13:08:12.263366 23250 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.312191 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:12.313737 23311 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:12.314576 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:12.262305 23318 consensus_queue.cc:1048] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.123s
I20260709 13:08:12.316254 21880 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:12.313731 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.318428 21879 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:12.301900 23316 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:12.308341 23373 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:12.339586 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:12.408121 21911 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:12.383838 21728 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:12.335973 21909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1126) took 2255 ms (client timeout 1670 ms). Trace:
I20260709 13:08:12.341773 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:12.334188 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:12.335712 21912 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:12.344383 21731 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:12.411887 21909 rpcz_store.cc:269] 0709 13:08:10.080860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.085510 (+  4650us) service_pool.cc:224] Handling call
0709 13:08:11.756271 (+1670761us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b1800036c00. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae392646 00007fc6ae2cc58e 00007fc6ae34df9e 00007fc6ae34f7de 00007fc6ae35b27c 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c
0709 13:08:11.959530 (+203259us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b580005f6d0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae2b30aa 00007fc6ae335447 00007fc6ae34dfe7 00007fc6ae34f7de 00007fc6ae35b27c 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c
0709 13:08:11.983004 (+ 23474us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b580005f9d0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae2b30aa 00007fc6ae335447 00007fc6ae34dfe7 00007fc6ae34f7de 00007fc6ae35b27c 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c
0709 13:08:12.335840 (+352836us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1788371200}
W20260709 13:08:12.413565 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 97484.4us
I20260709 13:08:12.358357 21910 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:12.416673 22481 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:12.335186 23018 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:12.393587 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:12.343443 23193 raft_consensus.cc:2804] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:12.342146 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:12.335444 23343 raft_consensus.cc:3060] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:12.408077 23311 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:12.427552 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 109234us
I20260709 13:08:12.412487 23250 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:12.419049 21840 raft_consensus.cc:2393] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:12.427054 21909 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:12.427829 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:08:12.435457 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 91184us
I20260709 13:08:12.429612 21834 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 1.
I20260709 13:08:12.391848 23368 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:12.439064 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:12.443205 22485 raft_consensus.cc:1240] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:12.339387 23218 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:12.448012 21731 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:12.462304 21835 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:12.499933 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:12.500418 21728 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:12.440217 23335 raft_consensus.cc:2804] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:12.435194 23193 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:12.459726 21912 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:12.465811 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:12.506114 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 66370.3us
I20260709 13:08:12.416692 23332 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.418918 23135 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 13:08:12.513367 22484 raft_consensus.cc:2368] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4.
I20260709 13:08:12.447029 23333 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:12.526834 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:12.528966 23333 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:12.529166 21909 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:12.530128 23333 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:12.502801 23274 raft_consensus.cc:2804] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:12.438621 23311 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:12.532080 21879 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:12.502949 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:12.505185 23193 raft_consensus.cc:3060] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:12.463321 23218 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:08:12.504794 23335 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:12.442945 23376 raft_consensus.cc:2804] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:08:12.558523 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 308690us
I20260709 13:08:12.511487 23312 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:12.507687 23238 consensus_meta.cc:287] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.689s	user 0.013s	sys 0.000s
I20260709 13:08:12.612474 23238 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:12.462850 23273 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.614713 23238 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.615890 23218 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:12.616700 21908 raft_consensus.cc:2368] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:12.616623 23218 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:12.513911 21649 catalog_manager.cc:5028] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): tablet b0e72cc3f09a4d549ebd824be85955a3 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:08:12.581521 23176 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:12.519097 23368 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.515859 21905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:49554
W20260709 13:08:12.510319 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 46750.8us
I20260709 13:08:12.590909 23335 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:12.606921 23316 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:12.607527 23376 raft_consensus.cc:697] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:12.602532 23312 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:12.610147 23378 log.cc:927] Time spent T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:08:12.617523 22477 raft_consensus.cc:1240] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:12.557734 23274 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:12.464918 23217 consensus_queue.cc:1059] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.132s
I20260709 13:08:12.577361 21728 leader_election.cc:400] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3.
I20260709 13:08:12.679297 21728 leader_election.cc:403] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:12.599998 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 139884us
I20260709 13:08:12.614725 23332 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:12.662839 21649 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 148965us
I20260709 13:08:12.682489 21906 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:12.684178 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:08:12.685352 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 69075.1us
I20260709 13:08:12.687906 21729 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:12.663681 23176 raft_consensus.cc:697] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:12.669063 23312 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:12.707116 21835 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:12.709791 21880 leader_election.cc:400] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4.
I20260709 13:08:12.710229 21880 leader_election.cc:403] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:08:12.711256 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.668705 23238 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:12.683459 23274 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:12.700122 23275 raft_consensus.cc:2804] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:12.732053 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:12.732797 21906 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:12.735396 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 228359us
I20260709 13:08:12.713521 22987 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.713979 23366 raft_consensus.cc:3055] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:12.723682 23273 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:12.747114 23238 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:12.744659 23366 raft_consensus.cc:740] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:12.755239 23366 consensus_queue.cc:260] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:12.732316 23275 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:12.756876 23275 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:12.682544 23308 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:12.763623 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 44068us
I20260709 13:08:12.765623 22987 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:12.758769 21728 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:12.775163 21906 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
W20260709 13:08:12.791507 21711 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:08:12.792018 21711 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 291227c6f9914476b4363d40f7cfebb8 already in progress
W20260709 13:08:12.792315 21711 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 291227c6f9914476b4363d40f7cfebb8 already in progress
I20260709 13:08:12.797688 23271 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:12.801856 23376 consensus_queue.cc:237] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:12.771764 23238 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.810600 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.812548 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.816860 21913 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:12.820287 21909 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:12.826400 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:12.842687 21906 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:12.843546 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:12.844167 21913 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:12.826056 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:12.839362 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 80702.4us
I20260709 13:08:12.822609 23233 raft_consensus.cc:2764] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 13:08:12.844940 21756 consensus_meta.cc:287] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.012s
I20260709 13:08:12.862334 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:12.841343 21907 consensus_meta.cc:287] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.504s	user 0.002s	sys 0.012s
I20260709 13:08:12.830796 22478 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:12.866899 21728 leader_election.cc:400] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:12.877214 21728 leader_election.cc:403] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:12.857483 23271 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.788666 23176 consensus_queue.cc:237] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:12.877903 23271 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.878597 21728 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:12.880247 23271 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.880906 23271 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:12.868971 23135 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:12.881114 23308 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:12.881760 23135 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:12.874387 22987 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.874545 23382 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:12.875038 23383 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.855355 23250 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.894351 23383 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.895401 23135 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:12.896304 23250 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.896540 23383 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.869217 23352 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:12.877931 23310 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:08:12.897468 23352 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.899761 23352 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.875300 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.875900 23183 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:12.841079 23193 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:12.871774 21907 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:12.901830 23183 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.868423 23218 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:12.902886 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.903015 23382 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.903529 23193 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:12.903714 21907 raft_consensus.cc:2393] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:12.866247 23316 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.904134 23183 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.904628 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.904505 23316 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:12.872658 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 85594.8us
I20260709 13:08:12.904170 23255 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4.
I20260709 13:08:12.881381 23271 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:12.906477 23271 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:12.907233 21729 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:12.901345 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.910861 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:12.911528 21909 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:12.826787 23227 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:12.854944 21905 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:12.841351 23126 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:12.932297 23126 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.935186 23126 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.935703 22987 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.936242 22987 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:12.938714 22987 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.870896 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.897110 23250 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.893347 22476 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:08:12.942638 23250 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.944654 23250 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.918462 21905 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:12.946568 23206 consensus_meta.cc:287] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.854s	user 0.010s	sys 0.011s
I20260709 13:08:12.947118 23206 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.948558 21761 raft_consensus.cc:2393] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:12.870092 21756 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:12.959177 23274 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:12.959957 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.961282 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:12.961901 21914 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:12.963122 22476 raft_consensus.cc:1240] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:08:12.964102 22481 raft_consensus.cc:1240] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:12.965637 23227 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:12.968487 23227 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:12.969496 23387 log.cc:927] Time spent T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.274s	user 0.000s	sys 0.006s
I20260709 13:08:12.970363 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:12.922597 23366 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:12.973942 23311 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.906620 23316 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.923851 21909 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:12.926674 23218 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:12.927870 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:12.940675 23312 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.931010 23335 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:12.939615 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:12.941021 22482 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:12.924646 23343 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:12.977241 23311 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:12.910179 21906 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:12.981598 23193 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:12.905362 23382 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:13.003574 23275 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:13.074401 21905 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.075277 23275 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:13.076753 23271 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:13.078850 23271 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:13.080060 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.010417 22477 raft_consensus.cc:1240] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:08:13.011138 23206 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:13.011691 23227 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.015435 23273 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3.
I20260709 13:08:12.930742 21908 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:13.048029 21913 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:13.048154 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:13.047441 22449 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:12.922719 21907 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:13.079963 23274 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:13.008311 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 99363.7us
I20260709 13:08:13.081863 23227 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:13.086562 21911 raft_consensus.cc:1240] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:13.087522 22449 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:13.092164 22449 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:13.058780 22478 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:13.110252 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:13.111091 21913 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:13.116204 23311 consensus_queue.cc:1059] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:13.117169 23311 raft_consensus.cc:3055] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:13.117592 23311 raft_consensus.cc:740] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:13.118078 23172 consensus_queue.cc:1059] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:13.118468 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:13.118490 23311 consensus_queue.cc:260] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.119158 23382 raft_consensus.cc:3055] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:13.119889 23382 raft_consensus.cc:740] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:13.120340 23311 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:13.095423 22987 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:13.099066 23218 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:13.112237 23238 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:13.125216 22480 raft_consensus.cc:2393] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 4: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:13.131276 22449 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:13.132349 22481 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:13.133806 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:13.084264 23193 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:13.138593 21910 raft_consensus.cc:1240] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:13.120956 23382 consensus_queue.cc:260] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.141387 23382 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:13.142849 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:13.144780 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:13.126933 23172 consensus_queue.cc:1059] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:08:13.145910 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:13.146034 23172 raft_consensus.cc:3055] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:13.146557 21834 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:13.146770 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:13.147652 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:13.128051 23316 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:08:13.148216 21834 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:13.150722 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:13.151122 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.130147 22987 raft_consensus.cc:697] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:13.059577 23333 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:13.132748 23368 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:13.156586 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:13.157616 21831 raft_consensus.cc:1275] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:13.151113 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:13.162173 21832 raft_consensus.cc:2393] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:13.164000 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:13.165823 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:13.168227 21835 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:08:13.139197 23238 raft_consensus.cc:697] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 3 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:13.146561 23172 raft_consensus.cc:740] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:13.140637 23193 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.206244 21831 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:13.151502 23218 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:13.217861 21837 raft_consensus.cc:2393] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:08:13.226123 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 661213us
I20260709 13:08:13.200299 23233 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:08:13.224295 23312 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:13.235225 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:13.226804 23335 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:13.227463 23371 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:13.240002 23343 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:13.240518 23310 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:13.242002 22448 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:13.242842 23343 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:13.243221 22448 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:13.243250 23343 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:13.244016 23343 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.238540 21837 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:08:13.233996 22987 consensus_queue.cc:237] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.250129 21804 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:13.251188 23135 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:13.251549 23135 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.251909 23135 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:13.252166 21910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 784) took 1134 ms. Trace:
I20260709 13:08:13.252552 21910 rpcz_store.cc:276] 0709 13:08:12.117515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.463805 (+346290us) service_pool.cc:224] Handling call
0709 13:08:12.504159 (+ 40354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:13.138992 (+634833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.251948 (+112956us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b54002d8f54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:13.252110 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1458728704}
I20260709 13:08:13.253494 23172 consensus_queue.cc:260] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.253724 23238 consensus_queue.cc:237] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.255367 21905 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:13.237756 23373 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.256951 21911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 781) took 1140 ms. Trace:
I20260709 13:08:13.257284 23373 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.257381 21911 rpcz_store.cc:276] 0709 13:08:12.116641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.462653 (+346012us) service_pool.cc:224] Handling call
0709 13:08:12.507470 (+ 44817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:13.096177 (+588707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.256717 (+160540us) spinlock_profiling.cc:243] Waited 576 ms on lock 0x7b54001ea5d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:13.256893 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1325307136}
I20260709 13:08:13.259665 23373 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:13.260231 23373 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:13.260665 23373 raft_consensus.cc:697] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 3 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:13.257990 23368 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:13.261854 23368 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:13.262715 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:13.263337 22480 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:13.264778 23227 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:13.266623 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:13.267022 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:13.267238 21911 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:13.267617 21836 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:13.268826 23172 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:13.270957 23371 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:13.271421 23371 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:13.273589 23333 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:13.273736 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:13.281831 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 47123.4us
I20260709 13:08:13.283751 21729 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:13.286149 23310 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:13.286510 23310 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.286562 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:13.286924 23310 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:13.287184 21910 raft_consensus.cc:3060] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:13.289345 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:13.290012 21840 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:13.290485 21804 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:13.293015 21804 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:13.294572 21804 leader_election.cc:400] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 3. Current term is 4.
I20260709 13:08:13.294724 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:13.311548 21839 raft_consensus.cc:2410] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:08:13.326807 21729 leader_election.cc:400] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:13.327277 21729 leader_election.cc:403] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:13.325127 21910 raft_consensus.cc:2468] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:13.328841 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:13.312175 23227 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:13.331478 21836 raft_consensus.cc:2393] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:08:13.337474 21877 connection.cc:256] RPC call timeout handler was delayed by -1.0323455839999269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
I20260709 13:08:13.338742 21877 leader_election.cc:400] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4.
I20260709 13:08:13.333925 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:13.339421 21833 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:08:13.339686 21877 leader_election.cc:400] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4.
I20260709 13:08:13.341614 23335 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:13.318229 23382 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:13.345491 21840 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:13.345994 21804 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:13.347620 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 81689.5us
I20260709 13:08:13.349141 22449 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:13.349915 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:13.351545 21804 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:13.328369 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 85249.3us
I20260709 13:08:13.353355 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:13.294816 23371 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.333566 21729 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:13.356511 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:13.350960 23266 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:08:13.358093 23218 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:13.358574 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:13.359256 21905 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:13.360308 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:13.361089 23371 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:13.361619 23412 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:13.362144 23412 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.362422 23366 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:13.362545 23412 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:13.347195 23368 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.363000 23366 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.364482 23368 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:13.364997 23366 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:13.365247 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:13.354511 23172 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:13.359261 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:13.366304 21804 leader_election.cc:400] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3.
I20260709 13:08:13.366528 21911 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:13.366711 21804 leader_election.cc:403] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:13.365875 21907 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:13.365897 23172 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.368098 23172 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:13.368394 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:13.368727 23227 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:13.369107 23227 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:13.369460 23227 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.369870 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:13.369665 23193 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:13.370492 21909 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:13.370630 22448 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:13.372336 22484 raft_consensus.cc:1240] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:13.351912 22449 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:13.376889 21909 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:13.328231 23135 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:13.380275 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:13.384455 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:13.384680 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:13.385164 21909 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:13.387197 22987 raft_consensus.cc:2804] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:13.388198 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:13.383421 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:13.324126 23373 consensus_queue.cc:237] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.369777 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:13.389248 21761 raft_consensus.cc:2468] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:13.391206 21763 raft_consensus.cc:2393] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 4: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:13.391031 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:13.391471 21804 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:13.391742 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:13.392658 21906 raft_consensus.cc:2368] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3.
I20260709 13:08:13.391731 21913 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:13.400359 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:13.380548 23218 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:13.411646 21906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:08:13.411612 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:13.413733 22480 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:13.390702 22987 raft_consensus.cc:697] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:13.415411 22485 raft_consensus.cc:1275] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:13.412547 21906 raft_consensus.cc:606] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:13.418659 23135 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:13.419625 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:13.435209 21834 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:13.421044 21831 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:08:13.436386 21913 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:13.421839 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:13.422771 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:13.423189 21835 raft_consensus.cc:1240] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:13.423498 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:13.438215 21832 raft_consensus.cc:3055] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:13.423667 21838 raft_consensus.cc:1240] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:13.382462 23273 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:08:13.427017 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:13.416488 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:13.430363 23343 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.431221 23193 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:13.415848 23368 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.414918 23183 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:13.437744 21840 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:13.439697 21909 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:13.441190 23312 consensus_queue.cc:1059] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:13.442503 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:13.412473 23218 raft_consensus.cc:697] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:13.438495 21832 raft_consensus.cc:740] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:13.447009 21911 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:13.415038 22478 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:13.453321 21756 raft_consensus.cc:2393] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 4: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:13.448457 21804 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:13.436069 23382 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3.
I20260709 13:08:13.462605 22484 raft_consensus.cc:1240] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:13.462982 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:13.464720 21837 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:08:13.465629 21834 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:13.465817 21806 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:13.449970 23371 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:13.453578 23274 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:13.476442 21877 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:13.453225 23206 consensus_queue.cc:1048] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:08:13.456771 23183 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:13.483089 21837 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:08:13.483726 21837 pending_rounds.cc:85] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 5
I20260709 13:08:13.484916 21804 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:13.475514 23250 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:13.486374 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:13.479977 23401 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:13.512640 21840 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
W20260709 13:08:13.489552 23402 log.cc:927] Time spent T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:08:13.490077 23274 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.459705 23415 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:13.462684 21832 consensus_queue.cc:260] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.480430 23371 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.482563 23183 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:13.493016 22449 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:13.528926 22449 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:13.488458 23218 consensus_queue.cc:237] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:13.484043 21837 pending_rounds.cc:107] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 3.6
W20260709 13:08:13.521824 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 135282us
W20260709 13:08:13.533004 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.459987 23368 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.527160 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:13.532078 21837 raft_consensus.cc:2889] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:13.525319 23058 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:13.535965 23266 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:13.546265 22479 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:13.539733 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:13.550053 21763 raft_consensus.cc:3060] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:13.534200 23238 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:08:13.566984 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 99538us
I20260709 13:08:13.529947 23316 consensus_queue.cc:1059] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:08:13.537120 23335 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:13.573843 23373 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:13.574592 23373 raft_consensus.cc:697] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 3 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:13.577502 23403 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:13.548708 23333 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:13.530821 23310 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:13.571059 22477 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:13.566627 23193 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:13.553723 23273 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:13.601706 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:13.602465 21906 raft_consensus.cc:2368] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:13.602186 23273 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.602865 23376 raft_consensus.cc:3055] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:13.603312 23376 raft_consensus.cc:740] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:13.565738 23206 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:13.604315 23376 consensus_queue.cc:260] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.549104 22987 consensus_queue.cc:237] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.606093 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:13.606571 21877 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:13.606807 23193 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:13.607139 23255 consensus_queue.cc:1048] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:13.600133 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:13.599633 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:13.608722 21879 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:13.581285 23335 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.604465 23206 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:13.609549 23335 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:13.609931 23227 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:13.594141 23333 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:13.612376 23227 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:13.613085 23176 raft_consensus.cc:2764] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:08:13.613817 23176 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:13.614670 23255 consensus_queue.cc:1048] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:13.615963 23018 raft_consensus.cc:2764] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:08:13.585961 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 57133.7us
I20260709 13:08:13.608984 21908 raft_consensus.cc:2368] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3.
I20260709 13:08:13.600920 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:13.616940 21879 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:13.617411 23373 consensus_queue.cc:237] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.620672 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:13.621229 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:13.622097 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:13.623309 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:13.623983 21911 raft_consensus.cc:2393] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:13.624249 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:13.624678 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:13.624941 21913 raft_consensus.cc:2368] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:13.625866 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:13.626322 23274 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:13.627187 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:13.628397 23268 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:13.628970 21877 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:13.629001 23268 raft_consensus.cc:697] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:13.629982 23335 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:13.630743 23368 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:13.630828 23268 consensus_queue.cc:237] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:13.631757 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:13.632328 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:13.631057 21909 raft_consensus.cc:2368] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:13.633877 23332 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:13.634326 23332 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:08:13.600730 23409 log.cc:927] Time spent T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.229s	user 0.001s	sys 0.001s
I20260709 13:08:13.604640 23273 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:13.616657 23018 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:13.630971 22476 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:13.634740 23332 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.648887 23376 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:13.662043 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:13.662503 22450 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:13.663066 21877 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:13.663229 21832 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:13.670640 21914 raft_consensus.cc:1275] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:08:13.726455 21914 pending_rounds.cc:85] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 5
I20260709 13:08:13.726703 21914 pending_rounds.cc:107] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:08:13.726925 21914 raft_consensus.cc:2889] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:13.671702 23335 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:13.672418 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:13.673141 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:13.663259 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:13.677825 21906 raft_consensus.cc:1240] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:13.679651 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:13.743444 21909 raft_consensus.cc:2368] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:13.680599 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:13.681972 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:13.687422 23308 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:13.660465 23343 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:13.687215 23412 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.694578 21763 raft_consensus.cc:2468] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
W20260709 13:08:13.713325 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:13.727362 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 148678us
I20260709 13:08:13.734488 23018 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:13.755590 23018 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:13.755992 23018 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:13.734416 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 71421.9us
I20260709 13:08:13.737083 23371 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:13.737493 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:13.737716 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:13.737854 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:13.757467 21760 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:13.757368 21757 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:08:13.739295 21908 raft_consensus.cc:2393] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 2: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:13.739883 21761 raft_consensus.cc:1240] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:13.727494 23172 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:13.740428 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:13.741030 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 87090.9us
I20260709 13:08:13.741139 23430 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:13.657279 23401 raft_consensus.cc:697] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:13.749390 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:13.756078 21804 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:13.765820 21762 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:13.757274 21759 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:13.759686 21914 raft_consensus.cc:1240] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:08:13.762658 21910 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:13.763047 21877 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:13.760977 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:13.764353 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:13.744256 23238 raft_consensus.cc:697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:13.725520 23334 consensus_queue.cc:1059] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:08:13.732208 23183 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:13.768008 23238 consensus_queue.cc:237] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:13.968472 21762 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:13.789734 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:13.824340 21832 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:13.974166 23018 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:13.768147 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:13.787272 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:13.935223 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.787850 21877 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:13.934844 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.769204 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:13.934469 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 46037.7us
I20260709 13:08:13.977401 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:13.978035 21760 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
W20260709 13:08:13.986531 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 198755us
I20260709 13:08:13.986615 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:13.870936 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.988093 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:13.988729 21762 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:13.981448 21804 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:13.745293 23058 raft_consensus.cc:697] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:14.017529 23018 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:14.019631 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:14.020886 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:13.882871 23432 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:14.020983 23430 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:14.021639 21761 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.022010 22484 raft_consensus.cc:1240] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:13.966228 23333 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:14.023020 23432 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:14.024628 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:13.818940 23332 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:14.025198 21757 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:14.027099 23332 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:14.027165 23227 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:14.041931 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.008056 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:14.050614 21760 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:14.052407 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:14.053647 21759 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
W20260709 13:08:14.055248 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 50712.8us
I20260709 13:08:13.855113 23268 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:14.030959 21804 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:13.820147 23382 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:13.935051 23335 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:14.046262 21761 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:14.065390 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:14.065768 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:13.822916 21907 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:13.975325 21763 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:08:13.954488 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:14.060590 21762 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:14.028306 21764 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:13.853924 22480 raft_consensus.cc:1240] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:08:14.067849 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:13.768383 21905 raft_consensus.cc:2368] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:13.883819 23434 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:13.815698 23172 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:14.069084 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:14.083652 21761 raft_consensus.cc:2393] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 4: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:14.057737 23176 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:13.989742 23310 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:14.070498 23382 raft_consensus.cc:697] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:14.072959 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:14.075042 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:14.092361 21764 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:08:14.075596 21877 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:14.076278 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 387390us
I20260709 13:08:14.076611 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:14.093009 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:14.059548 23268 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:14.078593 21759 raft_consensus.cc:2393] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 4: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:14.078783 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:14.065837 23316 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:08:14.077232 23432 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:13.816256 22450 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:14.081252 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:14.021868 23401 consensus_queue.cc:237] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:14.096169 23430 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:08:14.096470 21647 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 291227c6f9914476b4363d40f7cfebb8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6fadfd81c5a645f1806a284ddbb6bf0d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:08:14.146763 21647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 50348.1us
I20260709 13:08:14.096984 23431 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:14.076762 21908 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 1.
I20260709 13:08:14.096505 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:14.102537 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:14.103390 21763 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:08:13.768836 23308 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:14.105070 21764 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:14.073679 23335 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:14.106312 23382 consensus_queue.cc:237] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:14.195495 23428 log.cc:927] Time spent T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.372s	user 0.004s	sys 0.006s
I20260709 13:08:14.107393 23227 consensus_queue.cc:1059] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:14.124157 21757 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:14.114742 23206 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:14.174088 22987 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.110548 23193 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:14.187876 21765 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:14.188781 23334 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:14.187840 21762 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
W20260709 13:08:14.189960 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 85306.8us
W20260709 13:08:14.193009 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 376850us
W20260709 13:08:14.190131 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 44009.6us
I20260709 13:08:14.192337 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:14.214928 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 238524us
I20260709 13:08:14.191602 23332 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 13:08:14.216830 23440 log.cc:927] Time spent T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:08:14.217793 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:14.190415 23217 raft_consensus.cc:3055] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:14.218429 23217 raft_consensus.cc:740] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:14.196187 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:14.219434 21758 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:14.194813 23335 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:14.144573 23268 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.198041 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:14.144986 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 69463us
I20260709 13:08:14.199996 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:14.084859 23434 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:14.201779 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:14.227721 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:14.228181 21763 raft_consensus.cc:2393] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 4: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:14.229022 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:14.191118 21804 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:14.203670 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:14.210086 23308 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:14.197840 23431 raft_consensus.cc:697] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:14.212667 23412 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:14.159164 23183 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:14.218554 21764 raft_consensus.cc:2393] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 2: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:14.237301 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:14.237813 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:14.237454 23217 consensus_queue.cc:260] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:14.238524 21762 raft_consensus.cc:2393] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:14.238423 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:14.238915 23217 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.239341 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:14.196894 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:14.239825 23432 consensus_queue.cc:1059] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:14.219838 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:14.240483 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:14.240629 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:14.240641 23423 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:14.241120 21762 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:14.241606 23183 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:14.241518 23423 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:14.242053 23183 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.242489 23183 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.242983 21760 raft_consensus.cc:2393] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:14.219321 23018 consensus_queue.cc:1059] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:14.225616 21757 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.225891 21877 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:14.090200 23176 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.230660 21761 raft_consensus.cc:2393] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:14.229753 21879 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:14.243860 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:14.090580 23058 consensus_queue.cc:237] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:14.233889 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:14.253995 21760 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:14.234100 21913 raft_consensus.cc:1240] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:14.234419 21729 leader_election.cc:400] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:14.254822 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:14.255460 21729 leader_election.cc:403] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:08:14.239466 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:14.196863 22449 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:14.219937 21914 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:14.258118 23018 raft_consensus.cc:3055] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:14.258592 23018 raft_consensus.cc:740] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:14.262126 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:14.262178 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:14.263549 21909 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.266824 21763 raft_consensus.cc:2393] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:14.268671 21729 leader_election.cc:400] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3.
I20260709 13:08:14.231412 23334 raft_consensus.cc:697] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:08:14.270454 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 73667.1us
I20260709 13:08:14.271663 21764 raft_consensus.cc:2393] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:14.252559 21757 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:14.273640 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:14.273964 21757 raft_consensus.cc:1240] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:14.269003 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:14.275523 21757 raft_consensus.cc:1240] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:14.258313 23233 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:14.236537 23335 consensus_queue.cc:1059] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:08:14.265190 23255 consensus_queue.cc:1059] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:08:14.276453 23332 consensus_queue.cc:1059] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:14.276502 23334 consensus_queue.cc:237] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:14.279654 23366 consensus_queue.cc:1059] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:14.238722 23431 consensus_queue.cc:237] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:14.285418 21762 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:14.286217 21761 raft_consensus.cc:1240] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:14.257889 23176 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.266309 23432 raft_consensus.cc:3055] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:14.349658 23432 raft_consensus.cc:740] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:14.350737 23432 consensus_queue.cc:260] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:14.352353 23432 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:14.287973 23183 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:14.355688 23183 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:14.288864 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:14.296034 21909 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:14.299484 21758 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:14.274823 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:14.304030 21763 raft_consensus.cc:1240] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:14.308466 21759 raft_consensus.cc:1240] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:14.309453 21757 raft_consensus.cc:1240] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:14.362577 21759 raft_consensus.cc:1240] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:14.269577 23308 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:14.300910 23415 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:14.363751 21914 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:14.363961 23415 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:14.364472 23415 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.362612 21757 raft_consensus.cc:1240] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:14.369534 21805 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:14.371402 23250 raft_consensus.cc:2764] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:08:14.372032 23250 consensus_queue.cc:1059] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.372100 21805 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:14.374452 21760 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:14.374596 21805 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:14.375418 23227 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:14.375905 23227 raft_consensus.cc:697] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:14.376910 23227 consensus_queue.cc:237] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:14.378567 23250 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:14.379093 23250 raft_consensus.cc:697] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:14.385246 22480 raft_consensus.cc:1240] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:14.386744 21805 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:14.379892 23250 consensus_queue.cc:237] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:14.389712 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 88927.8us
I20260709 13:08:14.390461 21729 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:14.390559 21805 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:14.392676 21805 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:14.392814 21729 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:14.391402 23316 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:14.394562 21909 raft_consensus.cc:1275] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:14.394610 21729 leader_election.cc:400] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:14.398764 21729 leader_election.cc:403] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:08:14.396116 21805 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:14.398344 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 141978us
I20260709 13:08:14.401839 21729 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:14.404207 21877 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:14.403407 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 212347us
W20260709 13:08:14.406477 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 177725us
I20260709 13:08:14.407704 21877 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:14.405071 21805 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:14.393952 23206 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:14.392148 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 90916.3us
I20260709 13:08:14.398660 23183 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.417811 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:14.403137 23310 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:14.419215 21804 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:14.400938 23318 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:14.402822 23316 raft_consensus.cc:697] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:14.402611 23135 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.422901 21910 raft_consensus.cc:2393] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:08:14.418932 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.419633 23274 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:08:14.430020 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.430490 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:14.400882 21907 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.403901 23376 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:14.433216 21764 raft_consensus.cc:1240] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 3. Ops: []
I20260709 13:08:14.393937 23193 consensus_queue.cc:1059] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:08:14.433957 22450 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:14.410274 23430 consensus_queue.cc:1048] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 13:08:14.405741 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 176123us
W20260709 13:08:14.442216 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 152045us
I20260709 13:08:14.441097 21804 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:14.409358 23233 raft_consensus.cc:3055] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:14.410537 23401 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:14.429219 21914 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:14.421394 23382 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:14.443429 23058 raft_consensus.cc:2804] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:14.477859 22449 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:14.478492 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 70863.7us
I20260709 13:08:14.447896 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:14.483086 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 49442.4us
I20260709 13:08:14.494969 21804 leader_election.cc:400] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3.
I20260709 13:08:14.476723 23233 raft_consensus.cc:740] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:08:14.543776 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.482196 23401 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:08:14.551194 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 56410.6us
I20260709 13:08:14.794275 23401 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.794664 21804 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:14.553282 23446 log.cc:927] Time spent T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 13:08:14.794920 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 305684us
W20260709 13:08:14.558208 23452 log.cc:927] Time spent T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:08:14.492532 23058 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:14.797106 23058 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:14.797628 23448 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.477201 23193 consensus_queue.cc:1243] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer 8c6c2207af3d47b3acf352d81959f4dd log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:08:14.800179 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:14.800915 21840 raft_consensus.cc:2368] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:14.496124 23382 raft_consensus.cc:697] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:14.802469 21840 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:14.803413 23382 consensus_queue.cc:237] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:14.805845 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:14.722451 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 311779us
W20260709 13:08:14.770620 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 325383us
W20260709 13:08:14.545595 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 103313us
I20260709 13:08:14.808553 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:14.809640 21729 leader_election.cc:400] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:14.809973 21729 leader_election.cc:403] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:08:14.810992 23333 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:14.811503 23193 consensus_queue.cc:1048] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:14.809996 23233 consensus_queue.cc:260] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:14.812605 23233 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:14.817193 23448 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.817780 23448 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:14.819799 23268 consensus_meta.cc:287] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.007s
I20260709 13:08:14.819993 23448 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:14.820251 23268 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:14.828156 23453 consensus_queue.cc:1059] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:14.507066 23447 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:14.835775 21914 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:14.494374 23183 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:14.790478 23415 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:14.498008 23433 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:14.496011 23449 raft_consensus.cc:3055] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:14.488412 23343 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:14.792287 23274 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.845124 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:14.792755 23332 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.847500 23274 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:14.854105 22480 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:14.824267 23058 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:14.855507 23433 raft_consensus.cc:697] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:14.855712 23274 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:14.856559 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:14.856638 23433 consensus_queue.cc:237] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:14.793394 23176 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:14.796255 21877 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:14.802402 23401 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:14.806143 21834 raft_consensus.cc:1240] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:14.811776 21729 leader_election.cc:400] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:14.870750 21729 leader_election.cc:403] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:14.844591 21756 raft_consensus.cc:1240] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:14.857906 22476 raft_consensus.cc:1240] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:14.858081 21832 raft_consensus.cc:1240] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:14.857285 21837 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:14.845033 23449 raft_consensus.cc:740] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:14.559360 23316 consensus_queue.cc:237] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:14.868585 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 72505.2us
I20260709 13:08:14.864477 23432 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:14.871377 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 59712.2us
I20260709 13:08:14.872272 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:14.788545 21907 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:14.884444 21877 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:14.891212 21905 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:14.861927 23255 raft_consensus.cc:3055] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:14.784547 23366 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:14.857312 23058 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:14.871742 23274 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:14.888306 21729 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:14.889344 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:14.848453 23443 log.cc:927] Time spent T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.388s	user 0.008s	sys 0.000s
I20260709 13:08:14.877453 23447 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:14.912014 21729 leader_election.cc:400] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:14.912523 21729 leader_election.cc:403] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:08:14.867537 23332 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:14.917009 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:14.893959 23463 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.886368 23431 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.917682 21834 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
W20260709 13:08:14.899834 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 114664us
W20260709 13:08:14.924847 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.894304 23255 raft_consensus.cc:740] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:14.892202 23459 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:14.898413 21756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 759) took 1208 ms. Trace:
I20260709 13:08:14.898680 23366 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:14.918505 23193 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:14.944149 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:14.894197 23462 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:08:14.894484 23430 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:08:14.979446 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:14.993631 21834 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:14.922073 23333 consensus_queue.cc:1059] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:08:14.995410 21837 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:08:14.892829 23432 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:14.922570 23058 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:08:14.943146 23366 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.924535 23310 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
W20260709 13:08:14.983248 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 107844us
W20260709 13:08:15.003611 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 124563us
W20260709 13:08:15.057508 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 55459.5us
W20260709 13:08:15.057720 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.930948 23431 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:14.940573 23206 consensus_queue.cc:1059] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:08:15.038337 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:14.939970 23463 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:15.015899 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.060178 21758 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
new_leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:35914
I20260709 13:08:14.999279 23376 consensus_queue.cc:1059] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:08:15.063654 23238 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:15.060774 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:15.138582 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 60971.8us
I20260709 13:08:15.005645 23193 raft_consensus.cc:697] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:15.135156 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:15.065837 21758 raft_consensus.cc:606] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Received request to transfer leadership to TS 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:15.065356 21839 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:15.143352 21833 raft_consensus.cc:1240] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:15.055672 23415 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:15.058460 23268 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:14.942055 23459 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:15.147648 21835 raft_consensus.cc:2393] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:08:15.246469 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.228029 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 164368us
I20260709 13:08:15.249506 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:15.249083 21879 leader_election.cc:336] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.620s (SENT)
I20260709 13:08:15.244784 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:15.251678 21831 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:08:15.280473 21837 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:15.310676 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.337174 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.045259 23255 consensus_queue.cc:260] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:15.135502 23460 raft_consensus.cc:2804] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:15.362500 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:15.359277 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 110219us
W20260709 13:08:15.397383 21879 leader_election.cc:336] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.743s (SENT)
I20260709 13:08:15.431373 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:15.432411 21831 raft_consensus.cc:2393] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 2: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:15.431529 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:15.225194 23462 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.434163 21835 raft_consensus.cc:2393] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:15.146740 23447 raft_consensus.cc:697] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:15.250183 23457 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:15.490743 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:15.226362 23176 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:15.240787 23401 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:15.148361 23270 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:15.466435 21764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2149) took 1396 ms. Trace:
W20260709 13:08:15.464572 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 67233.4us
W20260709 13:08:15.493121 23470 log.cc:927] Time spent T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.489s	user 0.001s	sys 0.000s
I20260709 13:08:15.460110 23018 consensus_queue.cc:260] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:15.562645 23018 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:15.565666 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:15.555908 21879 leader_election.cc:336] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.505s (SENT)
I20260709 13:08:15.605262 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:14.937297 21756 rpcz_store.cc:276] 0709 13:08:13.695118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.733397 (+ 38279us) service_pool.cc:224] Handling call
0709 13:08:14.844166 (+1110769us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b5800000098. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232eee 0000000000375939 00007fc6b32a61e0 00007fc6b336f0c4 00007fc6b336f131 00007fc6b3330fc0 00007fc6b331b929 00007fc6b331b3d2 00007fc6ac892bd4
0709 13:08:14.844331 (+   165us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:14.882645 (+ 38314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.896567 (+ 13922us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23085952}
I20260709 13:08:15.612174 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:15.613248 21831 raft_consensus.cc:2368] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:15.146432 23472 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.490s
I20260709 13:08:15.542575 23415 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:15.549163 23238 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:15.641398 21729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.003s	sys 0.008s
W20260709 13:08:15.660310 21729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.004s	sys 0.008s
W20260709 13:08:15.660591 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 726561us
I20260709 13:08:15.661540 21729 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:15.554601 21764 rpcz_store.cc:276] 0709 13:08:14.069560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.304762 (+235202us) service_pool.cc:224] Handling call
0709 13:08:14.433045 (+128283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:14.461911 (+ 28866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.466159 (+1004248us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54000a3cd0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:15.466357 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247726848}
W20260709 13:08:15.646946 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 78051.1us
W20260709 13:08:15.659332 22987 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.008s	sys 0.004s
W20260709 13:08:15.669517 22987 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.009s	sys 0.004s
I20260709 13:08:15.669704 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:15.617098 23334 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.017s	sys 0.005s
I20260709 13:08:15.674118 21831 raft_consensus.cc:1240] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:15.674685 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.614931 22480 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:08:15.676365 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:15.682178 21913 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:15.677683 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:15.680334 21831 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:08:15.573370 23457 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:15.698632 21833 raft_consensus.cc:3055] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:15.701100 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:15.574314 23270 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:15.699961 21833 raft_consensus.cc:740] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:08:15.679728 23334 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.018s	sys 0.005s
W20260709 13:08:15.711638 23468 log.cc:927] Time spent T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.613s	user 0.000s	sys 0.001s
I20260709 13:08:15.685963 23488 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.691687 23432 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:15.718238 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:15.718888 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.696266 23464 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.672963 23415 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:15.674810 23238 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:15.720448 21831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:08:15.747232 21831 raft_consensus.cc:606] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:15.571266 23193 consensus_queue.cc:237] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:15.692936 23484 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.709653 21833 consensus_queue.cc:260] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:15.735867 21879 leader_election.cc:336] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.665s (SENT)
I20260709 13:08:15.750801 21833 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:15.749622 21879 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:15.755987 23477 log.cc:927] Time spent T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.510s	user 0.002s	sys 0.000s
I20260709 13:08:15.756340 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:15.757094 21831 raft_consensus.cc:2368] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3.
I20260709 13:08:15.716841 23431 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:15.722170 23488 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:15.747159 23464 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:15.717020 23447 consensus_queue.cc:237] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:15.762791 23494 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:15.567754 23462 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:15.774917 23459 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:15.740094 21913 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:15.777794 23415 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:15.860102 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 198667us
I20260709 13:08:15.862519 21729 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
W20260709 13:08:15.878847 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.864296 21729 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:15.870664 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:15.802969 23480 log.cc:927] Time spent T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.250s	user 0.002s	sys 0.000s
W20260709 13:08:15.789587 23183 consensus_meta.cc:287] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.949s	user 0.007s	sys 0.004s
W20260709 13:08:15.957549 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 93356.7us
I20260709 13:08:15.784720 23491 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:15.791114 23485 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.964875 23270 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:15.783834 23464 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:15.966183 23233 consensus_meta.cc:287] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 1.136s	user 0.011s	sys 0.000s
W20260709 13:08:15.967136 23343 consensus_meta.cc:287] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 1.119s	user 0.008s	sys 0.003s
I20260709 13:08:15.969405 23172 raft_consensus.cc:3055] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:15.973902 22449 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:15.974325 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:15.795557 23472 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:15.781395 23488 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:15.761353 23484 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:16.023026 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:16.013497 21805 leader_election.cc:336] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.600s (SENT)
I20260709 13:08:16.023155 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:15.988967 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:16.176293 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 202477us
I20260709 13:08:16.176806 21763 raft_consensus.cc:2393] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:15.792330 23434 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:16.022814 23494 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.175930 23172 raft_consensus.cc:740] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:15.968873 23183 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:16.022950 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:16.170921 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2140) took 1112 ms. Trace:
I20260709 13:08:15.973856 21833 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:16.199409 21833 pending_rounds.cc:85] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 1
W20260709 13:08:16.136849 21837 consensus_meta.cc:287] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.766s	user 0.010s	sys 0.000s
I20260709 13:08:16.175920 21805 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:16.135012 21839 consensus_meta.cc:287] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.778s	user 0.008s	sys 0.002s
W20260709 13:08:16.107900 21730 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.003s	sys 0.011s
I20260709 13:08:15.946728 23376 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:16.200037 21833 pending_rounds.cc:107] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:16.204282 21833 raft_consensus.cc:2889] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:16.200100 21837 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:16.204993 21831 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:16.205708 21837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38352 (request call id 2146) took 1145 ms. Trace:
W20260709 13:08:16.200560 21730 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.208s	user 0.004s	sys 0.016s
I20260709 13:08:16.200820 21839 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
W20260709 13:08:16.203276 21804 connection.cc:256] RPC call timeout handler was delayed by -1.2183754630001431s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
I20260709 13:08:16.207464 21839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38348 (request call id 1376) took 1205 ms. Trace:
I20260709 13:08:16.207836 21839 rpcz_store.cc:276] 0709 13:08:15.002177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.002410 (+   233us) service_pool.cc:224] Handling call
0709 13:08:16.207413 (+1205003us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:15.962991 23333 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:16.199182 21834 rpcz_store.cc:276] 0709 13:08:15.058635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.061911 (+  3276us) service_pool.cc:224] Handling call
0709 13:08:15.140675 (+ 78764us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.214751 (+ 74076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.214784 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.248718 (+ 33934us) log.cc:844] Serialized 26 byte log entry
0709 13:08:15.830501 (+581783us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:15.830555 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.830651 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:15.975292 (+144641us) raft_consensus.cc:1685] finished
0709 13:08:15.975309 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.170856 (+195547us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":56649,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":24280,"thread_start_us":245287,"threads_started":1,"wal-append.queue_time_us":539770}
W20260709 13:08:16.210306 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 196891us
W20260709 13:08:16.076908 23430 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.003s	sys 0.011s
I20260709 13:08:16.218866 21840 raft_consensus.cc:2410] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:16.220424 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2151) took 1158 ms. Trace:
I20260709 13:08:16.220959 21833 rpcz_store.cc:276] 0709 13:08:15.062146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.670747 (+608601us) service_pool.cc:224] Handling call
0709 13:08:15.698466 (+ 27719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.220121 (+521655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.220349 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:16.215252 21805 leader_election.cc:336] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.698s (SENT)
I20260709 13:08:16.222335 21805 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:16.206142 21837 rpcz_store.cc:276] 0709 13:08:15.060416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.147784 (+ 87368us) service_pool.cc:224] Handling call
0709 13:08:16.205641 (+1057857us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:15.975677 23492 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:15.976764 23462 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:16.194659 23343 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:16.178674 23494 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:16.100241 23238 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:16.234208 21805 leader_election.cc:336] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.717s (SENT)
W20260709 13:08:16.235383 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.195483 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:16.236665 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:16.077217 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 357067us
I20260709 13:08:16.235271 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:16.238868 21805 leader_election.cc:336] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.750s (SENT)
I20260709 13:08:16.193761 23486 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:16.259444 21805 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:16.261353 21805 leader_election.cc:336] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.760s (SENT)
W20260709 13:08:16.262600 21805 leader_election.cc:336] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.764s (SENT)
I20260709 13:08:16.229498 23434 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:16.276124 22484 raft_consensus.cc:1240] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:16.266160 21837 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:16.275113 23316 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:16.268641 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.271862 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:16.205721 23472 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:16.295812 23472 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:16.299324 23494 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:16.242164 23183 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:16.211241 21756 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:16.238848 23492 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:16.303359 23492 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:16.288077 23486 raft_consensus.cc:697] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
W20260709 13:08:16.277949 23497 log.cc:927] Time spent T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:08:16.269884 23376 raft_consensus.cc:697] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:08:16.278674 23498 log.cc:927] Time spent T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 13:08:16.306612 23489 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:16.319742 23489 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:16.323529 23310 raft_consensus.cc:3055] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:16.324170 23310 raft_consensus.cc:740] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:16.326437 23486 consensus_queue.cc:237] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:16.334292 23430 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:16.335567 23430 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:15.988611 23485 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:16.239770 23172 consensus_queue.cc:260] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:16.282337 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.338214 23172 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.339195 23485 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:16.339789 23494 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:16.282876 23484 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:16.340328 23494 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:16.285373 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:16.263420 21805 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:16.342407 23494 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:16.343060 23482 log.cc:927] Time spent T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.710s	user 0.000s	sys 0.001s
W20260709 13:08:16.343212 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 80655.2us
I20260709 13:08:16.344292 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:16.344936 21909 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
W20260709 13:08:16.290602 23366 consensus_meta.cc:287] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 1.278s	user 0.011s	sys 0.000s
I20260709 13:08:16.345746 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:16.345698 23366 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:16.347787 21906 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:16.349076 21911 raft_consensus.cc:1240] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:16.352245 23491 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:16.352560 23434 consensus_queue.cc:1059] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:16.353497 23183 raft_consensus.cc:3055] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:16.353955 23183 raft_consensus.cc:740] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:16.354691 23333 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.355242 23333 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:16.354952 23183 consensus_queue.cc:260] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:16.356663 23183 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:16.358793 22477 consensus_queue.cc:237] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 3, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:16.360321 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 44977.7us
I20260709 13:08:16.311329 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:16.348093 23366 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:16.316864 23376 consensus_queue.cc:237] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:16.345709 23172 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:16.367143 23366 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:16.367857 23366 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:16.370803 23366 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:16.372514 23430 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:16.376439 21764 raft_consensus.cc:1275] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:16.376971 23274 raft_consensus.cc:3055] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:16.377359 21756 raft_consensus.cc:1275] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:16.379971 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:16.380998 23332 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:16.380945 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:16.381924 21906 raft_consensus.cc:2410] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:16.383009 21908 raft_consensus.cc:1275] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:16.385365 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.386458 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:16.410382 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.411026 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:16.411835 21758 raft_consensus.cc:2376] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3. Re-sending same reply.
I20260709 13:08:16.393949 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:16.394519 21805 leader_election.cc:336] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.797s (SENT)
I20260709 13:08:16.413662 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.406708 22987 consensus_queue.cc:1048] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:16.414414 21758 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:08:16.408648 21764 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:16.409582 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.417939 21763 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:16.419100 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.420035 21763 raft_consensus.cc:2393] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 4: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:16.423121 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.423381 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.423977 21761 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 1.
I20260709 13:08:16.426214 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.427786 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.429719 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.431149 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.432430 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:16.433755 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.435451 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:16.436339 21839 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:16.438988 21765 raft_consensus.cc:3055] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:16.439471 21765 raft_consensus.cc:740] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:16.352982 23491 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:16.444056 22479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36278 (request call id 188) took 1605 ms. Trace:
I20260709 13:08:16.444679 22479 rpcz_store.cc:276] 0709 13:08:14.839004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.839497 (+   493us) service_pool.cc:224] Handling call
0709 13:08:16.372946 (+1533449us) spinlock_profiling.cc:243] Waited 9.73 ms on lock 0x7b5800004898. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232a22 00007fc6b414bc09 00007fc6b32a5ee0 00007fc6b336f0ab 00007fc6b336f131 00007fc6b3330fc0 00007fc6b331b929 00007fc6b331b3d2 00007fc6ac892bd4
0709 13:08:16.373260 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.381327 (+  8067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.381382 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:16.405404 (+ 24022us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:16.413271 (+  7867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.438419 (+ 25148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.443992 (+  5573us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22381952}
I20260709 13:08:16.446148 23491 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:16.446843 23491 consensus_queue.cc:1059] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:16.446918 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.447360 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.447888 23491 consensus_queue.cc:1059] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:16.398566 23333 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:16.449889 21760 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 1.
I20260709 13:08:16.451377 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:16.452163 21761 raft_consensus.cc:2376] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4. Re-sending same reply.
I20260709 13:08:16.377381 23274 raft_consensus.cc:740] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:16.440346 21765 consensus_queue.cc:260] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:16.457198 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:16.456535 23491 raft_consensus.cc:3055] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:16.416971 23492 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:08:16.325227 23310 consensus_queue.cc:260] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:16.462220 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:16.462893 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.475447 21914 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:16.477151 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:16.481444 21914 raft_consensus.cc:1240] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:16.489991 21839 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:16.465588 23491 raft_consensus.cc:740] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:16.465087 22485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 613) took 1616 ms. Trace:
I20260709 13:08:16.468740 23437 raft_consensus.cc:3055] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:16.496310 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:16.497759 21839 raft_consensus.cc:2393] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 2: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:16.494145 22485 rpcz_store.cc:276] 0709 13:08:14.848883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.849032 (+   149us) service_pool.cc:224] Handling call
0709 13:08:16.361605 (+1512573us) spinlock_profiling.cc:243] Waited 8.4 ms on lock 0x7b5800004898. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232a22 00007fc6b414bc09 00007fc6b32a5ee0 00007fc6b336f0ab 00007fc6b336f131 00007fc6b3330fc0 00007fc6b331b929 00007fc6b331b3d2 00007fc6ac892bd4
0709 13:08:16.361793 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.361974 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:16.362267 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 13:08:16.462930 (+100663us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:16.463006 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:16.463070 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.463171 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.464595 (+  1424us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3464,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":382,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":845,"spinlock_wait_cycles":19326336,"thread_start_us":99539,"threads_started":1}
I20260709 13:08:16.498534 23491 consensus_queue.cc:260] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:16.499917 23491 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.499773 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:16.501545 21839 raft_consensus.cc:2376] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4. Re-sending same reply.
I20260709 13:08:16.496615 23437 raft_consensus.cc:740] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:08:16.491905 22448 leader_election.cc:336] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.603s (SENT)
W20260709 13:08:16.503417 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 65562.4us
I20260709 13:08:16.493278 23274 consensus_queue.cc:260] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:16.505920 23437 consensus_queue.cc:260] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:16.506749 23274 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.507160 23437 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.505980 22450 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:16.511165 22450 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:16.512365 23430 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:16.512465 21729 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:16.512786 23430 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:16.513224 23430 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:16.514614 23492 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:16.515028 23492 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:16.515398 23492 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.518988 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:16.519788 21839 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.522509 21906 raft_consensus.cc:1217] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Deduplicated request from leader. Original: 2.5->[4.6-4.6]   Dedup: 4.6->[]
I20260709 13:08:16.523052 21906 raft_consensus.cc:1240] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:08:16.529698 23511 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.530401 23511 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:16.539937 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.541553 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 51253.4us
I20260709 13:08:16.525955 23489 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:16.543324 23489 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:16.543813 23489 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.544245 23489 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:16.549230 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 1.16619e+06us
I20260709 13:08:16.562542 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1359) took 1764 ms. Trace:
I20260709 13:08:16.564968 21839 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:16.562959 21832 rpcz_store.cc:276] 0709 13:08:14.798235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.798376 (+   141us) service_pool.cc:224] Handling call
0709 13:08:14.798687 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:14.877345 (+ 78658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.562303 (+1684958us) spinlock_profiling.cc:243] Waited 59.1 ms on lock 0x7b54000bdbd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:16.562482 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136008960}
I20260709 13:08:16.572638 23457 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:16.572664 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:16.572811 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:16.574815 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:16.575663 21839 raft_consensus.cc:2410] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:08:16.575564 21832 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:16.577019 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:16.577610 21832 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:16.578455 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:16.579149 21832 raft_consensus.cc:2393] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:16.579190 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:16.579977 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:16.580969 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:16.582839 21840 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38348 (request call id 1371) took 1712 ms (client timeout 1545 ms). Trace:
W20260709 13:08:16.583227 21840 rpcz_store.cc:269] 0709 13:08:14.870008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.871981 (+  1973us) service_pool.cc:224] Handling call
0709 13:08:16.582644 (+1710663us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400339fd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:16.582781 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3059671296}
I20260709 13:08:16.584141 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:16.585043 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:16.585758 21836 raft_consensus.cc:1240] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:16.587322 21836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2144) took 1527 ms. Trace:
I20260709 13:08:16.587607 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:16.588640 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:16.589265 21839 raft_consensus.cc:2393] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:16.570998 23492 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:16.593422 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 67342.1us
I20260709 13:08:16.587638 21836 rpcz_store.cc:276] 0709 13:08:15.059805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.059946 (+   141us) service_pool.cc:224] Handling call
0709 13:08:16.585534 (+1525588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.586223 (+   689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.587182 (+   959us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b5400339fd0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:16.587278 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3331741056}
I20260709 13:08:16.598752 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:16.593942 21840 raft_consensus.cc:2410] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:16.593701 21832 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:16.601233 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:16.602047 21832 raft_consensus.cc:2393] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:16.603484 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1385) took 1020 ms. Trace:
W20260709 13:08:16.590142 23499 log.cc:927] Time spent T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.312s	user 0.003s	sys 0.000s
I20260709 13:08:16.604255 21839 raft_consensus.cc:2393] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:16.608958 21834 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:16.609220 21839 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:16.598760 23415 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.611095 23492 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:16.611366 23415 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:16.613817 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:16.614360 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:16.609887 23463 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:16.610306 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36278 (request call id 185) took 2320 ms. Trace:
I20260709 13:08:16.610431 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:16.619974 21836 raft_consensus.cc:2410] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:08:16.610553 23423 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:16.615018 23491 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.623425 21839 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:16.604527 21832 rpcz_store.cc:276] 0709 13:08:15.583223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.602700 (+1019477us) service_pool.cc:224] Handling call
0709 13:08:16.603012 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.603173 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.603199 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:16.603252 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:16.603277 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.603336 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.603436 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:16.641461 21761 raft_consensus.cc:1275] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:16.628772 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.621057 23218 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.646245 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:16.652334 21762 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.652240 23218 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:16.653954 21834 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:16.652452 23489 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:16.659168 22483 raft_consensus.cc:1240] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:16.659435 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:16.661504 22481 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:16.662328 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:16.620849 22476 rpcz_store.cc:276] 0709 13:08:14.290366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.302431 (+ 12065us) service_pool.cc:224] Handling call
0709 13:08:14.398376 (+ 95945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:14.892764 (+494388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.610056 (+1717292us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b540051fc54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:16.610225 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1054029056}
I20260709 13:08:16.663625 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:16.664161 23511 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:16.659624 21758 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:16.668982 21762 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:16.615653 23415 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:16.670199 22450 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:16.654181 23492 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:08:16.671164 23415 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:16.671648 23415 raft_consensus.cc:697] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:16.643765 23522 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.640946 23491 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:16.690619 23430 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:16.693773 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:16.694152 23507 log.cc:927] Time spent T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.412s	user 0.002s	sys 0.000s
I20260709 13:08:16.694430 21912 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:16.694756 21880 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:16.695307 21759 raft_consensus.cc:1240] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:16.695389 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:16.696271 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:16.696424 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.698376 21757 raft_consensus.cc:1275] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:16.700085 22450 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:16.709514 23457 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.710054 21805 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:16.710302 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:16.711606 23423 consensus_queue.cc:1059] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:16.711923 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:16.712103 23447 consensus_queue.cc:1059] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:16.712606 21761 raft_consensus.cc:2376] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4. Re-sending same reply.
I20260709 13:08:16.712687 23423 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:16.713534 23423 raft_consensus.cc:3055] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:16.713652 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.713187 23447 raft_consensus.cc:3055] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:16.710144 23457 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:16.714403 23447 raft_consensus.cc:740] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:16.715639 23447 consensus_queue.cc:260] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:16.711630 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.716650 23457 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:16.717065 23447 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.717661 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.718724 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.719640 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:16.720252 21759 raft_consensus.cc:2393] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 4: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:16.720953 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:16.721580 23268 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.721741 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:16.721958 21805 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:16.721203 23494 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.722200 23268 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:16.723011 23458 raft_consensus.cc:3055] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:16.722865 23494 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:16.723469 23458 raft_consensus.cc:740] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:16.724372 21729 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:16.725003 23494 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:16.714030 23423 raft_consensus.cc:740] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:16.725291 23453 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.711944 23493 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:16.726261 23486 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:16.726058 23423 consensus_queue.cc:260] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:16.727236 23494 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.727329 23423 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:16.714483 21761 raft_consensus.cc:2393] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:16.728176 23523 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:16.727783 23494 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:16.722720 23172 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:16.728657 23523 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.729184 23523 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:16.729202 23172 raft_consensus.cc:697] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:16.730304 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 186) took 1046 ms. Trace:
I20260709 13:08:16.730737 23494 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:16.697646 23415 consensus_queue.cc:237] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:16.730800 21905 rpcz_store.cc:276] 0709 13:08:15.683794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.684865 (+  1071us) service_pool.cc:224] Handling call
0709 13:08:15.709468 (+ 24603us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:16.099954 (+390486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.107661 (+  7707us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:16.178415 (+ 70754us) log.cc:844] Serialized 52 byte log entry
0709 13:08:16.286606 (+108191us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:16.286650 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.693550 (+406900us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:16.729889 (+ 36339us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b540032d554. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:16.729956 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.730010 (+    54us) raft_consensus.cc:1685] finished
0709 13:08:16.730033 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.730235 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34844,"raft.queue_time_us":39547,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":7826,"spinlock_wait_cycles":595022976,"thread_start_us":95474,"threads_started":1,"wal-append.queue_time_us":103724}
I20260709 13:08:16.730410 23172 consensus_queue.cc:237] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:16.728704 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:16.736765 21761 raft_consensus.cc:2376] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3. Re-sending same reply.
I20260709 13:08:16.734670 22485 raft_consensus.cc:2393] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:16.736974 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.726984 23486 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:16.734707 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:16.734895 21759 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:16.735437 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:16.740679 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:16.734155 21805 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:16.736871 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:16.726388 23493 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.742561 21913 raft_consensus.cc:1240] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:16.745792 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:16.724647 23268 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:16.746948 21805 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:16.747943 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 152956us
W20260709 13:08:16.753086 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.749877 21910 raft_consensus.cc:2393] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:16.746991 21757 raft_consensus.cc:1240] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:16.754029 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:16.738119 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.760895 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:16.761656 21914 raft_consensus.cc:2393] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 4: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:16.763427 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:16.764514 21912 raft_consensus.cc:1240] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:16.763479 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:08:16.745460 23460 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.110s	user 0.006s	sys 0.014s
I20260709 13:08:16.737464 23492 raft_consensus.cc:2804] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:16.773908 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:16.770979 21761 raft_consensus.cc:2410] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:16.772081 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:16.746205 23183 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:16.786893 21910 raft_consensus.cc:1240] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:08:16.795378 21910 raft_consensus.cc:1275] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:16.762301 23274 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.791458 21911 raft_consensus.cc:1275] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:08:16.771938 23460 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.154s	user 0.006s	sys 0.014s
I20260709 13:08:16.746913 23493 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:16.677531 23522 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:16.716868 23449 consensus_queue.cc:260] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:16.799378 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:16.751508 23434 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:08:16.768508 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:16.724422 23458 consensus_queue.cc:260] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:16.725880 23453 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:16.785735 23492 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:16.799682 21910 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:17.111392 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:16.956408 23523 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:17.111848 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.112322 21905 raft_consensus.cc:2393] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 2: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:16.815624 23227 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:17.113550 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.115811 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:16.799968 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:16.983385 22484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 616) took 1924 ms. Trace:
I20260709 13:08:17.118024 21765 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:17.117566 22484 rpcz_store.cc:276] 0709 13:08:15.059341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.059501 (+   160us) service_pool.cc:224] Handling call
0709 13:08:15.059766 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.276505 (+1216739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.983073 (+706568us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54001a59d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:16.983305 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2797029248}
W20260709 13:08:17.096634 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 338192us
W20260709 13:08:16.853006 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.120646 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.828138 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:17.121795 23492 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:17.114289 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 367406us
I20260709 13:08:17.006608 21759 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:17.127774 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1384) took 1664 ms. Trace:
I20260709 13:08:17.130880 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:17.131510 21914 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
W20260709 13:08:17.132155 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.133337 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.133659 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.124071 23449 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:17.130038 21831 rpcz_store.cc:276] 0709 13:08:15.463414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.765330 (+301916us) service_pool.cc:224] Handling call
0709 13:08:16.204839 (+439509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.205356 (+   517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.127593 (+922237us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54002882d0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:17.127719 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1010046336}
I20260709 13:08:16.774834 23376 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.771552 23469 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:17.109123 23437 raft_consensus.cc:993] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239: : Instructing follower 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:08:17.105306 23206 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.150007 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:17.162518 21906 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:17.150435 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:17.152184 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:16.980515 23500 log.cc:927] Time spent T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 1.039s	user 0.000s	sys 0.002s
I20260709 13:08:17.107734 23310 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:16.798102 23430 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:17.164494 21759 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:16.976732 23489 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:17.273865 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:17.268433 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:17.275269 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:17.275487 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:17.152387 23523 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:17.169991 21765 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:17.279390 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:17.279917 21765 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 1.
I20260709 13:08:17.170616 21913 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:17.171751 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 405127us
W20260709 13:08:17.177857 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.189285 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:17.282392 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.282788 21757 raft_consensus.cc:2393] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 2: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:17.197938 23492 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:17.209446 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.216122 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 102937us
W20260709 13:08:16.971153 22448 leader_election.cc:336] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.933s (SENT)
I20260709 13:08:17.108256 22478 raft_consensus.cc:1217] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Deduplicated request from leader. Original: 2.5->[4.6-4.6]   Dedup: 4.6->[]
I20260709 13:08:16.820413 23486 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:17.116843 23460 raft_consensus.cc:697] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:16.826340 23491 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:17.220147 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:17.220537 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:17.138113 23457 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.220767 23318 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.107758 23433 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:08:17.286047 23193 raft_consensus.cc:1081] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Signalling peer 8c6c2207af3d47b3acf352d81959f4dd to start an election
W20260709 13:08:17.157289 21879 leader_election.cc:336] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.930s (SENT)
I20260709 13:08:17.302744 21879 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:17.276945 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:16.815129 23274 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:17.219754 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:17.309330 22449 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:17.160415 23376 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:17.161648 23469 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:17.291203 21660 catalog_manager.cc:5697] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 1 to 2, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 2 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:17.267215 23527 consensus_queue.cc:1059] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 13:08:17.295256 23491 consensus_queue.cc:1059] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:17.295953 23457 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:17.304009 22478 raft_consensus.cc:1240] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:08:17.297695 21760 raft_consensus.cc:2376] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3. Re-sending same reply.
I20260709 13:08:17.345793 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:17.346171 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:17.346967 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:17.220872 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 51042.5us
I20260709 13:08:17.347493 23489 raft_consensus.cc:3055] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:17.347959 23489 raft_consensus.cc:740] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:17.349239 23539 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.349794 23539 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:17.350456 23528 log.cc:927] Time spent T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.591s	user 0.002s	sys 0.000s
I20260709 13:08:17.350898 23274 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:17.352064 23539 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:17.352213 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:17.347544 21760 raft_consensus.cc:2376] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3. Re-sending same reply.
I20260709 13:08:17.300421 21906 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
W20260709 13:08:17.303670 23423 consensus_meta.cc:287] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.000s
W20260709 13:08:17.303694 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 146398us
W20260709 13:08:17.354915 21879 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.106s (SENT) [suppressed 74 similar messages]
I20260709 13:08:17.304636 21835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2155) took 2054 ms. Trace:
I20260709 13:08:17.346753 21911 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:17.306243 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.306916 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:17.359797 21765 raft_consensus.cc:2393] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 5: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:17.307790 23318 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:17.220837 23458 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:17.324527 21913 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:17.142237 22480 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:17.288950 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:17.261070 23206 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:17.299950 21761 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:17.353925 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:17.378491 21914 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:17.378605 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:17.320550 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:17.379280 21761 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:17.379485 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:17.380246 21762 raft_consensus.cc:2368] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5.
I20260709 13:08:17.380077 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:17.380811 21761 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:17.381785 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:17.382061 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 233404us
I20260709 13:08:17.313256 23463 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:17.375285 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:17.383912 21760 raft_consensus.cc:2376] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4. Re-sending same reply.
I20260709 13:08:17.346683 23453 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:17.356526 21835 rpcz_store.cc:276] 0709 13:08:15.250230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.694041 (+443811us) service_pool.cc:224] Handling call
0709 13:08:15.694420 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.695049 (+   629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.695100 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.704307 (+  9207us) log.cc:844] Serialized 26 byte log entry
0709 13:08:15.940673 (+236366us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:16.216173 (+275500us) log.cc:844] Serialized 14 byte log entry
0709 13:08:16.225697 (+  9524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.225749 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.979834 (+754085us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:17.297103 (+317269us) raft_consensus.cc:1685] finished
0709 13:08:17.301352 (+  4249us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.304569 (+  3217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1219,"prepare.queue_time_us":341108,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":9365,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":2827,"spinlock_wait_cycles":29539200,"thread_start_us":502017,"threads_started":2,"wal-append.queue_time_us":230703}
W20260709 13:08:17.322767 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 351637us
W20260709 13:08:17.388628 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 106663us
I20260709 13:08:17.389822 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:17.382265 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:17.382500 21761 raft_consensus.cc:2393] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:17.369973 21805 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:17.382839 21759 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:17.391204 21762 raft_consensus.cc:2376] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4. Re-sending same reply.
I20260709 13:08:17.391485 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:17.393141 21805 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:17.348788 23489 consensus_queue.cc:260] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:17.397327 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:17.398069 21831 raft_consensus.cc:2410] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:17.376096 23430 raft_consensus.cc:2804] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:17.400933 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:17.402392 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:17.402493 21765 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:17.404656 22450 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:17.405683 21914 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:17.408402 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:17.391557 21728 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:17.410128 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:17.411146 21837 raft_consensus.cc:2393] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:17.399653 23172 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:17.413311 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:17.416116 21837 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.417688 21728 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:17.418274 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:17.378180 23449 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 13:08:17.419719 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:17.420454 21835 raft_consensus.cc:2410] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:08:17.400754 22478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:36270
I20260709 13:08:17.423321 22478 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:17.423408 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:17.423729 23536 log.cc:927] Time spent T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:08:17.423801 22478 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.424503 21835 raft_consensus.cc:2393] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:17.425917 23206 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:17.421482 23539 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:17.426987 23539 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:17.427516 23539 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:17.401311 23332 consensus_queue.cc:1059] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:08:17.430315 21831 raft_consensus.cc:1275] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:17.396075 23227 consensus_queue.cc:1059] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:08:17.434849 21838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2141) took 2372 ms. Trace:
I20260709 13:08:17.434765 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:17.421339 23489 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:17.455312 23479 raft_consensus.cc:3055] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:17.455716 23479 raft_consensus.cc:740] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:17.456467 23479 consensus_queue.cc:260] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:17.457473 23492 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:17.458163 23492 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:17.458364 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:17.421205 23511 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:17.441884 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:17.441670 23541 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:08:17.459993 21833 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:17.460855 23479 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.446267 21831 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:08:17.448496 23218 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:17.464699 23493 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:17.449796 21911 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
W20260709 13:08:17.450024 23510 log.cc:927] Time spent T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.953s	user 0.002s	sys 0.000s
I20260709 13:08:17.450693 23255 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:17.452710 23469 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:17.458510 23492 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:17.418066 23522 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:17.467681 21728 leader_election.cc:336] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.625s (SENT)
I20260709 13:08:17.473688 21760 raft_consensus.cc:1240] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:17.422261 23543 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:17.435571 23453 raft_consensus.cc:3055] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:17.474514 21729 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:17.494163 23522 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:17.494689 23522 raft_consensus.cc:697] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:17.495558 23522 consensus_queue.cc:237] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:17.500622 21729 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:17.501335 23511 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:17.502224 23496 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.212s	user 0.013s	sys 0.012s
W20260709 13:08:17.502569 23496 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.213s	user 0.013s	sys 0.012s
I20260709 13:08:17.505353 21729 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:17.506927 23534 raft_consensus.cc:2804] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:17.479828 23527 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.480314 21833 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:17.436744 21838 rpcz_store.cc:276] 0709 13:08:15.058955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.061589 (+  2634us) service_pool.cc:224] Handling call
0709 13:08:15.135055 (+ 73466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.246661 (+111606us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.246692 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.556494 (+1309802us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b1800323260. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab2382a6 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6acc50a11 00007fc6acc60372 00007fc6ae392a01 00007fc6ae35743a
0709 13:08:16.701442 (+144948us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b2c0000e678. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6acc50a11 00007fc6acc60372 00007fc6ae392a01 00007fc6ae35743a 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2
0709 13:08:16.763513 (+ 62071us) log.cc:844] Serialized 26 byte log entry
0709 13:08:17.278917 (+515404us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:17.278965 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:17.279033 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:17.431551 (+152518us) raft_consensus.cc:1685] finished
0709 13:08:17.431572 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:17.431748 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":58633,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":25597,"spinlock_wait_cycles":10084352,"thread_start_us":462446,"threads_started":1,"wal-append.queue_time_us":587911}
I20260709 13:08:17.481464 21762 raft_consensus.cc:1275] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:17.481477 21728 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:17.467928 23434 raft_consensus.cc:993] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
W20260709 13:08:17.526787 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 59144.4us
W20260709 13:08:17.527500 21728 leader_election.cc:336] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.644s (SENT)
I20260709 13:08:17.527885 21728 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:17.528981 21728 leader_election.cc:336] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.662s (SENT)
I20260709 13:08:17.414177 23460 consensus_queue.cc:237] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:17.491516 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:17.510370 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.475066 21837 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
W20260709 13:08:17.513298 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 145270us
W20260709 13:08:17.514375 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 158008us
I20260709 13:08:17.529345 21728 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:17.533121 21728 leader_election.cc:336] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.734s (SENT)
I20260709 13:08:17.533728 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:17.480571 23492 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:17.492369 23453 raft_consensus.cc:740] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:17.557771 23548 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:17.564065 21729 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:17.508037 23316 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:17.466910 23486 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:08:17.565827 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:17.564770 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 150097us
I20260709 13:08:17.570361 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:17.570910 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:17.585038 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:17.585917 21914 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:17.525481 23534 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.534965 23511 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:17.530907 23218 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:17.591539 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:17.606657 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:17.608356 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:17.609416 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:17.609978 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:17.610708 21832 raft_consensus.cc:2393] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:17.611466 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:17.612130 21833 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
W20260709 13:08:17.587217 23509 log.cc:927] Time spent T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:08:17.597811 21729 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:17.601747 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:17.480975 23539 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:17.632478 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:17.525658 23423 consensus_queue.cc:1059] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:08:17.616076 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:17.607547 21835 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 1.
I20260709 13:08:17.588450 23227 raft_consensus.cc:1081] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
W20260709 13:08:17.599426 21728 leader_election.cc:336] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.801s (SENT)
I20260709 13:08:17.605046 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:17.560827 23549 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:17.558321 23543 raft_consensus.cc:697] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:17.612543 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:17.595242 23206 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:17.646687 21762 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:17.642768 21728 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:17.602686 23534 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:17.633211 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:17.532666 23527 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:17.642433 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 221141us
W20260709 13:08:17.648164 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 48789.9us
I20260709 13:08:17.650245 21834 raft_consensus.cc:2376] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2. Re-sending same reply.
W20260709 13:08:17.653872 21728 leader_election.cc:336] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.809s (SENT)
I20260709 13:08:17.654361 21728 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:17.605890 23376 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:17.658344 21833 raft_consensus.cc:1275] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:08:17.658640 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.666924 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.679108 21804 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:17.635064 23548 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:17.747201 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 93360.7us
I20260709 13:08:17.594372 23316 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:17.612840 23551 consensus_queue.cc:1059] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:08:17.614460 23531 consensus_queue.cc:1048] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260709 13:08:17.654240 23491 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:08:17.627533 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 225449us
W20260709 13:08:17.765237 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:17.746634 23509 log.cc:927] Time spent T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 13:08:17.768070 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.724875 23206 raft_consensus.cc:697] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:17.750429 23548 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.689869 23453 consensus_queue.cc:260] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:17.786208 23453 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:17.783704 23227 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.767468 23376 consensus_queue.cc:1059] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:08:17.767237 23423 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.790419 23447 raft_consensus.cc:3055] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:17.790691 23423 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:17.792013 23543 consensus_queue.cc:237] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:17.792680 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:17.790123 23560 log.cc:927] Time spent T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:17.794023 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:17.794705 21912 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:17.795687 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:17.796389 21912 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:17.788962 23227 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:17.793149 23423 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:17.814284 21912 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:17.780730 23183 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:17.765554 23555 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:17.824399 23206 consensus_queue.cc:237] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:17.594403 23469 raft_consensus.cc:2955] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:17.827661 21914 raft_consensus.cc:2410] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:17.798449 23548 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:17.801712 23447 raft_consensus.cc:740] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:17.812068 23556 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:17.829154 23316 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:17.848755 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 313819us
W20260709 13:08:17.847443 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 286037us
W20260709 13:08:17.851507 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 319324us
I20260709 13:08:17.852978 23561 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.893782 21877 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:17.890239 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:17.907143 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.873760 23544 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:17.923764 21877 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:17.829530 23183 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:17.936982 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.940452 23335 consensus_queue.cc:1059] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
W20260709 13:08:17.943517 23572 log.cc:927] Time spent T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:08:17.944160 23227 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:17.949692 23310 consensus_meta.cc:287] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.677s	user 0.010s	sys 0.000s
I20260709 13:08:17.965222 23539 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:17.966630 21764 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:17.950672 23476 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.967098 23522 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.967531 23476 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:17.954933 23546 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:08:17.955430 21905 consensus_meta.cc:287] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.612s	user 0.006s	sys 0.002s
I20260709 13:08:17.969653 21905 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
W20260709 13:08:17.970072 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.957360 23183 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:17.957697 23562 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:17.935393 23479 consensus_queue.cc:1048] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:08:17.962147 21757 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:17.893167 23561 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:17.962419 23447 consensus_queue.cc:260] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:17.973562 23447 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:17.963697 23318 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:17.974644 23561 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:17.975373 23453 consensus_queue.cc:1175] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3843e9b794a245dd8608e04ec7915239" responder_term: 4 status { last_received { term: 2 index: 2 } last_committed_idx: 2 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:17.883859 23556 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:17.963573 23548 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:17.967587 23522 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:17.938673 23568 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:17.953859 22478 consensus_meta.cc:287] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 13:08:17.984316 23423 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.988746 21880 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:17.996521 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:17.983879 23543 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:18.010807 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:17.986205 23556 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:18.012468 22481 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:18.010836 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 331870us
I20260709 13:08:18.022275 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:18.023227 22485 raft_consensus.cc:2410] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:18.024065 21804 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:18.024353 22481 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
W20260709 13:08:18.035048 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 82151.7us
W20260709 13:08:18.037580 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 113947us
I20260709 13:08:18.011159 23458 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:18.042110 22485 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:08:18.045145 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:18.046108 21905 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:18.047235 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:18.047857 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 59213.1us
W20260709 13:08:18.048483 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.048671 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:18.049247 21880 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:17.995338 22478 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:18.050298 23447 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:18.047336 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:18.050355 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:18.050882 23447 raft_consensus.cc:697] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:18.051455 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:18.051648 22478 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:18.051743 23447 consensus_queue.cc:237] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:18.052798 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:18.052985 21905 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:18.053474 22482 raft_consensus.cc:1240] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:18.054028 22483 raft_consensus.cc:1240] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:18.054638 22482 raft_consensus.cc:1240] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:18.054780 23548 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:18.056330 23553 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:18.058728 21877 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:18.060045 23556 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:18.061400 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:18.067432 21832 raft_consensus.cc:2393] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 2: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:08:18.068958 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 44974.3us
I20260709 13:08:18.062911 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:18.063287 21764 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 807) took 1672 ms (client timeout 1750 ms). Trace:
I20260709 13:08:18.049867 23571 raft_consensus.cc:2804] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:18.042016 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:18.076465 21907 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:08:18.076978 21907 pending_rounds.cc:85] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 2
I20260709 13:08:18.077272 21907 pending_rounds.cc:107] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:08:18.077618 23570 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:18.064360 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:18.078763 21833 raft_consensus.cc:2393] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:18.023579 23543 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:18.064826 23533 raft_consensus.cc:3055] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:18.065395 23476 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:18.065862 23492 consensus_meta.cc:287] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.002s
I20260709 13:08:18.066007 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:18.066287 23434 raft_consensus.cc:3055] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:18.062176 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:18.071470 21764 rpcz_store.cc:269] 0709 13:08:16.390652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.433461 (+ 42809us) service_pool.cc:224] Handling call
0709 13:08:18.063117 (+1629656us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b540017cd54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:18.063230 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3523705216}
I20260709 13:08:18.063560 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:18.072624 21806 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:18.073464 21804 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:18.074295 22482 raft_consensus.cc:1240] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:18.075376 23457 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:18.077613 21907 raft_consensus.cc:2889] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:18.010746 23423 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:18.079639 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 138000us
I20260709 13:08:18.074082 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:18.088523 21760 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:18.095225 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:18.096997 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:18.063899 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:18.040131 23227 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:18.062209 23463 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:17.993314 23568 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:18.071321 23458 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:18.103668 21806 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:18.080041 23571 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.086594 23332 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:18.083817 23533 raft_consensus.cc:740] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:18.110512 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:18.122597 23332 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:18.123569 21760 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:08:18.123334 23533 consensus_queue.cc:260] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:18.090863 23492 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:18.101400 21729 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:18.112357 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:18.112403 21804 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:18.126796 21729 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:18.107103 21877 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:18.106942 21761 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59108
I20260709 13:08:18.102646 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:18.128005 21761 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.128343 21764 raft_consensus.cc:3055] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:18.128859 21764 raft_consensus.cc:740] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:18.102115 21839 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 1.
I20260709 13:08:18.128454 21761 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.111364 21759 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:18.131857 23576 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:18.132092 23489 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:18.132946 23492 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:18.103031 21836 raft_consensus.cc:2376] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3. Re-sending same reply.
I20260709 13:08:18.126701 21762 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:18.112474 21912 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:18.120398 21879 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:18.133540 23310 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:18.133601 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:18.136313 23577 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:18.130020 21764 consensus_queue.cc:260] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:18.136919 21805 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:18.136906 23577 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:18.137591 21764 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.137770 21756 raft_consensus.cc:2955] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:18.139894 21760 raft_consensus.cc:1240] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:18.140372 23543 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:18.140992 23543 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:18.142141 21804 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:18.142382 23543 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:18.142771 23543 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:18.143132 23543 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.143342 21804 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:18.136201 23310 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.154390 21764 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:18.156550 22450 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:18.132709 23576 consensus_queue.cc:1059] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:18.134253 22484 raft_consensus.cc:1240] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:18.159000 21879 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:18.159785 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 52743.9us
I20260709 13:08:18.163268 21879 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:18.164929 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:18.121167 23556 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:18.124683 23316 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.166518 21879 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:18.125216 23571 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:18.168007 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:18.154129 23463 raft_consensus.cc:697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 2 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:18.134685 23458 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:18.167570 21764 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.147755 23491 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:18.170210 22450 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:18.101845 23434 raft_consensus.cc:740] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:18.157634 23310 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:18.172660 23585 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:18.177606 23476 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:18.177856 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:18.117530 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 80201.4us
I20260709 13:08:18.170496 21912 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:18.181595 21879 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:18.120637 23433 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:08:18.162331 23489 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.169387 23457 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:18.165529 23492 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:18.201567 23486 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:18.204941 23554 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:18.204120 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.204411 21761 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:18.169358 23545 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:18.181895 23183 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:18.206813 21805 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:18.181146 23562 consensus_queue.cc:1059] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:08:18.208602 21879 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:18.207604 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:18.240026 21879 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:18.208717 23583 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 13:08:18.178283 23318 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:18.121958 23227 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:18.180316 23491 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.203583 23576 raft_consensus.cc:3055] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:18.125362 23544 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
W20260709 13:08:18.203156 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 54624.8us
I20260709 13:08:18.218485 21912 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:18.183691 23556 consensus_queue.cc:1059] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:08:18.213836 23569 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:18.231094 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 87833.8us
I20260709 13:08:18.266530 21804 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:18.235711 21761 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:18.236239 21764 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:18.244920 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:18.206820 23577 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:18.242244 21728 leader_election.cc:336] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.679s (SENT)
I20260709 13:08:18.248445 21879 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:18.217178 23492 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.257405 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:18.267171 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:18.273774 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:18.233946 23486 raft_consensus.cc:697] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:18.272460 21879 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:18.268548 22450 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:18.245565 23463 consensus_queue.cc:237] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:18.218461 23489 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:18.254370 23585 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:18.259104 23491 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:18.266172 21905 raft_consensus.cc:1275] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:18.263705 23576 raft_consensus.cc:740] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:18.295995 21879 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:18.297504 21804 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:18.276232 23492 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:18.271759 23318 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:18.263443 23457 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:08:18.267161 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 47751.6us
I20260709 13:08:18.301159 23183 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:18.316682 21647 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 291227c6f9914476b4363d40f7cfebb8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6fadfd81c5a645f1806a284ddbb6bf0d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:18.319195 23316 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:18.238039 23434 consensus_queue.cc:260] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:18.292371 23539 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.279724 22480 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:18.296178 23562 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:18.298791 23460 raft_consensus.cc:2764] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:08:18.322229 21764 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
W20260709 13:08:18.325682 21728 leader_election.cc:336] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.765s (SENT)
I20260709 13:08:18.338798 21728 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:18.315738 23586 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:18.300590 23577 consensus_queue.cc:1059] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:08:18.334034 23183 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.314066 23569 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:18.337298 21804 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:18.321583 23585 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:18.344094 21912 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:18.351812 23585 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.352237 23595 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:18.352973 23595 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:18.354324 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:18.355170 23493 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:18.355578 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:18.356317 23590 log.cc:927] Time spent T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:18.356442 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:18.357100 21837 raft_consensus.cc:2368] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3.
I20260709 13:08:18.357021 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:18.357708 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:18.359220 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 143) took 1733 ms. Trace:
I20260709 13:08:18.341961 21907 raft_consensus.cc:1240] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:18.380267 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:18.381471 21763 rpcz_store.cc:276] 0709 13:08:16.626159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.626645 (+   486us) service_pool.cc:224] Handling call
0709 13:08:16.627034 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:16.740838 (+113804us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:16.740909 (+    71us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.741459 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:08:17.166220 (+424761us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:17.166274 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.358890 (+1192616us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54000a3cd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:18.358937 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:18.358976 (+    39us) raft_consensus.cc:1685] finished
0709 13:08:18.358989 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.359167 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4640,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":12998,"spinlock_wait_cycles":260727040,"thread_start_us":424404,"threads_started":1,"wal-append.queue_time_us":550226}
I20260709 13:08:18.345773 23562 raft_consensus.cc:697] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:18.382208 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:18.389850 21832 raft_consensus.cc:2368] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:18.390652 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:18.390718 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:18.382704 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36270 (request call id 370) took 1770 ms. Trace:
I20260709 13:08:18.341739 23593 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:08:18.393556 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:18.358634 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:18.343478 23555 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:18.357740 21831 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:18.341851 23568 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:18.391855 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:18.391635 21832 raft_consensus.cc:2410] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:18.392911 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:18.394570 21839 raft_consensus.cc:2410] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:08:18.373473 21728 leader_election.cc:336] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.814s (SENT)
I20260709 13:08:18.403462 21728 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:18.340317 23539 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:18.394985 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 129883us
W20260709 13:08:18.405249 21728 leader_election.cc:336] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.827s (SENT)
I20260709 13:08:18.395279 23543 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:18.352244 23585 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:18.358974 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:18.405738 21728 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:18.398028 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:18.340071 23545 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
W20260709 13:08:18.400957 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 105041us
I20260709 13:08:18.402416 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:18.405263 21806 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:18.407933 21837 raft_consensus.cc:2410] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:08:18.411535 21728 leader_election.cc:336] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.828s (SENT)
I20260709 13:08:18.348937 23434 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:18.349179 23183 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:18.414724 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:18.412016 21728 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:18.417017 21879 leader_election.cc:400] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5.
I20260709 13:08:18.413399 23333 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:18.421357 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:18.405786 23534 consensus_meta.cc:287] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.682s	user 0.004s	sys 0.007s
I20260709 13:08:18.391602 23458 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:18.416872 22448 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:18.439630 21831 raft_consensus.cc:1240] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:18.444145 21729 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:18.448377 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:18.422096 21879 leader_election.cc:403] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:18.348158 23576 consensus_queue.cc:260] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:18.450356 23548 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:18.417295 23569 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:18.417212 23519 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:18.346263 23486 consensus_queue.cc:237] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:18.450997 23576 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:18.439589 23588 log.cc:927] Time spent T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:08:18.467434 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 56981.9us
I20260709 13:08:18.506783 21879 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:18.507738 21879 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:18.469651 21831 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:18.464072 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:18.508591 21831 pending_rounds.cc:85] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 1
I20260709 13:08:18.508873 21831 pending_rounds.cc:107] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:18.509106 21831 raft_consensus.cc:2889] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:18.483865 21728 leader_election.cc:336] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.924s (SENT)
I20260709 13:08:18.446419 23555 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:18.520241 23493 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.450930 23469 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:35796 (request call id 0) took 3574 ms. Trace:
W20260709 13:08:18.440287 23574 log.cc:927] Time spent T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.480s	user 0.000s	sys 0.002s
I20260709 13:08:18.509832 21879 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:18.511425 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:18.511680 23598 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:08:18.510016 21728 leader_election.cc:336] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.934s (SENT)
W20260709 13:08:18.931885 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 421863us
W20260709 13:08:18.933467 21728 leader_election.cc:336] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.970s (SENT)
I20260709 13:08:18.516086 23449 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:18.518290 23489 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:18.466295 23542 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:18.502189 23460 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5.
I20260709 13:08:18.446597 23534 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:18.944151 23534 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:18.420856 23595 consensus_queue.cc:1059] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.135s
I20260709 13:08:18.945415 23595 consensus_queue.cc:1243] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer 8c6c2207af3d47b3acf352d81959f4dd log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:18.526289 23447 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:18.946404 23447 raft_consensus.cc:697] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:18.947413 23447 consensus_queue.cc:237] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:18.531700 23457 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:18.949779 23591 raft_consensus.cc:3055] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:18.581255 23548 raft_consensus.cc:697] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:18.950256 23591 raft_consensus.cc:740] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:18.951035 23548 consensus_queue.cc:237] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:18.951190 23591 consensus_queue.cc:260] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:18.952320 23591 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:18.583413 23227 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:18.574355 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:19.004649 21834 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
W20260709 13:08:18.600782 23596 log.cc:927] Time spent T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:08:19.005712 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:18.528641 21879 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:19.074594 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 545974us
I20260709 13:08:19.075532 21879 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:18.595655 21836 raft_consensus.cc:2368] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 5.
W20260709 13:08:18.547272 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.581511 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:19.125264 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:19.125963 21839 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:19.126796 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:19.127830 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:19.128372 21839 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:08:18.525274 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:18.535780 21907 raft_consensus.cc:1240] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:19.133219 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 841) took 1053 ms. Trace:
I20260709 13:08:19.133610 21907 rpcz_store.cc:276] 0709 13:08:18.079298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.446193 (+366895us) service_pool.cc:224] Handling call
0709 13:08:18.502761 (+ 56568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.132941 (+630180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.133161 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.133988 23453 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.134624 23453 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:19.136873 23453 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:19.138484 23268 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.138991 23268 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:19.141335 23268 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:18.535066 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:18.524408 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 105864us
I20260709 13:08:18.615613 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:18.555677 22485 raft_consensus.cc:1240] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:19.150918 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:18.531827 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:19.149276 22448 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:19.152868 23486 raft_consensus.cc:2804] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:18.445855 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:18.393468 22477 rpcz_store.cc:276] 0709 13:08:16.612327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.624838 (+ 12511us) service_pool.cc:224] Handling call
0709 13:08:17.345237 (+720399us) spinlock_profiling.cc:243] Waited 7.8 ms on lock 0x7b5800004898. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232a22 00007fc6b414bc09 00007fc6b32a5ee0 00007fc6b336f0ab 00007fc6b336f131 00007fc6b3330fc0 00007fc6b331b929 00007fc6b331b3d2 00007fc6ac892bd4
0709 13:08:17.345461 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:17.387715 (+ 42254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:17.393509 (+  5794us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:17.398568 (+  5059us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:17.401512 (+  2944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:18.382440 (+980928us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b5400510c54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:18.382492 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:18.382637 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86456960}
W20260709 13:08:18.747103 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.840801 21877 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:19.161792 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 321049us
I20260709 13:08:19.162994 21877 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:19.163826 21877 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:18.850257 21840 raft_consensus.cc:2410] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:08:19.166647 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:18.855381 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:18.870677 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:18.873493 21909 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45202 (request call id 191) took 2493 ms (client timeout 1529 ms). Trace:
I20260709 13:08:18.887935 21765 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:19.169633 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:19.170081 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 830) took 1700 ms. Trace:
I20260709 13:08:18.905581 21905 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:18.908380 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:19.169291 21909 rpcz_store.cc:269] 0709 13:08:16.379568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.379733 (+   165us) service_pool.cc:224] Handling call
0709 13:08:18.873284 (+2493551us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b5400033c54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:18.873408 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3987323136}
I20260709 13:08:19.170864 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:19.171366 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 842) took 1067 ms. Trace:
I20260709 13:08:19.171525 21761 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:19.171872 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:19.171804 21905 rpcz_store.cc:276] 0709 13:08:18.103608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.904906 (+801298us) service_pool.cc:224] Handling call
0709 13:08:18.905199 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.171080 (+265881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.171304 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:19.172845 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:18.925721 21913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 827) took 2173 ms. Trace:
I20260709 13:08:19.173341 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:19.173580 21913 rpcz_store.cc:276] 0709 13:08:16.752775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.773684 (+ 20909us) service_pool.cc:224] Handling call
0709 13:08:18.925557 (+2151873us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54001ebed4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:18.925664 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":911093120}
I20260709 13:08:18.929067 21911 raft_consensus.cc:1240] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:18.934168 21728 leader_election.cc:336] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.978s (SENT)
I20260709 13:08:18.960446 21912 raft_consensus.cc:1275] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:18.960867 22483 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:08:19.173046 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:19.170447 21765 rpcz_store.cc:276] 0709 13:08:17.469389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.887232 (+1417843us) service_pool.cc:224] Handling call
0709 13:08:18.887583 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.169824 (+282241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.170028 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:18.993651 21914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1227) took 1430 ms. Trace:
I20260709 13:08:18.996304 21661 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52326 (request call id 149) took 9766 ms. Trace:
I20260709 13:08:19.178819 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:19.177829 21914 rpcz_store.cc:276] 0709 13:08:17.563622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.597363 (+ 33741us) service_pool.cc:224] Handling call
0709 13:08:18.993382 (+1396019us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b540032da54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:18.993561 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455593216}
I20260709 13:08:19.173046 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:19.180893 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:19.180447 21911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1220) took 1684 ms. Trace:
I20260709 13:08:19.180198 21835 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:19.182770 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:19.183423 21759 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:19.180203 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:19.184605 21760 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:19.184434 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:19.185106 21759 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.022627 22484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 630) took 1026 ms. Trace:
I20260709 13:08:19.185847 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:19.185711 22484 rpcz_store.cc:276] 0709 13:08:17.995838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.995991 (+   153us) service_pool.cc:224] Handling call
0709 13:08:17.996321 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:18.164199 (+167878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.022328 (+858129us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54004c5c54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:19.022557 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":316756736}
I20260709 13:08:18.610916 23310 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:19.203613 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:19.203953 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:19.204370 21905 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:19.204559 21912 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:18.703130 23332 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:18.955873 23227 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:18.966886 23316 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:19.409929 23316 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:18.877199 23423 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:19.416603 21840 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 1.
I20260709 13:08:18.723042 23433 raft_consensus.cc:3055] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:18.774927 23458 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:18.631619 23430 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.494290 23430 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:18.527954 23469 rpcz_store.cc:276] 0709 13:08:14.876301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.877186 (+   885us) service_pool.cc:224] Handling call
0709 13:08:16.357853 (+1480667us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b58000467d0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae2b30aa 00007fc6ae335447 00007fc6ae35270a 00007fc6ae35376a 00007fc6ae35291b 00007fc6ae35e03c 00007fc6ae35d6b3 00007fc6ae3559fa 00007fc6b331d4c9 00007fc6ac899c54
0709 13:08:16.363070 (+  5217us) log.cc:844] Serialized 487 byte log entry
0709 13:08:18.450851 (+2087781us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10399,"raft.run_cpu_time_us":1779,"raft.run_wall_time_us":137724,"spinlock_wait_cycles":2587907456,"thread_start_us":126899,"threads_started":1,"wal-append.queue_time_us":148521,"wal-append.run_cpu_time_us":1544,"wal-append.run_wall_time_us":1001554}
I20260709 13:08:18.898995 23479 raft_consensus.cc:3055] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:19.503108 23479 raft_consensus.cc:740] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:19.504027 23479 consensus_queue.cc:260] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:19.505074 23479 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:18.629037 23522 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:18.557039 23562 consensus_queue.cc:237] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:18.622423 23554 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:18.609337 23571 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:18.786338 23172 raft_consensus.cc:3055] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:19.512931 23172 raft_consensus.cc:740] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:18.633116 23183 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:19.513890 23571 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:19.515674 23183 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:18.595288 23491 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:19.518733 23491 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:19.519699 21838 raft_consensus.cc:2368] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 5.
I20260709 13:08:18.612896 23492 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:19.526729 22485 raft_consensus.cc:2393] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 5: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:19.527813 23492 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:18.638717 23493 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:19.003237 23531 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.775697 23527 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:19.531325 23531 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:18.601374 23539 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:19.533512 23531 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:19.533780 21834 raft_consensus.cc:2410] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:19.535323 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:19.536552 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:18.609371 23543 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:18.975256 23542 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:18.879349 23576 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:19.003954 23595 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:19.542057 23595 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:19.544272 23595 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:18.625032 23585 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:19.551651 23585 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:18.828177 23592 raft_consensus.cc:3055] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:18.876411 23579 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.569099 23598 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:19.553956 23579 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:19.553869 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:19.555297 21834 raft_consensus.cc:2393] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:18.972080 23591 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.043586 21660 catalog_manager.cc:5697] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 2 to 3, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 3 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.557962 23591 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:19.558543 21660 catalog_manager.cc:5697] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 1 to 3, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 3 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.560446 23591 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:19.047611 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.051522 23415 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:19.088433 23457 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:19.085038 23616 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:08:19.090399 23449 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:19.565073 23449 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.565229 21906 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:19.565505 23449 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:19.091092 23570 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.569690 23570 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:19.572279 23570 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:19.572062 23449 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:19.108870 23447 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.573024 23447 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:19.574100 23449 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:19.574923 23447 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:19.109149 23556 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.130167 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:19.575489 23556 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:19.577163 23556 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:19.131587 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:19.577809 21833 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:19.129156 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:19.578598 21839 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:19.146309 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:19.579645 21831 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:19.149724 21908 raft_consensus.cc:2376] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2. Re-sending same reply.
I20260709 13:08:19.153245 23486 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.581080 23486 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:19.176367 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 242209us
W20260709 13:08:19.585505 21728 leader_election.cc:336] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 2.059s (SENT)
I20260709 13:08:19.585901 21728 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:19.586840 21728 leader_election.cc:336] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 2.069s (SENT)
W20260709 13:08:19.587560 21728 leader_election.cc:336] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 2.092s (SENT)
W20260709 13:08:19.588227 21728 leader_election.cc:336] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 2.137s (SENT)
I20260709 13:08:19.588554 21728 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:18.985944 21758 raft_consensus.cc:1240] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:19.591344 21758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 829) took 2122 ms. Trace:
I20260709 13:08:19.591638 21833 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:19.181921 21911 rpcz_store.cc:276] 0709 13:08:17.491878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:17.492020 (+   142us) service_pool.cc:224] Handling call
0709 13:08:18.928890 (+1436870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.174866 (+245976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.175771 (+   905us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54001ebed0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:19.175903 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3303917824}
I20260709 13:08:19.188360 21765 raft_consensus.cc:1240] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:19.189703 21763 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:19.192776 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:19.593823 21913 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:19.007990 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:19.594185 23595 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:19.594691 23595 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:19.205713 22480 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:19.205094 23310 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:19.209465 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 58205.6us
I20260709 13:08:19.596849 23595 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:19.560849 21660 catalog_manager.cc:5697] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 2 to 3, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 3 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.599162 21806 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:19.599002 21660 catalog_manager.cc:5697] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 2 to 3, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 3 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.221668 21764 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:19.601181 23423 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:19.600829 21660 catalog_manager.cc:5697] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.601716 23423 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:19.603703 23423 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:19.604149 23423 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:19.604538 23423 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:19.602259 21660 catalog_manager.cc:5697] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 2 to 3, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 3 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.179695 23453 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:19.181039 23268 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:19.231252 21759 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:19.234530 21879 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:19.606066 23268 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:08:19.606396 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 371930us
I20260709 13:08:19.239096 21835 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
W20260709 13:08:19.243819 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 80039us
I20260709 13:08:19.240374 23617 consensus_queue.cc:1059] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:19.607503 21906 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:19.607906 23617 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.608506 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1232) took 1165 ms. Trace:
I20260709 13:08:19.154217 22448 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:19.609107 23531 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:19.261348 23621 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:19.609591 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:19.610018 23621 raft_consensus.cc:697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:19.610842 23621 consensus_queue.cc:237] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:19.611498 23469 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:19.261294 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 97525.1us
W20260709 13:08:19.271834 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 208530us
I20260709 13:08:19.614701 21877 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:19.224436 23555 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.616554 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:19.617209 23449 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:19.617030 23555 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:19.617633 23449 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.618033 23449 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:19.177907 21661 rpcz_store.cc:276] 0709 13:08:09.230300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.230440 (+   140us) service_pool.cc:224] Handling call
0709 13:08:09.819651 (+589211us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5400002210. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab2330b2 00007fc6b41aca89 00007fc6b4144da6 00007fc6b4116088 00007fc6b421437e 00007fc6b26d52a4 00007fc6b26d5232 00007fc6b26d5161 00007fc6b26d50dc
0709 13:08:18.996216 (+9176565us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:12.950816 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:12.951803 (+   987us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:12.951874 (+    71us) write_op.cc:435] Acquired schema lock
0709 13:08:12.951902 (+    28us) tablet.cc:662] Decoding operations
0709 13:08:12.952697 (+   795us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:12.952812 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:12.952861 (+    49us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:08:13.007176 (+ 54315us) tablet.cc:701] Row locks acquired
0709 13:08:13.007258 (+    82us) write_op.cc:260] PREPARE: finished
0709 13:08:13.007482 (+   224us) write_op.cc:270] Start()
0709 13:08:13.014950 (+  7468us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b54002ae0a8. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b47139e1 00007fc6b471264c 00007fc6b1da2624 00007fc6b1d8d286 00007fc6b1d8cd58 00007fc6b1d919f1 00007fc6b1d919a9 00007fc6b1d91939 00007fc6b1d91901 00007fc6b1d90b2d 000000000038f354
0709 13:08:13.015220 (+   270us) write_op.cc:276] Timestamp: P: 1783602493007411 usec, L: 0
0709 13:08:13.015267 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:08:13.085573 (+ 70306us) log.cc:844] Serialized 1341 byte log entry
0709 13:08:13.368179 (+282606us) op_driver.cc:464] REPLICATION: finished
0709 13:08:13.524156 (+155977us) write_op.cc:301] APPLY: starting
0709 13:08:13.524279 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:13.526534 (+  2255us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:13.526581 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:13.600422 (+ 73841us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:13.600693 (+   271us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:08:13.600756 (+    63us) write_op.cc:312] APPLY: finished
0709 13:08:13.601030 (+   274us) log.cc:844] Serialized 35 byte log entry
0709 13:08:13.601215 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:13.601301 (+    86us) write_op.cc:454] Released schema lock
0709 13:08:13.601354 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:13.601764 (+   410us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:13.601798 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":186984,"reported_tablets":10,"spinlock_wait_cycles":24553728,"child_traces":[["op",{"apply.queue_time_us":126871,"apply.run_cpu_time_us":2742,"apply.run_wall_time_us":85355,"num_ops":3,"prepare.queue_time_us":526849,"prepare.run_cpu_time_us":28123,"prepare.run_wall_time_us":342938,"raft.queue_time_us":83698,"raft.run_cpu_time_us":24483,"raft.run_wall_time_us":48083,"replication_time_us":352772,"spinlock_wait_cycles":11358080,"thread_start_us":530388,"threads_started":4,"wal-append.queue_time_us":175927,"wal-append.run_cpu_time_us":76050,"wal-append.run_wall_time_us":1510210}]]}
I20260709 13:08:19.273883 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:19.619141 23555 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:19.244495 21756 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:08:19.321586 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 158972us
I20260709 13:08:19.620826 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:19.299784 23496 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.621770 23496 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:19.609624 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 455522us
I20260709 13:08:19.623185 21833 raft_consensus.cc:1275] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:08:19.623560 21833 pending_rounds.cc:85] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 2
I20260709 13:08:19.623777 21833 pending_rounds.cc:107] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:08:19.623936 23496 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:19.280556 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:19.624771 21905 raft_consensus.cc:2393] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:19.354545 23460 consensus_queue.cc:1059] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:19.624688 21660 catalog_manager.cc:5697] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 2 to 3, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 3 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.627063 23493 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:19.413094 23316 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:19.627578 23493 raft_consensus.cc:697] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:08:19.432241 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 159543us
I20260709 13:08:19.628525 23493 consensus_queue.cc:237] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:19.629686 21832 raft_consensus.cc:2410] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:19.627594 23460 raft_consensus.cc:3055] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:19.634541 23460 raft_consensus.cc:740] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:19.635226 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:19.431236 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 184864us
I20260709 13:08:19.635288 23460 consensus_queue.cc:260] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:19.635919 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:19.636616 23460 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.636700 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:19.637337 22477 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:08:19.637670 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:19.638260 21831 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:19.638324 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:19.638799 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38348 (request call id 1429) took 1047 ms. Trace:
I20260709 13:08:19.638958 22485 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:08:19.639153 21831 rpcz_store.cc:276] 0709 13:08:18.591119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.580217 (+989098us) service_pool.cc:224] Handling call
0709 13:08:19.637540 (+ 57323us) spinlock_profiling.cc:243] Waited 56.5 ms on lock 0x7b5800005498. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232a22 00007fc6b414bc09 00007fc6b32a5ee0 00007fc6b336f0ab 00007fc6b336f131 00007fc6b331d0a0 00007fc6b331c984 00007fc6ac8976d4 00007fc6ac897662
0709 13:08:19.638752 (+  1212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129839360}
I20260709 13:08:19.640442 21831 raft_consensus.cc:1240] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
W20260709 13:08:19.641119 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.642040 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:19.642606 22483 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:19.433887 23227 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:19.643813 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:19.644407 21907 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:19.644764 23227 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:19.456729 21762 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:19.486562 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:19.485122 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:19.646080 21840 raft_consensus.cc:3055] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:19.646376 21840 raft_consensus.cc:740] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:19.646597 23585 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:19.647110 23585 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:19.647171 21840 consensus_queue.cc:260] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:19.648152 21840 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:19.649150 23585 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:19.522238 23172 consensus_queue.cc:260] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:19.524907 21837 raft_consensus.cc:1240] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:19.530720 21838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38348 (request call id 1410) took 1176 ms. Trace:
I20260709 13:08:19.650180 21838 rpcz_store.cc:276] 0709 13:08:18.354739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.358765 (+  4026us) service_pool.cc:224] Handling call
0709 13:08:19.524431 (+1165666us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400339ad4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:19.530655 (+  6224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2559819136}
I20260709 13:08:19.529738 21912 raft_consensus.cc:1240] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:19.522274 23430 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:19.651907 22482 raft_consensus.cc:2393] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:19.652645 23430 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:19.537961 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.539660 22479 raft_consensus.cc:2410] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:08:19.653656 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:19.553061 23592 raft_consensus.cc:740] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:19.655460 23172 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.655252 23592 consensus_queue.cc:260] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:19.656656 23592 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.555979 23598 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:18.559329 23583 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:19.556293 23579 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:19.102461 23533 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:19.658849 23583 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:19.660128 21837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2184) took 1246 ms. Trace:
I20260709 13:08:19.660547 21837 rpcz_store.cc:276] 0709 13:08:18.414133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.414399 (+   266us) service_pool.cc:224] Handling call
0709 13:08:19.524586 (+1110187us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.649899 (+125313us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.659922 (+ 10023us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400339ad0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:19.660073 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2552184832}
I20260709 13:08:19.607080 21879 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:19.661559 21805 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:19.661868 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:19.662880 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 633) took 1666 ms. Trace:
I20260709 13:08:19.663057 23543 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:19.663419 23579 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:19.664034 21805 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:19.663497 23543 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:19.664762 23543 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.664995 21835 raft_consensus.cc:1240] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:19.664999 23579 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:19.608376 23617 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:19.249316 21909 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:19.591676 21758 rpcz_store.cc:276] 0709 13:08:17.469067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.651464 (+1182397us) service_pool.cc:224] Handling call
0709 13:08:18.651743 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.589217 (+937474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.591114 (+  1897us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b540028e454. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:19.591284 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":768090880}
I20260709 13:08:19.663329 22476 rpcz_store.cc:276] 0709 13:08:17.996784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.010518 (+ 13734us) service_pool.cc:224] Handling call
0709 13:08:18.895962 (+885444us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b5800004898. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232a22 00007fc6b414bc09 00007fc6b32a5ee0 00007fc6b336f0ab 00007fc6b336f131 00007fc6b3330fc0 00007fc6b331b929 00007fc6b331b3d2 00007fc6ac892bd4
0709 13:08:18.896159 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:19.661859 (+765700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.661897 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:19.661951 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:19.661987 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:19.662645 (+   658us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b54004fd8d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:19.662700 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:19.662825 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1794975360}
I20260709 13:08:19.669831 23583 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:19.672035 23183 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:19.673056 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:19.674598 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:19.676110 21837 raft_consensus.cc:1275] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:19.276023 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:19.676190 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:19.676858 21910 raft_consensus.cc:2393] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:19.678151 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:19.678696 21837 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:19.679558 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:19.505916 21650 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a218be1e72294b138c21b46dfa317d11 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 13:08:19.680068 21832 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:08:19.680438 21650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 174546us
I20260709 13:08:19.489842 23433 raft_consensus.cc:740] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:19.681561 23433 consensus_queue.cc:260] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:19.682691 23433 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:19.683950 21840 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:19.659318 22479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36278 (request call id 199) took 1186 ms. Trace:
I20260709 13:08:19.685575 22479 rpcz_store.cc:276] 0709 13:08:18.473303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.502040 (+ 28737us) service_pool.cc:224] Handling call
0709 13:08:19.659121 (+1157081us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54005eae54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:19.659256 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2312577280}
I20260709 13:08:19.606496 23268 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.686964 21837 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:19.688272 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:19.624595 22448 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:19.697089 23268 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:19.690037 23539 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:19.675889 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:19.690615 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 102403us
W20260709 13:08:19.692713 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 50991.2us
I20260709 13:08:19.693346 21729 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:19.693158 23458 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:19.706284 21914 raft_consensus.cc:1240] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:19.707149 21729 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:19.693161 23496 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:19.693795 23310 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:19.693920 23555 consensus_queue.cc:1048] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:08:19.694497 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 87499.7us
I20260709 13:08:19.723404 21879 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:19.724495 21879 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:19.694957 23457 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:19.725241 21879 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:19.608866 21906 rpcz_store.cc:276] 0709 13:08:18.442731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.855155 (+412424us) service_pool.cc:224] Handling call
0709 13:08:19.608341 (+753186us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b5400195ad4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:19.608453 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914071296}
I20260709 13:08:19.699139 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:19.725332 21660 catalog_manager.cc:5697] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.727223 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:19.728529 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:19.697996 21880 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:19.701815 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:19.702280 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:19.702260 21836 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:19.703303 23486 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:19.705505 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 80987.9us
I20260709 13:08:19.689607 23491 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:19.707769 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:19.751169 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:19.751986 21914 raft_consensus.cc:2393] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 2: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:08:19.752439 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.752629 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:19.708170 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:19.708783 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:19.707370 23539 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:19.709858 21729 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
W20260709 13:08:19.711056 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.754037 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:19.754494 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 44708.2us
I20260709 13:08:19.754868 21906 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:19.711315 21728 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:19.712106 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 46684.8us
I20260709 13:08:19.755895 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:19.712656 21806 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:19.624003 21833 raft_consensus.cc:2889] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:19.756265 21805 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:19.730400 21912 raft_consensus.cc:2393] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:19.732805 22448 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:19.758437 22448 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:19.761807 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 49249.4us
I20260709 13:08:19.762722 22448 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:19.761768 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:19.762584 21806 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:19.770118 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:19.757154 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:19.776417 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:19.776566 21833 raft_consensus.cc:1275] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:19.777076 21835 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:19.836210 21832 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:08:19.836336 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 55843.9us
W20260709 13:08:19.777755 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 52574.1us
W20260709 13:08:19.836427 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 51542.7us
I20260709 13:08:19.837726 21804 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:19.838197 22449 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.20.40.62:38057, user_credentials={real_user=slave}} blocked reactor thread for 67098.1us
I20260709 13:08:19.834486 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:19.837218 21879 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:19.840698 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 61607.1us
I20260709 13:08:19.842774 21804 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:19.731514 23522 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:19.841789 22448 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:19.855024 22448 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:19.710841 23583 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:19.789762 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:19.731859 23534 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:19.769976 23415 raft_consensus.cc:2764] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 13:08:19.856789 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 61395.1us
I20260709 13:08:19.884990 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:19.769949 23453 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:19.892524 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 55363.8us
W20260709 13:08:19.886576 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.750718 23548 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:19.889376 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:19.902806 21906 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:19.903885 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:19.904848 21906 raft_consensus.cc:2410] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:08:19.835471 23316 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:19.886093 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:19.835700 23595 raft_consensus.cc:2804] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:19.843786 23556 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:08:19.778254 23647 log.cc:927] Time spent T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:08:19.843338 23562 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:19.905524 21909 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:19.723083 23496 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:19.769630 23527 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:19.917312 21877 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:19.778510 23430 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:19.854267 23522 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.769639 23489 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:19.922271 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 167214us
I20260709 13:08:19.769711 23585 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:19.853788 23491 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:19.940621 21877 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:19.852952 23618 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:19.852820 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:19.890715 23469 raft_consensus.cc:2804] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:19.929100 21879 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:19.914322 23316 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:19.731731 23310 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:19.843068 23598 consensus_queue.cc:1059] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:08:19.961709 21914 raft_consensus.cc:2376] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3. Re-sending same reply.
I20260709 13:08:19.938961 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:19.845221 23576 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:08:19.927480 23591 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.843660 23227 consensus_queue.cc:1059] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:08:19.843465 23542 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:08:19.778168 23531 consensus_queue.cc:1048] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.115s
I20260709 13:08:19.893091 23453 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.940232 21729 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:19.914104 23493 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:19.961102 23469 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:19.884974 23447 consensus_queue.cc:1059] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:08:19.926872 21913 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:19.916282 23595 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:19.890904 23433 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:19.939478 23522 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:19.983362 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 272119us
I20260709 13:08:19.927690 23527 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.021781 23527 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:20.024649 23650 log.cc:927] Time spent T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:08:20.027513 22506 debug-util.cc:398] Leaking SignalData structure 0x7b08002e3060 after lost signal to thread 20643
I20260709 13:08:19.995482 23591 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:20.028643 22506 debug-util.cc:398] Leaking SignalData structure 0x7b08002e3740 after lost signal to thread 21697
W20260709 13:08:20.029997 22506 debug-util.cc:398] Leaking SignalData structure 0x7b0800376140 after lost signal to thread 21789
I20260709 13:08:20.030166 23591 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:20.030927 23310 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:20.031198 22506 debug-util.cc:398] Leaking SignalData structure 0x7b0800346400 after lost signal to thread 21864
W20260709 13:08:20.031589 22506 debug-util.cc:398] Leaking SignalData structure 0x7b08003957c0 after lost signal to thread 21865
I20260709 13:08:19.995126 23627 consensus_queue.cc:1048] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
W20260709 13:08:20.032663 22506 debug-util.cc:398] Leaking SignalData structure 0x7b0800338bc0 after lost signal to thread 21938
I20260709 13:08:19.976702 23623 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:20.032970 22506 debug-util.cc:398] Leaking SignalData structure 0x7b080036db20 after lost signal to thread 21939
I20260709 13:08:20.030886 23522 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:19.939095 23489 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.033607 23268 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:20.033710 23489 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:20.034066 23496 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:20.015271 23469 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:20.035633 22506 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8f00 after lost signal to thread 22509
I20260709 13:08:19.924817 23621 consensus_queue.cc:1059] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:08:19.943173 23562 raft_consensus.cc:697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:20.036715 23562 consensus_queue.cc:237] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:19.941728 23551 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:20.037667 23551 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.038127 23551 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:20.038707 23486 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:20.003995 23453 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:19.917243 23548 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:20.041292 23548 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:20.041379 21906 raft_consensus.cc:1240] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:19.927851 23458 consensus_queue.cc:1048] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:08:19.963111 23316 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.889289 23457 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:20.005962 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 65783us
I20260709 13:08:20.042899 23423 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:20.042788 23457 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.043406 21729 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:20.013496 23533 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.990698 23491 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.994127 23585 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:19.952153 23555 consensus_queue.cc:1059] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:08:20.020372 23595 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:19.895783 23534 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:20.033212 21905 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:20.035491 21907 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:19.996619 21911 raft_consensus.cc:1240] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:20.033208 23623 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:19.993158 23556 raft_consensus.cc:697] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:08:20.013722 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 55963.2us
I20260709 13:08:20.058719 21910 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:20.058791 21728 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:20.111197 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:20.137604 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 94285.2us
I20260709 13:08:20.020603 23598 raft_consensus.cc:3055] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:20.018873 23651 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:20.149040 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:20.154074 21911 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:08:20.159615 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 100902us
I20260709 13:08:20.161196 21728 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:20.162720 21728 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:20.141084 23548 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:08:20.163750 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 234725us
I20260709 13:08:20.147321 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:20.150218 23463 raft_consensus.cc:2764] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:08:20.134912 23310 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:08:20.154045 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:20.166242 23543 consensus_meta.cc:287] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.003s
I20260709 13:08:20.133893 23533 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.157594 23598 raft_consensus.cc:740] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:20.175334 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:20.134732 23491 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:20.155997 23623 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:20.165966 23651 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.171531 23636 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:20.171799 23496 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:20.216799 23533 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:20.178747 23548 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:20.228335 22479 raft_consensus.cc:2393] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 4: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:20.221660 23496 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:20.230011 23496 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:20.214248 23636 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:20.230985 23636 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:20.231407 23460 consensus_meta.cc:287] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.002s
W20260709 13:08:20.223664 23640 log.cc:927] Time spent T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 13:08:20.233074 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1439) took 1369 ms. Trace:
I20260709 13:08:20.233459 21834 rpcz_store.cc:276] 0709 13:08:18.864006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.612077 (+748071us) service_pool.cc:224] Handling call
0709 13:08:19.612339 (+   262us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:19.612533 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:19.612556 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:19.612953 (+   397us) log.cc:844] Serialized 26 byte log entry
0709 13:08:19.847694 (+234741us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:20.149961 (+302267us) log.cc:844] Serialized 14 byte log entry
0709 13:08:20.150250 (+   289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.150342 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.232844 (+ 82502us) raft_consensus.cc:1685] finished
0709 13:08:20.232866 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:20.233013 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66767,"prepare.queue_time_us":157056,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":3385,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":4748,"thread_start_us":440738,"threads_started":2,"wal-append.queue_time_us":343250}
I20260709 13:08:20.245800 23556 consensus_queue.cc:237] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:20.254560 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.213996 23651 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:20.180933 23543 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.226116 23598 consensus_queue.cc:260] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:20.273470 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 114674us
I20260709 13:08:20.275851 21832 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.273963 23598 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:20.273255 23534 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:20.314299 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 159603us
W20260709 13:08:20.314666 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 152053us
I20260709 13:08:20.278343 23491 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:20.313723 23663 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.328565 21728 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:20.321767 23534 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.320099 23548 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:20.320806 23531 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.313838 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:20.334022 23663 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.325103 23522 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:20.327422 23539 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.329417 23172 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:20.336812 23527 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:20.326237 23666 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.349769 21728 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:20.329228 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:20.339485 21832 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:20.345384 21729 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:20.324458 23489 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.354120 21729 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:20.337965 23669 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:08:20.361289 23543 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:20.350484 23310 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:20.361411 23623 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:20.362134 23669 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:20.362215 23661 raft_consensus.cc:3055] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:20.362636 23669 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.362690 23661 raft_consensus.cc:740] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:20.363116 23669 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:20.363549 23489 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:20.357561 22506 debug-util.cc:398] Leaking SignalData structure 0x7b08002f34a0 after lost signal to thread 23593
I20260709 13:08:20.358976 23491 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:20.350816 23539 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.363700 23661 consensus_queue.cc:260] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.373888 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:20.364137 23469 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:20.375294 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:20.375376 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:20.375633 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:20.375870 21764 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:08:20.376003 21759 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:20.376159 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:20.376441 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:20.376870 21757 raft_consensus.cc:2393] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 2: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:20.376753 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:20.338578 23531 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:20.366845 23527 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:20.363559 23623 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:20.367550 23457 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:20.367740 21804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.006s	sys 0.009s
W20260709 13:08:20.385283 21804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.006s	sys 0.010s
I20260709 13:08:20.372509 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:20.338514 23534 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:20.385849 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 543120us
I20260709 13:08:20.364390 21728 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:20.343698 23316 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:20.387724 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:20.379829 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:20.380167 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:20.388372 21765 raft_consensus.cc:2393] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 4: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:20.355890 23666 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.379041 23522 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:20.381177 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:20.373169 23449 consensus_meta.cc:287] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.755s	user 0.009s	sys 0.002s
W20260709 13:08:20.373488 22506 debug-util.cc:398] Leaking SignalData structure 0x7b08001d1e00 after lost signal to thread 23600
I20260709 13:08:20.386484 21804 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:20.378230 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:20.388093 22449 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:20.396281 22987 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:20.390962 21728 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:20.391091 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:20.396745 22987 raft_consensus.cc:697] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:20.350687 23668 consensus_queue.cc:1059] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:08:20.395110 22476 raft_consensus.cc:1240] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:20.395110 23449 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.398584 23310 raft_consensus.cc:3055] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:20.398957 23310 raft_consensus.cc:740] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:20.399889 23666 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:20.400092 23449 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:20.400554 23617 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:20.394335 23522 raft_consensus.cc:697] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:20.399797 23310 consensus_queue.cc:260] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.373301 23663 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:20.387169 23661 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:20.370155 23551 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:20.401700 21804 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:20.396027 21760 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:20.397037 21765 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:20.401266 21761 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:20.394503 21756 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:20.401230 21908 raft_consensus.cc:1240] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:20.406100 22987 consensus_queue.cc:237] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:20.423308 21804 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:20.407760 23453 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.393002 23491 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:20.401252 23316 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:20.392611 23489 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.434861 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:20.435649 22482 raft_consensus.cc:2393] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 4: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:20.409969 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:20.433705 23617 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:20.437216 23617 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.411196 23531 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:20.437593 23617 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:20.411270 21728 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:20.416208 23310 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.417215 23496 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:20.418012 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:20.426560 23551 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:20.426824 21765 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:20.428371 23534 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:20.432719 21804 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:20.413281 23556 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:20.436600 23491 raft_consensus.cc:697] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:20.436322 23489 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:20.448869 21909 raft_consensus.cc:1240] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:20.431839 23663 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:20.478883 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 46195.2us
I20260709 13:08:20.482590 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:20.449172 23668 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:20.485131 21804 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:20.485002 23522 consensus_queue.cc:237] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.486513 23491 consensus_queue.cc:237] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:20.490829 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:20.475040 23548 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.491561 21757 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:20.492594 22987 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:20.493594 23469 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:20.494002 23531 consensus_queue.cc:1059] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:20.495124 23531 raft_consensus.cc:3055] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:20.495527 23531 raft_consensus.cc:740] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:20.496330 21756 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:20.496439 23531 consensus_queue.cc:260] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.499300 23489 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:20.480793 23636 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:20.501106 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:20.501564 23636 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:20.498400 23556 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:20.492775 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:20.503734 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:20.499300 23496 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:20.505765 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:20.499454 23531 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:20.510908 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:20.483909 23598 raft_consensus.cc:2804] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:20.529327 21758 raft_consensus.cc:2393] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 5: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:20.508001 23453 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:20.535491 23539 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:20.539034 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:20.540467 21758 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:20.541527 21805 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:20.542706 21758 raft_consensus.cc:1240] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:20.507663 23663 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.546053 21839 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:08:20.547945 21839 pending_rounds.cc:85] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 2
I20260709 13:08:20.548220 21839 pending_rounds.cc:107] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:08:20.548588 21839 raft_consensus.cc:2889] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:20.510123 23666 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:20.546737 23316 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:20.539793 23598 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.549325 21758 raft_consensus.cc:1240] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:20.543273 23172 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.551462 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:20.559566 21837 raft_consensus.cc:2410] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:20.552099 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:20.552353 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:20.529172 23556 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.552719 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:20.559471 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:20.561020 21835 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:20.544687 23183 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.553496 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:20.553829 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:20.554780 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.563308 21836 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:20.564529 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:20.548141 23423 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.566560 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:20.497176 23669 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.546965 21832 raft_consensus.cc:1240] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:20.546022 21805 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:20.556186 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:20.551766 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:20.561841 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:20.549832 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:20.565246 21836 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:20.571674 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:20.574093 21805 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:20.558847 23598 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:20.558032 23316 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:20.536347 23548 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.569379 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:20.584394 21837 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:20.569977 21839 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.578918 21836 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:20.578992 21835 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:20.586789 21835 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:08:20.583258 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:20.582855 21805 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:20.587932 21835 raft_consensus.cc:1240] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:20.587932 21832 raft_consensus.cc:2410] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:20.569521 23183 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:20.552949 23663 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:20.580092 21756 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:20.568292 23556 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.578001 23543 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:20.592408 21758 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:20.612018 23554 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:20.612416 23651 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.583983 23316 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:20.567756 23172 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.604787 21805 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:20.632827 23663 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:20.633033 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:20.695444 21757 raft_consensus.cc:2393] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 5: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
W20260709 13:08:20.672313 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.675843 21837 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:20.675725 21839 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:20.698088 21832 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:20.681815 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:20.699563 22448 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:20.702085 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:20.703645 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.682716 23548 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:20.570760 23423 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.684720 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:20.684937 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:20.686223 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:08:20.691382 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 86704.8us
I20260709 13:08:20.705868 23469 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:20.705801 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:08:20.688153 23595 consensus_meta.cc:287] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.534s	user 0.007s	sys 0.004s
I20260709 13:08:20.687805 23554 consensus_queue.cc:1243] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer 6fadfd81c5a645f1806a284ddbb6bf0d log is divergent from this leader: its last log entry 4.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:20.709153 23617 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.706562 23669 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:20.713243 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:20.723354 21834 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:20.723775 22484 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:20.715838 21805 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:20.716187 21758 raft_consensus.cc:1275] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:20.726123 21758 raft_consensus.cc:1240] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:20.717298 21839 pending_rounds.cc:85] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 5
I20260709 13:08:20.727077 21839 pending_rounds.cc:107] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:08:20.720782 21765 raft_consensus.cc:2368] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3.
I20260709 13:08:20.717689 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:20.714277 21760 raft_consensus.cc:2393] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 5: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:20.713649 21757 raft_consensus.cc:1240] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:20.679436 23533 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:20.712796 23579 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:20.727363 21839 raft_consensus.cc:2889] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:20.727415 21805 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:20.705828 23653 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:20.740092 21805 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:20.738569 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:20.739167 21728 leader_election.cc:336] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 2.169s (SENT)
I20260709 13:08:20.691015 23496 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:08:20.712424 23658 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:20.744927 21831 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:20.742180 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:20.749253 21757 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:20.720920 23542 consensus_queue.cc:1059] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:08:20.722064 22479 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:20.732964 23661 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:20.752521 21805 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:20.723855 23595 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:20.763195 23651 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:20.779223 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 861) took 1058 ms. Trace:
I20260709 13:08:20.779487 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:20.779785 23595 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:20.780258 21760 raft_consensus.cc:2393] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 4: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:20.781600 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:20.776818 23598 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.758011 21757 raft_consensus.cc:1275] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:20.758868 23172 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:20.759268 23183 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:20.760937 23617 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:20.747664 23227 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:20.803503 23570 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:20.813216 23570 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:20.761868 23469 raft_consensus.cc:3055] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:20.755900 23661 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.745884 23592 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:20.762681 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:20.763164 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.763334 23621 raft_consensus.cc:3055] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:20.763669 23543 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:20.768301 23316 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.733039 23533 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.770010 23460 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:20.771085 23679 log.cc:927] Time spent T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:08:20.771322 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:20.772840 23449 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.773255 23463 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:20.773979 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:20.820581 23469 raft_consensus.cc:740] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:20.775367 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:20.776134 23585 raft_consensus.cc:697] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 2 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:20.782653 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:20.745311 23653 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:20.840560 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:20.770355 22484 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:20.786154 22482 raft_consensus.cc:1240] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:20.791704 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:20.795118 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:20.843448 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:20.807385 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:20.808775 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:20.809661 23618 consensus_queue.cc:1048] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:08:20.811403 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:20.820063 21840 raft_consensus.cc:2393] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 3: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:20.816011 23570 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:20.822697 21879 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:20.834925 23669 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:20.836077 21838 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:20.774631 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:20.867869 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:20.868486 21913 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:20.824877 23661 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:20.867936 23335 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:20.840998 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:20.872710 21759 raft_consensus.cc:1240] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:20.798059 21804 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:20.826802 23543 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.824293 23621 raft_consensus.cc:740] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:20.779631 21908 rpcz_store.cc:276] 0709 13:08:19.720829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.023651 (+302822us) service_pool.cc:224] Handling call
0709 13:08:20.024053 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:20.433187 (+409134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.778971 (+345784us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b540029b8d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:20.779161 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":866711936}
I20260709 13:08:20.833367 23556 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:20.854398 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:20.855346 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:20.890697 21836 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:20.857143 21879 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:20.833606 23592 raft_consensus.cc:697] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:20.860634 21758 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:20.872926 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:20.874788 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:20.892644 21760 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:20.833350 23479 consensus_queue.cc:1059] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 13:08:20.875710 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 77790.3us
I20260709 13:08:20.846378 23653 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:20.853257 21907 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:20.867843 23570 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:20.893154 21838 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:20.900058 21804 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:20.880749 23621 consensus_queue.cc:260] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.839335 23449 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.882023 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:20.886123 23695 log.cc:927] Time spent T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:08:20.887702 23316 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:20.898712 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:20.846263 23463 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.838840 23460 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.881481 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:20.876871 23543 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:20.868891 21905 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
W20260709 13:08:20.910921 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 53880.2us
I20260709 13:08:20.923506 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:20.983729 21879 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:20.983817 21838 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
W20260709 13:08:20.917037 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.878015 23531 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:20.939888 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:20.907707 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:20.985267 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:20.970793 21836 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:20.995564 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:20.998543 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:20.998672 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:20.999104 21838 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:20.998555 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:21.000638 21879 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:20.902837 23533 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:20.875556 23669 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.002586 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:20.890121 23335 raft_consensus.cc:697] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 2 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:20.902325 23598 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:21.016834 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:20.924906 23556 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:20.905893 23423 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:20.999203 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:21.006388 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:20.996454 23268 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:21.009014 23463 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:21.012818 23623 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:20.963868 23479 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.024066 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:20.924338 23660 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:20.944380 23449 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:20.996939 21908 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:21.020358 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:21.030679 21911 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:20.964077 23661 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:21.028851 23479 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:21.032260 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:21.028030 23652 raft_consensus.cc:3055] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:21.033543 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:21.033950 23479 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:20.996582 23447 consensus_queue.cc:1048] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:08:21.019565 23556 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.004271 23595 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.005034 23531 raft_consensus.cc:697] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:21.033852 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:20.946609 23493 raft_consensus.cc:3055] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:20.999634 23621 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:21.034394 21908 raft_consensus.cc:2410] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:21.033542 23652 raft_consensus.cc:740] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:20.902160 23592 consensus_queue.cc:237] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:21.048193 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:21.036216 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:21.049239 21912 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:20.903309 23570 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:21.035231 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:21.051342 21911 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:21.052390 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:21.036624 21831 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:21.054714 21831 pending_rounds.cc:85] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 4
I20260709 13:08:21.055037 21831 pending_rounds.cc:107] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 13:08:21.055312 21831 raft_consensus.cc:2889] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:21.050266 21880 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:21.027295 23335 consensus_queue.cc:237] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:20.906159 23585 consensus_queue.cc:237] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:21.039772 23556 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:21.045559 22480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 646) took 1206 ms. Trace:
I20260709 13:08:21.046587 21905 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:21.045038 23493 raft_consensus.cc:740] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:21.041358 23595 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.063308 23623 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:21.091219 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 847) took 1391 ms. Trace:
I20260709 13:08:21.094136 21906 rpcz_store.cc:276] 0709 13:08:19.699776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.918356 (+218580us) service_pool.cc:224] Handling call
0709 13:08:20.041199 (+122843us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.041835 (+   636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.090954 (+1049119us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400420ed0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:21.091138 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281208064}
I20260709 13:08:21.037462 23469 consensus_queue.cc:260] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.065168 21907 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
W20260709 13:08:21.205899 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 463049us
W20260709 13:08:21.220206 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.089083 21908 raft_consensus.cc:1240] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:21.065830 23479 consensus_queue.cc:1059] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:08:21.230211 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:21.250139 23651 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:21.250586 23651 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:21.250936 23651 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:21.251163 23554 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:21.251719 23554 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.245822 23548 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:08:21.255044 23554 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:21.206339 23542 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:21.206166 23449 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:21.205833 23591 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.219688 23458 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:21.219935 23423 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:21.218854 23623 raft_consensus.cc:697] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:21.267777 21912 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:21.257635 23463 raft_consensus.cc:3055] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:21.242074 23469 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:21.240339 23460 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:21.099236 23531 consensus_queue.cc:237] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:21.089840 23652 consensus_queue.cc:260] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:21.264886 23316 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:21.287734 23458 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.270123 23449 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.240175 23690 consensus_queue.cc:1048] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:08:21.287531 23423 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.304396 23447 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:21.305195 23463 raft_consensus.cc:740] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:21.282207 23591 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.365571 23623 consensus_queue.cc:237] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.372522 23653 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.373601 23661 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:21.270568 23542 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.377149 23458 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:21.361907 23555 consensus_queue.cc:1175] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" responder_term: 3 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:21.399149 23542 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:21.376679 21838 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:21.380458 23627 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:21.391033 23447 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.400182 23627 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.402226 23627 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:21.365084 21756 consensus_meta.cc:287] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.692s	user 0.011s	sys 0.000s
I20260709 13:08:21.402320 23447 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:21.402840 21756 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:21.320616 23570 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:21.360333 23652 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:21.407008 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:21.411438 21914 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:21.412672 21839 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:21.389926 21908 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:21.359457 23316 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:21.415247 23653 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:21.422878 23661 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.427497 23661 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.429710 23661 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:21.087826 22480 rpcz_store.cc:276] 0709 13:08:19.835272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.841140 (+  5868us) service_pool.cc:224] Handling call
0709 13:08:19.923561 (+ 82421us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:20.141454 (+217893us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.146890 (+  5436us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:20.253580 (+106690us) log.cc:844] Serialized 52 byte log entry
0709 13:08:20.311252 (+ 57672us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:20.315481 (+  4229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.027621 (+712140us) spinlock_profiling.cc:243] Waited 66.7 ms on lock 0x7b54004f0bd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:21.027690 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.027737 (+    47us) raft_consensus.cc:1685] finished
0709 13:08:21.027754 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.041577 (+ 13823us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15660,"raft.queue_time_us":102602,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":6697,"spinlock_wait_cycles":153411456,"thread_start_us":42665,"threads_started":1,"wal-append.queue_time_us":71180,"wal-append.run_cpu_time_us":2135,"wal-append.run_wall_time_us":1045258}
I20260709 13:08:21.430513 23449 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:21.432946 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 202845us
I20260709 13:08:21.434260 21728 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:21.434755 22485 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:21.435487 21728 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:21.438040 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:21.438597 22481 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:21.439703 21806 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:21.383075 23651 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.479349 21728 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:21.481784 21728 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:21.426051 23669 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:21.487316 21728 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:21.489104 21728 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:21.490923 21728 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:21.445150 23469 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.479672 23491 raft_consensus.cc:2764] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:08:21.468201 23653 raft_consensus.cc:2804] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:21.446094 23595 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:21.480139 23690 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:21.481148 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:21.503077 21728 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:21.487830 23666 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:21.518560 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 865) took 1143 ms. Trace:
I20260709 13:08:21.491925 23548 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:21.492170 23533 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:21.519197 21761 rpcz_store.cc:276] 0709 13:08:20.375315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.375425 (+   110us) service_pool.cc:224] Handling call
0709 13:08:21.518319 (+1142894us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b54000a41d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:21.518480 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57655680}
I20260709 13:08:21.500771 23469 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.496197 23669 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:21.501509 23653 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.530290 23651 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:21.433264 23463 consensus_queue.cc:260] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.533360 23666 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:21.535190 23491 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:21.536202 23653 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:21.603152 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 100160us
W20260709 13:08:21.599133 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.604413 21728 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:21.596869 21837 raft_consensus.cc:2955] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 3 to 5, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:21.539288 23533 raft_consensus.cc:697] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:21.627902 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:21.541750 23463 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:21.543481 23669 raft_consensus.cc:697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:21.630223 21728 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:21.542013 22480 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:21.642741 22450 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:21.652073 21728 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:21.653818 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 108659us
I20260709 13:08:21.632918 23591 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:21.657284 21728 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:21.634423 23335 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:21.666739 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.655089 23666 raft_consensus.cc:2804] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:21.668427 23491 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:21.686662 23669 consensus_queue.cc:237] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:21.693753 23715 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:21.673740 23316 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:21.702024 23469 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:21.668367 23704 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:21.702977 23704 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.703442 23704 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:21.703824 21837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56424 (request call id 134) took 1070 ms. Trace:
I20260709 13:08:21.704290 21837 rpcz_store.cc:276] 0709 13:08:20.633830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.734113 (+100283us) service_pool.cc:224] Handling call
0709 13:08:20.734521 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:20.734791 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.734810 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:21.511139 (+776329us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b2c0000e678. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6acc50a11 00007fc6acc60372 00007fc6ae392a01 00007fc6ae35743a 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2
0709 13:08:21.511898 (+   759us) log.cc:844] Serialized 487 byte log entry
0709 13:08:21.596695 (+ 84797us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:21.638870 (+ 42175us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.639157 (+   287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.639230 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.703438 (+ 64208us) raft_consensus.cc:1685] finished
0709 13:08:21.703550 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.703731 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":6166,"spinlock_wait_cycles":2937728,"thread_start_us":84449,"threads_started":1,"wal-append.queue_time_us":140124}
W20260709 13:08:21.680140 23676 log.cc:927] Time spent T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 1.191s	user 0.004s	sys 0.000s
I20260709 13:08:21.713641 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 853) took 1995 ms. Trace:
I20260709 13:08:21.714085 21909 rpcz_store.cc:276] 0709 13:08:19.718642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.941883 (+223241us) service_pool.cc:224] Handling call
0709 13:08:19.977118 (+ 35235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.483264 (+506146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.713236 (+1229972us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b540021a054. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:21.713422 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1084221184}
I20260709 13:08:21.674046 23335 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:21.715889 23718 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:21.716451 23718 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.717525 23335 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:21.718571 21762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 858) took 1346 ms. Trace:
I20260709 13:08:21.718636 23718 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:21.719069 21762 rpcz_store.cc:276] 0709 13:08:20.372530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.372661 (+   131us) service_pool.cc:224] Handling call
0709 13:08:20.372962 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.385109 (+ 12147us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:20.442587 (+ 57478us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.717246 (+1274659us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b1800410f80. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab1e4c0a 00007fc6b4924219 00007fc6ab26ca40 00007fc6ab2674e4 00007fc6ab267455 00007fc6b1d4f3c7 00007fc6ae3619a7 00007fc6ae3710bf 00007fc6ae371038
0709 13:08:21.717476 (+   230us) log.cc:844] Serialized 14 byte log entry
0709 13:08:21.717653 (+   177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:21.717705 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:21.717744 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.718374 (+   630us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b5400359154. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:21.718413 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.718521 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13468,"prepare.queue_time_us":163773,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":36,"raft.queue_time_us":1603,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":72,"spinlock_wait_cycles":47674368,"thread_start_us":452979,"threads_started":2,"wal-append.queue_time_us":492184}
I20260709 13:08:21.679247 23666 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.685859 23433 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:21.675225 23542 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:08:21.726749 23666 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:21.736997 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 81762.3us
I20260709 13:08:21.724825 23316 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:21.729583 23591 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:21.731411 23556 consensus_meta.cc:287] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.002s
I20260709 13:08:21.745319 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:21.745757 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2206) took 1589 ms. Trace:
I20260709 13:08:21.746182 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:08:21.747313 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 898452us
I20260709 13:08:21.746454 21833 rpcz_store.cc:276] 0709 13:08:20.156499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.157710 (+  1211us) service_pool.cc:224] Handling call
0709 13:08:20.157999 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:20.159142 (+  1143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.159172 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:20.168593 (+  9421us) log.cc:844] Serialized 26 byte log entry
0709 13:08:20.372032 (+203439us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:20.372059 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.372102 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:20.765733 (+393631us) spinlock_profiling.cc:243] Waited 9.31 ms on lock 0x7b48001a0358. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b3280aa1 00007fc6b3277b37 00007fc6b32779ca 00007fc6b336f26f 00007fc6b336ef37 00007fc6b338355c 00007fc6b3383508 00007fc6b3383488 00007fc6b3383443 00007fc6b33826ec 00007fc6b22aca96
0709 13:08:21.537442 (+771709us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:21.745534 (+208092us) raft_consensus.cc:1685] finished
0709 13:08:21.745555 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.745702 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":797,"raft.queue_time_us":908,"raft.run_cpu_time_us":1969,"raft.run_wall_time_us":601584,"spinlock_wait_cycles":65235584,"thread_start_us":47988,"threads_started":1,"wal-append.queue_time_us":231231}
I20260709 13:08:21.749387 21877 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:21.749862 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:21.750345 21877 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:21.680552 23533 consensus_queue.cc:237] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:21.745416 23543 consensus_meta.cc:287] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.748s	user 0.012s	sys 0.000s
I20260709 13:08:21.756700 23543 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.740273 23531 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.760778 23531 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:21.762245 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:21.762735 23531 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:21.763211 22477 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:21.745134 23316 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:21.755980 23623 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:21.767872 23623 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:21.753753 23678 log.cc:927] Time spent T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 1.201s	user 0.004s	sys 0.002s
I20260709 13:08:21.768257 23543 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:21.768301 23623 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:21.769644 23621 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:21.745735 23591 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:21.767901 23316 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:21.771510 23591 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:21.771651 23423 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:21.769408 21764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 870) took 1391 ms. Trace:
I20260709 13:08:21.772444 21764 rpcz_store.cc:276] 0709 13:08:20.377980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.378092 (+   112us) service_pool.cc:224] Handling call
0709 13:08:20.378402 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:20.378692 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.378719 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:20.379154 (+   435us) log.cc:844] Serialized 26 byte log entry
0709 13:08:20.424153 (+ 44999us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:20.424190 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:20.424250 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.724517 (+1300267us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:21.769134 (+ 44617us) raft_consensus.cc:1685] finished
0709 13:08:21.769155 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:21.769350 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":13936,"spinlock_wait_cycles":10688512,"thread_start_us":29304,"threads_started":1,"wal-append.queue_time_us":86932}
W20260709 13:08:21.778981 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:21.782101 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 117758us
I20260709 13:08:21.783598 21877 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:21.747754 23556 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:21.803249 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:21.813758 23623 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:21.816799 23623 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:21.821651 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:21.822494 21914 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:21.784893 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:21.827328 21839 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:21.828389 21837 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:21.824395 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:21.835799 21837 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:21.841874 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:21.806500 21907 raft_consensus.cc:1240] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:21.845934 23556 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:21.850674 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:21.851632 21908 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:21.853657 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:21.855548 21837 raft_consensus.cc:2410] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:21.788158 23463 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:08:21.825192 23447 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:08:21.868847 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:21.868901 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:21.868517 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:21.872797 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:21.874545 21839 raft_consensus.cc:2393] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:21.875188 21837 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:21.789577 23723 consensus_queue.cc:1059] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
W20260709 13:08:21.876360 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 88671.8us
I20260709 13:08:21.879469 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:21.862692 23469 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:21.872421 23623 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:21.883605 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:21.886230 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:21.841156 23653 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.889947 23669 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:21.889825 23447 raft_consensus.cc:697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:21.889811 23731 consensus_queue.cc:1059] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:08:21.889753 23730 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:21.889417 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:21.892194 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:21.919883 21837 raft_consensus.cc:2393] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 5: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:21.899641 21877 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:21.905179 23652 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:21.910238 21907 raft_consensus.cc:1275] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:21.910399 21908 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:21.911212 22477 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:21.882795 23533 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:21.940598 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:21.938855 21877 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:21.912288 23627 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:08:21.928791 23268 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:21.930922 23723 raft_consensus.cc:3055] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:21.913364 23469 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.926885 23730 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:21.920071 23669 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:21.951083 23447 consensus_queue.cc:237] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.918912 23623 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.951810 23335 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:21.930588 23652 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:21.942184 23554 consensus_queue.cc:1059] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:08:21.955081 23723 raft_consensus.cc:740] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:21.953991 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:21.945210 23460 consensus_queue.cc:1059] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:08:21.962121 23335 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:21.955686 23463 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:08:21.944523 23533 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.010818 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:21.969277 23723 consensus_queue.cc:260] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:21.965508 23730 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:22.029692 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.012540 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:22.024945 23542 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:08:22.010648 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:22.013938 22477 raft_consensus.cc:1240] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:08:22.023959 23335 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:21.967447 23653 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:22.032034 23469 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:22.069213 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36270 (request call id 388) took 2062 ms. Trace:
I20260709 13:08:22.078425 22476 rpcz_store.cc:276] 0709 13:08:20.006976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.016206 (+  9230us) service_pool.cc:224] Handling call
0709 13:08:20.036214 (+ 20008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.398514 (+362300us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.068641 (+1670127us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b5400510c54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:22.068998 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":817672960}
I20260709 13:08:22.066872 21912 raft_consensus.cc:1240] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:22.068023 21911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1259) took 1292 ms. Trace:
I20260709 13:08:22.063513 21840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38348 (request call id 1461) took 1510 ms. Trace:
I20260709 13:08:22.058904 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38348 (request call id 1457) took 1507 ms. Trace:
I20260709 13:08:22.029191 23533 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:22.032805 23548 consensus_meta.cc:287] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.501s	user 0.012s	sys 0.006s
I20260709 13:08:22.089785 21912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 873) took 1302 ms. Trace:
I20260709 13:08:22.083299 21911 rpcz_store.cc:276] 0709 13:08:20.775884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.053339 (+277455us) service_pool.cc:224] Handling call
0709 13:08:21.059403 (+  6064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:21.061136 (+  1733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:21.061167 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:21.061225 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:21.061253 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.067458 (+1006205us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b540021aa54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:22.067528 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.067815 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3553024}
I20260709 13:08:22.046177 23268 raft_consensus.cc:3055] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:22.064560 23652 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:22.043758 23669 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:22.091432 23268 raft_consensus.cc:740] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:22.083685 21840 rpcz_store.cc:276] 0709 13:08:20.553514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.553630 (+   116us) service_pool.cc:224] Handling call
0709 13:08:22.063010 (+1509380us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54003c1254. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:22.063323 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589772544}
I20260709 13:08:22.090327 21912 rpcz_store.cc:276] 0709 13:08:20.785234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.275017 (+489783us) service_pool.cc:224] Handling call
0709 13:08:22.065560 (+790543us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b5800003998. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232a22 00007fc6b414bc09 00007fc6b32a5ee0 00007fc6b336f0ab 00007fc6b336f131 00007fc6b3330fc0 00007fc6b331b929 00007fc6b331b3d2 00007fc6ac892bd4
0709 13:08:22.066005 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:22.084928 (+ 18923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.087441 (+  2513us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18154240}
I20260709 13:08:22.085606 21834 rpcz_store.cc:276] 0709 13:08:20.551739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.551857 (+   118us) service_pool.cc:224] Handling call
0709 13:08:22.058359 (+1506502us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5400021a54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:22.058600 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375177600}
I20260709 13:08:22.048287 23623 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:22.066341 21880 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:22.067589 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:22.105297 22477 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:22.097154 23268 consensus_queue.cc:260] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.107005 23666 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.108368 23617 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:22.109230 23433 raft_consensus.cc:3055] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:22.109786 23433 raft_consensus.cc:740] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:22.109175 23617 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.111128 23433 consensus_queue.cc:260] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:22.113371 23617 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:22.113592 23653 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:22.114419 23653 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:22.115226 23496 consensus_queue.cc:1059] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:08:22.116341 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 50421.2us
I20260709 13:08:22.048475 23554 raft_consensus.cc:3055] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:22.117094 23554 raft_consensus.cc:740] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:22.117998 21880 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:22.119246 23457 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:22.118824 23554 consensus_queue.cc:260] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.119521 23332 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:22.120384 23548 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:22.120935 23554 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:22.122285 23493 consensus_queue.cc:260] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.124593 23493 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:22.124830 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.126129 23729 raft_consensus.cc:476] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 13:08:22.127509 21879 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:22.128788 23666 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:22.128919 22448 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:22.129462 23332 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:22.117030 23653 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:22.108446 23268 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:22.134956 23723 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:22.068799 23704 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.139991 23433 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:22.146746 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.153605 21805 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:22.155236 23579 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:08:22.156488 21805 leader_election.cc:400] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3.
I20260709 13:08:22.163429 21805 leader_election.cc:403] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:08:22.169602 21906 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:22.147039 23542 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:08:22.184778 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 44989.4us
I20260709 13:08:22.182502 23731 consensus_queue.cc:1059] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:08:22.189049 23731 consensus_queue.cc:1243] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer 6d698a5544b946939790e7a3972db9fb log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:08:22.193538 21879 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:22.198019 23579 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:22.209533 22479 raft_consensus.cc:1240] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:22.212024 23447 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:08:22.217849 23332 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:08:22.218909 23699 log.cc:927] Time spent T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.912s	user 0.003s	sys 0.002s
I20260709 13:08:22.220759 21910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1248) took 1447 ms. Trace:
I20260709 13:08:22.224659 23651 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:22.225394 23651 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.207767 23653 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:22.226918 23653 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.227876 23651 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:22.229017 23653 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:22.211267 23704 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:22.236182 23653 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:22.237203 23653 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:22.239897 23653 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:22.221107 21910 rpcz_store.cc:276] 0709 13:08:20.772995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.773118 (+   123us) service_pool.cc:224] Handling call
0709 13:08:20.782555 (+  9437us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:20.803872 (+ 21317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:20.803906 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:20.804354 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:08:21.080015 (+275661us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:21.080093 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:21.080197 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:21.530355 (+450158us) spinlock_profiling.cc:243] Waited 9.4 ms on lock 0x7b48000b1258. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b3280aa1 00007fc6b3277b37 00007fc6b32779ca 00007fc6b336f26f 00007fc6b336ef37 00007fc6b338355c 00007fc6b3383508 00007fc6b3383488 00007fc6b3383443 00007fc6b33826ec 00007fc6b22aca96
0709 13:08:22.217948 (+687593us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:22.220293 (+  2345us) raft_consensus.cc:1685] finished
0709 13:08:22.220328 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.220530 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20964,"raft.queue_time_us":22607,"raft.run_cpu_time_us":3625,"raft.run_wall_time_us":722036,"spinlock_wait_cycles":55605888,"thread_start_us":263003,"threads_started":1,"wal-append.queue_time_us":420198}
I20260709 13:08:22.213682 23666 consensus_queue.cc:1059] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:08:22.229038 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:22.254590 22477 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:22.252091 23579 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3.
I20260709 13:08:22.254045 21914 raft_consensus.cc:1275] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:08:22.261092 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.260852 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:22.263190 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:22.267566 23548 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.268400 23548 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:22.260916 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 117294us
I20260709 13:08:22.244939 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:22.294739 21805 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:22.301834 23579 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.293514 23548 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:22.292497 23268 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:22.304549 23651 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:22.304667 23579 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.307499 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:22.307643 23651 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.309082 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:22.309525 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 62064.9us
I20260709 13:08:22.312140 23653 raft_consensus.cc:2804] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:22.312644 23653 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.313002 23653 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:22.313992 23579 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:22.316044 23579 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:22.317513 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:22.317732 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.316627 23579 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:22.318351 21806 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:22.319588 23556 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:22.320214 23556 raft_consensus.cc:697] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:22.319600 21806 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:22.323275 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2229) took 1772 ms. Trace:
I20260709 13:08:22.323524 23618 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:22.323988 23618 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.324198 23726 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:22.324513 23556 consensus_queue.cc:237] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:22.325862 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:22.327601 23618 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:22.328433 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:22.329118 21913 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:22.329195 23463 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.329949 23463 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.331166 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:22.294028 23447 consensus_queue.cc:1059] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:08:22.332314 21911 raft_consensus.cc:1275] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:22.337903 23268 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.323753 21763 rpcz_store.cc:276] 0709 13:08:20.550931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.726064 (+175133us) service_pool.cc:224] Handling call
0709 13:08:20.726399 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:20.852740 (+126341us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:08:21.722573 (+869833us) log.cc:844] Serialized 14 byte log entry
0709 13:08:22.002062 (+279489us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:22.002186 (+   124us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:22.002326 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:22.322778 (+320452us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540020bcd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:22.322829 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:22.323052 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":869439,"prepare.queue_time_us":871564,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":34029,"raft.run_cpu_time_us":406,"raft.run_wall_time_us":406,"spinlock_wait_cycles":289976192,"thread_start_us":278750,"threads_started":1,"wal-append.queue_time_us":246963}
I20260709 13:08:22.332295 23463 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:22.334251 23460 raft_consensus.cc:3055] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:22.343014 23423 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:22.355728 23585 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.009s	sys 0.004s
W20260709 13:08:22.356261 23585 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.009s	sys 0.004s
I20260709 13:08:22.349658 23460 raft_consensus.cc:740] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:22.350112 23335 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.374155 23579 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:22.374795 23460 consensus_queue.cc:260] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.375600 21838 raft_consensus.cc:1240] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:22.375970 23335 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:22.376327 23460 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:22.376696 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:22.387253 23729 raft_consensus.cc:3055] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:22.387764 23729 raft_consensus.cc:740] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:22.390724 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:22.391458 21837 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:22.391361 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:22.392218 22479 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:22.393509 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:22.393716 23579 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:22.394265 23579 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:22.395190 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.395103 21806 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:22.396412 23335 consensus_queue.cc:1059] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:22.396883 23579 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:22.397421 23579 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:22.397817 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:22.397682 23423 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.398021 23579 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:22.398914 23493 raft_consensus.cc:3055] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:22.399305 23493 raft_consensus.cc:740] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:22.343315 22477 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:22.400164 23579 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:22.400321 23493 consensus_queue.cc:260] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.401155 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:22.402256 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.402650 21806 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:22.402954 23555 raft_consensus.cc:3055] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:22.403396 23555 raft_consensus.cc:740] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:08:22.405159 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.402295 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:22.400903 23579 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:22.412456 21913 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
W20260709 13:08:22.393203 23735 log.cc:927] Time spent T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.494s	user 0.002s	sys 0.000s
I20260709 13:08:22.324229 23731 consensus_queue.cc:1059] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:08:22.418736 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:22.411288 23579 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:22.421778 23579 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:22.400226 23423 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:22.429265 23548 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:22.429945 23666 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:22.430068 23522 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:22.431504 23669 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.432173 23730 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.434739 23729 consensus_queue.cc:260] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:22.441263 23579 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:22.465564 21835 raft_consensus.cc:1275] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.443583 21832 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:22.468443 23522 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.470777 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:22.445572 23705 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:22.417924 23493 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:22.456173 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:22.460067 23730 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.460083 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:22.461097 23669 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.466782 23423 raft_consensus.cc:2804] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:22.484133 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:22.457052 23268 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:22.485077 21834 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:22.482614 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:22.471371 23651 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:22.497979 23522 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:22.498760 23730 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:22.499428 22482 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:22.499951 23268 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:22.501051 23618 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:22.503222 21837 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:22.490828 23423 raft_consensus.cc:697] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:22.505339 23555 consensus_queue.cc:260] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:22.506157 23423 consensus_queue.cc:237] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:22.506860 23555 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:22.520056 21660 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45778 (request call id 281) took 10248 ms. Trace:
I20260709 13:08:22.521682 21663 catalog_manager.cc:5697] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 2 to 3, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 3 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.529568 21835 raft_consensus.cc:1240] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:22.486771 23666 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:22.532037 21806 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:22.532240 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:22.533968 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:22.535127 21759 raft_consensus.cc:1240] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:22.535027 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:22.535684 21761 raft_consensus.cc:1275] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:08:22.536046 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:22.536108 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.549293 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:22.550101 21839 raft_consensus.cc:2393] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:22.537122 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.551306 21834 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:22.551393 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.537019 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:22.552294 23753 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:22.552713 21765 raft_consensus.cc:2376] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5. Re-sending same reply.
I20260709 13:08:22.538561 21760 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:22.552722 23753 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:22.553799 23753 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:22.554265 21907 raft_consensus.cc:2393] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:22.555279 21908 raft_consensus.cc:2393] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 4: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:22.538726 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:22.556583 21905 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:22.537875 21911 raft_consensus.cc:1275] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:08:22.557615 21911 pending_rounds.cc:85] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 2
I20260709 13:08:22.557921 21911 pending_rounds.cc:107] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:08:22.540519 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:22.558233 21911 raft_consensus.cc:2889] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:22.543005 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:22.543720 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:22.553112 21757 raft_consensus.cc:1240] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:22.541759 21764 raft_consensus.cc:1240] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:22.549909 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.541527 21913 consensus_queue.cc:237] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:22.472388 23705 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.563613 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:22.485829 23548 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:22.574783 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:22.570521 21914 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:22.571966 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.568882 21756 raft_consensus.cc:1813] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Handling vote request from an unknown peer 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:22.581758 21910 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:22.584156 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.583912 21663 catalog_manager.cc:5697] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 1 to 2, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 2 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:22.589799 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.590505 23705 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:22.590915 21832 raft_consensus.cc:2393] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 2: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:22.587884 23627 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.592010 21756 raft_consensus.cc:2393] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:22.591861 23627 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.592933 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.593976 23627 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:22.594213 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.595268 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.590854 23651 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.596302 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:22.596459 23651 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.597155 21912 raft_consensus.cc:1275] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:22.598574 23651 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:22.586701 21757 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:22.599635 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.599979 23666 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:22.600203 21757 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:22.601055 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.603253 21756 raft_consensus.cc:1240] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:22.604928 21756 raft_consensus.cc:1275] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:22.606200 21756 raft_consensus.cc:1240] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:22.606467 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:22.576824 23669 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:22.607583 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.608886 23653 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.609747 21757 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:22.596863 21760 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:22.611040 23653 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:22.611829 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.612385 23618 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:22.612514 21879 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.568s (SENT) [suppressed 15 similar messages]
W20260709 13:08:22.613361 23754 log.cc:927] Time spent T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.245s	user 0.001s	sys 0.004s
I20260709 13:08:22.613811 23493 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.614601 23493 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:22.618602 21760 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:22.588874 21663 catalog_manager.cc:5697] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 2 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.622810 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.622598 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:22.621693 21804 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:22.546100 21660 rpcz_store.cc:276] 0709 13:08:12.271931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.272443 (+   512us) service_pool.cc:224] Handling call
0709 13:08:22.519836 (+10247393us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:20.178238 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:20.225110 (+ 46872us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:20.225162 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:08:20.225188 (+    26us) tablet.cc:662] Decoding operations
0709 13:08:20.226515 (+  1327us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:20.226596 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:20.226637 (+    41us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:08:20.227620 (+   983us) tablet.cc:701] Row locks acquired
0709 13:08:20.227646 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:08:20.227829 (+   183us) write_op.cc:270] Start()
0709 13:08:20.227980 (+   151us) write_op.cc:276] Timestamp: P: 1783602500227774 usec, L: 0
0709 13:08:20.228012 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:08:20.364417 (+136405us) log.cc:844] Serialized 3572 byte log entry
0709 13:08:20.938755 (+574338us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b54002ae254. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae352e28 00007fc6b1d8d581 00007fc6b1d8cd58 00007fc6b1d919f1 00007fc6b1d919a9 00007fc6b1d91939 00007fc6b1d91901 00007fc6b1d90b2d 000000000038f354 000000000038f199
0709 13:08:21.245472 (+306717us) op_driver.cc:464] REPLICATION: finished
0709 13:08:21.431259 (+185787us) write_op.cc:301] APPLY: starting
0709 13:08:21.431346 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:21.431551 (+   205us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:21.431571 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:21.435274 (+  3703us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:21.435546 (+   272us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:08:21.435608 (+    62us) write_op.cc:312] APPLY: finished
0709 13:08:21.435915 (+   307us) log.cc:844] Serialized 71 byte log entry
0709 13:08:21.436087 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:21.445006 (+  8919us) write_op.cc:454] Released schema lock
0709 13:08:21.477195 (+ 32189us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:21.479033 (+  1838us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:21.479068 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5063278,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":176319,"apply.run_cpu_time_us":3219,"apply.run_wall_time_us":52604,"num_ops":9,"prepare.queue_time_us":229663,"prepare.run_cpu_time_us":54621,"prepare.run_wall_time_us":769968,"raft.queue_time_us":345477,"raft.run_cpu_time_us":6461,"raft.run_wall_time_us":127554,"replication_time_us":1008011,"spinlock_wait_cycles":64123264,"thread_start_us":409714,"threads_started":4,"wal-append.queue_time_us":203843,"wal-append.run_cpu_time_us":12598,"wal-append.run_wall_time_us":1924068}]]}
I20260709 13:08:22.626852 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.627715 21763 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:22.636333 21759 raft_consensus.cc:1240] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:08:22.597172 23548 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:22.637933 23753 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:22.638567 23618 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:22.638754 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.639534 21757 raft_consensus.cc:2393] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:22.629209 21663 catalog_manager.cc:5697] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 1 to 2, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 2 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.643566 23753 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:22.645790 21663 catalog_manager.cc:5697] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 2 to 3, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 3 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:22.649724 21804 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:22.650993 21760 raft_consensus.cc:2410] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:22.652601 21804 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:22.653327 23423 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:22.654733 21804 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:22.655469 23556 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:22.655750 21762 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:22.656188 23556 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:08:22.658959 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 46471.6us
I20260709 13:08:22.659121 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.659966 21764 raft_consensus.cc:2410] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:22.668008 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:22.668452 21910 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:08:22.640059 23493 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:22.651551 23653 consensus_queue.cc:1059] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:08:22.672371 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:22.678596 22477 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:22.661406 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:22.679428 22480 raft_consensus.cc:2368] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3.
I20260709 13:08:22.678695 23653 raft_consensus.cc:3055] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:22.680768 23653 raft_consensus.cc:740] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:22.684970 21731 leader_election.cc:400] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3.
I20260709 13:08:22.685331 23729 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:22.688274 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:22.685338 21731 leader_election.cc:403] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:22.691751 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:22.692636 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:22.693275 21763 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:22.695187 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.695827 21762 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
W20260709 13:08:22.701912 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 45675.2us
I20260709 13:08:22.702698 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:22.703469 21839 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:22.706851 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.707484 21804 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:22.708256 23556 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:22.706935 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:22.708801 21804 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:22.710130 23423 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:22.710471 23423 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.710672 23579 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:22.710809 23423 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:22.711834 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:22.712662 21757 raft_consensus.cc:2393] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:22.682497 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.714407 21764 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:22.713665 23555 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:08:22.717227 21763 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:22.722126 21877 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:22.723716 23570 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:22.724215 23570 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:22.724660 23570 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:22.723738 23493 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:22.725488 22477 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:22.723881 23268 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:22.725673 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:22.726620 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:22.728102 23554 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:22.729558 21877 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:22.730891 21877 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:22.681674 23653 consensus_queue.cc:260] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.734160 23653 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:22.737768 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:22.742641 22482 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:22.744114 21806 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:22.754571 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.757592 22476 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
W20260709 13:08:22.758718 23762 log.cc:927] Time spent T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:22.747866 23585 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:22.760363 23585 raft_consensus.cc:697] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:22.761113 23618 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:22.761353 23585 consensus_queue.cc:237] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.763876 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.753113 23493 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:22.764089 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.764830 23493 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:22.765224 23493 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:22.765961 21757 raft_consensus.cc:2393] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 5: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:22.767761 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.768354 21761 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:22.770022 21806 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:22.772742 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:22.773522 21763 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:22.774286 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 65689us
I20260709 13:08:22.779337 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.781677 21757 raft_consensus.cc:1275] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:22.784117 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.784777 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.790378 21758 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:22.791067 21765 raft_consensus.cc:2393] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:22.791442 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.791501 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.791834 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:22.792295 21758 raft_consensus.cc:2393] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:22.792294 21762 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:22.792593 21765 raft_consensus.cc:2393] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:22.793545 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.793685 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:22.794066 21762 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:22.794870 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:22.795077 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:22.785055 23555 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3.
I20260709 13:08:22.785777 23618 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:22.786187 23556 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.786451 23753 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.787109 23579 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:22.800105 23579 raft_consensus.cc:697] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:22.801059 23579 consensus_queue.cc:237] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:22.736413 23570 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.805330 23753 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.807121 23570 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:22.807780 23753 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:22.808771 23556 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.811040 23556 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:22.790366 21757 pending_rounds.cc:85] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 1
I20260709 13:08:22.812001 21757 pending_rounds.cc:107] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:22.812294 21757 raft_consensus.cc:2889] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:22.813493 21756 raft_consensus.cc:1275] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:22.814967 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:22.815551 21839 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:22.816783 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:22.793239 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:22.821310 21758 raft_consensus.cc:2393] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 4: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:22.831264 21761 raft_consensus.cc:2393] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:22.835086 21764 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:22.841794 21804 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:22.844497 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.848590 22484 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:08:22.849099 22484 pending_rounds.cc:85] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd: Aborting all ops after (but not including) 4
I20260709 13:08:22.833123 23618 raft_consensus.cc:697] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:22.847138 21729 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:22.849395 22484 pending_rounds.cc:107] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:08:22.854810 22484 raft_consensus.cc:2889] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:22.871361 21763 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:22.857820 23579 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:22.889674 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.891100 23618 consensus_queue.cc:237] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:22.891917 23585 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:22.892617 23570 raft_consensus.cc:2955] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:22.908885 21839 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:22.861832 23555 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:22.914705 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.919348 21759 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
W20260709 13:08:22.925089 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 125923us
W20260709 13:08:22.933753 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.938277 23423 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:22.945396 23423 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:22.918625 23268 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:08:22.972319 21877 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:22.989637 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.993817 21729 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:22.996059 23463 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:22.928884 23585 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:23.010470 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.023029 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 61931.8us
I20260709 13:08:23.028579 21804 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:23.008212 23460 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.018258 23548 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:23.020222 23554 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.006160 23493 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:23.055866 21729 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:23.029582 23755 consensus_queue.cc:1059] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:08:23.063576 23460 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:23.066851 23585 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:23.068343 23772 log.cc:927] Time spent T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.138s	user 0.003s	sys 0.000s
I20260709 13:08:23.068495 23460 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:23.069283 23460 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.071889 23460 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:23.068496 23585 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.073823 23585 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:23.076769 23585 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:23.091749 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 48119.2us
I20260709 13:08:23.088212 21804 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:23.105496 23769 log.cc:927] Time spent T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.170s	user 0.003s	sys 0.000s
I20260709 13:08:23.107174 22476 raft_consensus.cc:2955] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:23.109874 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:23.085541 23423 raft_consensus.cc:3055] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:23.086145 23666 raft_consensus.cc:2764] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:08:23.115991 22484 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:23.064141 23554 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:23.085882 23579 raft_consensus.cc:2804] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:23.092574 23460 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:23.123967 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 118179us
I20260709 13:08:23.120349 23423 raft_consensus.cc:740] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:23.139287 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.138123 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.143334 21729 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:23.143181 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 55083.9us
I20260709 13:08:23.149611 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.161854 21804 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:23.162981 23753 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:23.135872 23579 raft_consensus.cc:697] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:23.164780 23423 consensus_queue.cc:260] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:23.176398 23423 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:23.181792 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.172719 21804 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:23.184501 23653 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:23.185153 23653 raft_consensus.cc:697] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:23.186267 23653 consensus_queue.cc:237] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:23.187292 23556 consensus_queue.cc:1048] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:23.175001 23755 consensus_queue.cc:1048] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:23.193845 21880 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:23.195600 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.196641 21804 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:23.162684 23463 raft_consensus.cc:697] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:23.197631 23335 raft_consensus.cc:2804] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:23.198215 23335 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.198611 23335 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:23.205497 23666 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:23.206023 23666 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.206219 23755 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:23.206486 23666 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:23.206740 23755 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.207181 23755 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:23.213158 21804 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:23.214270 23753 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:23.214773 23753 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.215173 23753 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:23.125782 23618 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:23.249630 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bfdda4b9a4f14b5c90c55134ebfd6303 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:23.252914 23755 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:23.256235 23335 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:23.258406 23335 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:23.198558 23463 consensus_queue.cc:237] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:23.292969 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.267136 23755 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:23.218104 23579 consensus_queue.cc:237] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:23.275501 23555 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.306352 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:23.306986 22477 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:23.304936 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:23.317140 21832 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:23.266938 23618 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:08:23.277281 23493 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:23.334496 21832 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:23.335870 21877 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:23.336933 23776 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:23.337567 23776 raft_consensus.cc:697] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:23.338904 23776 consensus_queue.cc:237] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:23.349716 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.356176 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 89350us
I20260709 13:08:23.375216 22484 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:08:23.376983 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.324304 23555 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:23.384951 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 166395us
I20260709 13:08:23.385694 21804 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:23.387705 23554 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:23.398160 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 136951us
I20260709 13:08:23.398627 22477 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:23.400705 23555 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:23.401630 23797 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:23.402066 23797 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:23.402395 23797 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:23.402472 21833 raft_consensus.cc:1240] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:23.403601 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:23.404336 21833 raft_consensus.cc:2393] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 3: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:23.405756 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:23.406088 21834 raft_consensus.cc:1240] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:08:23.407130 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.408278 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:23.408807 21838 raft_consensus.cc:2376] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3. Re-sending same reply.
I20260709 13:08:23.409538 21840 raft_consensus.cc:1240] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:23.386687 23653 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:08:23.410471 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.411818 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.412724 21831 raft_consensus.cc:2410] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:23.413045 21833 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:23.406039 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 277795us
I20260709 13:08:23.415244 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:23.417443 21832 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:23.413228 21880 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:23.430445 23463 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.432252 23463 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:23.434602 23463 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:23.435091 23554 raft_consensus.cc:2804] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:23.435679 23554 raft_consensus.cc:697] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:23.436648 23554 consensus_queue.cc:237] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:23.437572 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 124934us
I20260709 13:08:23.441617 21836 raft_consensus.cc:1240] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:08:23.442682 21839 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:08:23.412744 23666 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:23.437304 21729 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:23.443188 21839 pending_rounds.cc:85] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 2
I20260709 13:08:23.453955 21839 pending_rounds.cc:107] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:08:23.454298 21839 raft_consensus.cc:2889] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:23.463166 21833 raft_consensus.cc:1275] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:23.469851 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.470685 21836 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:23.471937 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.472728 21838 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:23.473585 21831 raft_consensus.cc:1240] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:23.471827 21832 raft_consensus.cc:1275] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:23.473519 23555 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.479169 23555 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:23.480854 23555 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:23.482216 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:23.482993 22482 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:23.484302 21731 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:23.476037 21877 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:23.489192 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 52009.7us
I20260709 13:08:23.428877 23753 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:23.492383 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.493001 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.491264 21877 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:23.490849 23463 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:23.490586 23555 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:23.485365 23790 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:23.496588 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.498785 23666 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:23.498914 21729 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:23.500000 23548 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:23.500061 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:23.500715 23548 raft_consensus.cc:697] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:23.500949 21831 raft_consensus.cc:2393] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:23.501883 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.502053 21835 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:23.502951 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.503031 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.504168 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.504390 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.497390 23463 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.505103 21837 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:23.505236 23463 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:23.505719 21834 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:23.506090 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.497162 23335 consensus_queue.cc:1048] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:08:23.496138 23784 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:23.509483 23753 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:23.509485 23784 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.494302 23786 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.510555 23784 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:23.497360 23555 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.511598 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.511945 23555 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:23.512398 21840 raft_consensus.cc:2393] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 2: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:23.510684 23786 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:23.513837 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.506790 21839 raft_consensus.cc:2368] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5.
I20260709 13:08:23.515651 23786 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:23.516310 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:23.501663 23548 consensus_queue.cc:237] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:23.513414 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:23.548126 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.552011 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:23.561890 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 58636.4us
I20260709 13:08:23.567214 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.567574 22448 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:23.567472 23806 consensus_queue.cc:1059] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:23.575587 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.596655 23554 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.600206 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.597221 23554 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:23.610308 23797 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:23.612154 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.599494 23801 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:23.682345 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:23.686404 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 123834us
I20260709 13:08:23.695057 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.695922 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.704696 22482 raft_consensus.cc:1275] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:23.696758 23786 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.698154 23776 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:23.699085 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:23.701956 21834 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:23.690407 23570 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.694885 23797 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:23.730193 21729 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:23.707863 23463 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:23.711480 23786 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:23.717097 23570 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:23.719578 23423 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:08:23.716357 23776 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:23.753086 23776 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:23.736352 23554 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:23.755725 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.755406 23555 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:23.758802 23463 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:23.749466 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 50514.4us
W20260709 13:08:23.763489 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.762625 23797 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.766816 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:23.767400 21837 raft_consensus.cc:2376] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3. Re-sending same reply.
I20260709 13:08:23.771637 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:23.772364 21834 raft_consensus.cc:2393] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 3: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:08:23.785249 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:23.767832 23797 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:23.792887 23669 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:23.793747 23669 consensus_queue.cc:1059] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:23.794121 23723 raft_consensus.cc:3055] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:23.794518 23723 raft_consensus.cc:740] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:23.794591 23669 consensus_queue.cc:1059] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:08:23.796284 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 79442.8us
I20260709 13:08:23.821565 21877 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:23.835425 23813 raft_consensus.cc:3055] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:23.835892 23813 raft_consensus.cc:740] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:23.836764 23813 consensus_queue.cc:260] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:23.842974 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:23.851219 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:23.852236 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:23.852972 21910 raft_consensus.cc:2393] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 4: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:23.795426 23723 consensus_queue.cc:260] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:23.833889 23816 raft_consensus.cc:3055] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:23.860939 21906 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:23.860816 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 144145us
I20260709 13:08:23.863061 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:23.863801 21911 raft_consensus.cc:2393] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 4: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:23.866451 21729 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:23.867381 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:23.847518 23463 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:23.847808 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:23.872434 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:23.873256 23570 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:23.877499 23817 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:08:23.847127 23666 consensus_queue.cc:1059] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:08:23.850797 23548 consensus_queue.cc:1059] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:08:23.861752 23816 raft_consensus.cc:740] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:23.864629 23797 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:23.864383 23813 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:23.885107 23798 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.854843 23555 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:23.897732 21906 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
W20260709 13:08:23.898938 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 62024.4us
I20260709 13:08:23.889153 23463 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.907167 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:23.894300 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:23.865268 23669 consensus_queue.cc:1059] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:08:23.894624 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:23.914564 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:23.917347 21911 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:23.901147 23723 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:23.900311 23570 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:23.913869 23463 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:23.932426 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:23.938256 21913 raft_consensus.cc:2393] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 4: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:23.909803 23784 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:23.952883 21805 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:23.908370 23815 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:08:23.961091 21805 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:23.943231 23555 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.963485 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:23.908717 23798 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:23.936167 23825 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:23.968626 21908 raft_consensus.cc:2393] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:23.961344 23556 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:23.969530 23556 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:23.969939 23556 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:23.933707 23469 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:08:23.967917 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:23.924237 23570 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:23.978260 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 52703us
I20260709 13:08:23.978787 21912 raft_consensus.cc:2393] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:24.017081 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:24.017974 21913 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
W20260709 13:08:24.020648 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 89421.7us
W20260709 13:08:24.020957 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 110807us
I20260709 13:08:23.977583 23618 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:23.967267 23555 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:24.029800 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:24.029945 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 68606.2us
I20260709 13:08:24.021730 21728 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:24.031379 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.034750 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:24.030144 23729 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:08:24.035283 21765 raft_consensus.cc:2376] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4. Re-sending same reply.
I20260709 13:08:24.036103 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.036834 21761 raft_consensus.cc:2393] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:24.037668 23815 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.038163 23815 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:24.038755 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:24.039101 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.040019 21761 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:08:24.040360 23815 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:24.041272 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.042016 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.042546 23570 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:24.043488 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.044795 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.045469 21761 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:24.046391 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.047081 21758 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:24.047740 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:24.030431 21759 raft_consensus.cc:2376] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2. Re-sending same reply.
I20260709 13:08:24.048207 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:23.955020 23816 consensus_queue.cc:260] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:24.048632 21906 raft_consensus.cc:2393] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:24.048767 21758 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:24.032909 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.049760 21764 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:24.050902 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.052220 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.053328 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:24.058076 23823 log.cc:927] Time spent T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:08:24.058614 23786 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:24.062496 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:24.064394 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.064930 21759 raft_consensus.cc:1813] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Handling vote request from an unknown peer 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:24.064600 23801 consensus_queue.cc:1059] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:24.064956 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.065393 21759 raft_consensus.cc:2368] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4.
I20260709 13:08:24.066068 23790 raft_consensus.cc:3055] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:24.066272 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:24.066591 23790 raft_consensus.cc:740] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:24.066947 21760 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:24.067585 21805 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:24.067780 23790 consensus_queue.cc:260] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:24.068490 21805 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:24.069780 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.070942 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.071713 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.072384 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.073956 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.075074 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.075279 23579 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:24.075918 23579 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:24.076282 23579 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:24.076212 21805 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:24.077903 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:24.081521 21760 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:24.084967 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:24.086220 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 198142us
I20260709 13:08:24.097470 21764 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
W20260709 13:08:24.103266 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 81610.3us
I20260709 13:08:24.027163 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:24.107142 23423 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:08:24.108712 23819 log.cc:927] Time spent T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:08:24.032092 23828 raft_consensus.cc:3055] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:24.109736 23828 raft_consensus.cc:740] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:24.110600 23828 consensus_queue.cc:260] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:24.111838 23828 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:24.114390 23798 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:24.120889 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.126327 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:24.069326 23790 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:24.107040 23817 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:24.139014 21728 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:24.131656 21663 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45762 (request call id 241) took 11792 ms (client timeout 15000 ms). Trace:
I20260709 13:08:24.141889 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.145124 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:24.115026 23798 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:08:24.098016 23753 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:24.168579 21728 leader_election.cc:400] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5.
W20260709 13:08:24.169850 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.174579 21728 leader_election.cc:403] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:24.175094 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:24.168336 23824 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:24.179970 23824 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:24.180413 23824 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:24.180104 23833 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:24.174552 23809 consensus_queue.cc:1059] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:08:24.184055 23809 raft_consensus.cc:3055] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:24.184429 23809 raft_consensus.cc:740] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:24.193327 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.195176 21728 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:24.195176 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:24.196379 21906 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:24.031973 23825 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.137s
I20260709 13:08:24.202298 23784 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:24.205399 23555 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:24.206501 22477 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:24.206704 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:24.207327 21906 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:24.206521 23833 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:08:24.212343 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.214180 21761 raft_consensus.cc:1275] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:24.216578 23833 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5.
I20260709 13:08:24.217120 21763 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:24.217370 23817 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:24.219971 23548 raft_consensus.cc:3055] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:24.220402 23548 raft_consensus.cc:740] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:24.190481 23824 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:24.223028 23824 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:24.226491 23818 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.221299 23548 consensus_queue.cc:260] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:24.227123 23818 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:24.230577 23818 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:24.231545 21765 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:24.198906 21905 raft_consensus.cc:2393] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:24.233896 21764 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:24.236454 21804 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:24.237540 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:24.238778 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:24.241231 21804 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:24.239101 21906 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:24.243366 21906 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:24.251973 23618 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:24.243608 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:24.247677 23797 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:24.248804 21911 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:24.259544 21911 raft_consensus.cc:1240] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:24.250046 23548 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:08:24.252341 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.185333 23809 consensus_queue.cc:260] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:24.250275 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.264827 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:24.278723 21764 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.280176 21911 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:24.219986 21728 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:24.322546 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 102620us
I20260709 13:08:24.171111 23423 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.281520 21912 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:08:24.283720 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:24.284348 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.328482 21760 raft_consensus.cc:2393] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:24.271152 21913 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:24.289181 21764 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:24.298071 21758 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:24.286080 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:24.306666 23579 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:24.277937 23753 raft_consensus.cc:2804] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:08:24.140117 21663 rpcz_store.cc:269] 0709 13:08:12.338854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.339103 (+   249us) service_pool.cc:224] Handling call
0709 13:08:24.131598 (+11792495us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:22.929787 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:22.930748 (+   961us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:22.930804 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:08:22.930828 (+    24us) tablet.cc:662] Decoding operations
0709 13:08:22.931530 (+   702us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:22.931640 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:22.931667 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:08:22.932258 (+   591us) tablet.cc:701] Row locks acquired
0709 13:08:22.932305 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:08:22.932464 (+   159us) write_op.cc:270] Start()
0709 13:08:22.932607 (+   143us) write_op.cc:276] Timestamp: P: 1783602502932408 usec, L: 0
0709 13:08:22.932641 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:08:22.933365 (+   724us) log.cc:844] Serialized 2049 byte log entry
0709 13:08:23.425056 (+491691us) op_driver.cc:464] REPLICATION: finished
0709 13:08:23.520149 (+ 95093us) write_op.cc:301] APPLY: starting
0709 13:08:23.520288 (+   139us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:23.520531 (+   243us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:23.568051 (+ 47520us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:23.596121 (+ 28070us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:23.596394 (+   273us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:08:23.596454 (+    60us) write_op.cc:312] APPLY: finished
0709 13:08:23.596793 (+   339us) log.cc:844] Serialized 47 byte log entry
0709 13:08:23.596986 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:23.597085 (+    99us) write_op.cc:454] Released schema lock
0709 13:08:23.597140 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:23.597516 (+   376us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:23.597541 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":140306,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":91806,"apply.run_cpu_time_us":3759,"apply.run_wall_time_us":77351,"num_ops":5,"prepare.queue_time_us":264215,"prepare.run_cpu_time_us":23361,"prepare.run_wall_time_us":159116,"raft.queue_time_us":199116,"raft.run_cpu_time_us":42471,"raft.run_wall_time_us":112738,"replication_time_us":460243,"thread_start_us":392884,"threads_started":4,"wal-append.queue_time_us":163791}]]}
I20260709 13:08:24.282524 23554 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.334756 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:24.335414 21764 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:24.330273 21757 raft_consensus.cc:2376] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3. Re-sending same reply.
W20260709 13:08:24.331866 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 90705.7us
I20260709 13:08:24.336184 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.325584 21728 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:24.331115 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:24.339564 21758 raft_consensus.cc:2393] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 5: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:24.321115 23809 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:24.320559 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.342052 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:24.336941 21804 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:24.342708 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.348963 21757 raft_consensus.cc:2376] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6. Re-sending same reply.
I20260709 13:08:24.350287 21804 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:24.351331 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:24.351392 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.352428 21758 raft_consensus.cc:2393] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:08:24.344336 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 266930us
I20260709 13:08:24.353978 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.332086 23813 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:24.345398 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:24.356243 21759 raft_consensus.cc:2393] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:24.355047 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.356463 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:24.356896 21765 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:24.357894 21764 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:24.313129 23556 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:24.363627 21879 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.000s	sys 0.011s
W20260709 13:08:24.364038 21879 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.000s	sys 0.012s
I20260709 13:08:24.364874 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.362588 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:24.342581 23753 raft_consensus.cc:697] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:24.368095 21760 raft_consensus.cc:2393] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 5: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:24.372067 21765 raft_consensus.cc:1240] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:24.336275 23423 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:24.367555 21804 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:24.374164 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 293574us
I20260709 13:08:24.363765 23797 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:24.359681 23618 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:24.390627 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.398522 21764 raft_consensus.cc:1813] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Handling vote request from an unknown peer 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:24.398977 21764 raft_consensus.cc:2368] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4.
I20260709 13:08:24.362087 23832 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:24.359192 21756 raft_consensus.cc:2376] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3. Re-sending same reply.
I20260709 13:08:24.403172 21765 raft_consensus.cc:1240] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:08:24.405241 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.416937 23834 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:08:24.417369 23841 log.cc:927] Time spent T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:08:24.348948 23554 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:24.421547 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.428938 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:24.429564 21764 raft_consensus.cc:2376] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5. Re-sending same reply.
I20260709 13:08:24.377846 23829 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:24.434643 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:24.435209 21764 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:24.436124 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:24.438843 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 63705.3us
I20260709 13:08:24.437364 21764 raft_consensus.cc:1275] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:24.421380 23833 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.422331 23840 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:24.448084 21879 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:24.369395 21912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:08:24.451308 21912 raft_consensus.cc:606] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:24.451762 21912 raft_consensus.cc:614] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:24.432090 23832 raft_consensus.cc:697] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:24.458858 23816 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:24.461977 23837 log.cc:927] Time spent T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:08:24.465772 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.491499 23618 raft_consensus.cc:697] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:24.486657 21758 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:24.508322 21880 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:24.501116 22450 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:24.514554 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 141383us
I20260709 13:08:24.456807 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:24.517885 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 69879.1us
I20260709 13:08:24.425875 23834 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:24.492524 23618 consensus_queue.cc:237] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:24.447386 23842 consensus_queue.cc:1048] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:08:24.446560 23833 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:24.533632 23856 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:24.549365 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:24.553452 21906 raft_consensus.cc:2393] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:24.536679 23579 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:24.559980 23579 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:08:24.562096 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.556967 23833 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:24.557521 23845 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:24.559015 23848 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:24.566838 23845 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.563410 23846 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
W20260709 13:08:24.567834 23838 log.cc:927] Time spent T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:08:24.567369 23845 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:24.546696 23463 consensus_meta.cc:287] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.595s	user 0.012s	sys 0.000s
I20260709 13:08:24.467639 23840 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:24.515688 23753 consensus_queue.cc:237] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:24.550359 21756 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:24.570055 23556 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:24.582752 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 215284us
I20260709 13:08:24.618806 21760 raft_consensus.cc:2410] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:24.620096 22450 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:24.552386 23797 raft_consensus.cc:697] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:24.623291 21906 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:24.627892 23423 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:24.571201 23570 consensus_queue.cc:1059] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:08:24.631826 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:24.633733 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 48625us
I20260709 13:08:24.636300 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:24.637141 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:24.633020 22449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.005s	sys 0.020s
I20260709 13:08:24.639537 21906 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
W20260709 13:08:24.639784 22449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.005s	sys 0.020s
W20260709 13:08:24.640127 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 560714us
I20260709 13:08:24.640686 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:24.640756 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:24.643435 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:24.573843 23463 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:24.645992 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.646538 21838 raft_consensus.cc:2393] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:24.624501 23554 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:24.653673 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:24.650729 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:24.648056 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:24.654822 21839 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:24.655366 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:24.652371 21836 raft_consensus.cc:1275] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:24.650035 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:24.657702 21838 raft_consensus.cc:2410] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:24.631371 23845 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:24.660599 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:24.676011 21914 raft_consensus.cc:2368] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5.
I20260709 13:08:24.657573 23856 raft_consensus.cc:697] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:24.651731 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:24.681944 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 135887us
I20260709 13:08:24.689754 21838 raft_consensus.cc:1240] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:24.690229 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 146720us
I20260709 13:08:24.679032 23785 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:24.692529 21805 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:24.692682 21728 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:24.582660 23832 consensus_queue.cc:237] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:24.698170 21728 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:24.717856 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:24.709133 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:24.718263 21728 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:24.724195 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:24.720101 21836 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:24.725208 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:24.729876 21805 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:24.731902 21909 raft_consensus.cc:2410] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:24.734740 21805 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:24.708217 23833 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:24.723093 23806 raft_consensus.cc:3055] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:24.744460 23863 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:24.750509 21879 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:24.756590 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.758643 21728 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:24.760375 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:24.734778 23463 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:24.770167 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:24.770934 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:24.768990 21729 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:24.774041 21836 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:24.749701 23806 raft_consensus.cc:740] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:24.756280 23854 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:24.751159 23850 raft_consensus.cc:2804] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:24.778630 21729 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:24.777498 21728 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:24.781128 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:24.758106 23818 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:24.781319 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:24.760598 23842 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:24.770957 23853 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:24.757005 23813 raft_consensus.cc:2804] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:24.712327 23797 consensus_queue.cc:237] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:24.785633 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 49766.3us
I20260709 13:08:24.767688 23864 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:08:24.795588 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:24.753798 23715 consensus_queue.cc:1059] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.142s
I20260709 13:08:24.838761 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:24.780794 23834 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:24.756294 23829 consensus_queue.cc:1048] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:08:24.822263 23850 raft_consensus.cc:697] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:24.823345 23824 raft_consensus.cc:2764] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:08:24.825474 23857 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.825970 23836 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:24.826802 23861 log.cc:927] Time spent T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 13:08:24.831681 23855 log.cc:927] Time spent T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:08:24.771770 23815 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:24.795120 23860 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.876554 23860 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:24.877442 23859 log.cc:927] Time spent T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:08:24.725939 23856 consensus_queue.cc:237] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:24.881739 21879 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:24.832089 21907 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:08:24.846131 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:24.796679 23813 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.851387 21837 raft_consensus.cc:1240] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:24.845162 21805 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:24.854442 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 75893us
I20260709 13:08:24.832948 23790 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:24.812217 23840 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:24.825309 23865 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:24.867307 21831 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:24.867621 23850 consensus_queue.cc:237] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:24.870034 21762 raft_consensus.cc:2410] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:08:24.858989 22477 raft_consensus.cc:1275] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:24.856459 23834 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:24.886360 21729 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:24.889026 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:24.903285 21911 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:24.907666 21729 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:24.909169 21729 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:24.901126 23863 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:24.911474 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 66386.3us
I20260709 13:08:24.914695 23865 raft_consensus.cc:697] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:24.914987 21833 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:24.914829 21805 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:24.922741 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 145340us
I20260709 13:08:24.924856 21728 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:24.911522 23860 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:24.887310 23813 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:24.901365 23848 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:24.929749 21729 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:24.917006 23828 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:24.905567 23834 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:24.920521 23840 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:24.918334 23864 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:24.944696 21729 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:24.945523 23815 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:24.946113 23824 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:24.941648 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 85190.5us
I20260709 13:08:24.959105 21879 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:24.948249 21805 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:24.956912 21728 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:24.957094 21729 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:24.921422 23863 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:08:24.947418 23834 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:24.835484 23853 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:24.969350 21805 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:24.903046 23857 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:24.984918 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 100504us
I20260709 13:08:24.887133 23806 consensus_queue.cc:260] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:24.965363 23860 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:24.990628 23888 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:24.989192 21805 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:25.009800 21879 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:24.973125 23784 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:25.033209 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 47592.2us
I20260709 13:08:24.973479 23840 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:25.038647 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 904) took 1189 ms. Trace:
I20260709 13:08:25.040239 23786 raft_consensus.cc:3055] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:25.040526 21831 raft_consensus.cc:1240] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:25.004664 23864 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:25.004285 23828 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:08:25.044584 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 80316.6us
I20260709 13:08:24.963649 23463 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
W20260709 13:08:25.051587 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 44889.2us
W20260709 13:08:25.049988 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 93003.8us
W20260709 13:08:25.057106 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 67972.8us
I20260709 13:08:25.061897 21729 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:25.054057 21905 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:25.050323 23852 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:25.050246 23786 raft_consensus.cc:740] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:25.052737 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:25.060672 23873 log.cc:927] Time spent T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:25.057500 23856 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:25.058450 23828 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.086966 23828 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:25.072136 21729 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:25.054227 23840 raft_consensus.cc:697] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:25.063972 23806 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:24.930660 23865 consensus_queue.cc:237] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:25.069888 23860 consensus_queue.cc:1059] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
W20260709 13:08:25.079618 23881 log.cc:927] Time spent T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:08:25.044417 21908 rpcz_store.cc:276] 0709 13:08:23.845744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.848194 (+  2450us) service_pool.cc:224] Handling call
0709 13:08:25.008084 (+1159890us) spinlock_profiling.cc:243] Waited 71.2 ms on lock 0x7b5400100754. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:25.034867 (+ 26783us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163810176}
I20260709 13:08:25.078405 23880 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:25.130366 21729 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:25.076373 23878 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:25.041421 23888 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:25.158293 21729 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:25.152379 23882 log.cc:927] Time spent T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:08:25.167330 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 157631us
I20260709 13:08:25.105342 23784 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:25.170887 23832 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:25.128314 23816 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:25.128259 23876 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.174623 23469 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.183746 21879 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:25.111783 22476 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:25.172480 23891 consensus_queue.cc:1059] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:25.141752 23879 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:25.182037 23784 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:25.189181 23784 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:25.189708 23857 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:25.190392 23890 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:25.164958 23786 consensus_queue.cc:260] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:25.191674 23786 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.189198 23840 consensus_queue.cc:237] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:25.105963 23845 consensus_queue.cc:1059] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:08:25.212347 21879 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:25.215070 23888 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:25.215873 23854 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:25.216560 23903 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:25.215634 23828 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:25.204821 23818 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:25.211640 23857 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:25.224195 23818 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:25.195832 23469 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:25.229884 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 58000.9us
I20260709 13:08:25.224637 23818 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:25.217120 23903 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:25.230104 23892 raft_consensus.cc:2804] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:25.238308 23892 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.238750 23892 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:25.224460 23857 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:25.245846 23835 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:25.246484 23835 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:25.188530 23876 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:25.258353 23809 consensus_meta.cc:287] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.904s	user 0.008s	sys 0.003s
I20260709 13:08:25.258668 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:25.259303 21759 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:08:25.259753 21759 pending_rounds.cc:85] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 1
I20260709 13:08:25.259996 21759 pending_rounds.cc:107] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:08:25.260275 21759 raft_consensus.cc:2889] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:25.225463 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 188012us
I20260709 13:08:25.223877 21879 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:25.274714 21877 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:25.279484 21877 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:25.286295 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 55083.2us
W20260709 13:08:25.288368 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 118161us
I20260709 13:08:25.291028 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:25.291833 21906 raft_consensus.cc:2393] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:25.277796 23554 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:25.297245 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:25.297263 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:25.301781 21764 raft_consensus.cc:1275] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:25.302647 23903 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:25.303676 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:25.305334 21760 raft_consensus.cc:2376] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3. Re-sending same reply.
W20260709 13:08:25.305459 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 81670.3us
I20260709 13:08:25.260244 23784 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:25.292419 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1276) took 1368 ms. Trace:
I20260709 13:08:25.309990 21763 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:25.313827 23469 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:25.314157 23835 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:25.315069 23876 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:25.317715 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:25.313534 21905 rpcz_store.cc:276] 0709 13:08:23.923021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.234297 (+311276us) service_pool.cc:224] Handling call
0709 13:08:25.011770 (+777473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:25.073531 (+ 61761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.261263 (+187732us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b5400100750. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:25.290956 (+ 29693us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1779469056}
I20260709 13:08:25.319923 21764 raft_consensus.cc:1275] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:25.305353 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:25.304589 21833 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:25.311786 21879 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:25.294023 23845 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:25.322221 23845 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.322775 23845 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.292652 23463 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:25.312772 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:25.329830 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:25.330839 21758 raft_consensus.cc:2410] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:25.335650 21908 raft_consensus.cc:1275] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:25.336105 21908 pending_rounds.cc:85] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 1
I20260709 13:08:25.336371 21908 pending_rounds.cc:107] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:25.336637 21908 raft_consensus.cc:2889] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:25.311674 23850 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:25.312397 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:25.339619 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:25.338001 23857 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:25.339136 23548 consensus_meta.cc:287] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 1.058s	user 0.012s	sys 0.004s
I20260709 13:08:25.343562 21760 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:25.376335 21756 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:25.380995 23842 consensus_meta.cc:287] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.586s	user 0.010s	sys 0.000s
I20260709 13:08:25.373953 23850 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:25.383183 23828 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:25.385272 23786 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:25.327561 23554 consensus_queue.cc:1059] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:08:25.378558 23463 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:25.410135 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 98431.1us
I20260709 13:08:25.388690 21757 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:25.402978 21758 raft_consensus.cc:1240] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:25.385893 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:25.380788 23813 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:25.412884 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:25.417122 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:25.398064 23830 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.413800 21805 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:25.414759 21760 raft_consensus.cc:1275] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:25.343703 23798 consensus_queue.cc:1048] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:08:25.417035 23828 consensus_queue.cc:1059] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:08:25.432967 23828 consensus_queue.cc:1243] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer 6d698a5544b946939790e7a3972db9fb log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:08:25.433527 23828 raft_consensus.cc:3055] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:25.433879 23828 raft_consensus.cc:740] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:25.435214 23798 raft_consensus.cc:2804] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:25.435664 23798 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.436044 23798 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:25.436131 23797 consensus_queue.cc:1059] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:25.437645 23856 raft_consensus.cc:3055] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:25.438089 23856 raft_consensus.cc:740] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:25.439046 23856 consensus_queue.cc:260] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:25.440074 23856 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:25.417198 23829 consensus_queue.cc:1048] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:08:25.434767 23828 consensus_queue.cc:260] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:25.413163 21879 leader_election.cc:400] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4.
I20260709 13:08:25.404330 23842 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:25.446595 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:25.450680 21765 raft_consensus.cc:2393] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:25.410360 23806 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.387040 23899 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 13:08:25.461696 21840 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:25.409842 23786 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:25.468014 23786 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:25.468922 23828 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:25.469866 23853 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:25.471572 21914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 906) took 1621 ms. Trace:
I20260709 13:08:25.471939 21914 rpcz_store.cc:276] 0709 13:08:23.850182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.850324 (+   142us) service_pool.cc:224] Handling call
0709 13:08:25.471349 (+1621025us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b5400112954. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:25.471507 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1858053504}
I20260709 13:08:25.474721 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:25.476897 23850 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:25.477317 21907 raft_consensus.cc:1240] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:25.515690 23834 consensus_meta.cc:287] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.001s
I20260709 13:08:25.516116 23834 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:25.419549 23554 raft_consensus.cc:3055] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:25.479773 23784 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:25.517206 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:25.517416 23554 raft_consensus.cc:740] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:25.518807 23554 consensus_queue.cc:260] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:25.519987 23554 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.521059 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:25.522102 21907 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:08:25.523116 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1294) took 1015 ms. Trace:
I20260709 13:08:25.523546 21909 rpcz_store.cc:276] 0709 13:08:24.507360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.758421 (+251061us) service_pool.cc:224] Handling call
0709 13:08:25.522459 (+764038us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b5800003998. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232a22 00007fc6b414bc09 00007fc6b32a5ee0 00007fc6b336f0ab 00007fc6b336f131 00007fc6b3330fc0 00007fc6b331b929 00007fc6b331b3d2 00007fc6ac892bd4
0709 13:08:25.522641 (+   182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:25.522805 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.522834 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:25.522876 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:25.522911 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.522966 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:25.523060 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2455808}
I20260709 13:08:25.482761 23892 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:25.485678 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:25.525729 21761 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:25.525995 23847 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:25.526585 23847 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:25.528117 23892 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:25.491910 23813 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:25.494648 23872 log.cc:927] Time spent T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.672s	user 0.001s	sys 0.004s
I20260709 13:08:25.485060 21762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44772 (request call id 191) took 1454 ms. Trace:
I20260709 13:08:25.461750 23860 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:08:25.462119 23463 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:08:25.508524 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 95577.6us
I20260709 13:08:25.496260 23905 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.510509 22448 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:25.529772 23852 raft_consensus.cc:3055] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:25.508661 23828 raft_consensus.cc:3055] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:25.488950 21756 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:25.431504 22476 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:25.530205 21762 rpcz_store.cc:276] 0709 13:08:24.031058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.041748 (+ 10690us) service_pool.cc:224] Handling call
0709 13:08:25.484855 (+1443107us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b5400038754. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:25.484971 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1902335744}
I20260709 13:08:25.555363 21758 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:08:25.556309 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 45903.6us
I20260709 13:08:25.514524 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:25.416385 23857 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 13:08:25.566234 23847 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:25.565061 23905 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:25.564898 23828 raft_consensus.cc:740] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:25.568701 21763 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 1.
I20260709 13:08:25.570359 22448 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:25.562964 21879 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:25.416018 23579 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 13:08:25.569075 23828 consensus_queue.cc:260] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:25.449853 23830 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:25.531538 23806 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:25.561396 23852 raft_consensus.cc:740] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:25.734728 23832 consensus_queue.cc:1059] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:08:25.714818 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.735905 23816 raft_consensus.cc:3055] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:25.736296 23816 raft_consensus.cc:740] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:25.564070 23463 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:25.737071 23816 consensus_queue.cc:260] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:25.738272 23816 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:25.731390 23900 raft_consensus.cc:3055] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:25.739168 23900 raft_consensus.cc:740] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:25.591907 23818 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:25.740221 22450 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:25.753593 23804 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:25.754083 23818 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:25.751612 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:25.757969 22478 raft_consensus.cc:1275] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:08:25.647953 23893 log.cc:927] Time spent T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.434s	user 0.002s	sys 0.000s
I20260709 13:08:25.731923 23828 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:25.766541 23804 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:25.593045 21757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 939) took 1287 ms. Trace:
I20260709 13:08:25.591385 23892 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:25.768707 21757 rpcz_store.cc:276] 0709 13:08:24.305738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.351009 (+ 45271us) service_pool.cc:224] Handling call
0709 13:08:25.592867 (+1241858us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54003da254. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:25.592983 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2383529472}
I20260709 13:08:25.541199 23813 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:08:25.773207 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.773978 21805 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:25.774802 21759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2288) took 1385 ms. Trace:
I20260709 13:08:25.775588 21805 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:25.776548 23423 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:25.777189 23839 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:25.777380 23579 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:25.777930 23579 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.778297 23579 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:25.778499 23839 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:25.778995 23839 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:25.775187 21759 rpcz_store.cc:276] 0709 13:08:24.389721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.389845 (+   124us) service_pool.cc:224] Handling call
0709 13:08:24.390170 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:25.261010 (+870840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:25.774583 (+513573us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b54001b99d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:25.774741 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1997792128}
I20260709 13:08:25.782828 23463 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:25.588333 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:25.734328 23830 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:25.645897 23911 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:25.770643 21728 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:25.771658 21765 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:25.788210 23911 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:25.782742 23845 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:25.783515 23798 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:25.784729 21805 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:25.786566 23423 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:25.731582 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 405702us
W20260709 13:08:25.790014 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 227163us
I20260709 13:08:25.792856 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:25.793509 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:25.802825 21837 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:25.809372 21879 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:25.597692 23847 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:25.809577 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:25.803960 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:25.805115 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:25.803845 21835 raft_consensus.cc:1275] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:25.806120 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:25.793524 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:25.816161 21759 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:25.798499 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:25.811757 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:25.819851 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:25.820050 22477 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:25.821821 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:25.812999 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:25.800221 21806 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:25.804407 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:25.804850 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:25.805473 21834 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:25.747929 23834 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:25.794425 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:25.818511 21911 raft_consensus.cc:1275] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:25.819087 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:08:25.899660 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 89349.6us
I20260709 13:08:25.901057 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:25.770766 23806 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:25.844990 21805 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:25.909744 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 139187us
I20260709 13:08:25.910212 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:25.910712 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:25.910064 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:25.834872 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:25.823096 21906 raft_consensus.cc:2393] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:25.825245 21833 raft_consensus.cc:2410] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:25.913969 21906 raft_consensus.cc:1240] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:25.918918 22449 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:25.919665 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 125557us
I20260709 13:08:25.791142 23813 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:25.937801 21913 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:25.940011 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:25.944052 21912 raft_consensus.cc:1275] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:25.820992 23579 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:25.945097 21804 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:25.794694 23824 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.946521 21804 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:25.947306 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:25.947733 21804 leader_election.cc:400] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5.
I20260709 13:08:25.948621 21804 leader_election.cc:403] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:08:25.950018 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 149878us
I20260709 13:08:25.798718 23845 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:25.808014 23842 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:25.813417 23869 raft_consensus.cc:3055] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:25.951048 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:25.953994 21911 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:25.956103 21912 raft_consensus.cc:2393] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:25.815003 23847 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.813159 23830 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.149s
I20260709 13:08:25.957015 23856 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:25.796069 23911 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:25.796916 23798 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:25.963881 21909 raft_consensus.cc:1275] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:08:25.967746 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 158426us
I20260709 13:08:25.989547 21879 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:25.991364 21836 raft_consensus.cc:2368] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6.
I20260709 13:08:25.735167 23852 consensus_queue.cc:260] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:25.949669 23892 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:26.004871 23876 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:25.985128 23847 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:25.972878 23853 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:26.008066 23853 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:26.008268 23798 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:26.008641 23853 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:25.985502 23842 raft_consensus.cc:697] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:26.011628 23842 consensus_queue.cc:237] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:25.983222 21831 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:25.984285 21914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:08:26.016271 21914 raft_consensus.cc:606] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:25.949635 23834 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.920272 23891 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:25.993506 21879 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:25.968729 23869 raft_consensus.cc:740] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:26.008773 23798 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.972754 23865 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:25.950498 23797 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:08:26.024689 21761 raft_consensus.cc:1240] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:25.975821 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 57011us
I20260709 13:08:26.039991 22449 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:26.041548 22449 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:25.991776 23850 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:25.740067 23900 consensus_queue.cc:260] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:25.966286 23824 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:26.037313 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 43929.6us
I20260709 13:08:26.049158 21879 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:26.013696 23845 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:26.018965 23840 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.052954 21879 leader_election.cc:400] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4.
I20260709 13:08:26.033418 23905 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:26.034065 23798 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:26.037339 23892 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:26.065387 21909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
W20260709 13:08:26.066771 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 221895us
I20260709 13:08:26.066933 21879 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:26.043025 23918 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.046469 23806 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:26.028223 23834 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:26.076691 22477 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:26.053570 23804 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:26.057344 23895 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:26.096293 21879 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:26.068055 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:26.077224 21908 raft_consensus.cc:1240] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:26.112519 21879 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:26.124153 21879 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:26.125634 21879 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:26.088145 23776 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:26.065820 23785 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:08:26.068908 23840 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:26.090803 23895 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:26.073207 23618 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:08:26.131443 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:26.136719 21761 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:26.067636 23903 consensus_queue.cc:1059] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:08:26.119174 23892 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:26.077833 23918 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:26.155104 23918 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:26.156155 23824 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:26.158669 23840 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:26.132148 23554 raft_consensus.cc:2804] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:26.159302 23554 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.159657 23554 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:26.162249 23813 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:26.138882 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.167001 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:26.167586 22477 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:26.127296 23818 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:26.133868 23863 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:26.149003 23493 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:26.150594 23834 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:26.174803 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:26.137718 23579 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:26.170195 21731 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:26.176218 23834 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:26.176600 23834 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.176918 23834 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:26.181082 21660 catalog_manager.cc:5697] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 1 to 2, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 2 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.136440 23895 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:26.129865 23784 consensus_queue.cc:1048] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:08:26.136094 23776 raft_consensus.cc:697] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:26.171710 23818 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:26.122709 23845 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
W20260709 13:08:26.184697 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.182917 21660 catalog_manager.cc:5697] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 3 to 5, term changed from 2 to 3, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to <none>, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New cstate: current_term: 3 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:26.206792 21833 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:08:26.209201 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:26.210675 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:26.211998 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:26.217672 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:26.219203 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:26.221019 21833 raft_consensus.cc:2410] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:26.211302 21834 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:26.224455 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:26.223935 21660 catalog_manager.cc:5697] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.093688 23869 consensus_queue.cc:260] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:26.226518 21660 catalog_manager.cc:5697] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 2 to 3, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 3 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:26.227959 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:26.186216 23579 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:26.230031 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:26.232378 21840 raft_consensus.cc:2393] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 5: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:26.229756 21660 catalog_manager.cc:5697] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 2 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.222201 23818 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:26.236754 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 289150us
I20260709 13:08:26.235445 21660 catalog_manager.cc:5697] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 2 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.239251 21660 catalog_manager.cc:5697] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 3 to 4, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 4 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.241185 21660 catalog_manager.cc:5697] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 3 to 5, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 5 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.230463 23876 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5.
I20260709 13:08:26.246907 21877 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:26.256361 21660 catalog_manager.cc:5697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.236836 23869 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:26.283679 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:26.285501 21660 catalog_manager.cc:5697] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 1 to 2, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 2 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.225287 23853 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:26.291661 21660 catalog_manager.cc:5697] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 1 to 3, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 3 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.258391 23844 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:26.300556 21660 catalog_manager.cc:5697] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 3 to 4, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 4 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:08:26.303380 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 176392us
I20260709 13:08:26.236132 23579 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:26.305706 21660 catalog_manager.cc:5697] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.307071 21836 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:26.295730 23784 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:26.254441 23918 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:08:26.309614 21660 catalog_manager.cc:5697] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 3 to 4, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 4 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:26.254671 23928 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
W20260709 13:08:26.315337 23839 consensus_meta.cc:287] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.001s
I20260709 13:08:26.317277 23844 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:26.331279 23853 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:26.332038 23924 log.cc:927] Time spent T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 13:08:26.332428 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:26.346513 21760 raft_consensus.cc:2376] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6. Re-sending same reply.
I20260709 13:08:26.317634 21660 catalog_manager.cc:5697] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:26.316555 23784 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:08:26.345646 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 58770.6us
I20260709 13:08:26.342813 21761 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:26.352989 21877 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:26.355046 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:26.317795 23554 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:26.306098 23776 consensus_queue.cc:237] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:26.349541 23784 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:26.358207 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:26.359819 23798 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:26.360618 23925 log.cc:927] Time spent T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:08:26.361055 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:26.346607 23839 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:26.362150 23579 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:26.368455 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:26.374413 21763 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:26.361167 23869 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:26.379526 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:26.379936 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:26.379571 23798 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:26.357347 23934 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:26.392714 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:26.401742 21757 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:26.402611 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:26.396296 23869 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:26.381529 23847 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:26.414881 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:26.415323 23847 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:26.415472 21762 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:26.416193 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:26.416332 23869 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:26.410413 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:26.417222 21756 raft_consensus.cc:2410] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:26.417474 21764 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:26.393932 23840 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.408696 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:26.421896 22448 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:26.405750 21763 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:26.427919 21909 raft_consensus.cc:606] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:26.428359 21909 raft_consensus.cc:614] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:26.427716 22448 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:26.429869 22448 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:26.432263 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:26.432849 21913 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:26.438882 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:26.440021 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:26.437288 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:26.421399 21756 raft_consensus.cc:1275] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:26.410840 22480 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:26.423185 23856 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:26.421095 23840 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:26.457707 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:26.450977 23869 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:26.460294 21764 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:26.382751 23834 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:26.429122 23863 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:26.474830 21757 raft_consensus.cc:1240] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:08:26.450731 23850 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:26.479203 23818 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:26.500778 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:26.501655 21833 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:26.484529 23840 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:26.504725 23840 consensus_queue.cc:1048] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:26.505561 23906 raft_consensus.cc:3055] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:26.505952 23906 raft_consensus.cc:740] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:26.506721 23906 consensus_queue.cc:260] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:26.507848 23906 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:26.445736 23824 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.485569 23929 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:26.485769 23844 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:26.486436 21764 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:26.446112 23847 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:26.492251 21762 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:26.498227 21913 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:26.449342 23790 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:26.499898 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:26.482357 23784 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:26.483951 23839 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:26.455225 23579 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:26.408650 23895 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:26.502988 23863 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:26.529217 21804 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:26.534368 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.740352 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:26.651333 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.741091 21909 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:26.740406 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:26.610759 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 167959us
I20260709 13:08:26.737481 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:26.742480 21728 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:26.740036 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:26.743616 21728 leader_election.cc:400] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6.
I20260709 13:08:26.743933 21728 leader_election.cc:403] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:08:26.600638 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:26.745848 21838 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:26.511528 21756 raft_consensus.cc:1240] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:26.746366 21833 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:26.555233 21913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:08:26.751191 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:26.752271 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 223183us
W20260709 13:08:26.538139 23935 log.cc:927] Time spent T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:08:26.750730 21913 raft_consensus.cc:606] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:26.739678 23845 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.756516 23863 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:26.611074 23847 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:26.756695 23895 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:26.757367 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:26.757719 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:26.761991 21804 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:26.759903 21913 raft_consensus.cc:614] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:26.765903 21804 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:26.686972 23753 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.768807 21914 raft_consensus.cc:1240] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:26.752140 23556 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:26.574648 23929 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:26.765991 23847 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:26.775249 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:26.780157 21840 raft_consensus.cc:1240] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:26.782063 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:26.761088 23866 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:26.764734 23858 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.531718 23824 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:26.767517 23856 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:26.770671 23928 consensus_queue.cc:1059] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 13:08:26.789816 21647 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 291227c6f9914476b4363d40f7cfebb8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6fadfd81c5a645f1806a284ddbb6bf0d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:26.796784 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:26.797567 22482 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:26.760814 23844 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:08:26.759084 23790 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:26.770603 23932 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:26.764544 23853 consensus_queue.cc:1059] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:08:26.751718 23579 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:26.765161 23828 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:08:26.765547 23845 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:26.772847 23842 consensus_queue.cc:1048] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:08:26.783465 23834 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:26.791810 23876 consensus_queue.cc:1048] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:08:26.776765 23618 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:08:26.774350 23753 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:26.812896 23828 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6.
I20260709 13:08:26.814604 23824 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:26.817581 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:26.802268 23941 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:26.820811 22482 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:26.794863 23866 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:26.811762 23579 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:26.838614 21731 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:26.798673 23858 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:26.825017 23818 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:26.829056 23853 raft_consensus.cc:3055] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:26.834509 23929 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:26.856761 23941 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:26.857461 23941 raft_consensus.cc:697] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:26.858554 23941 consensus_queue.cc:237] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:26.809840 21908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:08:26.851071 23853 raft_consensus.cc:740] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:08:26.899712 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 156206us
I20260709 13:08:26.882697 23828 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:26.881999 23945 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.894250 23847 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:26.905473 21908 raft_consensus.cc:606] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:26.910539 23784 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:26.934927 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:26.920125 23945 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:26.942992 23945 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:26.945634 23554 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:26.951727 23852 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:26.940457 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 151050us
I20260709 13:08:26.922075 21764 raft_consensus.cc:2955] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:26.955925 23790 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:26.958678 23960 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.959233 23960 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:26.954157 23948 log.cc:927] Time spent T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:08:26.966918 21804 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:26.917588 23828 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:26.975996 23839 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.977257 21880 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:27.026203 23839 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:27.026691 23900 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:27.028530 23839 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:27.029745 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:27.031217 23753 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:27.031503 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:26.970165 23960 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:27.032506 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:27.033102 22476 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:27.036476 21907 raft_consensus.cc:1240] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:27.039969 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.047914 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:27.049054 23556 raft_consensus.cc:3055] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:27.049527 23556 raft_consensus.cc:740] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:27.050323 23556 consensus_queue.cc:260] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.051440 23556 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:27.051820 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:27.052387 21758 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:27.053316 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:27.053761 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:27.054075 21760 raft_consensus.cc:2393] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 4: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:27.054791 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:27.055172 23790 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.055610 23790 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.055891 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:27.056535 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:27.056964 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:27.057097 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 91074.5us
I20260709 13:08:27.058085 23790 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:27.058154 21806 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:27.059510 23556 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:27.060104 23556 raft_consensus.cc:697] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:27.060310 23423 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:27.060940 23556 consensus_queue.cc:237] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.063563 22448 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:27.065043 23869 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:27.059429 21806 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:27.065569 23869 raft_consensus.cc:697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:27.066119 23797 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:27.066395 23869 consensus_queue.cc:237] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:27.067260 23790 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:27.067999 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:27.068729 21840 raft_consensus.cc:2393] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:27.068580 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:27.066812 23958 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:27.068933 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:27.069191 21832 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:27.067734 23790 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.069221 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:27.070436 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:26.976668 23866 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:27.077615 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 100481us
I20260709 13:08:27.082172 21880 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:27.082377 23921 log.cc:927] Time spent T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 1.079s	user 0.005s	sys 0.000s
I20260709 13:08:27.083546 22485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 699) took 1280 ms. Trace:
I20260709 13:08:27.083674 23798 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.084038 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:27.084182 23798 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:27.086642 23798 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:27.083949 22485 rpcz_store.cc:276] 0709 13:08:25.803315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:25.803418 (+   103us) service_pool.cc:224] Handling call
0709 13:08:25.819776 (+ 16358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:25.820150 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:25.820179 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:25.820657 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 13:08:26.834205 (+1013548us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b180014a0a0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6adeff4bc 00007fc6ab24d48b 00007fc6b40a7ab9 00007fc6ab26969b 00007fc6ab26793f 00007fc6ab269c02 00007fc6adef120b 00007fc6adef6d23 00007fc6adef70d1
0709 13:08:26.834382 (+   177us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:26.834431 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.834522 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.081809 (+247287us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:27.083234 (+  1425us) raft_consensus.cc:1685] finished
0709 13:08:27.083259 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.083391 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20908,"raft.queue_time_us":2766,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":19503,"spinlock_wait_cycles":70214144,"thread_start_us":108283,"threads_started":1,"wal-append.queue_time_us":176798}
I20260709 13:08:27.083495 23958 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.089553 22480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 690) took 2326 ms. Trace:
I20260709 13:08:27.090009 22480 rpcz_store.cc:276] 0709 13:08:24.764186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.775218 (+ 11032us) service_pool.cc:224] Handling call
0709 13:08:25.490298 (+715080us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b5800004898. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232eee 0000000000375939 00007fc6b32a61e0 00007fc6b336f0c4 00007fc6b336f131 00007fc6b3330fc0 00007fc6b331b929 00007fc6b331b3d2 00007fc6ac892bd4
0709 13:08:25.586732 (+ 96434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:26.472085 (+885353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.088497 (+616412us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54006af254. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:27.089317 (+   820us) spinlock_profiling.cc:243] Waited 79.8 ms on lock 0x7b54006af250. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:27.089475 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068009984}
I20260709 13:08:26.966290 23853 consensus_queue.cc:260] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:27.032878 23906 consensus_meta.cc:287] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.004s
I20260709 13:08:27.068496 23856 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.089310 23958 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:27.073648 21728 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:27.093986 21832 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:27.103499 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:27.104120 21833 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:27.104466 21838 raft_consensus.cc:1240] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:27.104599 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:27.098941 21759 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:27.100210 21765 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:27.080235 21758 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:27.108520 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:27.102766 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:27.110193 21834 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:27.103127 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:27.111119 21729 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:27.112318 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:27.112691 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:27.113148 21834 raft_consensus.cc:2410] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:27.111531 21835 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:27.115716 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:27.116586 21831 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:27.120947 21729 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:27.126682 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 53099.1us
I20260709 13:08:27.132663 21833 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:27.133993 22448 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:27.134945 22448 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:27.094388 23853 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:27.137010 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:27.137624 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:27.138199 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:27.138651 21728 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:27.139598 21839 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:27.141808 21729 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:27.142894 21729 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:27.100440 23790 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:27.095741 23828 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:27.146142 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:27.147082 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 64994.7us
I20260709 13:08:27.096882 23493 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:27.121006 23852 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.150321 21728 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:27.182533 21831 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:27.125801 23941 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.099243 23847 consensus_queue.cc:1059] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:08:27.217298 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:27.096628 23856 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.144168 23824 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.140923 23934 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:27.219393 21760 raft_consensus.cc:1275] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:27.220347 21879 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:27.222488 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 72251.6us
I20260709 13:08:27.141762 23906 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:27.143862 23955 raft_consensus.cc:2804] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:27.141556 23850 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:27.242379 21836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2301) took 1036 ms. Trace:
I20260709 13:08:27.246167 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:27.248044 21911 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:27.184106 23960 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:27.150573 23776 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:27.184540 23834 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.226449 23790 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:27.147188 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:27.253993 21879 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:27.184438 23840 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:27.178594 22476 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:27.253095 23906 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:27.212356 23852 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:27.260515 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 111850us
I20260709 13:08:27.262974 23960 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:27.144021 23798 consensus_queue.cc:1059] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.103s
I20260709 13:08:27.184288 23959 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:27.218568 23556 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.211066 23891 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:27.178280 23945 consensus_queue.cc:1059] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 13:08:27.259737 21805 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:27.278795 23899 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:27.290809 21806 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:27.254971 23824 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.279302 23906 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:27.263080 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:27.280776 21877 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:27.297307 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:27.269053 23790 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.282431 23493 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:27.285385 23960 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:27.266503 23955 raft_consensus.cc:697] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:27.218405 23941 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:27.277387 21879 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:27.259261 23850 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.256600 21836 rpcz_store.cc:276] 0709 13:08:26.205800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.206090 (+   290us) service_pool.cc:224] Handling call
0709 13:08:26.206370 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:26.308529 (+102159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.242028 (+933499us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540045bfd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:27.242296 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231174528}
I20260709 13:08:27.290050 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:27.319279 21911 raft_consensus.cc:2468] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:27.298565 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:27.272562 23834 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:27.302728 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:27.314112 21910 raft_consensus.cc:1275] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:27.255599 23934 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.323349 21805 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:27.292812 23891 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:27.332137 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 54782.3us
I20260709 13:08:27.333110 21879 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:27.336073 21912 raft_consensus.cc:1240] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:27.292670 23816 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:27.295976 23854 raft_consensus.cc:3055] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:27.316915 23971 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:27.353696 21879 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:27.353765 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:27.354528 21906 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:27.354883 21879 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:27.337602 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 80221.3us
I20260709 13:08:27.315647 23790 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:27.283644 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:27.296299 23952 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:27.341197 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.329205 23959 raft_consensus.cc:3055] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:27.337872 23891 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:27.340425 21762 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:27.321676 23850 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:27.346364 23962 log.cc:927] Time spent T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:08:27.347930 23964 log.cc:927] Time spent T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:08:27.348685 23965 log.cc:927] Time spent T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:27.341604 23854 raft_consensus.cc:740] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:27.349475 23926 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:08:27.350198 23963 log.cc:927] Time spent T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:08:27.324859 23463 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:27.356561 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 65024.5us
I20260709 13:08:27.326614 23844 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:27.315820 23936 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.369702 21879 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:27.291216 23556 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.339576 23899 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:27.379630 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 123341us
I20260709 13:08:27.337714 23945 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:27.349370 23966 log.cc:927] Time spent T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:08:27.339586 23970 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:27.451975 23970 raft_consensus.cc:697] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:27.453007 23977 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:27.453776 23977 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:27.373461 23900 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:27.455714 23900 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:27.368324 23959 raft_consensus.cc:740] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:27.456522 23977 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:27.457479 23959 consensus_queue.cc:260] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.458685 23959 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:27.458092 23854 consensus_queue.cc:260] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.459694 23854 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:27.352821 23816 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.463099 23816 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:27.365760 23618 consensus_queue.cc:1048] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:08:27.373297 23906 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:27.390017 23813 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.458006 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2312) took 1074 ms. Trace:
W20260709 13:08:27.430729 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 251320us
I20260709 13:08:27.465994 21763 rpcz_store.cc:276] 0709 13:08:26.383793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.803800 (+420007us) service_pool.cc:224] Handling call
0709 13:08:26.804168 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:26.918357 (+114189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.918391 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:26.918875 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:08:26.969293 (+ 50418us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:26.969328 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:26.969400 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.034475 (+ 65075us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b4800002958. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b3280aa1 00007fc6b3277b37 00007fc6b32779ca 00007fc6b336f26f 00007fc6b336ef37 00007fc6b338355c 00007fc6b3383508 00007fc6b3383488 00007fc6b3383443 00007fc6b33826ec 00007fc6b22aca96
0709 13:08:27.457703 (+423228us) raft_consensus.cc:1685] finished
0709 13:08:27.457724 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.457948 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47295,"raft.run_cpu_time_us":988,"raft.run_wall_time_us":180243,"spinlock_wait_cycles":2592512,"thread_start_us":163794,"threads_started":2,"wal-append.queue_time_us":225226}
I20260709 13:08:27.467342 21880 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:27.387498 23972 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:27.430421 23905 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:27.457266 23977 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:27.366376 23971 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.444392 23856 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:27.449455 23926 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.469632 23958 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:27.436869 23463 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.449787 23852 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:27.472245 23844 raft_consensus.cc:697] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:27.475013 23493 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:27.470878 23776 consensus_queue.cc:1059] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 13:08:27.501224 23969 log.cc:927] Time spent T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:08:27.505049 21757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2310) took 1163 ms. Trace:
W20260709 13:08:27.577262 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 109975us
I20260709 13:08:27.445573 23936 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.452919 23970 consensus_queue.cc:237] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.563699 23972 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:27.588083 23978 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:27.495955 23905 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.499321 23977 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:27.475252 23813 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.602030 22449 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
W20260709 13:08:27.603304 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.607095 21833 raft_consensus.cc:1240] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:27.608196 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:27.645093 21834 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
W20260709 13:08:27.646786 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 44839.4us
I20260709 13:08:27.608222 21804 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:27.609622 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 257684us
W20260709 13:08:27.609618 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 167425us
I20260709 13:08:27.647795 22449 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:27.648907 21804 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:27.465703 23945 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:27.616086 23976 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:08:27.618567 23973 log.cc:927] Time spent T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:08:27.618460 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:27.619131 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:27.659094 21906 raft_consensus.cc:1240] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:27.619980 23845 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:27.621981 23906 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:27.431070 23955 consensus_queue.cc:237] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:27.622669 23971 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:27.612010 21757 rpcz_store.cc:276] 0709 13:08:26.341947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.754264 (+412317us) service_pool.cc:224] Handling call
0709 13:08:26.754547 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:26.897111 (+142564us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:26.897158 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:26.897762 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 13:08:27.125935 (+228173us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:27.349041 (+223106us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b1800419320. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab24ce07 00007fc6b40a7ab9 00007fc6ab26969b 00007fc6ab26793f 00007fc6ab267455 00007fc6b1d4f3c7 00007fc6ae3619a7 00007fc6ae3710bf 00007fc6ae371038
0709 13:08:27.468451 (+119410us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.468699 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.468790 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:27.496005 (+ 27215us) raft_consensus.cc:1685] finished
0709 13:08:27.504407 (+  8402us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:27.504976 (+   569us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15755,"prepare.queue_time_us":14631,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":93332,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":21586,"spinlock_wait_cycles":7552256,"thread_start_us":458929,"threads_started":3,"wal-append.queue_time_us":271827}
I20260709 13:08:27.673468 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:27.674228 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:27.626926 23554 consensus_queue.cc:1059] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:27.627599 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:27.634552 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:27.593935 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 224310us
I20260709 13:08:27.651198 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:27.654322 21833 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:27.656335 21804 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:27.659488 21836 raft_consensus.cc:2410] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:08:27.617108 23824 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:27.661276 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:27.633116 23816 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:08:27.663697 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:27.664769 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:27.665462 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:27.637758 23941 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:27.521727 23926 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.639632 23790 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.658360 23804 raft_consensus.cc:2804] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:27.674989 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:28.184465 21908 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:28.185788 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:28.186281 23863 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:28.186866 23863 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:28.187279 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:28.188297 21908 raft_consensus.cc:2393] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 4: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:28.188851 23863 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:28.188925 23960 consensus_meta.cc:287] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.861s	user 0.010s	sys 0.000s
I20260709 13:08:28.054705 23899 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:28.189049 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:28.190578 23899 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:28.191247 21879 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:28.191561 21908 raft_consensus.cc:2393] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:28.192009 23863 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:28.192665 23863 raft_consensus.cc:697] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:28.192878 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:28.193707 23863 consensus_queue.cc:237] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:28.180905 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:28.195607 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 539327us
W20260709 13:08:28.190882 23853 consensus_meta.cc:287] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 1.047s	user 0.009s	sys 0.008s
I20260709 13:08:28.113605 23989 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:27.730938 22476 raft_consensus.cc:1275] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:27.657868 23834 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:27.657825 23929 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:28.194175 23804 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:28.189472 23960 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:28.183593 23813 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:28.194937 21912 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:28.204393 21804 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:28.247824 21914 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
W20260709 13:08:28.218380 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:27.814944 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 143195us
W20260709 13:08:27.714828 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:27.675099 21757 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:28.246697 21831 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
W20260709 13:08:28.247126 22449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.008s	sys 0.001s
I20260709 13:08:27.887579 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:28.249119 21763 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:28.242677 21906 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:28.270309 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:28.246162 21835 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:27.657814 23854 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:27.815675 23973 log.cc:927] Time spent T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:08:28.029253 23928 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.028s	sys 0.042s
W20260709 13:08:27.737028 23987 log.cc:927] Time spent T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 13:08:27.733242 23990 log.cc:927] Time spent T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:08:28.216975 23850 consensus_meta.cc:287] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.828s	user 0.007s	sys 0.003s
I20260709 13:08:27.661947 23952 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.719s
I20260709 13:08:27.661391 23976 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:27.654939 23978 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:27.731472 23844 consensus_queue.cc:237] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:28.034371 23974 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:27.736220 23940 log.cc:927] Time spent T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 1.125s	user 0.004s	sys 0.001s
I20260709 13:08:28.397989 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:28.278657 22449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.008s	sys 0.001s
I20260709 13:08:27.669708 23975 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:08:28.604852 21728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.000s	sys 0.031s
I20260709 13:08:28.153800 23906 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.316494 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:27.815056 23934 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:28.115402 23891 consensus_meta.cc:287] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.728s	user 0.007s	sys 0.002s
I20260709 13:08:29.093973 21914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1317) took 1427 ms. Trace:
W20260709 13:08:28.871498 21729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.014s	sys 0.037s
I20260709 13:08:28.279011 21760 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:28.030876 23852 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:27.943557 23959 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:29.101796 23852 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:27.890074 23936 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:29.102123 23906 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:29.101979 23959 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:29.103914 23852 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:29.104152 23906 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:29.104715 21756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2311) took 2760 ms. Trace:
I20260709 13:08:29.104882 23974 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.733829 23945 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:29.105822 23991 raft_consensus.cc:3055] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:29.106498 23991 raft_consensus.cc:740] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:29.105152 21756 rpcz_store.cc:276] 0709 13:08:26.343965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:26.802425 (+458460us) service_pool.cc:224] Handling call
0709 13:08:26.836326 (+ 33901us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:26.972248 (+135922us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:27.135840 (+163592us) log.cc:844] Serialized 14 byte log entry
0709 13:08:27.364878 (+229038us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:27.469095 (+104217us) log.cc:844] Serialized 26 byte log entry
0709 13:08:27.480175 (+ 11080us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:27.490553 (+ 10378us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:27.498907 (+  8354us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.104453 (+1605546us) raft_consensus.cc:1685] finished
0709 13:08:29.104481 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.104621 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29138,"prepare.queue_time_us":39988,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":100878,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":13176,"thread_start_us":201483,"threads_started":3,"wal-append.queue_time_us":218315}
I20260709 13:08:29.107059 23974 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:29.107618 23974 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.107290 23991 consensus_queue.cc:260] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:28.212705 23899 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:29.108224 23974 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:28.268883 23941 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:28.971908 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 767585us
I20260709 13:08:27.892581 23905 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:28.980348 23928 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.629s	user 0.033s	sys 0.053s
I20260709 13:08:28.214880 23797 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:28.978883 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 726890us
W20260709 13:08:29.099774 21760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 998) took 1382 ms (client timeout 1809 ms). Trace:
W20260709 13:08:29.035066 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 1.36504e+06us
W20260709 13:08:29.099328 21729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.903s	user 0.014s	sys 0.043s
I20260709 13:08:29.094472 21914 rpcz_store.cc:276] 0709 13:08:27.666361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.316194 (+649833us) service_pool.cc:224] Handling call
0709 13:08:29.093905 (+777711us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:28.383620 23834 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:28.421949 23977 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:28.544219 23816 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.287421 23876 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:08:28.853921 23970 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.220s	user 0.003s	sys 0.046s
I20260709 13:08:28.874372 23853 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.100853 23891 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:27.734309 23556 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:29.108561 23991 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:29.105809 23959 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:28.274005 23988 consensus_queue.cc:1059] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.886s
I20260709 13:08:28.706090 23493 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:29.080802 23850 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:29.087978 21728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.137s	user 0.006s	sys 0.039s
W20260709 13:08:28.718276 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:28.968777 24002 log.cc:927] Time spent T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.345s	user 0.000s	sys 0.001s
I20260709 13:08:28.374375 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:28.273312 23804 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:29.117703 21760 rpcz_store.cc:269] 0709 13:08:27.717042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.887274 (+170232us) service_pool.cc:224] Handling call
0709 13:08:29.099711 (+1212437us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:28.546347 23929 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:28.852898 23996 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:29.033859 23960 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:28.297564 23824 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:29.043577 24003 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:29.129691 23934 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:29.129860 23900 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.130792 21879 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:29.056649 23998 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.036934 23926 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:28.553663 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:28.610607 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:28.738235 23790 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:29.037556 24007 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:29.135058 22449 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:29.110319 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:29.140456 22485 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.010s	sys 0.003s
W20260709 13:08:29.137877 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 437724us
I20260709 13:08:29.080190 23950 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.101s
I20260709 13:08:28.554625 23972 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.583s
I20260709 13:08:29.230968 23959 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:29.125066 23899 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:29.200227 21877 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.042s	sys 0.070s
W20260709 13:08:29.243086 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 118605us
W20260709 13:08:29.138666 23970 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.505s	user 0.003s	sys 0.047s
I20260709 13:08:29.240964 23960 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.325901 23988 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:29.246330 23934 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:29.326637 23988 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:29.220496 21761 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.006s	sys 0.009s
W20260709 13:08:29.220712 23993 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.013s	sys 0.015s
W20260709 13:08:29.329785 23993 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.065s	user 0.013s	sys 0.016s
I20260709 13:08:29.116123 23941 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:29.330448 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 989) took 1673 ms. Trace:
I20260709 13:08:29.330845 21761 rpcz_store.cc:276] 0709 13:08:27.656718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.656862 (+   144us) service_pool.cc:224] Handling call
0709 13:08:27.671376 (+ 14514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:27.671562 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:27.746177 (+ 74615us) log.cc:844] Serialized 14 byte log entry
0709 13:08:29.329820 (+1583643us) log.cc:844] Serialized 14 byte log entry
0709 13:08:29.330082 (+   262us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:29.330151 (+    69us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:29.330200 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.330268 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.330387 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":195865,"prepare.queue_time_us":615673,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":253194,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":7107,"spinlock_wait_cycles":86936576,"thread_start_us":1382557,"threads_started":3,"wal-append.queue_time_us":636579}
I20260709 13:08:29.332304 23941 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:29.328526 23934 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:29.131538 23834 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:29.336478 23834 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:29.127710 23975 consensus_queue.cc:1059] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:08:29.235327 21910 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:08:29.213291 23493 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:29.138384 23816 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:29.340783 23816 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:29.251071 21729 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:29.342088 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 91110us
I20260709 13:08:29.343089 21729 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:29.168301 23876 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:29.345098 23493 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:29.347818 23876 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:29.168526 23853 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:29.349362 23493 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:29.351444 23853 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:29.352214 23853 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:08:29.257395 22485 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.010s	sys 0.003s
I20260709 13:08:29.356551 23891 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:29.357450 23891 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:29.361346 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:29.258322 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 123402us
I20260709 13:08:29.258880 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:29.366720 23977 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:29.367451 23977 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:29.260349 24014 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.256554 22476 raft_consensus.cc:1813] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Handling vote request from an unknown peer 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:29.370201 22476 raft_consensus.cc:2368] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4.
I20260709 13:08:29.369935 24014 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:29.231076 23929 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:29.371668 23929 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:29.372848 24014 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:29.374491 21731 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.40.4:37983 timed out after 1.510s (SENT) [suppressed 33 similar messages]
W20260709 13:08:29.266835 21805 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.979s	user 0.019s	sys 0.085s
W20260709 13:08:29.171016 23971 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.336s	user 0.029s	sys 0.063s
W20260709 13:08:29.375955 21805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.088s	user 0.021s	sys 0.096s
W20260709 13:08:29.376111 23971 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.541s	user 0.029s	sys 0.063s
I20260709 13:08:29.309949 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 952) took 1981 ms. Trace:
I20260709 13:08:29.376866 21909 rpcz_store.cc:276] 0709 13:08:27.328766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.329016 (+   250us) service_pool.cc:224] Handling call
0709 13:08:27.884846 (+555830us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b5800003998. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232a22 00007fc6b414bc09 00007fc6b32a5ee0 00007fc6b336f0ab 00007fc6b336f131 00007fc6b3330fc0 00007fc6b331b929 00007fc6b331b3d2 00007fc6ac892bd4
0709 13:08:27.885090 (+   244us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:27.885652 (+   562us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:27.885683 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:28.977224 (+1091541us) log.cc:844] Serialized 52 byte log entry
0709 13:08:29.172829 (+195605us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:29.220977 (+ 48148us) log.cc:844] Serialized 14 byte log entry
0709 13:08:29.246484 (+ 25507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:29.246572 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:29.246626 (+    54us) raft_consensus.cc:1685] finished
0709 13:08:29.309621 (+ 62995us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:29.309868 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":47895,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":9914,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":97,"spinlock_wait_cycles":4461312,"thread_start_us":141825,"threads_started":3,"wal-append.queue_time_us":80327}
W20260709 13:08:29.315217 21877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.042s	sys 0.073s
W20260709 13:08:29.379904 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 1.06263e+06us
I20260709 13:08:29.380764 21877 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:29.132172 23936 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:29.381971 23936 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:29.384685 23936 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:29.166465 23905 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:29.385484 23905 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:29.387864 23905 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:29.388512 23905 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:29.326133 24018 log.cc:927] Time spent T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:08:29.384773 23929 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:29.395855 23977 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:29.352851 23853 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:29.400871 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:29.401970 22476 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:29.403831 21806 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:29.410082 23876 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:29.411087 23876 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:29.413550 23988 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:29.325739 23928 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:28.348308 23989 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:29.400512 23853 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:29.416823 23929 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:29.419984 23928 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:29.434006 23928 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:29.442257 23989 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:29.448163 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:29.323608 21905 raft_consensus.cc:2410] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:29.445959 22480 raft_consensus.cc:2393] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 4: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
W20260709 13:08:29.453078 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 72431us
I20260709 13:08:29.325699 23797 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:29.247304 23900 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:29.245327 24021 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.265455 23906 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:08:29.261912 21907 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:29.315757 23790 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:29.456398 23850 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:29.449833 23853 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:29.452472 23934 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:29.245918 23824 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:29.241456 23996 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:29.462363 21908 raft_consensus.cc:2410] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:29.323369 23959 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:29.250898 23998 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:29.463661 23970 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:29.241159 24003 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:29.447384 23960 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:29.444883 23899 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:29.262933 24007 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:29.475718 23936 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:29.598930 23906 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:30.200886 24015 log.cc:927] Time spent T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.532s	user 0.001s	sys 0.000s
I20260709 13:08:30.200841 23906 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:29.978368 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:29.555451 23556 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.142135 23929 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.142530 23900 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:29.979876 23850 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:29.555111 24021 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:29.647606 21909 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:30.143582 23928 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.145382 23853 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:08:29.647606 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 243877us
I20260709 13:08:29.495867 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1323) took 1828 ms. Trace:
I20260709 13:08:29.554183 23974 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:30.203769 23906 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:29.662304 23979 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:29.532923 23958 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:30.147423 23959 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:30.148108 23852 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:30.149089 21908 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1321) took 2481 ms (client timeout 2436 ms). Trace:
I20260709 13:08:30.150041 24007 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:30.139488 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 1.00876e+06us
W20260709 13:08:30.266664 23905 consensus_meta.cc:287] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.863s	user 0.012s	sys 0.000s
I20260709 13:08:30.152213 23824 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:29.685281 23876 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:30.027357 22485 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.006s	sys 0.003s
I20260709 13:08:30.154538 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:30.281085 22485 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.008s	sys 0.003s
I20260709 13:08:30.155359 23895 raft_consensus.cc:993] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:08:29.943064 23952 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.979411 23858 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:30.145406 23960 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:29.498013 21762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 988) took 2240 ms (client timeout 2125 ms). Trace:
I20260709 13:08:30.216331 23929 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:30.199967 21805 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:30.204483 21912 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:30.241034 21757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 994) took 2573 ms. Trace:
I20260709 13:08:30.289958 23876 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:30.290380 23876 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.239831 24010 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:30.265479 21907 rpcz_store.cc:276] 0709 13:08:27.667779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.372666 (+704887us) service_pool.cc:224] Handling call
0709 13:08:29.488844 (+1116178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:30.290817 23876 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:30.288748 21762 rpcz_store.cc:269] 0709 13:08:27.245794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.246683 (+   889us) service_pool.cc:224] Handling call
0709 13:08:29.485721 (+2239038us) spinlock_profiling.cc:243] Waited 44.1 ms on lock 0x7b5400268c54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:29.485871 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101439360}
I20260709 13:08:30.291111 24010 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:30.291129 23804 consensus_meta.cc:287] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 1.049s	user 0.008s	sys 0.003s
I20260709 13:08:30.292102 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:30.236299 24009 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.212386 23556 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:30.243220 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:30.301554 21909 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:30.240458 23850 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:30.146215 23869 raft_consensus.cc:3055] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:29.621659 23977 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:30.212803 23891 consensus_meta.cc:287] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.854s	user 0.013s	sys 0.001s
I20260709 13:08:30.146435 23860 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:29.571704 23976 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:29.489748 21905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1320) took 1814 ms (client timeout 1850 ms). Trace:
I20260709 13:08:30.205924 23970 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:30.276538 21879 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:30.275393 21908 rpcz_store.cc:269] 0709 13:08:27.667281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.251363 (+584082us) service_pool.cc:224] Handling call
0709 13:08:30.149007 (+1897644us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:30.276062 23958 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:30.268476 23928 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:29.496443 23790 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:30.249166 24003 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:30.264758 23853 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:30.208729 23936 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:29.474298 23797 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:30.281863 22485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 710) took 2014 ms. Trace:
W20260709 13:08:30.289855 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 90012.6us
I20260709 13:08:30.292135 23804 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:30.290272 21757 rpcz_store.cc:276] 0709 13:08:27.667507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.318110 (+650603us) service_pool.cc:224] Handling call
0709 13:08:28.318541 (+   431us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:28.318983 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:28.319021 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:28.412812 (+ 93791us) log.cc:844] Serialized 52 byte log entry
0709 13:08:29.153741 (+740929us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:30.151340 (+997599us) spinlock_profiling.cc:243] Waited 99.4 ms on lock 0x7b1800402be0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6adeff4bc 00007fc6ab24d48b 00007fc6b40a7ab9 00007fc6ab26969b 00007fc6ab26793f 00007fc6ab267455 00007fc6b1d4f3c7 00007fc6ae3619a7 00007fc6ae3710bf
0709 13:08:30.151642 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 13:08:30.240563 (+ 88921us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.240661 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:30.240718 (+    57us) raft_consensus.cc:1685] finished
0709 13:08:30.240829 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.240978 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73839,"prepare.queue_time_us":168501,"prepare.run_cpu_time_us":105,"prepare.run_wall_time_us":2810,"raft.queue_time_us":799598,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":18755,"spinlock_wait_cycles":228727552,"thread_start_us":627690,"threads_started":2,"wal-append.queue_time_us":963952}
I20260709 13:08:30.317093 23891 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:30.277245 23852 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:30.313612 24020 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:30.316423 22450 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:30.287398 24025 raft_consensus.cc:1081] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
W20260709 13:08:30.320674 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 44235.2us
I20260709 13:08:29.680653 24023 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:30.324247 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:30.342130 21762 raft_consensus.cc:2393] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 4: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:30.304488 23869 raft_consensus.cc:740] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:30.334602 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:30.280359 23905 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:30.344852 21757 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
W20260709 13:08:30.318894 21905 rpcz_store.cc:269] 0709 13:08:27.667048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.891124 (+224076us) service_pool.cc:224] Handling call
0709 13:08:29.481219 (+1590095us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:30.330327 22485 rpcz_store.cc:276] 0709 13:08:28.267356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.267513 (+   157us) service_pool.cc:224] Handling call
0709 13:08:28.267879 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:28.268121 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:29.353783 (+1085662us) log.cc:844] Serialized 14 byte log entry
0709 13:08:30.281464 (+927681us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:30.281517 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:30.281572 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.281655 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.281800 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":964553,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":4493,"raft.queue_time_us":3513,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":150,"thread_start_us":1908278,"threads_started":3,"wal-append.queue_time_us":776740}
I20260709 13:08:30.322036 23971 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:30.322274 23970 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:30.336687 24010 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:30.341954 21879 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:30.332198 21805 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:30.342393 21731 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.041s	sys 0.058s
I20260709 13:08:30.325176 23899 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:30.321861 23860 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:30.345407 21728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.121s	user 0.021s	sys 0.048s
I20260709 13:08:30.294286 23952 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:30.280834 23979 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:30.364675 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:30.319453 23977 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:30.375340 23988 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.960s	user 0.026s	sys 0.050s
W20260709 13:08:30.375679 21878 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.032s	sys 0.026s
W20260709 13:08:30.375854 21804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.055s	user 0.004s	sys 0.001s
I20260709 13:08:30.379544 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:30.334108 22449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.965s	user 0.041s	sys 0.071s
W20260709 13:08:30.383415 21731 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.008s	user 0.042s	sys 0.058s
W20260709 13:08:30.384459 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 52361.1us
W20260709 13:08:30.386420 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 44527.5us
I20260709 13:08:30.398275 21758 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:30.342572 23906 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:30.392822 21728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.169s	user 0.022s	sys 0.048s
I20260709 13:08:30.399572 21762 raft_consensus.cc:2393] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 3: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:08:30.399768 22449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.035s	user 0.041s	sys 0.071s
W20260709 13:08:30.399973 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 1.02547e+06us
I20260709 13:08:30.400496 21805 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:30.407712 21805 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:30.408448 23891 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:30.397755 24034 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:30.408982 23891 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:30.410327 23753 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:30.410723 23753 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.411054 23753 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:30.411404 23891 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:30.411849 23976 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:30.412313 23976 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:30.326726 24009 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:30.414064 24010 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:30.414237 23976 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:30.416606 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:30.418919 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:30.419901 22485 raft_consensus.cc:2410] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:08:30.397140 23784 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:30.402166 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:30.432502 21758 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:30.398777 21878 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.032s	sys 0.026s
W20260709 13:08:30.398924 21804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.078s	user 0.004s	sys 0.001s
I20260709 13:08:30.436635 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:30.437203 21840 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:30.438186 21835 raft_consensus.cc:1275] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:30.439723 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:30.401347 23988 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.026s	sys 0.051s
W20260709 13:08:30.395452 21877 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.003s	sys 0.009s
W20260709 13:08:30.454304 21877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.003s	sys 0.010s
I20260709 13:08:30.414501 24010 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.445919 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:30.455395 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:30.455593 21762 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:30.456996 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:30.457914 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:30.458133 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:30.369656 24023 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:30.459344 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:30.459558 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:30.397548 24033 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:30.464483 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.448385 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:30.459954 21839 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:30.373759 24020 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:30.463984 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:30.460119 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:30.461838 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:30.477660 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:30.431510 21728 connection.cc:256] RPC call timeout handler was delayed by -1.0207003109999278s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
I20260709 13:08:30.478842 22482 raft_consensus.cc:2410] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:30.464339 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:30.436074 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:30.461712 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:30.460747 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:30.480031 21834 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:30.480122 21837 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:30.451694 21758 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:30.467281 24009 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:30.467777 23905 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.459959 24037 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:30.468236 24021 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:30.471124 23928 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:30.472133 23804 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:30.409329 24034 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:30.414750 24003 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:30.473115 23850 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:30.472045 24025 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:30.474954 23797 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:30.475023 23895 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.461196 21838 raft_consensus.cc:2410] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:08:30.478964 21728 connection.cc:256] RPC call timeout handler was delayed by -1.0016492009999638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
I20260709 13:08:30.466984 23891 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:30.456542 23996 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:30.482649 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:30.481499 21762 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
W20260709 13:08:30.550122 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.524545 21910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 951) took 3162 ms. Trace:
I20260709 13:08:30.569875 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:30.469106 23790 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:30.561769 21728 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:30.461201 24010 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:30.481353 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:30.571641 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 320891us
I20260709 13:08:30.481817 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:30.523698 21911 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:30.549958 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:30.565328 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:30.455210 23960 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:30.569905 21910 rpcz_store.cc:276] 0709 13:08:27.323995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.325107 (+  1112us) service_pool.cc:224] Handling call
0709 13:08:29.038071 (+1712964us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b5800003998. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232a22 00007fc6b414bc09 00007fc6b32a5ee0 00007fc6b336f0ab 00007fc6b336f131 00007fc6b3330fc0 00007fc6b331b929 00007fc6b331b3d2 00007fc6ac892bd4
0709 13:08:29.038358 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.338274 (+299916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.486005 (+1147731us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54000ff354. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:30.486216 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481776256}
I20260709 13:08:30.580282 22484 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:30.481746 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:30.581066 21839 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
W20260709 13:08:30.561089 23844 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.035s	sys 0.063s
I20260709 13:08:30.573798 21832 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:30.490193 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:30.422379 24028 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.149s
I20260709 13:08:30.575016 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:30.576967 22485 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 1.
I20260709 13:08:30.520239 23979 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:30.579197 22483 raft_consensus.cc:1275] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:08:30.589771 22483 pending_rounds.cc:85] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd: Aborting all ops after (but not including) 4
I20260709 13:08:30.590106 22483 pending_rounds.cc:107] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:08:30.508735 23784 raft_consensus.cc:697] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:30.579022 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:30.571044 21762 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:30.593475 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:30.464892 24033 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.484119 23865 raft_consensus.cc:3055] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:30.566833 22476 raft_consensus.cc:1240] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:30.574818 23556 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:30.520035 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:30.581313 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:30.532704 23905 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:30.488384 23899 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:30.585738 23790 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:30.584535 23844 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.036s	sys 0.063s
I20260709 13:08:30.566883 23895 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:30.621068 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:30.603391 21832 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:30.482338 23869 consensus_queue.cc:260] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:30.574246 23818 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.590416 22483 raft_consensus.cc:2889] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:30.606456 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:30.609411 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:30.610658 21758 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:30.604534 24033 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:30.567160 23929 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:30.567457 24003 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:30.585978 23996 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:30.567024 24025 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:30.608174 23976 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.624889 22485 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:30.587733 23960 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:30.639514 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:30.604915 23865 raft_consensus.cc:740] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:30.609189 23804 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:30.605135 24041 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:30.635916 21731 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:30.633808 23936 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:30.635028 23979 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:30.675559 21731 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:30.672437 21758 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:30.638501 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:30.644256 23852 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:30.682132 21762 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:30.682855 23952 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:30.683364 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:30.650864 23869 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:30.685273 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:30.647008 23971 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:30.685365 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:30.651158 24038 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:30.640195 23818 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:30.566329 24037 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:30.620334 23899 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:30.694986 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:30.694984 21759 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:30.678771 23891 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:30.702104 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:30.679899 23840 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:08:30.692854 21909 raft_consensus.cc:2410] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:08:30.675208 23804 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:30.707773 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:30.709656 24020 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:30.647478 23996 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:30.702831 23860 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:30.672214 23976 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:30.679384 24041 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:30.685200 23979 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:30.827275 23958 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:30.724293 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:30.869237 21757 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:30.870265 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:30.870322 21758 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:30.702641 23784 consensus_queue.cc:237] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:30.745575 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.870996 21757 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:30.856158 21840 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:08:30.874480 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:30.898908 21879 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:30.878132 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36278 (request call id 252) took 3272 ms. Trace:
I20260709 13:08:30.914546 21805 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:30.965327 21757 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:30.965672 22477 rpcz_store.cc:276] 0709 13:08:27.605413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.605624 (+   211us) service_pool.cc:224] Handling call
0709 13:08:27.605974 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:27.672484 (+ 66510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:27.672517 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:27.672555 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:27.672585 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.877780 (+3205195us) spinlock_profiling.cc:243] Waited 66.3 ms on lock 0x7b5400463f54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:30.877854 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.878049 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152554752}
I20260709 13:08:30.966863 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:30.896878 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:30.968102 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:30.964284 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:30.884722 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 991) took 3218 ms. Trace:
I20260709 13:08:30.883446 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:30.886194 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 999) took 3150 ms. Trace:
I20260709 13:08:30.970825 21761 rpcz_store.cc:276] 0709 13:08:27.735669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.332841 (+1597172us) service_pool.cc:224] Handling call
0709 13:08:29.333262 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.401145 (+ 67883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.401180 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:29.401226 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:29.401286 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.885879 (+1484593us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b540031a6d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:30.885942 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.886121 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155508608}
I20260709 13:08:30.882933 21911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 967) took 1267 ms. Trace:
I20260709 13:08:30.972363 21911 rpcz_store.cc:276] 0709 13:08:29.615687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.154278 (+538591us) service_pool.cc:224] Handling call
0709 13:08:30.882677 (+728399us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b540032d554. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:30.882837 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":557377792}
W20260709 13:08:30.767397 24045 log.cc:927] Time spent T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:08:30.968300 21833 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:30.889151 23463 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:30.772575 24046 log.cc:927] Time spent T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:08:30.976665 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 62216.6us
I20260709 13:08:30.979138 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:30.997123 21805 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:30.768060 24042 log.cc:927] Time spent T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:08:30.876904 23876 consensus_meta.cc:287] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.004s
W20260709 13:08:31.000417 21880 connection.cc:256] RPC call timeout handler was delayed by -1.011883054000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
I20260709 13:08:31.001672 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:31.002295 21911 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:30.707085 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:30.969301 21765 rpcz_store.cc:276] 0709 13:08:27.665927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.666044 (+   117us) service_pool.cc:224] Handling call
0709 13:08:27.666311 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:27.670673 (+  4362us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:27.702749 (+ 32076us) log.cc:844] Serialized 14 byte log entry
0709 13:08:29.107294 (+1404545us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b18003f1840. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab26a3f3 00007fc6ab26c7c1 00007fc6ab26c779 00007fc6ab26c709 00007fc6ab26c6d1 00007fc6ab26b9cd 000000000038f354 000000000038f199 00007fc6ab24d83a
0709 13:08:29.207066 (+ 99772us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:29.207139 (+    73us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:29.207201 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.884460 (+1677259us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b54003da754. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:30.884516 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.884648 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68377,"prepare.queue_time_us":75327,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":132950,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":11640,"spinlock_wait_cycles":121443456,"thread_start_us":441492,"threads_started":2,"wal-append.queue_time_us":547578,"wal-append.run_cpu_time_us":975,"wal-append.run_wall_time_us":1000987}
I20260709 13:08:30.773252 23895 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:30.982450 24028 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:30.772136 23853 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:30.722708 23840 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:30.981921 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:30.883797 23960 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:30.983088 23860 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:30.706933 24038 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:30.980782 23776 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:30.985673 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:30.988624 22481 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:30.990379 21764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 992) took 3324 ms. Trace:
W20260709 13:08:30.990727 23970 consensus_meta.cc:287] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.589s	user 0.009s	sys 0.000s
I20260709 13:08:30.980458 24033 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:30.893661 23997 log.cc:927] Time spent T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 2.679s	user 0.014s	sys 0.041s
I20260709 13:08:30.993409 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:30.842060 23991 consensus_meta.cc:287] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 1.637s	user 0.012s	sys 0.000s
I20260709 13:08:30.766672 24034 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:30.980993 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 82216.8us
I20260709 13:08:31.075882 21879 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:30.710517 21908 raft_consensus.cc:1240] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:30.998346 21805 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:31.003278 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:31.003836 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:31.057883 24028 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:30.913728 22450 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:31.005143 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:30.767146 24023 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:31.057811 24047 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:31.067260 21764 rpcz_store.cc:276] 0709 13:08:27.666273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.666389 (+   116us) service_pool.cc:224] Handling call
0709 13:08:27.666764 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:27.676281 (+  9517us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:27.788200 (+111919us) log.cc:844] Serialized 14 byte log entry
0709 13:08:28.399127 (+610927us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:28.399201 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:28.399264 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.990061 (+2590797us) spinlock_profiling.cc:243] Waited 9.33 ms on lock 0x7b540031ddd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:30.990129 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:30.990306 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70199,"prepare.queue_time_us":116154,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":14504,"raft.queue_time_us":236230,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":62607,"spinlock_wait_cycles":21460352,"thread_start_us":444091,"threads_started":2,"wal-append.queue_time_us":1252903,"wal-append.run_cpu_time_us":1335,"wal-append.run_wall_time_us":1087235}
I20260709 13:08:30.884521 23899 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:31.006232 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:30.876329 24003 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:31.091082 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:31.091935 21905 raft_consensus.cc:2410] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:31.092684 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:31.070183 23776 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:31.094702 24038 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:31.095499 22480 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36278 (request call id 250) took 3982 ms (client timeout 2125 ms). Trace:
I20260709 13:08:30.770548 23905 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:31.047777 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:31.052011 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:30.860951 24010 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:30.703876 23971 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:30.857278 23753 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:31.057107 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:31.058117 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:31.061143 21833 raft_consensus.cc:1813] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Handling vote request from an unknown peer 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:31.062403 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:30.707342 23865 consensus_queue.cc:260] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:31.006912 24020 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:31.067579 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:31.059630 24045 log.cc:927] Time spent T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:08:31.050300 23463 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.072719 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:31.078035 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:31.051259 23936 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:31.080384 21911 raft_consensus.cc:2410] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:30.766762 24025 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:31.082139 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 168530us
I20260709 13:08:31.063220 23840 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:30.766122 24037 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:31.062906 21907 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:31.085023 21832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38352
I20260709 13:08:31.087723 23978 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:31.088732 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:31.095552 23776 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:31.066057 23860 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.039602 23876 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:31.047646 21835 raft_consensus.cc:1275] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:31.096299 23996 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:31.096050 22480 rpcz_store.cc:269] 0709 13:08:27.112704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:27.116032 (+  3328us) service_pool.cc:224] Handling call
0709 13:08:31.095259 (+3979227us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b540018bd54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:31.095396 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4526558976}
W20260709 13:08:31.101895 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 103611us
I20260709 13:08:31.774238 22450 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:31.775156 21833 raft_consensus.cc:2368] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4.
I20260709 13:08:31.761264 21832 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:31.775774 22485 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:31.775995 21761 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:31.776247 21832 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:31.776556 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59102 (request call id 2324) took 1266 ms. Trace:
W20260709 13:08:31.553511 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 330014us
I20260709 13:08:31.777052 21761 rpcz_store.cc:276] 0709 13:08:30.509700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.027100 (+517400us) service_pool.cc:224] Handling call
0709 13:08:31.776503 (+749403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:31.128245 21836 raft_consensus.cc:2368] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5.
I20260709 13:08:31.195673 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:31.780226 21834 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:31.167178 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:31.771472 21839 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:31.775187 21805 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:31.782032 21764 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:31.772439 21765 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:31.788542 21764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59102 (request call id 2321) took 1327 ms. Trace:
I20260709 13:08:31.789238 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 1018) took 1027 ms. Trace:
I20260709 13:08:31.786922 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:31.789932 21765 rpcz_store.cc:276] 0709 13:08:30.762204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.056820 (+294616us) service_pool.cc:224] Handling call
0709 13:08:31.789186 (+732366us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:31.093230 21905 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:31.791106 21764 rpcz_store.cc:276] 0709 13:08:30.461238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.084107 (+622869us) service_pool.cc:224] Handling call
0709 13:08:31.788466 (+704359us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:31.096105 23818 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:31.799925 21840 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:08:31.800297 21840 pending_rounds.cc:85] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 1
I20260709 13:08:31.800565 21840 pending_rounds.cc:107] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:08:31.800843 21840 raft_consensus.cc:2889] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:31.807576 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:31.809211 21765 raft_consensus.cc:2410] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:31.081789 24028 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:31.330361 24054 log.cc:927] Time spent T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:08:31.814251 24033 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:31.814487 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:31.096681 24034 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:31.815639 23804 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:31.816972 24041 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:31.096534 24008 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.082022 23554 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.081669 23895 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:31.140152 24043 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:31.788595 23860 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:31.774539 24020 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:31.430464 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:31.792894 23929 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.852803 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:31.847790 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:31.825268 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:31.856202 21833 raft_consensus.cc:2410] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:31.080211 23970 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:31.858426 21764 raft_consensus.cc:2393] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:31.855392 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:31.861155 21764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59102 (request call id 2334) took 1156 ms. Trace:
I20260709 13:08:31.861755 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:31.862016 21764 rpcz_store.cc:276] 0709 13:08:30.705003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.807171 (+1102168us) service_pool.cc:224] Handling call
0709 13:08:31.861095 (+ 53924us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:31.862095 21840 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:31.825812 23895 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:31.858292 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:31.862614 21832 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:31.128499 24047 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:31.822643 23865 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:31.798409 23463 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:31.834349 23804 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:31.824560 24034 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:31.798023 23936 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:31.854264 24008 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:31.863881 23895 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:31.854388 23554 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:31.870115 21833 raft_consensus.cc:2393] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:31.866974 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:31.875638 24020 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:31.826340 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:31.912472 21832 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:31.914319 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:31.917817 21877 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:31.922778 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44772 (request call id 228) took 1334 ms. Trace:
I20260709 13:08:31.930817 21761 rpcz_store.cc:276] 0709 13:08:30.588471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.794543 (+1206072us) service_pool.cc:224] Handling call
0709 13:08:31.922718 (+128175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:31.915443 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:31.940227 21877 leader_election.cc:400] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4.
I20260709 13:08:31.940579 21840 raft_consensus.cc:1240] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:31.940742 21877 leader_election.cc:403] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:31.872239 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:31.943204 21764 raft_consensus.cc:1813] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Handling vote request from an unknown peer 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:31.919401 23895 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:31.870180 21765 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:31.943944 21764 raft_consensus.cc:2368] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4.
W20260709 13:08:31.948920 21762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 1003) took 1789 ms (client timeout 2117 ms). Trace:
I20260709 13:08:31.820526 23979 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:31.871317 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:31.826010 24043 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:31.860563 23929 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:32.059482 21911 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:32.061133 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 995) took 4393 ms. Trace:
I20260709 13:08:32.061964 23463 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:31.971194 23853 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:32.063109 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:31.951306 24047 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:31.985188 24041 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:08:32.066617 21834 raft_consensus.cc:1240] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:08:32.069583 24043 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:32.069885 23998 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:32.070513 23998 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:32.070924 23998 raft_consensus.cc:697] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:32.071731 23998 consensus_queue.cc:237] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:32.072526 21911 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:32.073028 21911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1338) took 1018 ms. Trace:
I20260709 13:08:32.073315 21911 rpcz_store.cc:276] 0709 13:08:31.054357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.858314 (+803957us) service_pool.cc:224] Handling call
0709 13:08:32.072969 (+214655us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1471360}
I20260709 13:08:31.871182 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:31.958320 23828 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.074512 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.074983 23828 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:32.065001 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.082955 21835 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:32.061555 21763 rpcz_store.cc:276] 0709 13:08:27.668039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.316031 (+647992us) service_pool.cc:224] Handling call
0709 13:08:28.316494 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:29.103671 (+787177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.103699 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:29.104235 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 13:08:29.204032 (+ 99797us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:29.204083 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:31.945414 (+2741331us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b240017e2f8. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab0f09c4 00007fc6ab0eeacb 00007fc6ab2a9dc9 00007fc6ab2a9a55 00007fc6ab2a8fb0 00007fc6adf1f488 00007fc6adf1fbe8 00007fc6adef7398 00007fc6adef276a 00007fc6adef1bb6
0709 13:08:32.060739 (+115325us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b54001b94d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:32.060806 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.060866 (+    60us) raft_consensus.cc:1685] finished
0709 13:08:32.060886 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.061058 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1816354432,"thread_start_us":99395,"threads_started":1,"wal-append.queue_time_us":116484}
I20260709 13:08:32.086113 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:32.086407 23828 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:31.866336 21908 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:32.087047 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59102 (request call id 2342) took 1187 ms. Trace:
I20260709 13:08:32.087451 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1341) took 1018 ms. Trace:
I20260709 13:08:32.087514 21763 rpcz_store.cc:276] 0709 13:08:30.899570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.085791 (+1186221us) service_pool.cc:224] Handling call
0709 13:08:32.086978 (+  1187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.088084 21908 rpcz_store.cc:276] 0709 13:08:31.069056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.196946 (+127890us) service_pool.cc:224] Handling call
0709 13:08:32.087374 (+890428us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.088838 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:31.941560 23804 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:31.938843 23926 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:32.026966 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:31.908478 23932 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:31.970502 21877 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:32.090935 21911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1339) took 1028 ms. Trace:
I20260709 13:08:32.140929 21911 rpcz_store.cc:276] 0709 13:08:31.062059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.074271 (+1012212us) service_pool.cc:224] Handling call
0709 13:08:32.090863 (+ 16592us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.095362 21761 raft_consensus.cc:2393] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 4: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:32.162878 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59102 (request call id 2332) took 1470 ms. Trace:
W20260709 13:08:32.096256 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 125871us
I20260709 13:08:32.163487 21761 rpcz_store.cc:276] 0709 13:08:30.691936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.932166 (+1240230us) service_pool.cc:224] Handling call
0709 13:08:32.162796 (+230630us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.096006 21910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 308) took 1413 ms. Trace:
I20260709 13:08:32.165263 21910 rpcz_store.cc:276] 0709 13:08:30.682690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.682836 (+   146us) service_pool.cc:224] Handling call
0709 13:08:30.683113 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.983748 (+300635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.983793 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:30.983858 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:30.983915 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.095793 (+1111878us) spinlock_profiling.cc:243] Waited 300 ms on lock 0x7b54002d8054. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:32.095835 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.095952 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":690828672}
I20260709 13:08:31.957347 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44772 (request call id 230) took 1161 ms. Trace:
I20260709 13:08:32.024930 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:32.095952 21729 connection.cc:256] RPC call timeout handler was delayed by -1.0308462880000206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
I20260709 13:08:32.168172 21765 rpcz_store.cc:276] 0709 13:08:30.796376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.858080 (+1061704us) service_pool.cc:224] Handling call
0709 13:08:31.957277 (+ 99197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:31.943043 24034 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:32.106760 21731 leader_election.cc:336] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Timed out: RequestConsensusVote RPC to 127.20.40.4:37983 timed out after 1.626s (SENT)
W20260709 13:08:32.171432 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 64729.6us
I20260709 13:08:32.166451 21877 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:32.168498 21906 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:32.173411 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:31.958192 21762 rpcz_store.cc:269] 0709 13:08:30.159944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.593234 (+433290us) service_pool.cc:224] Handling call
0709 13:08:31.948772 (+1355538us) spinlock_profiling.cc:243] Waited 88.1 ms on lock 0x7b54001b99d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:31.948867 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202538368}
W20260709 13:08:32.168747 21729 connection.cc:256] RPC call timeout handler was delayed by -1.0110500719999891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
W20260709 13:08:32.176111 21729 connection.cc:256] RPC call timeout handler was delayed by -1.008281069000077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1869s for a response
I20260709 13:08:32.169926 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:31.952903 23976 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:31.951036 23895 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:32.095607 23977 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:32.187758 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:31.958385 21764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59102 (request call id 2322) took 1494 ms. Trace:
W20260709 13:08:32.190014 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.217063 21764 rpcz_store.cc:276] 0709 13:08:30.463913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.862875 (+1398962us) service_pool.cc:224] Handling call
0709 13:08:31.958327 (+ 95452us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.190799 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:32.218256 21765 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:32.219012 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 1011) took 1614 ms. Trace:
I20260709 13:08:32.094038 23804 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:32.091933 23753 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:32.187273 23945 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.194900 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:32.089402 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.163494 23979 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.178433 21910 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:32.232141 21910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1340) took 1167 ms. Trace:
I20260709 13:08:32.232602 21910 rpcz_store.cc:276] 0709 13:08:31.065201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.169673 (+1104472us) service_pool.cc:224] Handling call
0709 13:08:32.232060 (+ 62387us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.233801 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.234553 21910 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:32.235559 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.236207 21910 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:32.236748 21910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1344) took 1103 ms. Trace:
I20260709 13:08:32.179486 21763 raft_consensus.cc:2393] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 7: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:32.238765 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 1016) took 1610 ms. Trace:
I20260709 13:08:32.239173 21763 rpcz_store.cc:276] 0709 13:08:30.628375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.088571 (+1460196us) service_pool.cc:224] Handling call
0709 13:08:32.238694 (+150123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:31.946087 23818 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:32.219537 21765 rpcz_store.cc:276] 0709 13:08:30.604240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.190507 (+1586267us) service_pool.cc:224] Handling call
0709 13:08:32.218927 (+ 28420us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.178318 23996 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:08:32.174800 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.237196 21910 rpcz_store.cc:276] 0709 13:08:31.133195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.235271 (+1102076us) service_pool.cc:224] Handling call
0709 13:08:32.236691 (+  1420us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:32.192909 23784 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.014s	user 0.025s	sys 0.069s
I20260709 13:08:32.091342 23929 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:32.222311 21911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1334) took 1219 ms. Trace:
I20260709 13:08:32.095606 23932 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.226006 21761 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:32.258255 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44772 (request call id 226) took 2007 ms. Trace:
I20260709 13:08:32.058451 24020 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:32.094609 23926 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:31.947069 24025 consensus_queue.cc:1048] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.275s
I20260709 13:08:32.220448 23876 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:32.247308 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:32.185034 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:32.253590 23784 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.075s	user 0.026s	sys 0.069s
I20260709 13:08:32.251490 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:32.272396 21762 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:32.272753 21763 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:32.252162 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:32.273839 21764 raft_consensus.cc:2393] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 4: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:32.250949 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.256947 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.228991 23895 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:32.258662 21761 rpcz_store.cc:276] 0709 13:08:30.250497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.171048 (+1920551us) service_pool.cc:224] Handling call
0709 13:08:32.258175 (+ 87127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:31.953049 23970 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:32.255514 21911 rpcz_store.cc:276] 0709 13:08:31.002746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.167023 (+1164277us) service_pool.cc:224] Handling call
0709 13:08:32.222243 (+ 55220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.276883 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.261986 23936 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:32.262450 24028 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:32.262903 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.228390 23977 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:32.230448 23945 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:32.228201 23971 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:32.271111 24020 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:32.246544 23818 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.273078 21762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59102 (request call id 2343) took 1373 ms. Trace:
I20260709 13:08:32.312554 21762 rpcz_store.cc:276] 0709 13:08:30.899876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.175669 (+1275793us) service_pool.cc:224] Handling call
0709 13:08:32.273005 (+ 97336us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.274796 21764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59102 (request call id 2320) took 1817 ms. Trace:
I20260709 13:08:32.313553 21764 rpcz_store.cc:276] 0709 13:08:30.457003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.230718 (+1773715us) service_pool.cc:224] Handling call
0709 13:08:32.274725 (+ 44007us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.232465 23979 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:32.277730 21906 raft_consensus.cc:2393] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:32.271045 23840 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:32.281230 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:32.319487 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:32.320029 21761 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:32.320382 21762 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:32.320745 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 1010) took 1729 ms. Trace:
I20260709 13:08:32.321198 21761 rpcz_store.cc:276] 0709 13:08:30.591438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.276594 (+1685156us) service_pool.cc:224] Handling call
0709 13:08:32.320676 (+ 44082us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.267354 23932 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:32.273295 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 1002) took 2113 ms. Trace:
I20260709 13:08:32.324200 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.323464 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:32.324508 21763 rpcz_store.cc:276] 0709 13:08:30.159667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.251199 (+2091532us) service_pool.cc:224] Handling call
0709 13:08:32.273229 (+ 22030us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:32.325845 21909 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.014s	sys 0.013s
I20260709 13:08:32.321805 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:32.323720 21880 leader_election.cc:400] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4.
I20260709 13:08:32.325742 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:32.326793 21909 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.014s	sys 0.013s
I20260709 13:08:32.326694 21763 raft_consensus.cc:2468] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:32.327787 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:32.328507 21763 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:32.284340 21910 raft_consensus.cc:2410] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:32.278034 23895 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:08:32.319698 22450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.014s	sys 0.010s
W20260709 13:08:32.330617 22450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.014s	sys 0.010s
W20260709 13:08:32.331131 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 556935us
I20260709 13:08:32.331279 21879 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:32.331589 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.331912 22450 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:32.332283 21764 raft_consensus.cc:2410] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:32.332310 21906 raft_consensus.cc:2410] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:32.334116 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.317852 23818 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:32.339110 21910 raft_consensus.cc:2393] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:32.337610 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.343628 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.343942 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:32.323789 21907 consensus_meta.cc:287] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.520s	user 0.006s	sys 0.003s
I20260709 13:08:32.319015 23979 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.341128 22450 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:32.343950 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:32.347543 21914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 307) took 2884 ms. Trace:
I20260709 13:08:32.346503 21911 raft_consensus.cc:2393] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:32.344993 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.347941 21914 rpcz_store.cc:276] 0709 13:08:29.462963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.463475 (+   512us) service_pool.cc:224] Handling call
0709 13:08:29.463888 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.252987 (+789099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.253031 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:30.253088 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:30.253139 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.347314 (+2094175us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b5400420ed4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:32.347393 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.347500 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814201728}
I20260709 13:08:32.349197 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.349313 21906 raft_consensus.cc:2410] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:32.342525 24058 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:32.353349 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.353549 21905 raft_consensus.cc:2368] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6.
I20260709 13:08:32.353655 24058 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.354218 24058 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:32.354494 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.355510 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.356195 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.360250 24028 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:32.360968 24010 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:32.335781 23971 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:32.362445 22481 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36270 (request call id 446) took 1770 ms (client timeout 2066 ms). Trace:
I20260709 13:08:32.335992 23463 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:32.362831 22481 rpcz_store.cc:269] 0709 13:08:30.592020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.605698 (+ 13678us) service_pool.cc:224] Handling call
0709 13:08:32.362275 (+1756577us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b54002e5c54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:32.362367 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843773184}
I20260709 13:08:32.363116 23463 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:32.364141 24043 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:32.373543 21912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 313) took 1687 ms. Trace:
I20260709 13:08:32.373974 21912 rpcz_store.cc:276] 0709 13:08:30.686337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.686448 (+   111us) service_pool.cc:224] Handling call
0709 13:08:30.894021 (+207573us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.894277 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:30.894318 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:30.894374 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:30.894423 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:30.894501 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.373338 (+1478837us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540032d550. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:32.373479 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468502784}
I20260709 13:08:32.375576 21912 raft_consensus.cc:1240] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:32.376137 21912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1342) took 1302 ms. Trace:
I20260709 13:08:32.333081 23895 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:32.381945 21912 rpcz_store.cc:276] 0709 13:08:31.073973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.375042 (+1301069us) service_pool.cc:224] Handling call
0709 13:08:32.375386 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.375923 (+   537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.376087 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.383548 23554 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:32.386375 23926 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:32.386756 21913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 317) took 1695 ms. Trace:
I20260709 13:08:32.387296 21913 rpcz_store.cc:276] 0709 13:08:30.691499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.708502 (+ 17003us) service_pool.cc:224] Handling call
0709 13:08:30.710915 (+  2413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:31.082147 (+371232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:31.082194 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:31.082233 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:31.082264 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.386461 (+1304197us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b54000a1754. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:32.386525 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.386684 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":853335936}
I20260709 13:08:32.318397 23977 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:32.390540 23977 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:32.391084 23977 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:32.391644 23977 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:32.350695 21908 raft_consensus.cc:2410] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:32.368111 24034 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:32.398459 24034 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:32.399541 24008 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:32.400548 23804 raft_consensus.cc:2804] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:32.401062 23804 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:32.401589 23804 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:32.361855 23971 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:32.360869 24028 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:32.414034 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.415509 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.416167 21914 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:32.347915 21910 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:32.345927 21907 raft_consensus.cc:2468] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:32.381995 23945 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:32.379500 23840 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:32.439086 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:32.439925 22484 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
W20260709 13:08:32.427089 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 260711us
I20260709 13:08:32.428042 21912 raft_consensus.cc:1240] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:32.432870 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:32.433780 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:32.433874 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 464040us
I20260709 13:08:32.435595 21911 raft_consensus.cc:2410] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:08:32.457726 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:32.458348 22477 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:32.381006 24041 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4.
I20260709 13:08:32.492775 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:32.496286 22481 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:32.494403 24043 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:32.465409 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:32.618072 22479 raft_consensus.cc:1813] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Handling vote request from an unknown peer 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:32.618913 22479 raft_consensus.cc:2410] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:08:32.517134 23804 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:32.620661 21910 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:32.623605 23804 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:32.554615 21729 leader_election.cc:336] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Timed out: RequestConsensusVote RPC to 127.20.40.3:43881 timed out after 1.512s (SENT)
W20260709 13:08:32.631181 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 76900.4us
W20260709 13:08:32.632438 21729 leader_election.cc:336] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Timed out: RequestConsensusVote RPC to 127.20.40.3:43881 timed out after 1.569s (SENT)
W20260709 13:08:32.555217 21694 diagnostics_log.cc:230] Unable to collect stacks to diagnostics log: Incomplete: not collecting stack trace since debugger or strace is attached
I20260709 13:08:31.947743 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:32.564867 21728 connection.cc:256] RPC call timeout handler was delayed by -1.6915079240001205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
I20260709 13:08:32.568588 21731 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:32.633986 21728 connection.cc:256] RPC call timeout handler was delayed by -1.3909079240000892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
W20260709 13:08:32.634445 21728 connection.cc:256] RPC call timeout handler was delayed by -1.3342079240001112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22450000000000003s for a response
W20260709 13:08:32.634791 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 298321us
I20260709 13:08:32.638381 22485 raft_consensus.cc:1240] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:32.639039 23840 consensus_queue.cc:1059] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:32.586202 21661 catalog_manager.cc:5697] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:32.590611 21756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 996) took 4921 ms. Trace:
I20260709 13:08:32.594422 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:32.595960 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:32.596341 21758 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59102 (request call id 2325) took 2070 ms (client timeout 1753 ms). Trace:
I20260709 13:08:32.598217 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:32.600895 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:32.601310 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 269997us
I20260709 13:08:32.601979 21765 raft_consensus.cc:1813] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Handling vote request from an unknown peer 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:32.644507 21765 raft_consensus.cc:2393] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 2: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
W20260709 13:08:32.459194 21907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45202 (request call id 315) took 1769 ms (client timeout 1960 ms). Trace:
W20260709 13:08:32.645288 21907 rpcz_store.cc:269] 0709 13:08:30.690064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.702092 (+ 12028us) service_pool.cc:224] Handling call
0709 13:08:32.438738 (+1736646us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.462761 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.647311 21908 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:32.483253 23463 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:32.341851 21805 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.002s	sys 0.028s
I20260709 13:08:32.648815 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:32.650120 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.512136 23895 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:32.650334 21879 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:32.517557 23860 consensus_meta.cc:287] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.003s
I20260709 13:08:32.654104 24043 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:32.654335 23860 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:32.655078 24043 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:32.658342 21831 raft_consensus.cc:2393] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:32.660120 21838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1572) took 2147 ms. Trace:
W20260709 13:08:32.660799 21831 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38352 (request call id 2346) took 1627 ms (client timeout 1614 ms). Trace:
W20260709 13:08:32.487388 23865 consensus_meta.cc:287] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.587s	user 0.006s	sys 0.004s
I20260709 13:08:32.638412 24062 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.604451 23932 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:32.511139 23971 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:32.481559 23977 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:32.515630 23979 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:32.495646 24060 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:08:32.596007 21806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.012s	sys 0.001s
W20260709 13:08:32.605780 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 236951us
W20260709 13:08:32.661396 21831 rpcz_store.cc:269] 0709 13:08:31.032970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.033280 (+   310us) service_pool.cc:224] Handling call
0709 13:08:32.660472 (+1627192us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b540033a9d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:32.660673 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2033963776}
I20260709 13:08:32.615995 23828 consensus_queue.cc:1048] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:32.505921 22477 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
W20260709 13:08:32.649089 21805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.002s	sys 0.029s
W20260709 13:08:32.712222 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 937055us
I20260709 13:08:32.431130 21836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38352 (request call id 2338) took 1858 ms. Trace:
I20260709 13:08:32.488682 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:32.714260 22480 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:32.713858 21836 rpcz_store.cc:276] 0709 13:08:30.572764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.883149 (+310385us) service_pool.cc:224] Handling call
0709 13:08:32.430830 (+1547681us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54000717d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:32.431053 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":362887424}
W20260709 13:08:32.673777 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 105626us
I20260709 13:08:32.662221 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.715873 21835 raft_consensus.cc:2393] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 7: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:32.663887 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.662851 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.689904 21762 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:32.664559 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:32.643579 21758 rpcz_store.cc:269] 0709 13:08:30.525887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:30.639192 (+113305us) service_pool.cc:224] Handling call
0709 13:08:32.595882 (+1956690us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b54003d9d54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:32.596122 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52617600}
W20260709 13:08:32.691007 21905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1335) took 1687 ms (client timeout 1909 ms). Trace:
I20260709 13:08:32.643229 21756 rpcz_store.cc:276] 0709 13:08:27.668830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.107791 (+1438961us) service_pool.cc:224] Handling call
0709 13:08:29.108117 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:29.452891 (+344774us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:29.457573 (+  4682us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:29.462983 (+  5410us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:29.465836 (+  2853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.589613 (+3123777us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b5400358c54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:32.589821 (+   208us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.590305 (+   484us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776272256}
I20260709 13:08:32.694013 21759 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:32.718696 21839 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
W20260709 13:08:32.718948 21728 leader_election.cc:336] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.510s (SENT)
I20260709 13:08:32.719511 21728 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:32.717983 21905 rpcz_store.cc:269] 0709 13:08:31.002999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.834964 (+831965us) service_pool.cc:224] Handling call
0709 13:08:32.690531 (+855567us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b5400112e54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:32.690793 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":595048192}
W20260709 13:08:32.670583 21806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.013s	sys 0.002s
I20260709 13:08:32.721664 21805 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:32.721895 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 768036us
I20260709 13:08:32.723771 24061 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:32.724452 24061 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.664062 24062 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:32.724949 24061 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:32.727023 24062 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:32.715958 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.650334 21761 raft_consensus.cc:2410] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:32.727926 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59102 (request call id 2341) took 1846 ms. Trace:
I20260709 13:08:32.728180 21837 raft_consensus.cc:2393] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:32.699427 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 1014) took 2085 ms. Trace:
I20260709 13:08:32.666743 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:32.666352 23932 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:32.701397 23860 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:32.701879 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 65243.6us
I20260709 13:08:32.642373 23840 raft_consensus.cc:3055] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:32.671051 24060 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:32.670049 23979 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:32.735492 21728 leader_election.cc:336] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.569s (SENT)
I20260709 13:08:32.689211 22449 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:32.660583 21838 rpcz_store.cc:276] 0709 13:08:30.512223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.658313 (+2146090us) service_pool.cc:224] Handling call
0709 13:08:32.659134 (+   821us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.659573 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.659609 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:32.659658 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:32.659687 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.659750 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.659885 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:32.708230 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 55403.4us
I20260709 13:08:32.663193 23463 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:32.736048 21880 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:32.741552 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 52519us
I20260709 13:08:32.741811 23845 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.742466 23845 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:32.743031 23845 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:32.743150 22449 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:32.661535 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.735457 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.745776 23977 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:32.746236 23977 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.746485 21832 raft_consensus.cc:2393] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:32.746670 23977 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:32.741084 23463 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:32.747386 24071 raft_consensus.cc:2804] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:32.747682 23463 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:32.747991 24071 raft_consensus.cc:697] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:32.748976 24060 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:32.749498 23828 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:32.695333 23895 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:32.705276 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1330) took 1703 ms. Trace:
I20260709 13:08:32.663203 21760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 997) took 4981 ms. Trace:
I20260709 13:08:32.728358 21761 rpcz_store.cc:276] 0709 13:08:30.881954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.648307 (+1766353us) service_pool.cc:224] Handling call
0709 13:08:32.727849 (+ 79542us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.732167 21757 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:32.734254 21839 raft_consensus.cc:1240] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:32.728914 21765 rpcz_store.cc:276] 0709 13:08:30.613857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.246967 (+1633110us) service_pool.cc:224] Handling call
0709 13:08:32.699102 (+452135us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b540028df54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:32.699338 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":757622016}
I20260709 13:08:32.740281 21728 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:32.733982 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.674719 23945 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:32.752229 23945 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:32.752647 23945 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:32.735368 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.734856 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.733139 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.754719 21836 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:32.730728 23840 raft_consensus.cc:740] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:32.757557 21834 raft_consensus.cc:2393] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:32.757999 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.750612 21909 rpcz_store.cc:276] 0709 13:08:31.001599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.001764 (+   165us) service_pool.cc:224] Handling call
0709 13:08:31.002248 (+   484us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:31.140598 (+138350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:31.140643 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:31.187542 (+ 46899us) log.cc:844] Serialized 52 byte log entry
0709 13:08:32.327231 (+1139689us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:32.644658 (+317427us) log.cc:844] Serialized 14 byte log entry
0709 13:08:32.645175 (+   517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.704231 (+ 59056us) spinlock_profiling.cc:243] Waited 94.3 ms on lock 0x7b540021a054. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:32.704330 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:32.704464 (+   134us) raft_consensus.cc:1685] finished
0709 13:08:32.704737 (+   273us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.705028 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2046,"prepare.queue_time_us":193380,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":70479,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":427,"spinlock_wait_cycles":216908544,"thread_start_us":850084,"threads_started":2,"wal-append.queue_time_us":1155875}
I20260709 13:08:32.758669 21831 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:32.758509 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.762369 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.762606 21764 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:32.763286 21831 raft_consensus.cc:2410] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:08:32.763200 21764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 1013) took 2151 ms. Trace:
I20260709 13:08:32.764022 21764 rpcz_store.cc:276] 0709 13:08:30.611669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.666214 (+2054545us) service_pool.cc:224] Handling call
0709 13:08:32.763148 (+ 96934us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.765266 21879 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:32.765924 23828 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:32.767310 21761 raft_consensus.cc:1240] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:32.768060 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 219) took 3267 ms. Trace:
I20260709 13:08:32.768250 21879 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:32.768453 21761 rpcz_store.cc:276] 0709 13:08:29.501132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.755137 (+3254005us) service_pool.cc:224] Handling call
0709 13:08:32.767024 (+ 11887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.767768 (+   744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.767980 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.750847 21760 rpcz_store.cc:276] 0709 13:08:27.681327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:29.236629 (+1555302us) service_pool.cc:224] Handling call
0709 13:08:29.252187 (+ 15558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:30.146399 (+894212us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:30.379095 (+232696us) log.cc:844] Serialized 14 byte log entry
0709 13:08:30.613527 (+234432us) log.cc:844] Serialized 14 byte log entry
0709 13:08:30.618870 (+  5343us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:30.618920 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:30.618961 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.095065 (+1476104us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b1800403f60. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab26a3f3 00007fc6ab26c7c1 00007fc6ab26c779 00007fc6ab26c709 00007fc6ab26c6d1 00007fc6ab26b9cd 000000000038f354 000000000038f199 00007fc6ab24d83a
0709 13:08:32.261070 (+166005us) spinlock_profiling.cc:243] Waited 7.73 ms on lock 0x7b1800403f60. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab2382a6 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419
0709 13:08:32.662650 (+401580us) spinlock_profiling.cc:243] Waited 894 ms on lock 0x7b540020b7d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:32.662729 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.663006 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35253,"prepare.queue_time_us":423258,"prepare.run_cpu_time_us":85,"prepare.run_wall_time_us":3561,"raft.queue_time_us":14105,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":14196,"spinlock_wait_cycles":2078553088,"thread_start_us":462912,"threads_started":2,"wal-append.queue_time_us":292891}
I20260709 13:08:32.770741 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:32.771400 22480 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:32.772416 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.773649 21760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2323) took 2282 ms. Trace:
I20260709 13:08:32.754911 24043 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:32.774400 21760 rpcz_store.cc:276] 0709 13:08:30.491694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.770971 (+2279277us) service_pool.cc:224] Handling call
0709 13:08:32.771425 (+   454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.771677 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.771786 (+   109us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:32.771855 (+    69us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:32.771885 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.771946 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.773574 (+  1628us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.775210 21834 raft_consensus.cc:2393] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:08:32.779964 21728 leader_election.cc:336] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.626s (SENT)
I20260709 13:08:32.776304 21758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 216) took 3276 ms. Trace:
I20260709 13:08:32.806504 21758 rpcz_store.cc:276] 0709 13:08:29.500221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.775219 (+3274998us) service_pool.cc:224] Handling call
0709 13:08:32.775631 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.775932 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.775965 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:32.776004 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:32.776057 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.776121 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.776214 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.777873 21757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1000) took 4994 ms. Trace:
I20260709 13:08:32.750013 24071 consensus_queue.cc:237] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:32.781966 21756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 224) took 3279 ms. Trace:
I20260709 13:08:32.814249 21756 rpcz_store.cc:276] 0709 13:08:29.502510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.780907 (+3278397us) service_pool.cc:224] Handling call
0709 13:08:32.781305 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.781620 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.781654 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:32.781696 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:32.781735 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.781802 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.781910 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.816334 21756 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:08:32.816982 21756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2329) took 2245 ms. Trace:
I20260709 13:08:32.783121 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 221) took 3281 ms. Trace:
I20260709 13:08:32.788275 22480 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:32.795166 21661 catalog_manager.cc:5697] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 2 to 3, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 3 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:32.817577 21765 rpcz_store.cc:276] 0709 13:08:29.501683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.778851 (+3277168us) service_pool.cc:224] Handling call
0709 13:08:32.782501 (+  3650us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.782786 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.782819 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:32.782875 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:32.782904 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.782974 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.783070 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.818255 21763 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:32.819199 21765 raft_consensus.cc:1240] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:32.818711 21661 catalog_manager.cc:5697] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 3 to 4, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 4 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:32.819679 21763 raft_consensus.cc:1240] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:32.819780 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1015) took 2197 ms. Trace:
I20260709 13:08:32.820323 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2331) took 2135 ms. Trace:
I20260709 13:08:32.820155 21765 rpcz_store.cc:276] 0709 13:08:30.622658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.818591 (+2195933us) service_pool.cc:224] Handling call
0709 13:08:32.818979 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.819570 (+   591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.819732 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.820802 21763 rpcz_store.cc:276] 0709 13:08:30.684922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.819251 (+2134329us) service_pool.cc:224] Handling call
0709 13:08:32.819546 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.820104 (+   558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.820275 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.805366 24069 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:32.820962 21661 catalog_manager.cc:5697] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 2 to 3, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 3 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:32.798501 21660 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52326 (request call id 150) took 9868 ms. Trace:
I20260709 13:08:32.758435 23840 consensus_queue.cc:260] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:32.802963 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:32.803028 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:32.770303 21764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1001) took 2611 ms. Trace:
I20260709 13:08:32.775377 21805 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:32.807627 21757 rpcz_store.cc:276] 0709 13:08:27.783642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.670448 (+4886806us) service_pool.cc:224] Handling call
0709 13:08:32.730377 (+ 59929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.751028 (+ 20651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.777618 (+ 26590us) spinlock_profiling.cc:243] Waited 57.8 ms on lock 0x7b54000de150. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:32.777800 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132982528}
I20260709 13:08:32.830258 21728 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:32.830617 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.832074 21764 rpcz_store.cc:276] 0709 13:08:30.159358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.764698 (+2605340us) service_pool.cc:224] Handling call
0709 13:08:32.769585 (+  4887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.769908 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.769936 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:32.769995 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:32.770033 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.770113 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.770218 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:32.835826 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 67674.3us
W20260709 13:08:32.836304 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 75070.2us
I20260709 13:08:32.837380 21879 leader_election.cc:400] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4.
I20260709 13:08:32.837628 21805 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:32.839504 21805 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:32.839124 24058 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:32.841677 21839 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:32.843024 21757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2336) took 2119 ms. Trace:
I20260709 13:08:32.843739 21762 raft_consensus.cc:1240] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:32.843505 21757 rpcz_store.cc:276] 0709 13:08:30.723382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.840429 (+2117047us) service_pool.cc:224] Handling call
0709 13:08:32.840903 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.841223 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.841261 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:32.841307 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:32.841346 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.841402 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:32.842967 (+  1565us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.849496 23932 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:32.849968 23932 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:32.850064 24069 consensus_queue.cc:1059] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:32.851200 24069 consensus_queue.cc:1059] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:32.851962 24043 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:32.852380 24043 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:32.852988 24043 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:32.853205 23971 raft_consensus.cc:3055] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:32.853698 23971 raft_consensus.cc:740] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:32.854916 23971 consensus_queue.cc:260] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:32.856186 23971 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:32.858085 23840 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:32.860248 24034 consensus_queue.cc:1059] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:32.832351 23979 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:32.788308 23945 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:32.862643 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:32.863220 21805 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:32.850427 23932 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:32.861991 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 82158.9us
W20260709 13:08:32.861392 21729 leader_election.cc:336] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Timed out: RequestConsensusVote RPC to 127.20.40.3:43881 timed out after 1.611s (SENT)
I20260709 13:08:32.852416 24065 raft_consensus.cc:3055] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:32.861605 23853 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:32.862335 24066 raft_consensus.cc:3055] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:32.880672 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:32.863858 23945 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:32.864182 23818 consensus_meta.cc:287] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.011s
I20260709 13:08:32.888641 21757 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:32.817323 21756 rpcz_store.cc:276] 0709 13:08:30.571081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.815416 (+2244335us) service_pool.cc:224] Handling call
0709 13:08:32.815910 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.816699 (+   789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.816921 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.895263 23463 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:32.896952 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:32.897265 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.897615 24010 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:32.897786 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:32.897989 21838 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:32.898118 24010 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.890260 21661 catalog_manager.cc:5697] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 1 to 3, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 3 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:32.898561 21728 leader_election.cc:336] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.678s (SENT)
I20260709 13:08:32.883364 23853 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:32.905685 21661 catalog_manager.cc:5697] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 2 to 5, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 5 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.880198 24065 raft_consensus.cc:740] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:32.908793 21728 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:32.886595 24066 raft_consensus.cc:740] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:32.911289 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.903255 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:32.906313 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:32.912900 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 75965.8us
I20260709 13:08:32.913022 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.913902 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:32.915169 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:32.909835 23853 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:32.917811 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.824512 21660 rpcz_store.cc:276] 0709 13:08:22.930549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.930846 (+   297us) service_pool.cc:224] Handling call
0709 13:08:23.103211 (+172365us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54002ae254. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c1090 00007fc6ae35ff3a 00007fc6b41161cc 00007fc6b421437e 00007fc6b26d52a4 00007fc6b26d5232 00007fc6b26d5161 00007fc6b26d50dc 00007fc6b26d4392 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:32.798215 (+9695004us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:26.613679 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:26.779239 (+165560us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:26.779281 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:08:26.779308 (+    27us) tablet.cc:662] Decoding operations
0709 13:08:26.799834 (+ 20526us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:26.801621 (+  1787us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:26.801672 (+    51us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:08:26.974025 (+172353us) tablet.cc:701] Row locks acquired
0709 13:08:26.974048 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:08:26.974205 (+   157us) write_op.cc:270] Start()
0709 13:08:26.974337 (+   132us) write_op.cc:276] Timestamp: P: 1783602506974156 usec, L: 0
0709 13:08:26.974363 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:08:26.975080 (+   717us) log.cc:844] Serialized 5775 byte log entry
0709 13:08:28.170229 (+1195149us) op_driver.cc:464] REPLICATION: finished
0709 13:08:29.334273 (+1164044us) write_op.cc:301] APPLY: starting
0709 13:08:29.334355 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:29.334651 (+   296us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:29.334786 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:29.336825 (+  2039us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:29.337225 (+   400us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:08:29.446870 (+109645us) write_op.cc:312] APPLY: finished
0709 13:08:29.614334 (+167464us) log.cc:844] Serialized 107 byte log entry
0709 13:08:30.626839 (+1012505us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:30.643914 (+ 17075us) write_op.cc:454] Released schema lock
0709 13:08:30.649611 (+  5697us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:30.691367 (+ 41756us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:30.695967 (+  4600us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9,"reported_tablets":24,"spinlock_wait_cycles":336762624,"child_traces":[["op",{"apply.queue_time_us":1115418,"apply.run_cpu_time_us":40554,"apply.run_wall_time_us":1352704,"num_ops":15,"prepare.queue_time_us":156923,"prepare.run_cpu_time_us":49134,"prepare.run_wall_time_us":590444,"raft.queue_time_us":453802,"raft.run_cpu_time_us":33953,"raft.run_wall_time_us":1341016,"replication_time_us":1143533,"spinlock_wait_cycles":35584,"thread_start_us":2363359,"threads_started":5,"wal-append.queue_time_us":1225050,"wal-append.run_cpu_time_us":31603,"wal-append.run_wall_time_us":2847216}]]}
I20260709 13:08:32.876641 24061 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:32.904749 24010 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:32.924962 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.937806 21838 raft_consensus.cc:2410] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:32.880277 23828 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:32.935575 21834 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:32.915931 21877 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:32.938949 21840 raft_consensus.cc:2393] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 6: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:32.943835 22484 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:32.944319 21832 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:32.946691 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:32.951797 24061 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:32.956013 21805 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:32.939925 21758 raft_consensus.cc:1275] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:32.910523 23804 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.965772 21661 catalog_manager.cc:5697] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.973937 21758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2327) took 2402 ms. Trace:
I20260709 13:08:32.974481 21758 rpcz_store.cc:276] 0709 13:08:30.563864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.807496 (+2243632us) service_pool.cc:224] Handling call
0709 13:08:32.899568 (+ 92072us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.957774 (+ 58206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:32.966022 (+  8248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:32.976644 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:32.977411 22476 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:32.965608 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:32.978250 21661 catalog_manager.cc:5697] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 2 to 5, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 5 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.980154 21661 catalog_manager.cc:5697] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 2 to 5, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 5 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:32.981884 22485 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:32.982920 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:32.983920 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:32.984196 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:32.987145 23463 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:32.987970 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.988678 21905 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:32.989553 24043 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:32.966599 24061 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.991070 24061 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:32.993858 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 111044us
I20260709 13:08:32.994918 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.996198 23979 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:32.996688 23979 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:32.997062 23979 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:32.997202 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:32.998167 21907 raft_consensus.cc:2393] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:33.001995 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.003849 21908 raft_consensus.cc:1240] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:33.003935 21756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2339) took 2174 ms. Trace:
I20260709 13:08:33.004287 21909 raft_consensus.cc:1240] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:33.004417 21756 rpcz_store.cc:276] 0709 13:08:30.830036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.002920 (+2172884us) service_pool.cc:224] Handling call
0709 13:08:33.003298 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:33.003543 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:33.003571 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:33.003633 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:33.003691 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.003747 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.003862 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:33.006815 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.001080 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:33.007759 21905 raft_consensus.cc:2393] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:32.993413 24061 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:32.989962 21661 catalog_manager.cc:5697] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:33.008505 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:33.002111 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:33.009819 21879 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:33.009629 21661 catalog_manager.cc:5697] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:33.009238 22479 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:33.010766 23463 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:33.014447 23463 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.014865 23463 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.011514 21879 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:33.017840 23845 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.018277 21879 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:33.019213 21879 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:33.011974 21729 leader_election.cc:336] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Timed out: RequestConsensusVote RPC to 127.20.40.3:43881 timed out after 1.850s (SENT)
I20260709 13:08:33.020001 23845 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:33.020067 21729 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:33.020733 23804 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:33.021960 21729 leader_election.cc:336] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Timed out: RequestConsensusVote RPC to 127.20.40.3:43881 timed out after 1.791s (SENT)
I20260709 13:08:33.022450 21729 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:33.023252 23804 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:33.023478 23813 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:32.972692 23945 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:33.023701 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:33.024245 23813 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:33.024571 21908 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.025691 24069 raft_consensus.cc:2804] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:33.026161 24069 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:33.026590 24069 raft_consensus.cc:3060] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:32.905171 23818 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:33.030418 21906 raft_consensus.cc:2368] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5.
I20260709 13:08:33.031234 23818 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:33.031348 23977 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.031961 23818 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:33.025313 23895 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:33.033794 23895 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:33.034149 23895 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.034202 21908 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:33.036402 21731 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:33.033118 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 148423us
I20260709 13:08:33.039376 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.039991 21835 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:33.040382 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:33.040781 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:33.040982 21831 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:33.041827 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.042011 21832 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:33.042562 21837 raft_consensus.cc:2393] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 7: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:33.043210 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.043911 21832 raft_consensus.cc:2393] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:33.044435 21837 raft_consensus.cc:1240] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:33.044705 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:33.041332 21835 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.045387 21839 raft_consensus.cc:2393] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:33.046576 21833 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:33.046693 21762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 214) took 3547 ms. Trace:
I20260709 13:08:33.047027 21762 rpcz_store.cc:276] 0709 13:08:29.499646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.732087 (+3232441us) service_pool.cc:224] Handling call
0709 13:08:32.832334 (+100247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.844720 (+ 12386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.046504 (+201784us) spinlock_profiling.cc:243] Waited 91.8 ms on lock 0x7b54001c7fd0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:33.046620 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211055360}
I20260709 13:08:33.049501 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.050103 21836 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:32.980733 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:33.051895 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:33.054632 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.012826 21757 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:32.992074 24043 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:32.953860 24065 consensus_queue.cc:260] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:33.059270 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.059736 24065 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:33.061497 21834 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:33.058267 21831 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:33.053907 22449 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:32.937821 24060 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:33.058724 23813 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:33.052146 21835 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:33.076651 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:32.967904 24058 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:33.086753 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.088585 21836 raft_consensus.cc:2368] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5.
W20260709 13:08:33.084611 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 173324us
I20260709 13:08:33.091450 22449 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:33.092217 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:33.086750 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:33.096151 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.097391 21905 raft_consensus.cc:1240] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:33.081977 23813 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:33.102837 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 83711.1us
I20260709 13:08:33.105912 21910 raft_consensus.cc:1240] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:33.109853 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:33.102864 23813 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.097172 24043 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:33.020740 23979 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:33.084559 24060 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.122362 21759 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:33.123171 21759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 218) took 3622 ms. Trace:
I20260709 13:08:33.124575 21912 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.123553 21759 rpcz_store.cc:276] 0709 13:08:29.500748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.942693 (+3441945us) service_pool.cc:224] Handling call
0709 13:08:33.097365 (+154672us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:33.122854 (+ 25489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.123103 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:33.097009 23840 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:08:33.109493 23804 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:33.104027 23977 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:33.138971 21879 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:33.120127 24043 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.142006 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.148516 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:33.150383 22477 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:33.136780 24058 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:33.155023 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.137856 23804 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:33.147825 24043 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:33.161270 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 139326us
I20260709 13:08:33.148940 22478 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.164297 23998 consensus_queue.cc:1059] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:08:33.165601 23977 raft_consensus.cc:3055] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:33.165972 23977 raft_consensus.cc:740] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:33.166812 23977 consensus_queue.cc:260] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.167995 23977 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:33.175520 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 50111.1us
I20260709 13:08:33.174203 21909 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:33.160694 23804 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:33.178879 21908 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:33.188244 21879 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:33.189450 21879 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:33.190441 21905 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:33.163187 24058 raft_consensus.cc:697] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:33.192034 21879 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:33.195276 22449 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:33.202869 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2333) took 2507 ms. Trace:
I20260709 13:08:33.189652 22476 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:33.220023 21905 raft_consensus.cc:1240] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:08:33.216322 21879 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:33.217528 23818 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:33.145128 24066 consensus_queue.cc:260] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.218415 24058 consensus_queue.cc:237] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.203311 21765 rpcz_store.cc:276] 0709 13:08:30.695237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.821154 (+2125917us) service_pool.cc:224] Handling call
0709 13:08:32.846025 (+ 24871us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.864477 (+ 18452us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:32.971744 (+107267us) log.cc:844] Serialized 14 byte log entry
0709 13:08:33.202493 (+230749us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:33.202563 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:33.202621 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.202689 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.202810 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":114781,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":27,"thread_start_us":262728,"threads_started":3}
I20260709 13:08:33.182029 24034 consensus_queue.cc:1059] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:08:33.218178 23813 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.243520 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.200065 23845 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:33.209880 23840 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:33.246214 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 120927us
I20260709 13:08:33.247664 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2335) took 2539 ms. Trace:
I20260709 13:08:33.248075 21763 rpcz_store.cc:276] 0709 13:08:30.708395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.822122 (+2113727us) service_pool.cc:224] Handling call
0709 13:08:32.822499 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.822838 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:08:32.835393 (+ 12555us) log.cc:844] Serialized 14 byte log entry
0709 13:08:33.247360 (+411967us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:33.247419 (+    59us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:33.247458 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.247517 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.247612 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11757,"prepare.queue_time_us":156160,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"thread_start_us":344804,"threads_started":3,"wal-append.queue_time_us":298922}
I20260709 13:08:33.250273 21908 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:33.234494 23818 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:33.261790 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 111914us
I20260709 13:08:33.245865 23845 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:33.238332 24071 consensus_queue.cc:1059] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 13:08:33.285297 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 90133.5us
I20260709 13:08:33.270989 23818 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.300197 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.252317 24069 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.303990 24068 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:33.306239 23463 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:33.306794 24078 log.cc:927] Time spent T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:33.310736 23813 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:33.253196 23932 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.284533 23845 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:33.311666 24074 log.cc:927] Time spent T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.335s	user 0.002s	sys 0.000s
I20260709 13:08:33.312804 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.313284 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1357) took 1363 ms. Trace:
I20260709 13:08:33.313638 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.313944 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.314432 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.316351 23853 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:33.280354 23979 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:33.317773 21806 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:33.272214 23840 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:33.326303 24060 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:33.367188 24083 log.cc:927] Time spent T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:08:33.367132 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:33.376228 22477 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:33.325513 24061 consensus_queue.cc:1059] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:08:33.376710 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:33.361814 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.377589 21905 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:08:33.378078 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.375159 21910 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:33.372848 21913 raft_consensus.cc:1240] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:08:33.352196 22485 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:33.370268 21729 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:33.378006 21906 rpcz_store.cc:276] 0709 13:08:31.955704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.350017 (+394313us) service_pool.cc:224] Handling call
0709 13:08:33.313058 (+963041us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b540032d054. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:33.313229 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1548704512}
I20260709 13:08:33.395489 21912 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:33.397749 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.400313 22483 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:33.401930 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:33.402355 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:33.403105 22482 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:33.403402 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 129773us
W20260709 13:08:33.404114 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 86441.6us
I20260709 13:08:33.405664 21728 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:33.405893 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:33.406459 21760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2326) took 2845 ms. Trace:
I20260709 13:08:33.406860 21760 rpcz_store.cc:276] 0709 13:08:30.552695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.806160 (+2253465us) service_pool.cc:224] Handling call
0709 13:08:32.821955 (+ 15795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:32.822386 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:32.904115 (+ 81729us) log.cc:844] Serialized 14 byte log entry
0709 13:08:33.396560 (+492445us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:33.396636 (+    76us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:33.396689 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.396769 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.396922 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27630,"prepare.queue_time_us":88539,"prepare.run_cpu_time_us":3610,"prepare.run_wall_time_us":20260,"raft.queue_time_us":89865,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":115,"thread_start_us":386407,"threads_started":3}
I20260709 13:08:33.404227 21879 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:33.366137 24034 raft_consensus.cc:3055] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:33.408444 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.408980 21914 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:33.329356 24050 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:33.363461 24069 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:33.349545 23932 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:33.394368 23998 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:33.334192 23860 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:33.393200 23828 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:33.410393 24091 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:33.347290 23895 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.366513 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:33.410846 23813 consensus_queue.cc:1059] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:33.428089 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.428632 21914 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:33.334013 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:33.366983 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:33.423728 23845 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:33.377173 23840 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:33.356474 24066 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.413872 21910 raft_consensus.cc:2393] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 6: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:33.372442 23463 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:33.415994 21806 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:33.413548 24034 raft_consensus.cc:740] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:33.353542 24010 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:33.420487 23932 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:33.422237 23853 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:33.423461 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:33.424491 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.398481 23971 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:33.424337 22478 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:33.430464 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1008) took 3010 ms. Trace:
I20260709 13:08:33.430423 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.451102 23845 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:33.431524 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 61339.3us
I20260709 13:08:33.435076 24050 raft_consensus.cc:697] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:33.453485 23932 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:33.454393 21729 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:33.443493 21907 raft_consensus.cc:1240] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:33.444968 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.469086 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.462486 21914 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 2.
I20260709 13:08:33.419145 22449 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:33.442783 21804 connection.cc:256] RPC call timeout handler was delayed by -3.1446937159998924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22200000000000003s for a response
I20260709 13:08:33.454303 24050 consensus_queue.cc:237] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:33.455327 21909 raft_consensus.cc:2393] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 4: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:33.455890 24034 consensus_queue.cc:260] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.456418 23932 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:33.457589 22479 raft_consensus.cc:2393] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 6: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:33.440670 23860 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:33.450847 21761 rpcz_store.cc:276] 0709 13:08:30.420395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.769395 (+2349000us) service_pool.cc:224] Handling call
0709 13:08:32.799069 (+ 29674us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:32.800166 (+  1097us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.800210 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:32.801064 (+   854us) log.cc:844] Serialized 52 byte log entry
0709 13:08:32.876298 (+ 75234us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:33.055804 (+179506us) log.cc:844] Serialized 14 byte log entry
0709 13:08:33.056037 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.056099 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:33.311435 (+255336us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b200019d5f8. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6adf05b91 00007fc6adf27a19 00007fc6adef28c3 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169 00007fc6adefb131 00007fc6adefa42d 000000000038f354
0709 13:08:33.424819 (+113384us) raft_consensus.cc:1685] finished
0709 13:08:33.430228 (+  5409us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.430382 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":103171,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":38,"raft.queue_time_us":1892,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":2287,"spinlock_wait_cycles":29793664,"thread_start_us":224924,"threads_started":2,"wal-append.queue_time_us":174515}
I20260709 13:08:33.442638 24097 raft_consensus.cc:3055] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:08:33.460793 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 137819us
I20260709 13:08:33.460414 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.486270 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.486557 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:08:33.494886 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 77673.5us
I20260709 13:08:33.422230 23818 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:33.504114 21913 raft_consensus.cc:2393] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:33.504666 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:33.514644 21731 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:33.515581 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.516453 21764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2337) took 2762 ms. Trace:
W20260709 13:08:33.517879 21804 connection.cc:256] RPC call timeout handler was delayed by -2.9412937159999046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24460000000000004s for a response
I20260709 13:08:33.518651 21910 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:33.517796 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:33.519649 21914 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:33.518527 21804 connection.cc:256] RPC call timeout handler was delayed by -1.8205204289999983s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
W20260709 13:08:33.520129 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 83126us
I20260709 13:08:33.520510 21906 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:08:33.520498 21804 connection.cc:256] RPC call timeout handler was delayed by -1.7926204289999532s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
I20260709 13:08:33.527896 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:33.528194 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:33.534768 21909 raft_consensus.cc:2393] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:33.529583 21912 raft_consensus.cc:2393] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 4: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:33.532734 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:33.538444 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.515964 23932 raft_consensus.cc:2804] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:33.506645 23828 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:33.516827 21764 rpcz_store.cc:276] 0709 13:08:30.754611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:32.842875 (+2088264us) service_pool.cc:224] Handling call
0709 13:08:32.847913 (+  5038us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:32.848388 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:32.848421 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:32.849121 (+   700us) log.cc:844] Serialized 52 byte log entry
0709 13:08:33.140366 (+291245us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:33.159795 (+ 19429us) log.cc:844] Serialized 14 byte log entry
0709 13:08:33.412852 (+253057us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b18002f1400. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab24ce07 00007fc6b40a7ab9 00007fc6ab26969b 00007fc6ab26793f 00007fc6ab267455 00007fc6ae34f060 00007fc6ae361716 00007fc6ae372287 00007fc6ae372208
0709 13:08:33.483157 (+ 70305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:33.483274 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:33.483341 (+    67us) raft_consensus.cc:1685] finished
0709 13:08:33.510332 (+ 26991us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:33.514927 (+  4595us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18091,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":144039,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":2284,"spinlock_wait_cycles":5062528,"thread_start_us":345943,"threads_started":2,"wal-append.queue_time_us":364685}
I20260709 13:08:33.542786 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:33.543123 21840 raft_consensus.cc:1240] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:33.504143 24097 raft_consensus.cc:740] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:08:33.539264 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 84983.5us
I20260709 13:08:33.542827 21835 raft_consensus.cc:1240] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:33.546108 21834 raft_consensus.cc:1240] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:33.545882 24104 consensus_queue.cc:1059] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:08:33.547197 24104 raft_consensus.cc:3055] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:33.547533 24104 raft_consensus.cc:740] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:33.548311 24104 consensus_queue.cc:260] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.549396 24101 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.549763 21905 raft_consensus.cc:2376] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6. Re-sending same reply.
I20260709 13:08:33.550447 24010 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:33.550729 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.551069 24010 consensus_queue.cc:1059] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:33.551896 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:33.552434 21905 raft_consensus.cc:3055] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:33.552767 21905 raft_consensus.cc:740] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:33.553539 24102 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:08:33.553962 23818 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:33.555574 24098 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:33.556137 24098 raft_consensus.cc:697] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:33.533273 23860 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:33.557054 24098 consensus_queue.cc:237] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.561784 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.562487 21909 raft_consensus.cc:2368] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6.
I20260709 13:08:33.562909 23804 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.552161 24010 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:33.520617 24060 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:33.555272 24043 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:33.568159 21838 raft_consensus.cc:2368] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 4. Current term is 5.
I20260709 13:08:33.563251 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.569888 21806 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:33.533653 23840 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:33.575253 21906 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:33.585496 22481 raft_consensus.cc:1240] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 1. Current term is 2. Ops: []
I20260709 13:08:33.581816 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.589001 21729 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:33.581365 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.592342 21909 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:33.540493 23932 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:33.564886 24065 consensus_meta.cc:287] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.001s
I20260709 13:08:33.543183 24034 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.593040 21840 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:33.594153 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.580030 22483 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:33.594696 21914 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
W20260709 13:08:33.580511 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 53236.5us
W20260709 13:08:33.596243 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 56864.9us
I20260709 13:08:33.597064 21731 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:33.585918 24043 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:33.584395 24060 raft_consensus.cc:697] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:33.604796 21908 raft_consensus.cc:2410] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:33.605536 24060 consensus_queue.cc:237] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.574910 23895 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:33.610697 21835 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:33.610942 21729 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:33.579686 21905 consensus_queue.cc:260] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.588235 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:33.610766 24091 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:33.612062 24107 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:33.614758 22479 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.586483 24097 consensus_queue.cc:260] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:33.588719 23828 consensus_queue.cc:1059] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:08:33.615175 24107 raft_consensus.cc:697] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:33.615741 24097 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.614789 21806 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:33.617616 24043 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:33.617697 21806 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:33.618170 24043 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:33.584774 23840 raft_consensus.cc:697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:33.618618 24043 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:33.619550 21806 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:33.620477 24106 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:33.620996 24106 raft_consensus.cc:697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:33.621574 23860 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:33.621980 23860 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:33.622336 23860 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:33.593500 24010 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.624624 21806 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:33.625727 24010 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:33.603196 23932 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:33.626317 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:33.628233 24106 consensus_queue.cc:237] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.616569 23804 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:33.619205 23840 consensus_queue.cc:237] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.629597 24102 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:33.630179 24102 raft_consensus.cc:697] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:33.631102 24102 consensus_queue.cc:237] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.617151 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.616163 24107 consensus_queue.cc:237] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:33.633657 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:33.635223 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.635087 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.638340 21905 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:33.585561 23998 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:33.637213 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 45920.1us
I20260709 13:08:33.645180 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:33.644739 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:33.651638 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.645889 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.654294 21836 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 5: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:33.657040 21835 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:33.657307 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:33.658253 21909 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:33.662413 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:33.659736 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:33.663928 21840 raft_consensus.cc:2393] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:33.637264 24104 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:33.662106 24091 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:33.666544 23828 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:33.666790 24091 raft_consensus.cc:697] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:33.667274 23828 raft_consensus.cc:3055] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:33.667651 23828 raft_consensus.cc:740] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:33.667742 24091 consensus_queue.cc:237] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.668541 23828 consensus_queue.cc:260] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:33.648025 22480 raft_consensus.cc:1240] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:33.669569 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 58731.7us
I20260709 13:08:33.669706 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.669957 23828 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.670867 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:33.672097 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.672117 24043 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.674180 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:33.674923 22478 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:33.675112 24043 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:33.676914 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.677505 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.677821 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:33.678246 21839 raft_consensus.cc:2393] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:33.679040 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:33.679602 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:33.680009 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:33.680212 21913 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:33.681078 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.644495 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:33.661983 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:33.681744 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.683321 22450 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:33.683645 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.684033 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.686297 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.688436 23804 consensus_queue.cc:1059] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:33.702453 23804 raft_consensus.cc:3055] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:33.702792 23804 raft_consensus.cc:740] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:33.703663 23804 consensus_queue.cc:260] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.704741 23804 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:33.704427 23932 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.705686 21838 raft_consensus.cc:2393] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:33.706347 22450 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:33.707916 23977 raft_consensus.cc:2804] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:33.708392 23977 raft_consensus.cc:697] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:33.708611 24096 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:33.709313 24096 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:33.709702 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.710002 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.710326 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.711151 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.711418 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:33.712095 21840 raft_consensus.cc:2393] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:33.712225 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.626350 24010 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:08:33.712788 21837 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:33.690135 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:33.713773 21912 raft_consensus.cc:2410] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:08:33.688740 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.714573 24094 consensus_queue.cc:1059] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:33.709339 23977 consensus_queue.cc:237] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.715605 24094 raft_consensus.cc:3055] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:33.715950 24094 raft_consensus.cc:740] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:33.657390 23998 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:33.713349 21877 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:33.695468 21835 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:33.697595 23860 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.698431 21906 raft_consensus.cc:1240] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:33.712663 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.699193 23853 raft_consensus.cc:3055] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:33.699630 21834 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:33.700289 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.701503 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:33.712728 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:33.729606 21831 raft_consensus.cc:2393] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:33.726897 21833 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
W20260709 13:08:33.738004 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.738782 21840 raft_consensus.cc:2393] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:33.720383 21806 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:33.726123 23853 raft_consensus.cc:740] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:33.716847 24094 consensus_queue.cc:260] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.740609 24094 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:33.739645 24100 raft_consensus.cc:3055] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:33.697117 21909 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:33.740648 23853 consensus_queue.cc:260] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:33.749753 21909 raft_consensus.cc:1240] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:33.749050 21905 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:33.719432 24098 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:33.752723 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:33.719660 24101 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:08:33.753960 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.762629 21835 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:33.738291 24010 consensus_queue.cc:1059] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:08:33.764485 21914 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 2.
I20260709 13:08:33.765249 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:33.765976 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.766564 21761 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:33.766667 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:33.750262 24100 raft_consensus.cc:740] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:33.768432 22479 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:33.768503 24100 consensus_queue.cc:260] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:33.769562 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.769727 21731 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:33.770217 24100 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.770689 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:33.773731 23945 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:33.774237 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:33.774885 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:33.775305 21912 raft_consensus.cc:1240] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:33.776067 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:33.776283 23860 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:33.776654 21760 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:33.780942 22478 raft_consensus.cc:1240] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:08:33.782536 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:33.774247 23945 raft_consensus.cc:697] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:33.783053 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:33.783880 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.783820 23945 consensus_queue.cc:237] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.784471 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.785702 21759 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.783265 22483 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:33.792703 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.793295 21758 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:33.793220 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:33.790949 22449 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:33.794661 21759 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:33.795974 21761 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:33.799181 22449 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:33.752830 24061 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:33.810499 22483 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:33.802403 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:33.753791 24098 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:33.793953 23895 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:33.813771 21765 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:33.802074 24060 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:33.814045 21877 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:33.814558 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.802913 24096 consensus_queue.cc:1059] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:33.803540 21911 raft_consensus.cc:1240] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:33.802457 24034 raft_consensus.cc:2764] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:08:33.803702 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.805779 23853 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:33.815028 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.819964 21759 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:08:33.821465 21913 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:33.821825 21806 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:33.822479 21905 raft_consensus.cc:1275] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:33.825867 23818 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:33.828483 21764 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:33.782632 24105 consensus_queue.cc:1059] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:08:33.829066 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.813843 24098 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:33.814124 24061 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:33.822608 24065 consensus_queue.cc:1059] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:08:33.834008 21877 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:33.834241 24071 raft_consensus.cc:3055] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:33.835157 23932 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:33.836170 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.838676 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.841838 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.843257 23860 raft_consensus.cc:3055] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:33.843639 23860 raft_consensus.cc:740] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:33.843978 24065 raft_consensus.cc:3055] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:33.844390 24065 raft_consensus.cc:740] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:33.844430 23860 consensus_queue.cc:260] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.840469 24058 consensus_queue.cc:1048] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:08:33.845345 24065 consensus_queue.cc:260] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.846742 24065 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.847685 21758 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:08:33.841019 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.850888 21765 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:33.854941 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.828068 24060 raft_consensus.cc:697] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:33.850384 21761 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:33.856961 21764 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:33.857303 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.860459 21877 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:33.839658 24061 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:33.861932 21880 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:33.862689 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.822597 23998 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:33.869848 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:33.870607 21760 raft_consensus.cc:2393] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 6: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:33.870988 23998 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:33.869885 21897 tablet_service.cc:1558] Processing DeleteTablet for tablet a218be1e72294b138c21b46dfa317d11 with delete_type TABLET_DATA_TOMBSTONED (TS 6d698a5544b946939790e7a3972db9fb not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:49532
I20260709 13:08:33.871379 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.861043 21762 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:33.871943 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:33.866142 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:33.825095 23895 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:33.872721 21913 raft_consensus.cc:2393] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:33.866660 23971 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:33.866984 24043 raft_consensus.cc:3055] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:33.867848 24068 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:33.866680 23845 consensus_queue.cc:1048] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:08:33.838802 24071 raft_consensus.cc:740] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:33.891063 22483 raft_consensus.cc:1240] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:33.891106 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:33.874001 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 52239us
I20260709 13:08:33.876116 21759 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:33.890664 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.879976 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.893330 21914 raft_consensus.cc:2393] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:33.880447 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:33.882789 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.882882 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.894389 21908 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:33.898069 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.898663 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.900133 21756 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:08:33.900251 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.901086 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.902068 21912 raft_consensus.cc:2393] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 7: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:33.902743 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.889669 21761 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:33.890625 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:33.865761 21763 raft_consensus.cc:2393] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 4: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:33.852334 23818 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:08:33.905346 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:33.907058 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:33.907157 21910 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:33.909590 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.954033 21761 raft_consensus.cc:2393] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:33.955083 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.956326 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:33.957000 22479 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:33.958036 21757 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:33.959257 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:33.881270 24043 raft_consensus.cc:740] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:33.955672 21761 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:33.963402 21756 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
W20260709 13:08:33.964141 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.886096 23932 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:33.976257 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.977319 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.977912 21763 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:33.978407 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 78323.1us
I20260709 13:08:33.979571 21908 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:08:33.981068 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:33.983660 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:33.983840 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.983964 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:33.984572 21764 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:33.985767 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:33.985927 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 78904.9us
I20260709 13:08:33.987754 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:33.905103 24068 raft_consensus.cc:697] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:33.900604 24050 raft_consensus.cc:2764] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:08:34.032685 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.022778 22449 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:34.022984 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:33.883718 24102 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:08:33.954074 23895 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:34.034497 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 48346.4us
W20260709 13:08:34.037878 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.040019 23860 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:34.039801 24050 consensus_queue.cc:1059] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:34.040356 21877 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:34.047369 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 163984us
I20260709 13:08:34.065593 24071 consensus_queue.cc:260] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:34.067687 21764 raft_consensus.cc:1240] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:34.069355 21908 raft_consensus.cc:1240] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:33.961398 23971 consensus_queue.cc:1059] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
W20260709 13:08:34.078043 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.064250 21756 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:34.084051 21761 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:34.033480 23932 raft_consensus.cc:697] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:34.050427 24094 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:08:34.093385 21729 leader_election.cc:336] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Timed out: RequestConsensusVote RPC to 127.20.40.3:43881 timed out after 2.761s (SENT)
I20260709 13:08:34.097596 21729 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:34.084601 21805 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:34.092670 21763 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:34.103045 22480 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
W20260709 13:08:34.103771 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 63492.1us
I20260709 13:08:34.105505 21805 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:34.108074 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:34.108989 21805 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:34.109846 21805 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:34.110472 24094 raft_consensus.cc:697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:34.111439 24094 consensus_queue.cc:237] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:34.113590 24105 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:34.114073 24105 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.114465 24105 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:34.117159 21805 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:34.123014 21756 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:34.124310 21879 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:34.127297 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:34.129027 21763 raft_consensus.cc:1275] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:34.134372 21756 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:34.076782 23979 consensus_queue.cc:1059] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:08:34.136628 21805 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:34.147194 21877 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:34.135201 24071 raft_consensus.cc:3060] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:34.136221 24100 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:34.154263 21804 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:34.139948 24010 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:34.162371 21756 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:34.136639 24101 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:34.141924 24091 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:34.141512 24069 raft_consensus.cc:2804] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:34.086822 24043 consensus_queue.cc:260] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:34.083993 24060 consensus_queue.cc:237] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:34.183169 24128 tablet_replica.cc:333] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:08:34.175977 24100 raft_consensus.cc:697] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:34.187772 24100 consensus_queue.cc:237] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:34.163686 23895 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.190778 23895 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:34.192543 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.194180 24043 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:34.205971 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 51794.9us
I20260709 13:08:34.177830 21877 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:34.201171 24126 log.cc:927] Time spent T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:08:34.165403 24102 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:34.211539 21804 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:34.214318 24110 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:34.164940 24010 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.179118 24107 raft_consensus.cc:2764] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:08:34.169561 23932 consensus_queue.cc:237] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:34.179620 23979 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:34.225844 23979 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:34.226615 23979 raft_consensus.cc:697] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:34.175235 24069 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:34.243727 24069 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:34.231654 24102 raft_consensus.cc:697] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:34.246762 23463 raft_consensus.cc:3055] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:34.247414 23463 raft_consensus.cc:740] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:34.247171 24102 consensus_queue.cc:237] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:34.250869 24119 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:34.256954 21880 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:34.268285 24110 raft_consensus.cc:697] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:34.269618 24110 consensus_queue.cc:237] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:34.164423 24068 consensus_queue.cc:237] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:34.230054 24010 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:34.293694 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 215819us
I20260709 13:08:34.295435 21729 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:34.296329 23828 raft_consensus.cc:2804] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:34.296489 23818 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:34.296739 23828 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:34.324343 21728 leader_election.cc:336] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.552s (SENT)
W20260709 13:08:34.334259 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 205332us
I20260709 13:08:34.335700 21805 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:34.336699 24119 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:08:34.316627 23804 consensus_meta.cc:287] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.611s	user 0.003s	sys 0.009s
W20260709 13:08:34.299139 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 91882us
I20260709 13:08:34.347384 22480 raft_consensus.cc:1240] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:34.248669 23463 consensus_queue.cc:260] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:34.301736 23845 raft_consensus.cc:3055] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:08:34.306438 24121 log.cc:927] Time spent T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.269s	user 0.002s	sys 0.000s
I20260709 13:08:34.312031 24065 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:34.227833 23979 consensus_queue.cc:237] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:34.314421 22479 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:34.315905 24105 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:34.318204 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 140523us
I20260709 13:08:34.351518 21805 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:34.298327 21729 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:34.337221 24119 raft_consensus.cc:697] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:34.350627 21760 raft_consensus.cc:1240] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:34.326511 23828 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:34.329496 23895 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:34.360246 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.334380 23818 raft_consensus.cc:697] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:34.374200 21805 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:34.376124 21877 leader_election.cc:400] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5.
I20260709 13:08:34.382763 21877 leader_election.cc:403] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:34.377477 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 79162.4us
I20260709 13:08:34.349706 23845 raft_consensus.cc:740] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:34.384114 21729 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:34.384552 23463 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:34.389393 23818 consensus_queue.cc:237] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:34.376118 24065 raft_consensus.cc:697] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:34.380760 24107 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:08:34.399546 21762 consensus_meta.cc:287] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.007s
I20260709 13:08:34.399956 21762 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
W20260709 13:08:34.407430 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 110091us
I20260709 13:08:34.391965 23840 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:34.400938 24098 consensus_meta.cc:287] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.553s	user 0.003s	sys 0.011s
W20260709 13:08:34.415195 22448 leader_election.cc:336] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.509s (SENT)
I20260709 13:08:34.418638 22448 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:34.423717 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 49601.8us
I20260709 13:08:34.405097 24091 raft_consensus.cc:3060] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:34.407863 24134 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5.
I20260709 13:08:34.425659 21729 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:34.408320 24107 raft_consensus.cc:697] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:34.413165 24125 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:08:34.442701 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.400527 24010 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:34.418044 23840 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:34.428386 21805 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:34.450516 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 193710us
I20260709 13:08:34.413064 23971 consensus_queue.cc:1059] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 13:08:34.464692 21765 consensus_meta.cc:287] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.607s	user 0.008s	sys 0.008s
I20260709 13:08:34.465567 21765 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
W20260709 13:08:34.478338 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 50039.8us
I20260709 13:08:34.479429 21805 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:34.447822 23977 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:34.422858 23845 consensus_queue.cc:260] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:34.470508 23853 consensus_meta.cc:287] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.648s	user 0.012s	sys 0.002s
W20260709 13:08:34.491168 24061 consensus_meta.cc:287] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.600s	user 0.012s	sys 0.000s
I20260709 13:08:34.491806 24061 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:34.499138 24104 raft_consensus.cc:3055] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:34.499734 24104 raft_consensus.cc:740] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:34.465618 23840 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:34.506119 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 381908us
I20260709 13:08:34.507036 21879 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:34.507929 24136 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:34.508327 21879 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:34.510066 21804 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:34.510511 21879 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:34.521196 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:34.521370 21879 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:34.522142 21835 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:34.523980 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:34.423272 24098 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:34.525246 21839 raft_consensus.cc:2393] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:34.527421 21879 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:34.530546 21840 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:34.539280 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.427740 24119 consensus_queue.cc:237] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:34.534231 24130 log.cc:927] Time spent T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:08:34.516784 24135 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:34.526736 24136 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:34.500851 24104 consensus_queue.cc:260] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:34.557390 24139 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:34.552897 24107 consensus_queue.cc:237] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:34.562531 24010 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:34.563596 24133 log.cc:927] Time spent T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
W20260709 13:08:34.567149 22448 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.588s (SENT) [suppressed 81 similar messages]
I20260709 13:08:34.570674 24069 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:34.571362 23840 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:34.577600 23945 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:34.528677 24134 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:34.556368 21909 raft_consensus.cc:1240] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:34.583068 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 55762.5us
W20260709 13:08:34.592294 22448 leader_election.cc:336] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.679s (SENT)
I20260709 13:08:34.616082 22448 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:34.526466 24106 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:34.614054 21877 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:34.514380 24065 consensus_queue.cc:237] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:34.619617 21879 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:34.620512 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 168770us
I20260709 13:08:34.591660 24100 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:34.623360 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 200871us
I20260709 13:08:34.624156 21905 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:08:34.624254 21729 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:34.625378 22448 leader_election.cc:336] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.826s (SENT)
W20260709 13:08:34.627954 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.625686 21729 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:34.635037 22448 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:34.636142 21728 leader_election.cc:336] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.593s (SENT)
W20260709 13:08:34.642967 21728 leader_election.cc:336] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.594s (SENT)
I20260709 13:08:34.627099 24143 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:34.632181 24091 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:34.653288 21905 raft_consensus.cc:606] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:34.653743 21905 raft_consensus.cc:614] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:34.645350 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.614065 24135 raft_consensus.cc:697] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:34.619131 24105 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:34.652683 21879 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:34.626207 23977 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:34.660297 21879 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:34.663972 21908 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:08:34.665488 21728 leader_election.cc:336] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.622s (SENT)
I20260709 13:08:34.668923 21907 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:34.654047 24139 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:34.678488 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 52878.9us
I20260709 13:08:34.653733 24143 raft_consensus.cc:697] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:34.658761 24060 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:34.690121 21729 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:34.658509 24147 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:34.661931 24104 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:34.689625 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:34.627351 23945 consensus_queue.cc:1059] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:08:34.692327 22480 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:34.694402 21804 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:34.661381 24148 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:34.678013 24094 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:34.696027 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 70672.3us
I20260709 13:08:34.710350 21729 leader_election.cc:400] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6.
I20260709 13:08:34.710811 21729 leader_election.cc:403] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:34.660732 24110 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:08:34.685256 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 171276us
I20260709 13:08:34.658607 24136 consensus_queue.cc:1059] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:08:34.678146 24139 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:34.701603 24142 log.cc:927] Time spent T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:08:34.702196 21728 leader_election.cc:336] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.660s (SENT)
I20260709 13:08:34.732120 24105 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:08:34.696028 24043 consensus_meta.cc:287] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.005s
I20260709 13:08:34.733311 24105 raft_consensus.cc:697] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:34.734649 24105 consensus_queue.cc:237] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:34.704661 24135 consensus_queue.cc:237] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:34.699529 24061 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:34.709398 24148 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:34.717478 22448 leader_election.cc:336] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.908s (SENT)
W20260709 13:08:34.738806 24138 log.cc:927] Time spent T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.253s	user 0.003s	sys 0.000s
I20260709 13:08:34.715210 24134 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:08:34.740404 22448 leader_election.cc:336] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.974s (SENT)
I20260709 13:08:34.740849 22448 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:34.738879 24148 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:34.717931 23945 consensus_queue.cc:1243] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer 8c6c2207af3d47b3acf352d81959f4dd log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:34.708946 24091 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:34.720273 24136 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.740965 24134 raft_consensus.cc:3055] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:34.746007 24134 raft_consensus.cc:740] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:34.746093 24136 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:34.746960 24134 consensus_queue.cc:260] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:34.748251 24134 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:34.741707 24050 raft_consensus.cc:3055] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:34.718456 24150 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:34.721071 24143 consensus_queue.cc:237] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:34.732143 21728 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:34.753366 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 92893.6us
I20260709 13:08:34.756614 22485 raft_consensus.cc:1275] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:34.761147 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:34.764865 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:34.753839 24068 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:08:34.766861 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 80908.1us
I20260709 13:08:34.769825 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:34.749258 24139 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:34.753178 24050 raft_consensus.cc:740] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:34.754494 24091 raft_consensus.cc:697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:34.754393 23945 raft_consensus.cc:3055] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:34.784265 21833 raft_consensus.cc:1275] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:34.753613 23804 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:34.714671 24094 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:34.788033 24136 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:34.792460 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:08:34.714274 24110 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:34.766564 24060 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.768683 22479 raft_consensus.cc:1275] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:34.768035 24153 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6.
I20260709 13:08:34.763633 23840 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:34.763373 24061 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:08:34.793365 23945 raft_consensus.cc:740] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:08:34.850593 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 190266us
I20260709 13:08:34.859005 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:34.841682 24068 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:34.872321 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 162151us
I20260709 13:08:34.866073 21804 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:34.867139 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 164978us
I20260709 13:08:34.868135 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:34.843801 24102 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.829907 24060 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:34.890475 21804 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:34.846124 24043 consensus_queue.cc:1059] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:08:34.863996 24168 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:34.873054 21729 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:34.878602 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 335) took 1334 ms. Trace:
I20260709 13:08:34.901902 21909 rpcz_store.cc:276] 0709 13:08:33.544229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.750872 (+206643us) service_pool.cc:224] Handling call
0709 13:08:33.751121 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:34.615907 (+864786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:34.873343 (+257436us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b5400219b54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:34.878543 (+  5200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1851553664}
W20260709 13:08:34.876412 21728 leader_election.cc:336] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.665s (SENT)
I20260709 13:08:34.871358 21879 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:34.933174 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 60180.5us
W20260709 13:08:34.936731 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 60359.6us
W20260709 13:08:34.937459 21728 leader_election.cc:336] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.668s (SENT)
I20260709 13:08:34.874269 23977 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:08:34.897185 24107 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:34.879158 24091 consensus_queue.cc:237] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:34.943053 21729 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:34.891657 24102 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:34.949973 24155 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:34.950766 23828 consensus_meta.cc:287] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.003s
I20260709 13:08:34.951182 24156 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:34.951238 23828 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:34.952419 24156 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:34.903678 23804 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:08:34.954062 23845 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:34.864094 24050 consensus_queue.cc:260] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:34.905252 24069 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:34.955796 23977 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:34.956054 24128 raft_consensus.cc:2243] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:34.956297 23977 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:34.887084 24068 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:34.939380 23840 raft_consensus.cc:2764] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:08:34.915995 24119 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:34.886379 23945 consensus_queue.cc:260] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:34.938891 22448 leader_election.cc:336] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 2.056s (SENT)
I20260709 13:08:34.953589 24158 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:08:34.957389 24128 raft_consensus.cc:2272] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:34.999732 24128 ts_tablet_manager.cc:1916] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:08:34.971621 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 100365us
I20260709 13:08:35.002451 21879 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:35.101406 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 99024.3us
W20260709 13:08:35.101934 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 265237us
I20260709 13:08:35.104720 21879 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:34.990496 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 51702.1us
I20260709 13:08:34.980242 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:34.974320 21729 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:35.110375 22448 leader_election.cc:336] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 2.165s (SENT)
W20260709 13:08:34.959975 23463 consensus_meta.cc:287] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.000s
I20260709 13:08:34.975653 21804 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:35.147305 22448 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:35.135203 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.148097 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.047780 21728 leader_election.cc:336] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.711s (SENT)
I20260709 13:08:35.149003 21728 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:35.150840 21833 raft_consensus.cc:2393] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:35.119908 21839 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:08:35.151520 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.153185 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:35.153616 22480 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:08:35.153843 21905 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
W20260709 13:08:35.154386 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 286028us
I20260709 13:08:34.991870 24061 raft_consensus.cc:3055] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:08:35.111948 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.155803 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 180211us
I20260709 13:08:34.972918 24094 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:34.987366 23828 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:34.995784 22479 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:35.157115 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:35.159597 21880 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:35.163185 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 188934us
I20260709 13:08:35.165400 21906 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:08:35.165556 24151 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:35.169560 24140 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.170986 24166 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:35.171103 24156 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:35.172714 24107 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:35.173383 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:34.959128 24068 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:34.991401 24060 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:35.178015 21729 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:34.974121 24110 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:34.991150 24102 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:35.146839 24100 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:34.973143 23977 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:35.252569 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 74641us
I20260709 13:08:34.979298 24043 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:35.243440 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 89900.5us
W20260709 13:08:35.191270 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:34.973471 24167 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:35.183315 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 135588us
W20260709 13:08:35.266497 21728 leader_election.cc:336] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.755s (SENT)
I20260709 13:08:35.267112 21728 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:35.268275 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 157921us
I20260709 13:08:34.973169 24157 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:35.112139 24136 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:34.992340 24139 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:35.255528 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.275615 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.246503 21880 raft_consensus.cc:2686] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:08:35.276562 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 117051us
I20260709 13:08:35.277312 21880 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:35.005729 24153 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:35.257781 24148 consensus_meta.cc:287] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.003s
I20260709 13:08:35.242754 23895 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:35.269055 22448 leader_election.cc:336] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 2.170s (SENT)
I20260709 13:08:35.286065 24148 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:35.286850 22448 leader_election.cc:336] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 2.219s (SENT)
I20260709 13:08:35.287287 22448 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:34.981330 24104 consensus_queue.cc:1048] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.264s
I20260709 13:08:35.239351 23840 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:35.288638 24148 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:35.289017 23840 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:35.239123 24168 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:35.157841 24061 raft_consensus.cc:740] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:35.290581 24061 consensus_queue.cc:260] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:35.291828 24061 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.109159 24106 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.143s
I20260709 13:08:35.244825 24071 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:35.253935 21729 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
W20260709 13:08:35.298667 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 44807us
I20260709 13:08:35.286192 23895 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:35.274689 22449 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:35.252142 23828 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:35.299453 22480 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:35.304682 21760 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:35.307500 21761 raft_consensus.cc:1275] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:35.311386 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:35.312011 22483 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:35.312748 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:34.950760 24155 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:35.338339 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:35.338570 21764 raft_consensus.cc:1275] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:35.320549 21763 raft_consensus.cc:1240] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:35.321313 21907 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:35.322503 21879 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:35.293665 24143 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:35.275871 24157 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:35.323835 21760 raft_consensus.cc:1275] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:35.347301 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:35.344276 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:35.348628 21757 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:35.345086 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:35.350065 21761 raft_consensus.cc:2393] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 5: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:35.298089 24168 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.309744 23840 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:35.342655 21762 raft_consensus.cc:1275] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:08:35.350759 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 190376us
I20260709 13:08:35.270063 24100 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:35.273293 24043 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:35.354703 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:35.310442 24098 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:35.354970 22483 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:35.346329 21756 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:35.293701 23977 consensus_queue.cc:1059] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:08:35.253073 24140 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:35.246690 24166 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:35.393033 21804 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:35.390044 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 103191us
I20260709 13:08:35.346760 24071 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:35.311524 24148 consensus_queue.cc:1059] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
W20260709 13:08:35.397959 22448 leader_election.cc:336] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.698s (SENT)
I20260709 13:08:35.402344 22448 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:35.298205 24153 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:35.344051 24169 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:35.310000 24107 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:08:35.343768 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:35.380244 23971 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:35.395573 24147 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.383255 23840 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:35.398398 24102 consensus_queue.cc:1059] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
W20260709 13:08:35.397939 24134 consensus_meta.cc:287] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.649s	user 0.009s	sys 0.003s
I20260709 13:08:35.346900 24094 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:08:35.425150 21833 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:35.424321 23840 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:35.394580 24135 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:35.425839 24165 log.cc:927] Time spent T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.471s	user 0.010s	sys 0.002s
I20260709 13:08:35.401964 24143 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:35.422272 24171 log.cc:927] Time spent T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:08:35.353901 24157 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:35.428507 24164 log.cc:927] Time spent T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:08:35.429898 24162 log.cc:927] Time spent T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:35.378983 24168 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:35.396579 24060 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:08:35.385110 24068 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:08:35.443944 21757 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:35.451642 21906 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:35.432528 24010 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:35.452230 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:35.454854 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:08:35.457175 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 190716us
I20260709 13:08:35.465515 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:35.466815 21663 catalog_manager.cc:5697] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 1 to 2, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 2 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.475658 21880 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:35.426141 24147 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:35.493515 21762 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:08:35.496527 21661 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45746 (request call id 226) took 11610 ms (client timeout 15000 ms). Trace:
W20260709 13:08:35.495308 21728 leader_election.cc:336] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.792s (SENT)
I20260709 13:08:35.498512 21728 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:35.499306 21757 raft_consensus.cc:1275] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:35.400561 24174 consensus_queue.cc:1048] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
W20260709 13:08:35.487413 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 50315.3us
I20260709 13:08:35.383529 23828 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:08:35.451808 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:35.503240 21908 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:35.498807 21663 catalog_manager.cc:5697] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.505919 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:35.506467 21760 raft_consensus.cc:1813] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Handling vote request from an unknown peer 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:35.493702 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 95810.2us
I20260709 13:08:35.499171 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:35.508769 21756 raft_consensus.cc:2393] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:35.509629 24184 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:35.510644 24170 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:08:35.511665 24147 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:35.497473 21661 rpcz_store.cc:269] 0709 13:08:23.886425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.897286 (+ 10861us) service_pool.cc:224] Handling call
0709 13:08:35.496469 (+11599183us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:33.282383 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:33.307740 (+ 25357us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:33.307789 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:08:33.307808 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:33.308919 (+  1111us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:33.309002 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:33.309034 (+    32us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:08:33.374572 (+ 65538us) tablet.cc:701] Row locks acquired
0709 13:08:33.374635 (+    63us) write_op.cc:260] PREPARE: finished
0709 13:08:33.374838 (+   203us) write_op.cc:270] Start()
0709 13:08:33.375000 (+   162us) write_op.cc:276] Timestamp: P: 1783602513374772 usec, L: 0
0709 13:08:33.375023 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:08:33.430107 (+ 55084us) log.cc:844] Serialized 4356 byte log entry
0709 13:08:33.820271 (+390164us) op_driver.cc:464] REPLICATION: finished
0709 13:08:34.081842 (+261571us) write_op.cc:301] APPLY: starting
0709 13:08:34.081952 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:34.082222 (+   270us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:34.082432 (+   210us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:34.113895 (+ 31463us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:34.114201 (+   306us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:08:34.114251 (+    50us) write_op.cc:312] APPLY: finished
0709 13:08:34.114655 (+   404us) log.cc:844] Serialized 83 byte log entry
0709 13:08:34.126606 (+ 11951us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:34.142252 (+ 15646us) write_op.cc:454] Released schema lock
0709 13:08:34.156608 (+ 14356us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:34.214857 (+ 58249us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:34.216597 (+  1740us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":124119,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":228028,"apply.run_cpu_time_us":4068,"apply.run_wall_time_us":102853,"num_ops":11,"prepare.queue_time_us":131194,"prepare.run_cpu_time_us":38456,"prepare.run_wall_time_us":382514,"raft.queue_time_us":207814,"raft.run_cpu_time_us":14959,"raft.run_wall_time_us":59248,"replication_time_us":445049,"spinlock_wait_cycles":5376,"thread_start_us":416623,"threads_started":4,"wal-append.queue_time_us":164914,"wal-append.run_cpu_time_us":30940,"wal-append.run_wall_time_us":1573385}]]}
I20260709 13:08:35.496717 24143 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:35.445202 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 180281us
I20260709 13:08:35.411897 24169 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.514539 24169 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:35.493506 24167 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.515761 24167 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:35.518080 24167 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:35.519042 24140 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:35.519776 21910 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.519876 21758 raft_consensus.cc:1275] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:35.446040 23977 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:35.488389 24173 log.cc:927] Time spent T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.169s	user 0.002s	sys 0.000s
W20260709 13:08:35.522846 21728 leader_election.cc:336] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.823s (SENT)
I20260709 13:08:35.523300 21728 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:35.524236 21728 leader_election.cc:336] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.848s (SENT)
I20260709 13:08:35.524618 21728 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:35.525323 24184 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:35.526016 24184 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:35.526811 24100 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:35.529636 23845 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:35.530186 23845 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:35.530587 23845 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:35.530665 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:35.533529 24156 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:35.534327 21805 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:35.534482 24106 consensus_queue.cc:1059] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:35.535101 23932 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:35.535454 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:35.535621 24106 raft_consensus.cc:3055] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:35.535715 23932 raft_consensus.cc:697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:08:35.521255 24178 log.cc:927] Time spent T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:08:35.445793 23971 raft_consensus.cc:697] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:08:35.546223 24171 log.cc:927] Time spent T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:08:35.546082 23971 consensus_queue.cc:237] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:35.489387 24135 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:35.532871 24169 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:35.538650 21760 raft_consensus.cc:2393] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 5: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:35.539845 21763 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:35.491971 24136 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:35.583344 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 48818.5us
I20260709 13:08:35.529652 24091 raft_consensus.cc:3055] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:35.501441 24098 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:08:35.545020 23977 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.554507 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:35.555511 24151 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:35.491113 22479 raft_consensus.cc:2393] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:35.536028 24106 raft_consensus.cc:740] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:35.572850 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:35.593047 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:35.593616 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 274863us
I20260709 13:08:35.595026 21663 catalog_manager.cc:5697] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:35.542503 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 161356us
I20260709 13:08:35.604554 21908 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:35.605542 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:35.614984 21914 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:35.606137 21910 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:35.608189 21759 raft_consensus.cc:2393] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:35.609665 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:35.616977 21760 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:35.609939 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:35.618202 21913 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:35.610122 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:35.610742 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:08:35.623121 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.595903 24147 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.625150 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:35.537191 23932 consensus_queue.cc:237] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:35.629081 21908 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:35.602254 24043 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:35.608969 24091 raft_consensus.cc:740] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:35.634048 21879 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:35.642015 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:35.642737 21756 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:35.636956 21758 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:35.637944 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:35.643998 22482 raft_consensus.cc:2393] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:35.644259 22481 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:08:35.591353 24136 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:35.654377 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:35.667485 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:35.675866 21759 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:08:35.672995 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:35.677090 21756 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:35.677523 21765 raft_consensus.cc:1275] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:35.657325 21879 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:35.652671 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:35.672307 21908 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:35.680994 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:35.655800 21760 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:35.922040 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:35.887427 24135 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:35.859124 24091 consensus_queue.cc:260] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:35.984421 24102 raft_consensus.cc:3055] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:35.672876 23818 consensus_queue.cc:1048] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.180s
I20260709 13:08:35.885972 24179 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:35.678501 24065 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:35.888298 24169 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:35.910367 24071 raft_consensus.cc:3055] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:35.872756 21912 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:35.647656 24156 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.211s
I20260709 13:08:35.642590 23860 consensus_queue.cc:1059] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.147s
I20260709 13:08:35.687556 24106 consensus_queue.cc:260] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:35.902796 21758 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:35.860085 24110 consensus_queue.cc:1059] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:08:35.881971 24182 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:35.888514 24050 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:35.916582 23945 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:35.687734 24168 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:35.915330 24153 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:35.642999 24147 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:35.667833 23804 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.192s
I20260709 13:08:36.050570 21911 raft_consensus.cc:2410] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:35.672722 24167 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.051262 24167 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:35.636422 23895 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:35.857785 21729 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
W20260709 13:08:36.054966 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 197250us
I20260709 13:08:35.793941 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:36.057804 21756 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:36.040584 24182 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:35.886716 24183 log.cc:927] Time spent T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.463s	user 0.003s	sys 0.000s
I20260709 13:08:35.823129 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:36.059963 24182 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:36.060407 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:36.061273 21908 raft_consensus.cc:2393] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:36.031226 24191 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.062163 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:36.062031 24191 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:36.063338 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:36.064467 24191 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:36.018833 24071 raft_consensus.cc:740] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:35.822253 21765 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:36.019070 24065 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:35.863544 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 45807.2us
I20260709 13:08:35.795271 21663 catalog_manager.cc:5697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.843258 24155 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:36.067441 24065 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:36.067533 24153 raft_consensus.cc:2804] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:36.033061 24091 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:36.068244 24153 raft_consensus.cc:697] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:36.067644 21663 catalog_manager.cc:5697] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 5 to 6, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 6 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.623544 24100 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:08:36.069391 24153 consensus_queue.cc:237] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:35.679881 21764 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
W20260709 13:08:35.822871 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 170946us
I20260709 13:08:35.613938 23977 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:35.968714 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.071877 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.072669 23977 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:36.072921 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:36.073237 24184 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.073881 21835 raft_consensus.cc:2410] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:36.073738 24184 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:36.074016 24071 consensus_queue.cc:260] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:36.074641 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:35.970633 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.075348 24071 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:36.075786 24184 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:36.076160 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.071031 21663 catalog_manager.cc:5697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 1 to 2, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 2 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:36.076491 22450 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:36.077147 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:36.077698 21837 raft_consensus.cc:2376] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7. Re-sending same reply.
I20260709 13:08:36.077618 21663 catalog_manager.cc:5697] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 2 to 5, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 5 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:36.078536 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:36.079165 21837 raft_consensus.cc:2368] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 6. Current term is 7.
I20260709 13:08:36.079278 21663 catalog_manager.cc:5697] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 3 to 4, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 4 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.975023 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.080600 21838 raft_consensus.cc:2393] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:35.974640 23845 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:36.081349 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.082451 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:35.975603 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.083400 21839 raft_consensus.cc:2410] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:36.083546 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:35.975286 24195 log.cc:927] Time spent T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:08:36.084132 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:35.976187 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:35.977375 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.085243 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:35.978317 24185 log.cc:927] Time spent T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.574s	user 0.000s	sys 0.003s
I20260709 13:08:35.976783 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:35.901298 24010 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
W20260709 13:08:35.980105 24196 log.cc:927] Time spent T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:08:35.978783 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.087739 21834 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:35.963474 23828 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:35.889220 24192 consensus_queue.cc:1059] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:08:36.088572 23828 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:36.088997 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:35.975107 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:35.889842 24188 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.120s
I20260709 13:08:35.993608 23463 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.090492 21832 raft_consensus.cc:2393] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 3: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:36.090473 23463 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:36.002205 21759 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:35.999326 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:36.002969 24139 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:36.006553 24136 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:35.884723 24172 raft_consensus.cc:2804] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:36.092226 24172 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:36.015272 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:36.008662 24102 raft_consensus.cc:740] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:36.038169 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:36.092708 23463 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:36.093405 21906 raft_consensus.cc:2393] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 5: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
W20260709 13:08:36.014441 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 357177us
I20260709 13:08:36.041985 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:36.093416 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:36.094089 21879 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:36.051622 24147 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:36.099243 23463 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:36.099552 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:36.099329 24102 consensus_queue.cc:260] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:36.100339 21914 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:36.100411 24155 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:36.100699 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:35.843539 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:36.101229 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:08:36.101475 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 307689us
I20260709 13:08:36.101881 21763 raft_consensus.cc:2376] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6. Re-sending same reply.
W20260709 13:08:35.795138 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 254273us
I20260709 13:08:36.079865 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.082516 23845 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:36.084013 24157 consensus_meta.cc:287] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.581s	user 0.002s	sys 0.009s
I20260709 13:08:36.090133 21833 raft_consensus.cc:2393] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:36.107971 21805 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:35.982064 24105 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.090924 23828 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:35.793731 21905 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:36.091773 21762 raft_consensus.cc:2376] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7. Re-sending same reply.
W20260709 13:08:35.992502 24061 consensus_meta.cc:287] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.700s	user 0.008s	sys 0.005s
W20260709 13:08:36.125540 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 49128.6us
I20260709 13:08:36.084174 21838 raft_consensus.cc:2393] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:36.075367 21835 raft_consensus.cc:2393] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 7: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:36.019610 24135 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.092648 24172 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:36.103129 21728 leader_election.cc:336] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.869s (SENT)
I20260709 13:08:36.172323 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:36.172549 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.172906 21906 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:36.172611 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 69513.5us
I20260709 13:08:36.173571 21835 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:36.174733 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.124945 21805 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:36.175822 21835 raft_consensus.cc:2393] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:36.155824 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:36.092342 21913 raft_consensus.cc:2393] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:36.158960 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:36.177292 21831 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:08:36.177366 21764 raft_consensus.cc:2468] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:36.177747 21831 pending_rounds.cc:85] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 4
I20260709 13:08:36.178279 21759 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:36.159430 21908 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
W20260709 13:08:36.161391 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 68647.6us
I20260709 13:08:36.163901 21879 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:36.158898 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:36.174767 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.109810 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.182268 21837 raft_consensus.cc:2393] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:36.179776 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:36.184003 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:36.184950 21908 raft_consensus.cc:2393] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:08:36.186273 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 61416.4us
I20260709 13:08:36.186949 21805 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:36.187085 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:36.181479 21832 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:36.186975 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:36.191425 21663 catalog_manager.cc:5697] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 3 to 4, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New cstate: current_term: 1 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:36.176543 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.193504 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:36.195506 24213 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:36.199877 21835 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:08:36.200577 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 134246us
I20260709 13:08:36.201660 21837 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:36.177992 21831 pending_rounds.cc:107] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:08:36.204423 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.171277 23804 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:36.213168 21831 raft_consensus.cc:2889] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:36.160400 24110 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:36.159474 24167 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:36.157310 24105 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:36.207799 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:36.206020 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:36.206359 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:36.213896 21832 raft_consensus.cc:1275] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:36.159430 24182 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:08:36.210139 21728 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:36.178354 23977 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:08:36.156864 24201 consensus_queue.cc:1048] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.108s
I20260709 13:08:36.158317 24157 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:36.266228 21906 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:08:36.306197 21834 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:36.216735 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.215376 21805 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:36.192420 23895 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:08:36.313897 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 151081us
I20260709 13:08:36.198909 23818 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:36.308239 21905 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:08:36.215250 22448 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:36.293509 21759 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:36.197075 24061 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:36.250201 24205 raft_consensus.cc:3055] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:36.235718 24100 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 13:08:36.190488 24135 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:36.229709 24208 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:08:36.202781 23860 raft_consensus.cc:2804] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:36.315408 22450 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:36.316929 21834 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
W20260709 13:08:36.252384 23840 consensus_meta.cc:287] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.767s	user 0.007s	sys 0.003s
W20260709 13:08:36.417181 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 207111us
I20260709 13:08:36.418527 21728 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:36.307443 21835 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:36.212443 23804 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:36.327826 24167 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:36.327703 24205 raft_consensus.cc:740] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
W20260709 13:08:36.444003 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:36.332681 23818 raft_consensus.cc:697] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:08:36.427793 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 112473us
I20260709 13:08:36.480648 22450 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:36.435834 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 220655us
I20260709 13:08:36.482877 24128 ts_tablet_manager.cc:1929] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:08:36.306169 24110 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:36.483568 24128 log.cc:1199] T a218be1e72294b138c21b46dfa317d11 P 6d698a5544b946939790e7a3972db9fb: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-2-root/wals/a218be1e72294b138c21b46dfa317d11
I20260709 13:08:36.483668 24110 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:36.474020 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 258694us
I20260709 13:08:36.429347 24201 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:36.499044 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 80630.7us
I20260709 13:08:36.500196 21728 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:36.433089 24191 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.433310 24071 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:36.437005 23804 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:36.439175 24184 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:36.448582 23977 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.436561 23828 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.327481 23895 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:36.508570 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:36.509209 21728 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:36.485175 24128 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49532 (request call id 83) took 2617 ms. Trace:
I20260709 13:08:36.505889 21914 raft_consensus.cc:1240] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:36.520880 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:36.429956 23840 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:36.518827 24151 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.509763 24169 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:36.563833 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:36.518622 24153 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:36.568770 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 59647us
I20260709 13:08:36.575814 21728 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:36.591531 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:36.595521 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 160480us
W20260709 13:08:36.564621 24050 consensus_meta.cc:287] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.519s	user 0.007s	sys 0.002s
I20260709 13:08:36.519371 24191 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:36.606433 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.557381 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:36.626143 24068 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.626607 24068 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:36.628605 24068 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:36.629069 24068 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.629557 24065 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.630018 24065 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:36.631942 24065 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:36.633648 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.634311 21837 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:36.635094 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:36.635599 21837 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:36.575919 23860 raft_consensus.cc:697] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:36.510088 24201 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:36.608834 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:36.567378 24167 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:36.620133 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 44400.1us
I20260709 13:08:36.622589 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.623548 21911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1001) took 1038 ms. Trace:
I20260709 13:08:36.625001 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:36.671150 21804 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:36.672178 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:36.672719 22485 raft_consensus.cc:1813] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Handling vote request from an unknown peer 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:36.673259 22485 raft_consensus.cc:2410] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:08:36.639070 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:36.528818 23977 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:36.670763 21833 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:36.673555 21804 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:36.648339 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 165426us
W20260709 13:08:36.648932 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 163805us
I20260709 13:08:36.531508 23828 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:36.625748 22479 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:36.654937 21832 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:36.562393 24071 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:08:36.603637 24184 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:36.656177 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.690438 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:36.660605 21914 raft_consensus.cc:2468] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:36.665700 21909 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:36.566452 24151 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:36.669633 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.671185 21911 rpcz_store.cc:276] 0709 13:08:35.584853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.585031 (+   178us) service_pool.cc:224] Handling call
0709 13:08:36.623361 (+1038330us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54000ff354. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:36.623493 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":991959424}
I20260709 13:08:36.674808 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.590699 24169 raft_consensus.cc:697] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
W20260709 13:08:36.685537 24194 log.cc:927] Time spent T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.796s	user 0.005s	sys 0.012s
I20260709 13:08:36.687588 22448 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:36.700987 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:36.667841 24166 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:36.699285 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:36.704216 22478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 749) took 1250 ms. Trace:
I20260709 13:08:36.704435 24010 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:36.704752 23945 consensus_meta.cc:287] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.661s	user 0.012s	sys 0.000s
I20260709 13:08:36.705798 21757 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
W20260709 13:08:36.705967 24218 log.cc:927] Time spent T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:08:36.706179 21757 pending_rounds.cc:85] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 7
I20260709 13:08:36.706476 21757 pending_rounds.cc:107] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:08:36.706418 22448 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:36.706825 21757 raft_consensus.cc:2889] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:36.707005 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.709715 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:36.710827 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:36.710979 24174 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:36.712065 21838 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:36.712409 24174 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:36.712581 24061 raft_consensus.cc:2804] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:36.713061 24174 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:36.705027 24010 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:36.704361 21914 raft_consensus.cc:2393] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:36.714589 24169 consensus_queue.cc:237] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:36.715320 21914 raft_consensus.cc:1240] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:36.647395 24068 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:36.715997 21914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1014) took 1040 ms. Trace:
I20260709 13:08:36.716312 21914 rpcz_store.cc:276] 0709 13:08:35.676118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.714894 (+1038776us) service_pool.cc:224] Handling call
0709 13:08:36.715168 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.715767 (+   599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.715948 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:36.717267 24068 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:36.715524 24010 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:36.713754 24101 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:36.700170 22485 raft_consensus.cc:1240] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:36.719480 21911 raft_consensus.cc:1813] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Handling vote request from an unknown peer 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:36.691355 24209 log.cc:927] Time spent T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 13:08:36.723438 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 242874us
I20260709 13:08:36.723965 21806 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:36.718796 24101 raft_consensus.cc:697] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:36.689407 24050 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.597481 23818 consensus_queue.cc:237] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:36.726922 21728 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:36.659323 24153 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:08:36.724967 21911 raft_consensus.cc:2410] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:08:36.691457 24215 raft_consensus.cc:2804] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:36.731153 21837 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:36.691776 24139 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.702266 24105 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:36.603439 24205 consensus_queue.cc:260] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:36.531327 24128 rpcz_store.cc:276] 0709 13:08:33.867602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:33.869602 (+  2000us) service_pool.cc:224] Handling call
0709 13:08:34.182569 (+312967us) ts_tablet_manager.cc:1151] Deleting tablet a218be1e72294b138c21b46dfa317d11
0709 13:08:34.182667 (+    98us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:08:35.408791 (+1226124us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:36.482703 (+1073912us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:36.485081 (+  2378us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":583387,"tablet-delete.queue_time_us":310654,"thread_start_us":275343,"threads_started":1}
I20260709 13:08:36.728529 24094 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:36.723286 24157 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:36.722335 24188 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:36.739789 24211 log.cc:927] Time spent T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
I20260709 13:08:36.719202 24135 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:36.774722 24188 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:36.732332 24225 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:08:36.783555 21913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1398) took 1149 ms. Trace:
I20260709 13:08:36.784044 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.739081 24143 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:36.785336 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:36.744266 24215 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.786331 24215 raft_consensus.cc:3060] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:36.786486 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.787704 23828 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:36.783600 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.790179 24201 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:36.790867 24184 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:36.791263 24184 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:36.772960 24230 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:36.792457 21912 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:08:36.799412 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 72593.2us
I20260709 13:08:36.799773 21912 raft_consensus.cc:1240] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:36.727953 24174 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:36.803656 24174 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:36.783993 21913 rpcz_store.cc:276] 0709 13:08:35.633888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.921751 (+287863us) service_pool.cc:224] Handling call
0709 13:08:36.783379 (+861628us) spinlock_profiling.cc:243] Waited 99.3 ms on lock 0x7b5400195fd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:36.783498 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228302208}
I20260709 13:08:36.804462 24101 consensus_queue.cc:237] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:36.805800 21913 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:08:36.806010 24191 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:36.806186 21913 pending_rounds.cc:85] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 1
I20260709 13:08:36.807461 21913 pending_rounds.cc:107] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:08:36.807719 21913 raft_consensus.cc:2889] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:36.704686 22478 rpcz_store.cc:276] 0709 13:08:35.454270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.455543 (+  1273us) service_pool.cc:224] Handling call
0709 13:08:35.455989 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:35.456436 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:35.456478 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:35.457063 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 13:08:35.672809 (+215746us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:35.681602 (+  8793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.790942 (+109340us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:36.684756 (+893814us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:36.703887 (+ 19131us) raft_consensus.cc:1685] finished
0709 13:08:36.703916 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:36.704134 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18078,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":7978,"spinlock_wait_cycles":26049408,"thread_start_us":189774,"threads_started":1,"wal-append.queue_time_us":432061}
I20260709 13:08:36.810046 24167 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:36.810621 24151 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:36.810581 24167 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:36.811407 23840 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:36.812743 24167 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:36.813324 24143 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.813866 24143 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:36.761689 24139 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:36.791638 24184 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:36.808673 21877 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:36.747568 24224 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:36.818533 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 183400us
W20260709 13:08:36.808905 24172 consensus_meta.cc:287] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.605s	user 0.003s	sys 0.007s
I20260709 13:08:36.829320 21877 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:36.743235 24050 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:36.817605 24179 consensus_meta.cc:287] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.800s	user 0.000s	sys 0.010s
W20260709 13:08:36.837522 22482 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.000s	sys 0.013s
W20260709 13:08:36.844280 22482 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.000s	sys 0.014s
W20260709 13:08:36.837885 21763 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.005s	sys 0.008s
I20260709 13:08:36.833201 21877 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:36.846002 21763 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.005s	sys 0.008s
I20260709 13:08:36.855126 21877 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:36.817389 24139 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:36.867342 22448 leader_election.cc:336] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.588s (SENT)
I20260709 13:08:36.828305 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 751) took 1226 ms. Trace:
I20260709 13:08:36.842897 24174 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:36.832043 24098 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:36.824286 24110 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:36.860096 24065 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:36.881760 21913 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:36.763456 23860 consensus_queue.cc:237] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:36.860885 23845 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:36.859817 21648 catalog_manager.cc:5028] TS 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): tablet a218be1e72294b138c21b46dfa317d11 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:08:36.860191 24179 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:36.854997 24151 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:36.845300 23945 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:36.823693 23804 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:36.843425 24172 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:36.938488 23845 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.958178 23845 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:36.958666 24151 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.959077 24151 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:36.959619 24172 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:36.959812 24176 log.cc:927] Time spent T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 1.469s	user 0.007s	sys 0.000s
I20260709 13:08:36.953583 21880 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:36.962387 24134 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:36.962746 24134 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:36.963076 24134 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:36.907449 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 234013us
I20260709 13:08:36.863142 23895 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:36.901072 24174 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:36.964083 21804 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
W20260709 13:08:36.964463 21648 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 142183us
I20260709 13:08:36.862614 24069 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
W20260709 13:08:36.964780 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 109743us
I20260709 13:08:36.903019 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:37.086369 21757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 246) took 1455 ms. Trace:
I20260709 13:08:37.109957 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:37.111013 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1011) took 1476 ms. Trace:
W20260709 13:08:37.095199 21905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1397) took 1643 ms (client timeout 1612 ms). Trace:
W20260709 13:08:37.125092 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.108273 21913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1024) took 1198 ms. Trace:
I20260709 13:08:37.091511 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:37.094900 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:36.905167 23463 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.224879 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:36.967028 21911 raft_consensus.cc:1240] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:37.222913 21909 rpcz_store.cc:276] 0709 13:08:35.634967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.088765 (+453798us) service_pool.cc:224] Handling call
0709 13:08:37.110792 (+1022027us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b54002d8f54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:37.110940 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189242112}
I20260709 13:08:37.223958 21913 rpcz_store.cc:276] 0709 13:08:35.909803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.821158 (+911355us) service_pool.cc:224] Handling call
0709 13:08:36.821501 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.907080 (+ 85579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.107958 (+200878us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x7b540032d054. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:37.108195 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137486720}
I20260709 13:08:37.095584 21910 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:37.018740 21840 raft_consensus.cc:1240] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:36.963181 23804 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:37.004142 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:37.083688 24232 log.cc:927] Time spent T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
W20260709 13:08:37.199225 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 235208us
I20260709 13:08:37.222354 21757 rpcz_store.cc:276] 0709 13:08:35.630437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.630846 (+   409us) service_pool.cc:224] Handling call
0709 13:08:35.652005 (+ 21159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:36.707267 (+1055262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.086097 (+378830us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540031e7d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:37.086302 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2422737152}
I20260709 13:08:36.945940 24202 raft_consensus.cc:3055] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:08:37.223109 21905 rpcz_store.cc:269] 0709 13:08:35.451760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.454549 (+  2789us) service_pool.cc:224] Handling call
0709 13:08:37.094950 (+1640401us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54001eafd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:37.095087 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687033728}
I20260709 13:08:37.113299 21912 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:37.095281 22482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36270 (request call id 473) took 1014 ms. Trace:
I20260709 13:08:37.051895 24050 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:37.018430 24172 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:37.131768 23977 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:37.221683 24166 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:37.131379 24102 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:37.222605 22483 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
I20260709 13:08:37.195451 24168 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.308781 22483 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:37.231802 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:37.050514 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:37.232831 21804 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:37.233204 21913 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:08:37.229745 24235 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.288918 21909 raft_consensus.cc:1275] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:37.221630 24223 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:37.061650 24010 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.297874 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:37.315482 24248 log.cc:927] Time spent T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.085s	user 0.000s	sys 0.002s
I20260709 13:08:37.085680 24110 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:37.198791 24167 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:36.969264 24188 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:37.198568 23828 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.009291 23945 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:37.315742 24168 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:37.447927 23828 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:37.448568 24168 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:37.231312 23463 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:37.312170 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:37.312318 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 137297us
I20260709 13:08:37.313444 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1028) took 1402 ms. Trace:
I20260709 13:08:37.232642 22482 rpcz_store.cc:276] 0709 13:08:36.080512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.080646 (+   134us) service_pool.cc:224] Handling call
0709 13:08:36.080970 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:36.128811 (+ 47841us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.128857 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:36.170103 (+ 41246us) log.cc:844] Serialized 26 byte log entry
0709 13:08:36.844812 (+674709us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:36.844868 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.844960 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:37.095042 (+250082us) raft_consensus.cc:1685] finished
0709 13:08:37.095066 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.095219 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54655,"raft.queue_time_us":80024,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":20662,"thread_start_us":629046,"threads_started":1,"wal-append.queue_time_us":703838}
I20260709 13:08:37.450304 23828 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:37.231303 24202 raft_consensus.cc:740] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:37.451104 23463 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:37.451437 24202 consensus_queue.cc:260] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:37.452709 24202 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:37.324736 21905 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:08:37.454059 24249 log.cc:927] Time spent T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:08:37.454602 21905 raft_consensus.cc:1240] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:37.006603 24230 consensus_queue.cc:1059] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.281s
I20260709 13:08:37.456800 23945 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:37.333922 24153 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:37.450217 21909 rpcz_store.cc:276] 0709 13:08:35.910920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.231933 (+1321013us) service_pool.cc:224] Handling call
0709 13:08:37.232248 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.313134 (+ 80886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.313353 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:37.378119 24223 raft_consensus.cc:697] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:37.401129 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:37.401499 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 350) took 1914 ms. Trace:
I20260709 13:08:37.311674 23845 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:37.307009 24172 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:37.310276 21913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1029) took 1399 ms. Trace:
I20260709 13:08:37.478017 21913 rpcz_store.cc:276] 0709 13:08:35.911160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.232604 (+1321444us) service_pool.cc:224] Handling call
0709 13:08:37.232886 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.310011 (+ 77125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.310205 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:37.440228 24151 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:37.441045 24069 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:08:37.329608 24157 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.009s	sys 0.034s
I20260709 13:08:36.891312 22476 rpcz_store.cc:276] 0709 13:08:35.601849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.605380 (+  3531us) service_pool.cc:224] Handling call
0709 13:08:35.628228 (+ 22848us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:35.681769 (+ 53541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:35.790082 (+108313us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:35.883033 (+ 92951us) log.cc:844] Serialized 26 byte log entry
0709 13:08:36.194744 (+311711us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:36.194810 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.194915 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:36.806822 (+611907us) raft_consensus.cc:1685] finished
0709 13:08:36.817614 (+ 10792us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:36.824894 (+  7280us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8600,"raft.queue_time_us":10713,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":136872,"thread_start_us":209729,"threads_started":1,"wal-append.queue_time_us":289929}
I20260709 13:08:37.441468 24167 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:37.443126 24255 log.cc:927] Time spent T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:08:37.444307 24188 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.319679 24235 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:37.381547 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 148786us
I20260709 13:08:37.537878 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:37.554807 21804 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:37.423046 24010 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:37.550590 24157 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.010s	sys 0.050s
I20260709 13:08:37.470767 21907 rpcz_store.cc:276] 0709 13:08:35.486991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.487116 (+   125us) service_pool.cc:224] Handling call
0709 13:08:35.492580 (+  5464us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:35.503612 (+ 11032us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:35.503643 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:36.461616 (+957973us) spinlock_profiling.cc:243] Waited 37.5 ms on lock 0x7b2c00021ff8. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6acc50a11 00007fc6acc60372 00007fc6ae392a01 00007fc6ae35743a 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2
0709 13:08:36.462131 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 13:08:36.667826 (+205695us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:36.667861 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.667927 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:37.379130 (+711203us) raft_consensus.cc:1685] finished
0709 13:08:37.379152 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.401380 (+ 22228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10669,"raft.queue_time_us":11059,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":28553,"spinlock_wait_cycles":86264192,"thread_start_us":142135,"threads_started":1,"wal-append.queue_time_us":337663}
I20260709 13:08:37.551281 24188 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:37.553009 24167 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:37.541986 21833 raft_consensus.cc:1275] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:37.566179 21804 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:37.576035 21804 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:37.533701 24256 log.cc:927] Time spent T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:08:37.534623 24247 log.cc:927] Time spent T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
W20260709 13:08:37.544214 24215 consensus_meta.cc:287] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.757s	user 0.011s	sys 0.000s
I20260709 13:08:37.427472 23932 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:37.591991 21804 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:37.507596 24250 log.cc:927] Time spent T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
W20260709 13:08:37.608160 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.544464 22478 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:08:37.548949 24068 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.615861 21804 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:37.483623 24153 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:37.547149 24174 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:37.612267 24238 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:37.618464 21804 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:37.548609 24151 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:37.591873 24224 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:37.604537 24213 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:37.605422 24069 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:37.652225 24069 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:37.534580 24223 consensus_queue.cc:237] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:37.642525 23845 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:37.642894 24224 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:37.642952 24202 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:37.647097 24166 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:37.617843 24215 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:37.649221 24153 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:37.620623 24068 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:37.639817 24151 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.634399 23932 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:37.638969 24238 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:37.673697 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 162220us
I20260709 13:08:37.674217 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 359) took 1100 ms. Trace:
I20260709 13:08:37.676699 21909 rpcz_store.cc:276] 0709 13:08:36.573753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.460072 (+886319us) service_pool.cc:224] Handling call
0709 13:08:37.460373 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.460559 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:37.468245 (+  7686us) log.cc:844] Serialized 14 byte log entry
0709 13:08:37.673860 (+205615us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:37.673914 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:37.673967 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.674035 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.674159 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30888,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":115,"thread_start_us":205230,"threads_started":1}
I20260709 13:08:37.636873 24213 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:37.668205 24202 raft_consensus.cc:697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:08:37.690013 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 55443.6us
I20260709 13:08:37.677657 23932 raft_consensus.cc:697] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:37.673774 24151 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:37.694288 24153 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:37.693801 24069 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:37.725493 24199 log.cc:927] Time spent T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 1.839s	user 0.004s	sys 0.004s
I20260709 13:08:37.728655 24091 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:37.729215 22480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36278 (request call id 288) took 2155 ms. Trace:
I20260709 13:08:37.729351 23945 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:37.729763 24260 log.cc:927] Time spent T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:08:37.729909 23945 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:37.730973 21910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1013) took 2072 ms. Trace:
I20260709 13:08:37.730664 23932 consensus_queue.cc:237] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:37.731317 21910 rpcz_store.cc:276] 0709 13:08:35.658382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.466686 (+808304us) service_pool.cc:224] Handling call
0709 13:08:37.095362 (+628676us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.227909 (+132547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.730784 (+502875us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b54001eafd0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:37.730918 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1444964096}
I20260709 13:08:37.731949 23945 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:37.729218 24091 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:37.733345 21836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1600) took 1761 ms. Trace:
I20260709 13:08:37.734978 24091 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:37.734869 24271 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:08:37.736088 21911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1025) took 1826 ms. Trace:
I20260709 13:08:37.736519 21911 rpcz_store.cc:276] 0709 13:08:35.910100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.956063 (+1045963us) service_pool.cc:224] Handling call
0709 13:08:36.956451 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.231569 (+275118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.735879 (+504310us) spinlock_profiling.cc:243] Waited 7.55 ms on lock 0x7b540032c154. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:37.736033 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17360640}
I20260709 13:08:37.737841 24213 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:37.739166 21912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1020) took 1831 ms. Trace:
I20260709 13:08:37.739511 21912 rpcz_store.cc:276] 0709 13:08:35.907834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.800698 (+892864us) service_pool.cc:224] Handling call
0709 13:08:37.112848 (+312150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.231854 (+119006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.738990 (+507136us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54002d8f50. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:37.739110 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717070592}
I20260709 13:08:37.740995 24215 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:37.741580 24215 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:37.741703 21880 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:37.742043 24215 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:37.744091 24215 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:37.744779 24188 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:37.690630 24238 consensus_queue.cc:1059] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:08:37.733737 21836 rpcz_store.cc:276] 0709 13:08:35.971482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.085978 (+114496us) service_pool.cc:224] Handling call
0709 13:08:36.086294 (+   316us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:36.657623 (+571329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.657676 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:36.690386 (+ 32710us) log.cc:844] Serialized 52 byte log entry
0709 13:08:36.822237 (+131851us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:36.891283 (+ 69046us) log.cc:844] Serialized 14 byte log entry
0709 13:08:36.894178 (+  2895us) log.cc:844] Serialized 14 byte log entry
0709 13:08:36.894468 (+   290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.732959 (+838491us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b540025d5d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:37.733012 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:37.733127 (+   115us) raft_consensus.cc:1685] finished
0709 13:08:37.733142 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.733262 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13565,"prepare.queue_time_us":133248,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":237604,"raft.run_cpu_time_us":445,"raft.run_wall_time_us":27139,"spinlock_wait_cycles":798774144,"thread_start_us":309147,"threads_started":2,"wal-append.queue_time_us":348474}
I20260709 13:08:37.729218 24167 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:37.748095 24264 consensus_queue.cc:1059] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:37.755056 24167 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:37.750515 21880 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:37.751272 24268 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:08:37.751410 24134 consensus_meta.cc:287] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.747s	user 0.010s	sys 0.005s
I20260709 13:08:37.729662 22480 rpcz_store.cc:276] 0709 13:08:35.573623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:35.574845 (+  1222us) service_pool.cc:224] Handling call
0709 13:08:35.575143 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:35.588949 (+ 13806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:35.588980 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:35.609780 (+ 20800us) log.cc:844] Serialized 26 byte log entry
0709 13:08:35.854138 (+244358us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:35.854190 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:35.854276 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:37.724933 (+1870657us) spinlock_profiling.cc:243] Waited 8.21 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:37.728887 (+  3954us) raft_consensus.cc:1685] finished
0709 13:08:37.728911 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.729132 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":8981,"spinlock_wait_cycles":18884352,"thread_start_us":203068,"threads_started":1,"wal-append.queue_time_us":262605}
I20260709 13:08:37.718847 24069 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:37.718978 24153 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:37.767637 24264 raft_consensus.cc:3055] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:37.768149 24264 raft_consensus.cc:740] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:37.768633 24153 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:37.722515 24010 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:37.769222 24264 consensus_queue.cc:260] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:37.770889 24264 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.766227 24238 raft_consensus.cc:3055] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:37.773962 24238 raft_consensus.cc:740] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:37.773869 24202 consensus_queue.cc:237] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:37.775120 24238 consensus_queue.cc:260] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:37.776676 24238 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:37.719609 24235 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:37.777595 24230 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.777784 24043 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:37.778345 24230 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:37.761919 23818 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:37.758164 24184 consensus_meta.cc:287] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.926s	user 0.007s	sys 0.009s
W20260709 13:08:37.808306 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 60902.7us
I20260709 13:08:37.746438 24172 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:37.858428 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:37.871457 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.855793 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:37.872303 21835 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:37.858842 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:37.856606 22480 raft_consensus.cc:1240] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:37.819170 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:37.875734 21839 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:37.764336 24268 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:37.877051 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:37.879572 21836 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:37.837323 21908 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:37.761420 24167 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:37.864797 24182 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:37.866075 24010 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:37.867390 24267 consensus_queue.cc:1059] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:37.872915 21832 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:37.885136 24267 raft_consensus.cc:3055] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:37.885726 24267 raft_consensus.cc:740] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:37.886788 24267 consensus_queue.cc:260] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:37.888526 24267 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:37.889767 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:37.766993 24068 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:37.897950 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:37.898749 21834 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:37.770901 24069 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:37.762351 24188 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.868888 24262 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:08:37.874497 23895 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:37.857969 24230 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:37.801899 24134 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:37.928100 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:37.910604 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 123570us
I20260709 13:08:37.910573 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:37.857765 24271 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:08:37.854955 24184 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:37.806161 24156 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 13:08:37.909598 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:37.962931 24069 consensus_queue.cc:1059] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:37.900439 24268 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.910635 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:37.957288 24230 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
W20260709 13:08:37.990029 24270 log.cc:927] Time spent T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:08:37.990362 24151 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:37.991638 21913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1404) took 1364 ms. Trace:
I20260709 13:08:37.992911 24143 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:37.980798 24134 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:37.981267 24269 log.cc:927] Time spent T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:08:37.914407 23932 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:08:37.995828 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 358) took 1436 ms. Trace:
I20260709 13:08:37.996405 24184 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:37.997648 24252 log.cc:927] Time spent T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.568s	user 0.003s	sys 0.000s
I20260709 13:08:37.999135 21914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1015) took 2211 ms. Trace:
I20260709 13:08:37.999490 21914 rpcz_store.cc:276] 0709 13:08:35.787931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.717171 (+929240us) service_pool.cc:224] Handling call
0709 13:08:36.719330 (+  2159us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:36.730700 (+ 11370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.730741 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:36.737515 (+  6774us) log.cc:844] Serialized 52 byte log entry
0709 13:08:37.060767 (+323252us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:37.304200 (+243433us) log.cc:844] Serialized 14 byte log entry
0709 13:08:37.304436 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.304510 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:37.748816 (+444306us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b18003f5d40. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab26a3f3 00007fc6ab26c7c1 00007fc6ab26c779 00007fc6ab26c709 00007fc6ab26c6d1 00007fc6ab26b9cd 000000000038f354 000000000038f199 00007fc6ab24d83a
0709 13:08:37.997073 (+248257us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:37.998915 (+  1842us) raft_consensus.cc:1685] finished
0709 13:08:37.998936 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.999079 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3002,"prepare.queue_time_us":395437,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":1685,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":3499,"spinlock_wait_cycles":16381952,"thread_start_us":453038,"threads_started":2,"wal-append.queue_time_us":511901}
I20260709 13:08:37.916587 24223 consensus_queue.cc:1059] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 13:08:38.004703 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2426) took 1381 ms. Trace:
I20260709 13:08:38.005087 21833 rpcz_store.cc:276] 0709 13:08:36.623678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.707820 (+ 84142us) service_pool.cc:224] Handling call
0709 13:08:36.708074 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.574713 (+866639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.004489 (+429776us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b54003c00d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:38.004648 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1916666624}
I20260709 13:08:37.914201 24188 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:37.979456 24061 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:38.007800 24061 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:38.008047 24188 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:38.008692 24106 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:37.983287 24205 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:37.982015 24069 raft_consensus.cc:3055] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:38.013821 24069 raft_consensus.cc:740] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:38.014686 24069 consensus_queue.cc:260] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:38.015527 24240 log.cc:927] Time spent T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.816s	user 0.004s	sys 0.010s
I20260709 13:08:38.015949 24069 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:37.992025 21913 rpcz_store.cc:276] 0709 13:08:36.627225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.479113 (+851888us) service_pool.cc:224] Handling call
0709 13:08:37.479575 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:37.481357 (+  1782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:37.481400 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:37.590348 (+108948us) log.cc:844] Serialized 26 byte log entry
0709 13:08:37.694195 (+103847us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:37.694237 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.694309 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:37.991433 (+297124us) raft_consensus.cc:1685] finished
0709 13:08:37.991451 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.991581 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1263,"raft.queue_time_us":4933,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":3781,"thread_start_us":76898,"threads_started":1,"wal-append.queue_time_us":237835}
I20260709 13:08:38.018980 24094 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:37.928135 24068 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:38.027083 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.034169 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 352) took 2446 ms. Trace:
I20260709 13:08:38.034795 21906 rpcz_store.cc:276] 0709 13:08:35.587975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.322870 (+734895us) service_pool.cc:224] Handling call
0709 13:08:36.323214 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:36.323807 (+   593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:36.323837 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:36.324325 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:08:36.819082 (+494757us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:36.819121 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:36.819187 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:38.014776 (+1195589us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:38.025692 (+ 10916us) raft_consensus.cc:1685] finished
0709 13:08:38.025716 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:38.034104 (+  8388us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":50725248,"thread_start_us":494325,"threads_started":1,"wal-append.queue_time_us":699158}
I20260709 13:08:38.036132 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:38.036854 21909 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:38.037971 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:38.035940 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:38.038933 21913 raft_consensus.cc:1275] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:38.038708 21914 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:38.041262 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:37.996187 21905 rpcz_store.cc:276] 0709 13:08:36.559345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.455408 (+896063us) service_pool.cc:224] Handling call
0709 13:08:37.455685 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.653091 (+197406us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:37.653841 (+   750us) log.cc:844] Serialized 14 byte log entry
0709 13:08:37.862193 (+208352us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:37.862257 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:37.862319 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:37.994826 (+132507us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b180013e0a0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab2382a6 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419
0709 13:08:37.995617 (+   791us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b5400219654. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:37.995663 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:37.995776 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82963,"prepare.queue_time_us":266,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":35,"raft.queue_time_us":62327,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":6088,"spinlock_wait_cycles":478388864,"thread_start_us":141799,"threads_started":1,"wal-append.queue_time_us":315727}
I20260709 13:08:38.052268 21910 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:38.054936 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.054868 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:38.055475 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:38.055871 21910 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:38.053032 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:38.058228 24188 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:38.058987 24188 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:38.062768 24188 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:38.057188 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:38.063500 24184 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.064163 21910 raft_consensus.cc:2393] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:38.064307 24184 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:38.052165 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:38.065692 21905 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:38.067359 24184 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:38.070786 21729 connection.cc:256] RPC call timeout handler was delayed by -1.2493158600000243s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
I20260709 13:08:38.071882 24167 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:38.072620 24167 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:38.073720 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:38.074661 21757 raft_consensus.cc:2393] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 3: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:38.074715 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:38.075621 21761 raft_consensus.cc:2393] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 7: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:38.075714 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:38.076454 21759 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:38.077206 24167 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:38.077404 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:38.078100 21765 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:38.004753 24223 raft_consensus.cc:3055] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:38.079278 21835 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:08:38.083112 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:38.080166 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:38.084151 21911 raft_consensus.cc:2393] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 4: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:37.929593 23895 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:38.081818 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:38.083398 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:08:38.043833 24199 log.cc:927] Time spent T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:08:38.113624 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:38.112673 21728 leader_election.cc:336] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.814s (SENT)
I20260709 13:08:38.117848 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:38.086640 21762 raft_consensus.cc:1275] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:38.107102 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:38.146483 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:38.147541 21760 raft_consensus.cc:2468] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:38.148627 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:38.128918 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:38.160935 21906 raft_consensus.cc:2393] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 8: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:38.026633 22479 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
W20260709 13:08:38.156046 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 245014us
I20260709 13:08:38.030507 24174 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:38.072563 24184 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:38.161907 21760 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:38.082855 24223 raft_consensus.cc:740] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:38.033684 24068 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:38.125399 21914 raft_consensus.cc:2368] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8.
W20260709 13:08:38.259616 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:38.556416 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.179792 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:38.253096 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:38.181011 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:38.546627 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:38.468252 21839 consensus_meta.cc:287] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.570s	user 0.008s	sys 0.000s
I20260709 13:08:38.431783 22481 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:38.187770 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:38.572916 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:38.573676 21759 raft_consensus.cc:2393] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 5: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
W20260709 13:08:38.573734 22449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.005s	sys 0.014s
W20260709 13:08:38.574220 22449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.006s	sys 0.014s
W20260709 13:08:38.574522 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 533823us
I20260709 13:08:38.574681 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:38.575471 21759 raft_consensus.cc:2410] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:38.571954 21839 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:08:38.583992 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:38.589555 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:38.590226 21838 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:38.590196 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:38.591202 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:38.591926 22483 raft_consensus.cc:2393] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 7: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:38.593647 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:38.594997 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:38.597365 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:38.424625 24224 consensus_meta.cc:287] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.760s	user 0.008s	sys 0.000s
I20260709 13:08:38.597645 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:38.599017 21759 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:38.600556 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:38.602020 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:38.608379 21838 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:38.609508 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:38.610376 21838 raft_consensus.cc:2393] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 8: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:38.611768 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:38.606223 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:38.612957 21907 raft_consensus.cc:2393] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:38.195619 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:38.615356 21832 raft_consensus.cc:2368] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8.
I20260709 13:08:38.294867 24238 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:38.588904 24167 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.639307 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:38.617681 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:38.641312 21833 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:38.641400 21839 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:38.641791 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:38.617457 21908 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1008) took 3013 ms (client timeout 3329 ms). Trace:
I20260709 13:08:38.642438 21838 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:38.604707 22482 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:38.571197 24188 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:38.644896 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:38.625028 21835 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:08:38.647179 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:38.642689 21908 rpcz_store.cc:269] 0709 13:08:35.592615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.205631 (+613016us) service_pool.cc:224] Handling call
0709 13:08:38.605414 (+2399783us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b540029b3d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:38.605682 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3386919296}
I20260709 13:08:38.649848 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:38.650779 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:38.651414 21759 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:38.651268 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:38.617089 24268 consensus_meta.cc:287] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.000s
I20260709 13:08:38.430944 24061 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:38.667836 21914 raft_consensus.cc:1275] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:38.729939 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:38.731254 24061 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:38.731357 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:38.732259 21914 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:38.658983 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:38.733675 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 223738us
I20260709 13:08:38.650401 24188 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:38.606648 23977 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:38.641162 24224 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:38.670903 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:38.671005 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:38.617275 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:38.650115 24238 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:38.589702 24184 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:38.639067 24043 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.661233 21905 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:38.676198 21877 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:38.596071 24174 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:38.679368 24215 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.809872 24215 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:38.680142 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:38.654351 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:38.681160 22477 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36290 (request call id 754) took 2200 ms (client timeout 2656 ms). Trace:
I20260709 13:08:38.651973 24167 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:38.681964 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:38.819407 21839 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:38.682858 24246 raft_consensus.cc:3055] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:08:38.688825 24272 log.cc:927] Time spent T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.687s	user 0.000s	sys 0.002s
I20260709 13:08:38.844950 24167 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:38.846096 24167 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:38.847162 22481 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36278 (request call id 296) took 1842 ms (client timeout 1617 ms). Trace:
I20260709 13:08:38.827165 24246 raft_consensus.cc:740] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:08:38.847735 22481 rpcz_store.cc:269] 0709 13:08:37.004302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.091141 (+ 86839us) service_pool.cc:224] Handling call
0709 13:08:38.846859 (+1755718us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54004885d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:38.847012 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2776004352}
I20260709 13:08:38.849098 24246 consensus_queue.cc:260] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:38.850512 24246 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:38.850525 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:38.692399 21759 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:08:38.712858 21836 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:38.718856 21760 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:38.734546 21914 raft_consensus.cc:1275] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:38.295559 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:38.852458 21761 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:38.737897 21758 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:38.672219 21909 raft_consensus.cc:1240] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:38.846711 24167 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:38.749765 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:38.753021 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 230328us
I20260709 13:08:38.856997 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:38.858186 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:38.859249 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:38.760663 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 84549.6us
I20260709 13:08:38.860096 21760 raft_consensus.cc:3060] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:38.677657 21908 raft_consensus.cc:1275] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:38.862040 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:38.626121 24205 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.791399 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:38.752060 24206 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.014s	sys 0.064s
I20260709 13:08:38.792472 21838 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:38.794131 24188 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:38.795642 24068 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:38.797549 24184 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:38.759406 23977 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:38.799441 24238 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:38.800391 24069 consensus_meta.cc:287] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.784s	user 0.011s	sys 0.000s
I20260709 13:08:38.916783 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:38.751056 24106 consensus_meta.cc:287] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.742s	user 0.006s	sys 0.006s
I20260709 13:08:38.805511 24283 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:38.918845 24283 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:38.919318 24283 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:38.650553 24223 consensus_queue.cc:260] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:38.816499 21834 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
W20260709 13:08:38.816188 22477 rpcz_store.cc:269] 0709 13:08:36.480461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.481160 (+   699us) service_pool.cc:224] Handling call
0709 13:08:38.680915 (+2199755us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400681354. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:38.681072 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3569350912}
I20260709 13:08:38.828055 21832 raft_consensus.cc:2393] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:38.831380 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:38.832257 24174 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:38.863523 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:38.931546 21759 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:38.864924 21729 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:38.860863 21877 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:38.750608 24213 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:08:38.874778 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:38.750311 24169 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.103s
I20260709 13:08:38.738476 24268 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:38.872270 24206 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.014s	sys 0.065s
I20260709 13:08:38.820521 24215 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:38.901021 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:38.916783 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:38.961002 21758 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:38.910923 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:38.963732 21833 raft_consensus.cc:1275] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:38.922348 21839 raft_consensus.cc:2410] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:38.965904 24106 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:38.966372 21839 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:38.966519 24106 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:38.933210 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 72481.2us
I20260709 13:08:38.929787 21760 raft_consensus.cc:2468] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:38.818153 24043 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:38.953873 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 89063.4us
I20260709 13:08:38.971344 21729 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:38.972298 21729 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:38.973553 21729 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:38.956177 21836 raft_consensus.cc:2393] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 3: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:38.956605 21832 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:38.956525 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:38.966051 24265 log.cc:927] Time spent T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 1.255s	user 0.003s	sys 0.000s
I20260709 13:08:38.920221 24231 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:38.952622 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:38.975015 21759 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:08:38.969789 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:38.979868 21760 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 2.
I20260709 13:08:38.980895 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:38.982276 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:38.983242 21877 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:38.983764 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:38.984784 21760 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:38.873286 24157 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.088s
I20260709 13:08:38.888994 24205 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:38.986598 21877 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:38.957841 24069 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:38.987548 24293 log.cc:927] Time spent T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:08:38.957659 24184 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:38.966430 23818 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:38.997752 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:38.990940 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:39.019399 21760 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:39.019948 21761 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:39.021138 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:39.022660 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:39.024609 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:39.025630 21761 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:38.975597 24282 consensus_queue.cc:1048] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:08:39.013618 21729 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:38.989753 23845 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:39.032119 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:39.032946 21760 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:39.033882 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:39.032195 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:39.035840 21761 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:39.037367 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:39.015643 21758 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
W20260709 13:08:39.039719 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.040285 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.040608 21758 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:39.034679 21760 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:39.041759 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:39.034041 21759 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:08:39.042596 21832 raft_consensus.cc:2410] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:08:39.050446 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.038890 21761 raft_consensus.cc:2410] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:39.042596 21760 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:39.014523 24134 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:39.085357 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:39.015377 24069 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:39.109805 24069 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:39.104650 22479 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
W20260709 13:08:39.119249 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 443280us
I20260709 13:08:39.028777 23977 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:39.120664 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:39.126997 22479 raft_consensus.cc:1240] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:38.988863 24231 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:39.132570 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:39.120033 21758 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:39.134665 21758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2415) took 1019 ms. Trace:
I20260709 13:08:39.135157 21758 rpcz_store.cc:276] 0709 13:08:38.115289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.041729 (+926440us) service_pool.cc:224] Handling call
0709 13:08:39.119706 (+ 77977us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.134225 (+ 14519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.134553 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:39.048454 24238 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.133546 21832 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:39.142772 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:39.113934 24235 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.103s	user 0.018s	sys 0.022s
W20260709 13:08:39.083539 22476 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.019s	sys 0.024s
I20260709 13:08:39.103225 24184 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:39.152923 21831 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:39.152948 21731 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:39.154564 22481 raft_consensus.cc:1275] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:08:39.155040 22480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36278 (request call id 299) took 1246 ms. Trace:
I20260709 13:08:39.155519 22480 rpcz_store.cc:276] 0709 13:08:37.909196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.909345 (+   149us) service_pool.cc:224] Handling call
0709 13:08:37.926019 (+ 16674us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:37.926487 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:37.926525 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:37.969395 (+ 42870us) log.cc:844] Serialized 26 byte log entry
0709 13:08:38.305630 (+336235us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:38.305687 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.305787 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:39.154821 (+849034us) raft_consensus.cc:1685] finished
0709 13:08:39.154846 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.154984 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":575,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":28732,"thread_start_us":261974,"threads_started":1,"wal-append.queue_time_us":791301}
I20260709 13:08:39.159766 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:39.031333 23818 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:39.151738 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:39.122493 24167 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:39.116770 24156 consensus_queue.cc:1059] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:08:39.166040 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:39.147634 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:39.195397 21832 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:39.157315 24184 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:39.153391 22476 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.020s	sys 0.024s
I20260709 13:08:39.126453 24134 raft_consensus.cc:697] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:39.181499 22482 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
W20260709 13:08:39.151222 24235 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.141s	user 0.019s	sys 0.022s
I20260709 13:08:39.198300 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:39.199295 22448 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:39.163741 24106 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:39.230860 22448 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:39.231941 21832 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:39.233579 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36278 (request call id 301) took 1054 ms. Trace:
W20260709 13:08:39.243819 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.154050 24238 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:39.246841 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:39.247313 21878 connection.cc:256] RPC call timeout handler was delayed by -1.3820288169999912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:08:39.193674 24167 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:39.189754 24288 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:39.246836 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:39.219957 24184 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:39.261582 21880 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:39.270605 21880 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:39.240782 24071 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:39.275518 21836 raft_consensus.cc:1240] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:08:39.285248 21880 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:39.268880 24288 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:39.266916 24157 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.296061 24157 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:39.297756 24043 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:39.261101 24068 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.298998 24068 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:39.299366 24157 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:39.300099 24157 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:39.300495 24157 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.300868 24157 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:39.255486 24303 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:39.278311 24071 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:39.202678 24287 consensus_queue.cc:1048] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:08:39.307168 22484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36278 (request call id 298) took 1522 ms. Trace:
I20260709 13:08:39.308532 24310 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:39.324519 24303 raft_consensus.cc:697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:39.326253 24179 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:39.325976 24303 consensus_queue.cc:237] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:39.326741 24179 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.327261 24179 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:39.331045 24276 log.cc:927] Time spent T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 1.329s	user 0.002s	sys 0.000s
I20260709 13:08:39.332880 24071 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:39.306134 24268 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:39.330842 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:39.339453 21728 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:39.339958 21910 raft_consensus.cc:3060] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:39.340611 21728 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:39.342834 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1419) took 1289 ms. Trace:
I20260709 13:08:39.343205 21907 rpcz_store.cc:276] 0709 13:08:38.053776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.053907 (+   131us) service_pool.cc:224] Handling call
0709 13:08:39.342581 (+1288674us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b540032c654. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:39.342746 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1066720640}
W20260709 13:08:39.302834 24299 log.cc:927] Time spent T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:08:39.344246 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:39.344946 21764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2392) took 1270 ms. Trace:
W20260709 13:08:39.345407 21834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38352 (request call id 2450) took 1443 ms (client timeout 1685 ms). Trace:
I20260709 13:08:39.318789 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:39.347883 21762 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 2.
W20260709 13:08:39.348449 21762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59102 (request call id 2411) took 1234 ms (client timeout 1584 ms). Trace:
I20260709 13:08:39.321919 22484 rpcz_store.cc:276] 0709 13:08:37.784764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.785014 (+   250us) service_pool.cc:224] Handling call
0709 13:08:37.854232 (+ 69218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.854517 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:37.906372 (+ 51855us) log.cc:844] Serialized 14 byte log entry
0709 13:08:39.306656 (+1400284us) spinlock_profiling.cc:243] Waited 73 ms on lock 0x7b1800380d40. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6adeff4bc 00007fc6ab24d48b 00007fc6b40a7ab9 00007fc6ab26969b 00007fc6ab26793f 00007fc6ab267455 00007fc6ae34f060 00007fc6ae361716 00007fc6ae372287
0709 13:08:39.306768 (+   112us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:39.306823 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:39.306877 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.306956 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.307090 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1873,"prepare.queue_time_us":46808,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":46,"raft.queue_time_us":133572,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":27971,"spinlock_wait_cycles":167820032,"thread_start_us":436486,"threads_started":2,"wal-append.queue_time_us":388640}
W20260709 13:08:39.348887 21762 rpcz_store.cc:269] 0709 13:08:38.113946 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.195895 (+ 81949us) service_pool.cc:224] Handling call
0709 13:08:39.318604 (+1122709us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b5800000098. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232a22 00007fc6b414bc09 00007fc6b32a5ee0 00007fc6b336f0ab 00007fc6b336f131 00007fc6b331d0a0 00007fc6b331c984 00007fc6ac8976d4 00007fc6ac897662
0709 13:08:39.348378 (+ 29774us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60154624}
I20260709 13:08:39.345377 21764 rpcz_store.cc:276] 0709 13:08:38.074886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.078782 (+  3896us) service_pool.cc:224] Handling call
0709 13:08:38.079112 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.079505 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:38.079534 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.175697 (+ 96163us) log.cc:844] Serialized 26 byte log entry
0709 13:08:38.878886 (+703189us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:38.878946 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:38.879050 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:39.344749 (+465699us) raft_consensus.cc:1685] finished
0709 13:08:39.344767 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.344891 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3977,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":36835,"thread_start_us":483149,"threads_started":1,"wal-append.queue_time_us":871350}
I20260709 13:08:39.355194 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:39.356015 22485 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
W20260709 13:08:39.346506 21834 rpcz_store.cc:269] 0709 13:08:37.902314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.902472 (+   158us) service_pool.cc:224] Handling call
0709 13:08:39.325313 (+1422841us) spinlock_profiling.cc:243] Waited 887 ms on lock 0x7b540025dad4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:39.345348 (+ 20035us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2041050880}
I20260709 13:08:39.344966 21907 raft_consensus.cc:2393] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:39.358870 21728 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:39.361202 21806 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:39.363966 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 378391us
I20260709 13:08:39.364929 21729 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
W20260709 13:08:39.381274 21905 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.014s	sys 0.022s
W20260709 13:08:39.381785 21905 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.014s	sys 0.022s
W20260709 13:08:39.383069 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 382535us
W20260709 13:08:39.436002 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 74862.7us
I20260709 13:08:39.297137 24288 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:39.439877 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 353657us
I20260709 13:08:39.360602 21728 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:39.450901 21840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2421) took 2824 ms. Trace:
I20260709 13:08:39.451007 21762 raft_consensus.cc:1240] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:39.451786 21762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1063) took 1027 ms. Trace:
I20260709 13:08:39.452133 21762 rpcz_store.cc:276] 0709 13:08:38.424334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.450578 (+1026244us) service_pool.cc:224] Handling call
0709 13:08:39.450848 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.451568 (+   720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.451738 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:39.454195 21762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1064) took 1029 ms. Trace:
I20260709 13:08:39.454553 21762 rpcz_store.cc:276] 0709 13:08:38.424617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.453334 (+1028717us) service_pool.cc:224] Handling call
0709 13:08:39.453662 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.453838 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.453874 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:39.453925 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:39.453968 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.454036 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.454137 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:39.456951 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.301400 24068 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:39.457522 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.469041 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.319145 24136 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:39.554627 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:39.556330 21762 raft_consensus.cc:1240] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:39.556375 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:39.307662 23818 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:39.310073 24238 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:39.468067 21840 rpcz_store.cc:276] 0709 13:08:36.618780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.621868 (+  3088us) service_pool.cc:224] Handling call
0709 13:08:36.622153 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:37.230813 (+608660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.442968 (+2212155us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b540025f3d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:39.443209 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":881548160}
I20260709 13:08:39.315526 23895 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:39.339459 24268 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:39.318463 24205 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:39.565042 21762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1065) took 1140 ms. Trace:
I20260709 13:08:39.566140 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:39.566715 21910 raft_consensus.cc:2468] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:39.607609 21762 rpcz_store.cc:276] 0709 13:08:38.424919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.455589 (+1030670us) service_pool.cc:224] Handling call
0709 13:08:39.467668 (+ 12079us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.556901 (+ 89233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.564977 (+  8076us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:39.608685 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:39.609634 21910 raft_consensus.cc:2393] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:08:39.579118 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.561928 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:39.596241 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:39.596935 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 50453.9us
I20260709 13:08:39.441499 23845 raft_consensus.cc:697] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:39.558457 24288 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.450244 24287 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:08:39.612432 22450 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.800s (SENT) [suppressed 36 similar messages]
I20260709 13:08:39.558461 23977 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:39.319463 24134 consensus_queue.cc:237] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:39.600729 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:39.633822 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:39.611732 21907 raft_consensus.cc:2376] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6. Re-sending same reply.
I20260709 13:08:39.435868 24302 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.175s
I20260709 13:08:39.631649 21840 raft_consensus.cc:1240] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:08:39.667331 24179 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:39.669414 24179 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:39.674911 24280 log.cc:927] Time spent T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 1.684s	user 0.015s	sys 0.006s
I20260709 13:08:39.682018 22482 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:39.682902 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:39.684971 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.686815 24246 consensus_meta.cc:287] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.836s	user 0.013s	sys 0.000s
I20260709 13:08:39.689020 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:39.695515 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:39.704701 21832 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:08:39.642205 24287 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:39.708839 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:39.710476 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:39.610934 24268 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:39.702942 24293 log.cc:927] Time spent T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:08:39.718221 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:39.708248 24069 consensus_meta.cc:287] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.598s	user 0.012s	sys 0.000s
W20260709 13:08:39.724261 21804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.006s	sys 0.029s
W20260709 13:08:39.724691 21804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.006s	sys 0.029s
I20260709 13:08:39.650171 24288 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:39.707929 24287 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:39.728564 22477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.066s	sys 0.078s
I20260709 13:08:39.666555 24184 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:39.730933 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:39.732688 21756 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.026s	sys 0.057s
W20260709 13:08:39.729110 22477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.066s	sys 0.078s
W20260709 13:08:39.733150 21756 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.026s	sys 0.058s
W20260709 13:08:39.729812 21765 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.003s	sys 0.037s
W20260709 13:08:39.733927 21765 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.003s	sys 0.037s
I20260709 13:08:39.734133 21756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2399) took 1648 ms. Trace:
W20260709 13:08:39.736334 21906 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.018s	sys 0.035s
W20260709 13:08:39.736788 21906 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.019s	sys 0.035s
I20260709 13:08:39.737970 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1041) took 1064 ms. Trace:
I20260709 13:08:39.738539 21906 rpcz_store.cc:276] 0709 13:08:38.673263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.733949 (+ 60686us) service_pool.cc:224] Handling call
0709 13:08:38.749449 (+ 15500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.755988 (+  6539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.756037 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.756702 (+   665us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.192892 (+436190us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:39.737224 (+544332us) log.cc:844] Serialized 14 byte log entry
0709 13:08:39.737694 (+   470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.737766 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:39.737802 (+    36us) raft_consensus.cc:1685] finished
0709 13:08:39.737811 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.737919 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8147,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":183,"thread_start_us":971199,"threads_started":2,"wal-append.queue_time_us":577105}
I20260709 13:08:39.740306 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:39.737900 21910 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
W20260709 13:08:39.749348 21839 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.023s	sys 0.020s
W20260709 13:08:39.752100 21839 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.023s	sys 0.021s
I20260709 13:08:39.752187 21911 raft_consensus.cc:2368] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7.
I20260709 13:08:39.754438 22482 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:39.745409 21804 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:39.734622 21756 rpcz_store.cc:276] 0709 13:08:38.086200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.117759 (+ 31559us) service_pool.cc:224] Handling call
0709 13:08:38.128012 (+ 10253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:38.128243 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:38.578597 (+450354us) log.cc:844] Serialized 14 byte log entry
0709 13:08:39.733667 (+1155070us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:39.733716 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:39.733911 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.733972 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.734084 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20230,"prepare.queue_time_us":599472,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":245616,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":27425,"thread_start_us":1604597,"threads_started":3,"wal-append.queue_time_us":676386}
W20260709 13:08:39.772593 21838 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.015s	sys 0.025s
W20260709 13:08:39.773085 21838 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.015s	sys 0.025s
W20260709 13:08:39.775341 21731 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.000s	sys 0.025s
W20260709 13:08:39.775729 21731 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.000s	sys 0.025s
W20260709 13:08:39.776010 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 623107us
I20260709 13:08:39.793315 21906 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:39.791420 24208 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.067s	user 0.009s	sys 0.020s
W20260709 13:08:39.827410 24208 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.009s	sys 0.020s
W20260709 13:08:39.803647 21761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.016s	sys 0.012s
I20260709 13:08:39.814268 21911 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:08:39.829013 21761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.016s	sys 0.012s
I20260709 13:08:39.829883 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:39.830044 24167 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:39.831012 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 260) took 1408 ms. Trace:
I20260709 13:08:39.831977 21911 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:39.816229 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:39.833088 21836 raft_consensus.cc:2376] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7. Re-sending same reply.
I20260709 13:08:39.834110 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:39.835273 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:39.836335 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:39.836917 21836 raft_consensus.cc:2376] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5. Re-sending same reply.
I20260709 13:08:39.813855 24213 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:39.837767 24213 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:39.840269 24213 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:39.818048 24230 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:08:39.818715 24313 log.cc:927] Time spent T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 13:08:39.819365 22448 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:39.819674 24316 log.cc:927] Time spent T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 13:08:39.820485 24315 log.cc:927] Time spent T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:08:39.823946 21758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.015s	sys 0.016s
W20260709 13:08:39.844561 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:39.844731 21758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.015s	sys 0.016s
I20260709 13:08:39.844854 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1044) took 1170 ms. Trace:
I20260709 13:08:39.828361 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:39.845306 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1046) took 1170 ms. Trace:
I20260709 13:08:39.844594 22448 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:39.845940 21914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1045) took 1171 ms. Trace:
I20260709 13:08:39.847702 24215 raft_consensus.cc:2804] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:39.852361 24215 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:39.845767 21909 rpcz_store.cc:276] 0709 13:08:38.674452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.855273 (+180821us) service_pool.cc:224] Handling call
0709 13:08:38.855584 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.856849 (+  1265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.856877 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.857360 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.361101 (+503741us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:39.361139 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.361204 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:39.845129 (+483925us) raft_consensus.cc:1685] finished
0709 13:08:39.845145 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.845257 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":774,"raft.queue_time_us":1537,"spinlock_wait_cycles":49142016,"thread_start_us":467147,"threads_started":1,"wal-append.queue_time_us":741240}
I20260709 13:08:39.852783 24215 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:39.846626 21914 rpcz_store.cc:276] 0709 13:08:38.674230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.853497 (+179267us) service_pool.cc:224] Handling call
0709 13:08:38.853820 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.854182 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:08:38.854223 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.869340 (+ 15117us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.382621 (+513281us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:39.382672 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.382752 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:39.845709 (+462957us) raft_consensus.cc:1685] finished
0709 13:08:39.845736 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.845878 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2570,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":26039,"thread_start_us":472447,"threads_started":1,"wal-append.queue_time_us":741940}
I20260709 13:08:39.831647 21761 rpcz_store.cc:276] 0709 13:08:38.422514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.115018 (+692504us) service_pool.cc:224] Handling call
0709 13:08:39.115260 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.829546 (+714286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.829588 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:39.829748 (+   160us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:39.829835 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.830809 (+   974us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.830948 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":192826,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":56,"thread_start_us":713895,"threads_started":1}
I20260709 13:08:39.847429 24205 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:39.858019 24205 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:39.858526 24205 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:39.845252 21905 rpcz_store.cc:276] 0709 13:08:38.673998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.759211 (+ 85213us) service_pool.cc:224] Handling call
0709 13:08:38.759512 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.759823 (+   311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:38.759853 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.793079 (+ 33226us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.382235 (+589156us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:39.382292 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.382385 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:39.844668 (+462283us) raft_consensus.cc:1685] finished
0709 13:08:39.844686 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.844803 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23591,"raft.queue_time_us":1434,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4429,"thread_start_us":588686,"threads_started":1,"wal-append.queue_time_us":657408}
I20260709 13:08:39.847925 24298 consensus_queue.cc:1059] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:08:39.848316 24213 consensus_queue.cc:1059] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:08:39.774740 24106 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:39.727643 24069 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:39.918687 21833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.002s	sys 0.031s
W20260709 13:08:39.919422 21833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.003s	sys 0.031s
I20260709 13:08:39.800843 24102 consensus_queue.cc:1059] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.122s
I20260709 13:08:39.724413 23845 consensus_queue.cc:237] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:39.814239 24235 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:39.815493 24322 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:39.933279 21880 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.007s	sys 0.013s
I20260709 13:08:39.774055 24238 consensus_queue.cc:1048] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.157s
I20260709 13:08:39.240607 22476 rpcz_store.cc:276] 0709 13:08:38.179070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.195352 (+ 16282us) service_pool.cc:224] Handling call
0709 13:08:38.431878 (+236526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:38.432140 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:38.432549 (+   409us) log.cc:844] Serialized 14 byte log entry
0709 13:08:39.232999 (+800450us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:39.233080 (+    81us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:39.233215 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.233308 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.233497 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":194,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":107,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":107,"thread_start_us":787484,"threads_started":1,"wal-append.queue_time_us":891142}
I20260709 13:08:39.803951 24119 consensus_queue.cc:1048] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.129s
W20260709 13:08:39.938905 21880 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.007s	sys 0.013s
I20260709 13:08:39.918751 24106 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:39.943495 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 658845us
I20260709 13:08:39.936484 24235 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:39.949596 24235 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:39.953451 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:39.954211 21905 raft_consensus.cc:2368] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7.
I20260709 13:08:39.955658 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:39.956476 22449 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:39.944842 24106 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:39.958810 24292 log.cc:927] Time spent T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 1.232s	user 0.001s	sys 0.011s
I20260709 13:08:39.960570 21760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 258) took 1565 ms. Trace:
I20260709 13:08:39.960920 21760 rpcz_store.cc:276] 0709 13:08:38.395180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.103684 (+708504us) service_pool.cc:224] Handling call
0709 13:08:39.104005 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.124706 (+ 20701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.124762 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.141161 (+ 16399us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.567665 (+426504us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:39.567692 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.567740 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:39.960385 (+392645us) raft_consensus.cc:1685] finished
0709 13:08:39.960401 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.960515 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":203848,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":67,"thread_start_us":341532,"threads_started":1,"wal-append.queue_time_us":654228}
I20260709 13:08:39.964262 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1047) took 1289 ms. Trace:
I20260709 13:08:39.964622 21908 rpcz_store.cc:276] 0709 13:08:38.674674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.862185 (+187511us) service_pool.cc:224] Handling call
0709 13:08:38.862578 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:38.863043 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:08:38.863084 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:38.863662 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.346181 (+482519us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:39.346221 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.346289 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:39.964078 (+617789us) raft_consensus.cc:1685] finished
0709 13:08:39.964095 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:39.964210 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4859,"raft.queue_time_us":992,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":26060,"thread_start_us":386076,"threads_started":1,"wal-append.queue_time_us":1032842}
I20260709 13:08:39.967887 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2436) took 2747 ms. Trace:
I20260709 13:08:39.968251 21831 rpcz_store.cc:276] 0709 13:08:37.220497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.220662 (+   165us) service_pool.cc:224] Handling call
0709 13:08:37.306588 (+ 85926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.153399 (+1846811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.967674 (+814275us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b54003c0ad4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:39.967833 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4245487360}
I20260709 13:08:39.971002 24184 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:39.971693 24184 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:39.972261 24184 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:39.983094 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:39.937173 24302 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:08:39.986387 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:39.988505 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:40.025275 21763 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.000s	sys 0.035s
W20260709 13:08:40.025740 21763 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.000s	sys 0.035s
I20260709 13:08:39.990537 24100 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:39.986334 24071 consensus_meta.cc:287] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.653s	user 0.011s	sys 0.000s
I20260709 13:08:39.911914 24215 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:39.997993 24302 raft_consensus.cc:697] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:08:40.103271 24324 log.cc:927] Time spent T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:08:40.104103 24302 consensus_queue.cc:237] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:40.060304 23895 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:40.105918 23895 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:40.108469 23895 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:40.108982 24071 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:40.111702 24071 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:40.114061 24334 log.cc:927] Time spent T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:08:40.115427 24268 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:40.116127 24268 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.116658 24268 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:40.119024 21839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56424 (request call id 219) took 1075 ms. Trace:
I20260709 13:08:40.119920 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:40.121454 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 767) took 1073 ms. Trace:
I20260709 13:08:40.121929 22477 rpcz_store.cc:276] 0709 13:08:39.047619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.048335 (+   716us) service_pool.cc:224] Handling call
0709 13:08:39.119462 (+ 71127us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.125236 (+  5774us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.125269 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.125785 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.733342 (+607557us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:39.733404 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.733527 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.121192 (+387665us) raft_consensus.cc:1685] finished
0709 13:08:40.121215 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.121368 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5333,"raft.queue_time_us":8763,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":13958,"thread_start_us":580560,"threads_started":1,"wal-append.queue_time_us":947177}
I20260709 13:08:40.127429 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:40.127981 24223 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:40.131319 24184 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:40.132095 24325 consensus_queue.cc:1059] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:40.133967 24325 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:08:40.134387 24157 consensus_meta.cc:287] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.833s	user 0.012s	sys 0.000s
I20260709 13:08:40.135389 24325 raft_consensus.cc:3055] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:40.135787 24325 raft_consensus.cc:740] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:40.136598 24325 consensus_queue.cc:260] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:40.137272 24283 consensus_meta.cc:287] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 1.217s	user 0.013s	sys 0.000s
I20260709 13:08:40.137862 24283 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:40.138464 24224 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.026494 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:40.123186 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56424 (request call id 224) took 1003 ms. Trace:
I20260709 13:08:40.141361 21832 rpcz_store.cc:276] 0709 13:08:39.119435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.246505 (+127070us) service_pool.cc:224] Handling call
0709 13:08:40.122992 (+876487us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b54003c05d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:40.123118 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1050902912}
I20260709 13:08:40.134912 24157 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:40.160729 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:40.162598 21806 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:40.119483 21839 rpcz_store.cc:276] 0709 13:08:39.043908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.044034 (+   126us) service_pool.cc:224] Handling call
0709 13:08:39.100266 (+ 56232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.100615 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.100640 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.101058 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.753012 (+651954us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:39.753067 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.753150 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.118738 (+365588us) raft_consensus.cc:1685] finished
0709 13:08:40.118762 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.118937 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13240,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":19818,"spinlock_wait_cycles":1430784,"thread_start_us":599285,"threads_started":1,"wal-append.queue_time_us":969547}
I20260709 13:08:40.185636 21831 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:40.133296 24320 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.137349 24231 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:40.206899 21729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.007s	sys 0.024s
I20260709 13:08:39.973320 24235 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:40.207993 21909 raft_consensus.cc:2393] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 7: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:40.195889 21914 raft_consensus.cc:1240] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:40.218815 21880 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:40.216209 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:40.219623 22483 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.012s	sys 0.007s
W20260709 13:08:40.270833 22483 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.012s	sys 0.007s
W20260709 13:08:40.180073 21728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.013s	sys 0.029s
W20260709 13:08:40.271770 21728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.014s	sys 0.029s
W20260709 13:08:40.272467 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 911895us
I20260709 13:08:40.280439 21728 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:40.292395 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 126413us
I20260709 13:08:40.211758 24325 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:40.295306 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:08:40.020233 24289 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.005s	sys 0.043s
I20260709 13:08:40.194530 24224 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:40.231098 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 274680us
W20260709 13:08:40.254869 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 92359.6us
W20260709 13:08:40.255937 21729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.007s	sys 0.026s
W20260709 13:08:40.333725 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 968844us
I20260709 13:08:40.334614 21729 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:40.335531 21729 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:40.256300 24332 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:40.339425 24332 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.298552 24335 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:40.258733 21760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1070) took 1607 ms. Trace:
I20260709 13:08:40.340225 21760 rpcz_store.cc:276] 0709 13:08:38.651238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.962284 (+1311046us) service_pool.cc:224] Handling call
0709 13:08:39.962579 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.962858 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.962885 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.963309 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:08:40.230302 (+266993us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:40.230349 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.230423 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.258549 (+ 28126us) raft_consensus.cc:1685] finished
0709 13:08:40.258568 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.258680 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":170177,"raft.run_cpu_time_us":56,"raft.run_wall_time_us":56,"thread_start_us":266608,"threads_started":1,"wal-append.queue_time_us":293365}
I20260709 13:08:40.338930 21729 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:40.259506 24369 raft_consensus.cc:2804] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:40.100800 24100 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:40.297957 24337 raft_consensus.cc:2764] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 13:08:40.300565 21762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.020s	sys 0.030s
W20260709 13:08:40.346931 21762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.020s	sys 0.030s
W20260709 13:08:40.223667 21759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.013s	sys 0.008s
I20260709 13:08:40.220333 24205 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:40.339821 24332 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.257542 24268 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:40.258863 24283 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:40.262017 24320 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:40.319067 24289 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.005s	sys 0.044s
W20260709 13:08:40.331344 22481 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.012s	sys 0.012s
I20260709 13:08:40.345808 21760 raft_consensus.cc:1240] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 13:08:40.348548 21759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.013s	sys 0.008s
I20260709 13:08:40.332001 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:40.348446 21729 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:40.338691 24104 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:40.343593 21757 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.007s	user 0.008s	sys 0.053s
W20260709 13:08:40.366565 21757 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.009s	sys 0.053s
W20260709 13:08:40.357795 22481 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.012s	sys 0.013s
I20260709 13:08:40.346680 24069 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:40.359277 21760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1071) took 1605 ms. Trace:
I20260709 13:08:40.370247 21760 rpcz_store.cc:276] 0709 13:08:38.753945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.342022 (+1588077us) service_pool.cc:224] Handling call
0709 13:08:40.342399 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.358938 (+ 16539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.359210 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:40.371085 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:08:40.367758 21756 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.009s	sys 0.013s
W20260709 13:08:40.373028 21756 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.009s	sys 0.013s
W20260709 13:08:40.369246 21838 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.012s	sys 0.010s
W20260709 13:08:40.374341 21838 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.013s	sys 0.010s
I20260709 13:08:40.372400 24104 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:40.375893 21764 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.007s	sys 0.064s
W20260709 13:08:40.376617 21764 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.008s	sys 0.064s
I20260709 13:08:40.292027 21728 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:40.377329 21838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56424 (request call id 217) took 1335 ms. Trace:
W20260709 13:08:40.382596 21761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.010s	sys 0.003s
W20260709 13:08:40.382997 21761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.010s	sys 0.003s
I20260709 13:08:40.378643 21838 rpcz_store.cc:276] 0709 13:08:39.042147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.043410 (+  1263us) service_pool.cc:224] Handling call
0709 13:08:39.043697 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.044150 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.044195 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.083855 (+ 39660us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.784037 (+700182us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:40.376099 (+592062us) log.cc:844] Serialized 14 byte log entry
0709 13:08:40.377065 (+   966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.377131 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.377168 (+    37us) raft_consensus.cc:1685] finished
0709 13:08:40.377179 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.377280 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2375,"prepare.queue_time_us":345027,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":4636,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":18405,"thread_start_us":1203653,"threads_started":2,"wal-append.queue_time_us":973226}
I20260709 13:08:40.393903 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:40.368297 24310 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:08:40.397919 21911 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.005s	sys 0.015s
W20260709 13:08:40.401347 21911 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.005s	sys 0.015s
W20260709 13:08:40.394428 21910 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.011s	sys 0.045s
W20260709 13:08:40.402271 21910 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.011s	sys 0.045s
I20260709 13:08:40.394368 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:40.404544 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:40.393368 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 101422us
I20260709 13:08:40.409350 21728 leader_election.cc:400] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8.
I20260709 13:08:40.409834 21728 leader_election.cc:403] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:40.411275 21728 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:40.390206 24298 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.005s	sys 0.010s
I20260709 13:08:40.352936 24304 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:08:40.420192 21877 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:40.370116 24283 consensus_queue.cc:1059] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 13:08:40.398809 24213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.006s	sys 0.008s
I20260709 13:08:40.440048 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2396) took 2355 ms. Trace:
I20260709 13:08:40.443096 21763 rpcz_store.cc:276] 0709 13:08:38.085161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.085306 (+   145us) service_pool.cc:224] Handling call
0709 13:08:39.343341 (+1258035us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b5800000098. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232a22 00007fc6b414bc09 00007fc6b32a5ee0 00007fc6b336f0ab 00007fc6b336f131 00007fc6b3330fc0 00007fc6b331b929 00007fc6b331b3d2 00007fc6ac892bd4
0709 13:08:39.343584 (+   243us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.343861 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.343903 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.344443 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 13:08:40.026357 (+681914us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:40.026402 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.026470 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:40.418313 (+391843us) raft_consensus.cc:1685] finished
0709 13:08:40.418340 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.439975 (+ 21635us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51534720,"thread_start_us":681495,"threads_started":1,"wal-append.queue_time_us":1029316}
I20260709 13:08:40.440640 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:40.445755 21839 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:40.441988 21877 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:40.431295 21840 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.017s	sys 0.010s
W20260709 13:08:40.448055 21840 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.017s	sys 0.010s
I20260709 13:08:40.457485 24282 raft_consensus.cc:3055] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:40.458092 24282 raft_consensus.cc:740] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:40.462517 24184 consensus_queue.cc:1048] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:40.406689 24310 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:40.418174 24335 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:40.418736 24345 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:40.443029 24213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.006s	sys 0.009s
W20260709 13:08:40.434226 24303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.040s	sys 0.046s
W20260709 13:08:40.430370 24298 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.005s	sys 0.010s
I20260709 13:08:40.434325 24157 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:40.417724 24106 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:40.497905 24298 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:40.498543 24298 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:40.499759 24106 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:40.488215 21763 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:08:40.500872 24298 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:40.500861 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1076) took 1697 ms. Trace:
I20260709 13:08:40.501708 21763 rpcz_store.cc:276] 0709 13:08:38.803535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.444657 (+1641122us) service_pool.cc:224] Handling call
0709 13:08:40.482387 (+ 37730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.500547 (+ 18160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.500795 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:08:40.431213 24208 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.007s	sys 0.016s
I20260709 13:08:40.440073 24267 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.479583 24179 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:40.450574 24215 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:40.513738 21758 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.008s	sys 0.021s
I20260709 13:08:40.483762 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:08:40.516757 21834 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.014s	sys 0.032s
I20260709 13:08:40.487015 24345 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:40.522081 21834 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.014s	sys 0.033s
W20260709 13:08:40.517707 21758 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.008s	sys 0.022s
W20260709 13:08:40.494038 24303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.041s	sys 0.046s
I20260709 13:08:40.492936 24065 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:40.486472 24104 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:40.513345 24208 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.007s	sys 0.016s
I20260709 13:08:40.540377 21758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 264) took 2116 ms. Trace:
I20260709 13:08:40.513757 24235 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:40.517311 24287 consensus_meta.cc:287] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.766s	user 0.012s	sys 0.000s
W20260709 13:08:40.536754 21803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.014s	sys 0.012s
W20260709 13:08:40.540753 21805 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.012s	sys 0.012s
W20260709 13:08:40.598491 21803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.014s	sys 0.013s
W20260709 13:08:40.598610 21805 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.012s	sys 0.012s
W20260709 13:08:40.599108 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 725879us
I20260709 13:08:40.565320 21758 rpcz_store.cc:276] 0709 13:08:38.423729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.136446 (+712717us) service_pool.cc:224] Handling call
0709 13:08:39.136854 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.137148 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:39.167110 (+ 29962us) log.cc:844] Serialized 14 byte log entry
0709 13:08:40.539677 (+1372567us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:40.539953 (+   276us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:40.540070 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.540159 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.540312 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24269,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":8917,"raft.queue_time_us":287477,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":62,"thread_start_us":1372053,"threads_started":2,"wal-append.queue_time_us":1038731}
W20260709 13:08:40.521755 23845 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.011s	sys 0.037s
W20260709 13:08:40.527280 24340 log.cc:927] Time spent T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
W20260709 13:08:40.622716 21837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.014s	sys 0.037s
W20260709 13:08:40.631796 21837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.015s	sys 0.037s
W20260709 13:08:40.626619 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.633469 21763 raft_consensus.cc:1240] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 2. Current term is 3. Ops: []
W20260709 13:08:40.626096 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:40.635317 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.531123 21839 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:40.527631 22476 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:40.594287 24061 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.008s	sys 0.016s
I20260709 13:08:40.525167 24352 consensus_queue.cc:1059] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.142s
W20260709 13:08:40.622867 24098 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.002s	sys 0.037s
I20260709 13:08:40.538987 24224 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:40.622478 23845 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.011s	sys 0.040s
I20260709 13:08:40.528951 24345 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:40.492280 24335 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:40.596800 24322 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:40.677503 24339 log.cc:927] Time spent T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.326s	user 0.000s	sys 0.001s
I20260709 13:08:40.517670 24267 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:40.671170 24061 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.008s	sys 0.017s
I20260709 13:08:40.670328 24184 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:40.625771 24344 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:40.680559 21731 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.001s	sys 0.028s
I20260709 13:08:40.648243 24100 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:40.678395 24098 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.002s	sys 0.037s
W20260709 13:08:40.680398 24188 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.005s	sys 0.009s
I20260709 13:08:40.667658 24222 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.632349 24337 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:40.682525 24303 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:40.750479 24094 raft_consensus.cc:3055] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:40.754102 24335 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:40.777837 24350 log.cc:927] Time spent T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:08:40.715821 24352 consensus_queue.cc:1243] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer 6d698a5544b946939790e7a3972db9fb log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:08:40.791965 21731 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.002s	sys 0.028s
I20260709 13:08:40.633677 24287 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:40.708684 24208 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:40.828953 24322 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:40.830226 24071 raft_consensus.cc:3055] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:08:40.706153 24206 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.009s	sys 0.009s
I20260709 13:08:40.756455 24205 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:40.792373 24320 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:40.872756 24188 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.005s	sys 0.010s
W20260709 13:08:40.897030 21833 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.014s	sys 0.031s
W20260709 13:08:40.904793 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 1.09876e+06us
W20260709 13:08:40.982286 21833 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.038s	user 0.014s	sys 0.031s
W20260709 13:08:40.908283 22449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.013s	sys 0.033s
I20260709 13:08:40.884178 24337 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:40.872344 22478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36270 (request call id 485) took 2222 ms. Trace:
W20260709 13:08:40.903484 21939 heartbeater.cc:646] Failed to heartbeat to 127.20.40.62:38057 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.40.62:38057 timed out after 15.000s (SENT)
W20260709 13:08:40.988011 22481 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.013s	sys 0.021s
W20260709 13:08:40.989859 22481 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.013s	sys 0.021s
W20260709 13:08:40.977713 21761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.018s	sys 0.010s
W20260709 13:08:40.904220 24325 consensus_meta.cc:287] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.000s
W20260709 13:08:40.983342 22449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.013s	sys 0.033s
I20260709 13:08:40.893816 24094 raft_consensus.cc:740] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:40.990495 21836 raft_consensus.cc:1240] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:40.990899 21761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.018s	sys 0.010s
W20260709 13:08:40.993124 21805 leader_election.cc:336] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.845s (SENT)
I20260709 13:08:41.005096 21805 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:40.995553 22448 leader_election.cc:336] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.801s (SENT)
I20260709 13:08:41.006031 22448 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:40.996692 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 664998us
W20260709 13:08:41.002125 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.973592 24322 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:40.990568 22481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 769) took 1745 ms. Trace:
I20260709 13:08:41.009730 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56424 (request call id 227) took 1845 ms. Trace:
I20260709 13:08:40.973835 24071 raft_consensus.cc:740] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
W20260709 13:08:41.016789 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.989957 24337 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:41.040786 22449 leader_election.cc:400] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7.
W20260709 13:08:41.047739 21756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.012s	sys 0.032s
I20260709 13:08:41.048026 22449 leader_election.cc:403] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:41.048184 21756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.012s	sys 0.032s
I20260709 13:08:41.048623 24071 consensus_queue.cc:260] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:41.049860 24071 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:41.050150 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.994292 24346 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8.
I20260709 13:08:40.892584 24222 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:40.994343 24361 raft_consensus.cc:3055] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:41.017246 21833 rpcz_store.cc:276] 0709 13:08:39.164552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.259913 (+ 95361us) service_pool.cc:224] Handling call
0709 13:08:39.260332 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.272979 (+ 12647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.273010 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.273519 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.919970 (+646451us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:40.993603 (+1073633us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.009325 (+ 15722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.009414 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.009481 (+    67us) raft_consensus.cc:1685] finished
0709 13:08:41.009499 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.009665 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27594,"prepare.queue_time_us":209290,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":54033,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":1656478,"threads_started":2,"wal-append.queue_time_us":1000633}
I20260709 13:08:40.976250 24208 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:41.041788 24205 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:41.012034 24289 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:41.054391 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:41.055806 21912 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:41.017930 24267 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:41.012411 24224 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:41.011610 24320 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.062038 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:41.052296 24321 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:41.082068 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:41.059376 24361 raft_consensus.cc:740] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:08:41.091396 21840 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.018s	sys 0.050s
W20260709 13:08:41.112111 21840 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.018s	sys 0.050s
W20260709 13:08:41.127280 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:41.129017 21834 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.009s	sys 0.022s
W20260709 13:08:41.129492 21834 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.009s	sys 0.022s
I20260709 13:08:41.130488 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2461) took 1691 ms. Trace:
I20260709 13:08:41.130996 21834 rpcz_store.cc:276] 0709 13:08:39.439076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.640027 (+200951us) service_pool.cc:224] Handling call
0709 13:08:39.640360 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.640584 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:40.537799 (+897215us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.130014 (+592215us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:41.130084 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:41.130143 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.130228 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.130419 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":488112,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"thread_start_us":1414531,"threads_started":2}
W20260709 13:08:41.132457 21877 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.009s	sys 0.020s
W20260709 13:08:41.132751 21759 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.008s	sys 0.030s
W20260709 13:08:41.202883 21759 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.008s	sys 0.030s
I20260709 13:08:41.203843 21759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 254) took 3005 ms. Trace:
W20260709 13:08:41.133088 21728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.001s	sys 0.031s
W20260709 13:08:41.162775 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.020766 22481 rpcz_store.cc:276] 0709 13:08:39.245497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.265561 (+ 20064us) service_pool.cc:224] Handling call
0709 13:08:39.277028 (+ 11467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.277288 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:39.435560 (+158272us) log.cc:844] Serialized 14 byte log entry
0709 13:08:40.990235 (+1554675us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:40.990293 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:40.990336 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.990402 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.990515 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":158084,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":333976,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":42142,"thread_start_us":1554287,"threads_started":2,"wal-append.queue_time_us":1187837}
W20260709 13:08:41.205595 21728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.001s	sys 0.031s
W20260709 13:08:41.206398 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 795184us
I20260709 13:08:41.073978 24376 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:41.207074 21728 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:41.204249 21759 rpcz_store.cc:276] 0709 13:08:38.198120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.042996 (+844876us) service_pool.cc:224] Handling call
0709 13:08:39.043249 (+   253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.458145 (+414896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.458176 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.458882 (+   706us) log.cc:844] Serialized 26 byte log entry
0709 13:08:40.358178 (+899296us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:41.203271 (+845093us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.203506 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.203585 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.203625 (+    40us) raft_consensus.cc:1685] finished
0709 13:08:41.203636 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.203786 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":264261,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":144,"thread_start_us":1951175,"threads_started":3,"wal-append.queue_time_us":1009702}
I20260709 13:08:41.090255 24224 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:41.090080 24320 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:41.211521 24223 consensus_meta.cc:287] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 1.083s	user 0.011s	sys 0.000s
W20260709 13:08:41.141480 22450 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.006s	sys 0.061s
W20260709 13:08:41.330741 22450 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.006s	sys 0.061s
W20260709 13:08:41.331111 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 710119us
W20260709 13:08:41.199186 21804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.377s	user 0.012s	sys 0.033s
W20260709 13:08:41.332332 21804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.510s	user 0.013s	sys 0.033s
W20260709 13:08:41.333068 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:41.333420 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.334496 21835 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:41.334766 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:41.335644 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:41.225924 21877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.010s	sys 0.029s
I20260709 13:08:41.336616 21832 raft_consensus.cc:2393] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 7: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:08:41.133034 24202 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.009s	sys 0.021s
I20260709 13:08:41.229620 21728 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:41.336689 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 856511us
I20260709 13:08:41.337734 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:41.339066 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:41.339695 21838 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:41.347497 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:41.348719 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 119188us
I20260709 13:08:41.348737 22480 raft_consensus.cc:1240] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:41.349563 21728 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:41.351001 21877 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:41.343230 24110 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.358539 21912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:08:41.359038 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:41.138578 24365 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:41.362440 21912 raft_consensus.cc:606] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:41.344724 24202 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.009s	sys 0.021s
W20260709 13:08:41.343466 24359 log.cc:927] Time spent T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.506s	user 0.000s	sys 0.001s
I20260709 13:08:41.369205 21912 raft_consensus.cc:614] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:41.358842 24110 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:41.388155 21906 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:41.389109 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:41.394295 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 44855.9us
I20260709 13:08:41.447525 21728 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:41.331562 24352 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:41.449723 24352 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:41.450371 24352 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:41.344079 24267 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:08:41.454795 21831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.020s	sys 0.043s
W20260709 13:08:41.455118 21831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.972s	user 0.020s	sys 0.043s
I20260709 13:08:41.457796 21728 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:41.463882 21728 connection.cc:256] RPC call timeout handler was delayed by -1.6733125720000999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
W20260709 13:08:41.436213 21880 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.989s	user 0.017s	sys 0.022s
W20260709 13:08:41.464601 21880 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.017s	sys 0.022s
W20260709 13:08:41.465302 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:41.433568 21762 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.000s	sys 0.038s
W20260709 13:08:41.466043 21762 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.000s	sys 0.038s
I20260709 13:08:41.360842 21838 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
W20260709 13:08:41.110224 24302 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.039s	sys 0.038s
I20260709 13:08:41.471050 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:41.361749 24346 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:41.471803 21906 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:41.212777 24364 consensus_queue.cc:1059] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.174s
I20260709 13:08:41.355090 24363 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:41.394098 24348 log.cc:927] Time spent T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:08:41.475389 21760 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.026s	user 0.034s	sys 0.037s
I20260709 13:08:41.485188 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:41.482997 22450 leader_election.cc:336] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.509s (SENT)
W20260709 13:08:41.486069 21910 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.083s	user 0.035s	sys 0.106s
W20260709 13:08:41.485832 22479 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.055s	user 0.056s	sys 0.087s
W20260709 13:08:41.511590 22479 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.081s	user 0.057s	sys 0.088s
I20260709 13:08:41.367929 24319 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:08:41.484046 24302 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.223s	user 0.039s	sys 0.038s
W20260709 13:08:41.506913 21760 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.034s	sys 0.037s
I20260709 13:08:41.518290 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:41.506124 21838 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:41.518992 21834 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:41.515494 22450 leader_election.cc:336] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.830s (SENT)
I20260709 13:08:41.435843 24289 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:41.519596 22450 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:41.435664 24238 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:08:41.506680 21910 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.104s	user 0.035s	sys 0.107s
I20260709 13:08:41.452822 24344 consensus_queue.cc:1048] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 13:08:41.470891 24100 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:08:41.530066 22450 leader_election.cc:336] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.972s (SENT)
I20260709 13:08:41.487892 24287 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:41.561110 22450 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:41.524737 24167 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:41.575728 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1077) took 2772 ms. Trace:
I20260709 13:08:41.576167 21763 rpcz_store.cc:276] 0709 13:08:38.803808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.503180 (+1699372us) service_pool.cc:224] Handling call
0709 13:08:40.524437 (+ 21257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.634918 (+110481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.575430 (+940512us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400358c54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:41.575663 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233020288}
I20260709 13:08:41.351498 24376 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:41.556315 21906 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:41.582429 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:41.583631 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:41.556968 21759 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:41.574735 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 44713.3us
I20260709 13:08:41.574970 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:41.585028 22450 leader_election.cc:336] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.075s (SENT)
I20260709 13:08:41.585033 21912 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:41.585592 22450 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:41.533756 24364 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:41.491852 24267 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:41.550114 24238 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:41.513410 24061 consensus_queue.cc:1059] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:08:41.518508 24202 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:08:41.524873 24356 consensus_queue.cc:1059] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.126s
I20260709 13:08:41.594132 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:41.628405 21906 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:41.550963 24335 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.528527 24319 raft_consensus.cc:697] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:41.597611 22479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 780) took 1217 ms. Trace:
I20260709 13:08:41.615636 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:41.623916 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:41.639756 24342 log.cc:927] Time spent T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.514s	user 0.001s	sys 0.000s
I20260709 13:08:41.641547 24335 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:41.635043 21912 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:41.587487 24205 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:41.634303 22479 rpcz_store.cc:276] 0709 13:08:40.380338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.381107 (+   769us) service_pool.cc:224] Handling call
0709 13:08:40.401175 (+ 20068us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.401403 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:41.512081 (+1110678us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.596937 (+ 84856us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:41.597024 (+    87us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:41.597143 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.597271 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.597490 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1165212,"threads_started":2}
I20260709 13:08:41.642149 24388 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.561998 24302 consensus_queue.cc:1059] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:08:41.606814 24206 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:41.655426 24214 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.104s
I20260709 13:08:41.656116 21912 raft_consensus.cc:1275] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:08:41.634708 24202 consensus_queue.cc:1243] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer 6d698a5544b946939790e7a3972db9fb log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:08:41.506007 24361 consensus_queue.cc:260] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:41.536568 24289 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:41.678740 22476 consensus_meta.cc:287] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.996s	user 0.007s	sys 0.003s
I20260709 13:08:41.656198 24387 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:41.671320 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:40.989953 22478 rpcz_store.cc:276] 0709 13:08:38.618104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.640010 (+ 21906us) service_pool.cc:224] Handling call
0709 13:08:38.689851 (+ 49841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:38.853601 (+163750us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:38.951853 (+ 98252us) log.cc:844] Serialized 14 byte log entry
0709 13:08:39.558626 (+606773us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:39.596670 (+ 38044us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:39.600307 (+  3637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.366378 (+766071us) spinlock_profiling.cc:243] Waited 27.4 ms on lock 0x7b1800416da0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab2382a6 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419
0709 13:08:40.791029 (+424651us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54006022d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:40.809843 (+ 18814us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:40.840861 (+ 31018us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":47333,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":95163,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":45057,"spinlock_wait_cycles":355887744,"thread_start_us":475324,"threads_started":1,"wal-append.queue_time_us":861155,"wal-append.run_cpu_time_us":1092,"wal-append.run_wall_time_us":1002958}
I20260709 13:08:41.675416 24335 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:41.676152 24386 log.cc:927] Time spent T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:08:41.678979 24289 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:41.661121 24319 consensus_queue.cc:237] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:41.680253 21757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2397) took 3594 ms. Trace:
I20260709 13:08:41.681406 24352 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:41.580919 24100 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:41.631980 21838 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:41.697636 21757 rpcz_store.cc:276] 0709 13:08:38.085523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.085649 (+   126us) service_pool.cc:224] Handling call
0709 13:08:39.319170 (+1233521us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b5800000098. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232a22 00007fc6b414bc09 00007fc6b32a5ee0 00007fc6b336f0ab 00007fc6b336f131 00007fc6b3330fc0 00007fc6b331b929 00007fc6b331b3d2 00007fc6ac892bd4
0709 13:08:39.319363 (+   193us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.335496 (+ 16133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.335527 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.335971 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:08:40.366940 (+1030969us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:40.366978 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.679973 (+1312995us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b540031a1d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:41.680017 (+    44us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.680056 (+    39us) raft_consensus.cc:1685] finished
0709 13:08:41.680068 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.680195 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11240,"raft.queue_time_us":12360,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":74,"spinlock_wait_cycles":67326592,"thread_start_us":1030605,"threads_started":1,"wal-append.queue_time_us":1382990}
I20260709 13:08:41.701673 21834 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:41.656701 24356 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:41.680896 24337 consensus_meta.cc:287] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.633s	user 0.000s	sys 0.007s
I20260709 13:08:41.717450 24337 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:41.688732 24310 consensus_meta.cc:287] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 1.196s	user 0.012s	sys 0.001s
I20260709 13:08:41.753126 24184 raft_consensus.cc:3055] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:41.757409 24184 raft_consensus.cc:740] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:41.759042 24238 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:41.760399 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2470) took 1402 ms. Trace:
I20260709 13:08:41.760811 21831 rpcz_store.cc:276] 0709 13:08:40.384354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.384512 (+   158us) service_pool.cc:224] Handling call
0709 13:08:40.404344 (+ 19832us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.404671 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.404699 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:40.405103 (+   404us) log.cc:844] Serialized 26 byte log entry
0709 13:08:41.456862 (+1051759us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:41.456902 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.456972 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.760162 (+303190us) raft_consensus.cc:1685] finished
0709 13:08:41.760205 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.760339 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2548,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":12248,"thread_start_us":972344,"threads_started":1,"wal-append.queue_time_us":1313507}
I20260709 13:08:41.762435 21760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1074) took 2959 ms. Trace:
W20260709 13:08:41.763682 24349 log.cc:927] Time spent T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.625s	user 0.001s	sys 0.000s
I20260709 13:08:41.762809 21760 rpcz_store.cc:276] 0709 13:08:38.802961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.371044 (+1568083us) service_pool.cc:224] Handling call
0709 13:08:40.371417 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.371893 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.371934 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:40.390033 (+ 18099us) log.cc:844] Serialized 26 byte log entry
0709 13:08:41.518835 (+1128802us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:41.518878 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.518965 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.762241 (+243276us) raft_consensus.cc:1685] finished
0709 13:08:41.762260 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.762382 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":154582,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":10514,"spinlock_wait_cycles":14208,"thread_start_us":1075789,"threads_started":1,"wal-append.queue_time_us":1337876}
I20260709 13:08:41.661952 24388 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:41.766840 22485 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36278 (request call id 314) took 1230 ms. Trace:
I20260709 13:08:41.767426 21914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 376) took 1819 ms. Trace:
I20260709 13:08:41.757473 21757 raft_consensus.cc:1240] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:41.767961 21914 rpcz_store.cc:276] 0709 13:08:39.948466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.954903 (+  6437us) service_pool.cc:224] Handling call
0709 13:08:39.955158 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:40.269652 (+314494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.767130 (+1497478us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b5400219654. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:41.767353 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":553172864}
I20260709 13:08:41.768749 21757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1083) took 2963 ms. Trace:
I20260709 13:08:41.769096 21757 rpcz_store.cc:276] 0709 13:08:38.822313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.705533 (+2883220us) service_pool.cc:224] Handling call
0709 13:08:41.757180 (+ 51647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.768514 (+ 11334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.768698 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:41.705291 24335 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.771585 24335 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:41.773809 22483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36278 (request call id 311) took 2145 ms. Trace:
I20260709 13:08:41.775189 24100 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:41.695546 22476 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:41.777762 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36290 (request call id 781) took 1344 ms. Trace:
I20260709 13:08:41.778255 22476 rpcz_store.cc:276] 0709 13:08:40.433391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.435541 (+  2150us) service_pool.cc:224] Handling call
0709 13:08:41.777683 (+1342142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:41.782022 24282 consensus_queue.cc:260] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:41.783133 24282 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:41.785506 24213 raft_consensus.cc:3055] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:41.786046 24213 raft_consensus.cc:740] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:41.767658 21913 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:08:41.774221 22483 rpcz_store.cc:276] 0709 13:08:39.628466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.629766 (+  1300us) service_pool.cc:224] Handling call
0709 13:08:39.630274 (+   508us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:39.636292 (+  6018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.636342 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:39.645241 (+  8899us) log.cc:844] Serialized 52 byte log entry
0709 13:08:40.271376 (+626135us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:40.271433 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.271521 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.763075 (+1491554us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:41.773510 (+ 10435us) raft_consensus.cc:1685] finished
0709 13:08:41.773534 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.773751 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5452,"raft.queue_time_us":6275,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":9897,"spinlock_wait_cycles":406038272,"thread_start_us":601287,"threads_started":1,"wal-append.queue_time_us":1389550}
I20260709 13:08:41.671350 24302 consensus_queue.cc:1243] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer 6fadfd81c5a645f1806a284ddbb6bf0d log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:08:41.767186 22485 rpcz_store.cc:276] 0709 13:08:40.536158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.536315 (+   157us) service_pool.cc:224] Handling call
0709 13:08:40.536627 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.536961 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.536987 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:40.537551 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 13:08:41.111678 (+574127us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:41.111732 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.111832 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.766650 (+654818us) raft_consensus.cc:1685] finished
0709 13:08:41.766668 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.766783 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":241260,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":80,"thread_start_us":444423,"threads_started":1,"wal-append.queue_time_us":1142251}
W20260709 13:08:41.796025 24362 log.cc:927] Time spent T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:08:41.797041 21911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1055) took 1974 ms. Trace:
W20260709 13:08:41.803403 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 310974us
I20260709 13:08:41.787122 24267 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:41.804433 21804 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:41.810161 24100 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:41.810750 24288 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:41.812613 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:08:41.813390 22484 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36290 (request call id 774) took 1790 ms (client timeout 1669 ms). Trace:
W20260709 13:08:41.813776 22484 rpcz_store.cc:269] 0709 13:08:40.023171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.024264 (+  1093us) service_pool.cc:224] Handling call
0709 13:08:41.812445 (+1788181us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b5800004898. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232a22 00007fc6b414bc09 00007fc6b32a5ee0 00007fc6b336f0ab 00007fc6b336f131 00007fc6b331d0a0 00007fc6b331c984 00007fc6ac8976d4 00007fc6ac897662
0709 13:08:41.813325 (+   880us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4967680}
W20260709 13:08:41.790776 24303 consensus_meta.cc:287] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.878s	user 0.009s	sys 0.000s
I20260709 13:08:41.803517 21911 rpcz_store.cc:276] 0709 13:08:39.822295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.847417 (+ 25122us) service_pool.cc:224] Handling call
0709 13:08:39.847752 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.851068 (+  3316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.851107 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.855230 (+  4123us) log.cc:844] Serialized 26 byte log entry
0709 13:08:40.401897 (+546667us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:40.417343 (+ 15446us) log.cc:844] Serialized 14 byte log entry
0709 13:08:40.440616 (+ 23273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.440716 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.796805 (+1356089us) raft_consensus.cc:1685] finished
0709 13:08:41.796836 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.796978 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11817,"prepare.queue_time_us":14925,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":31937,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":29838,"thread_start_us":546220,"threads_started":1,"wal-append.queue_time_us":1799960}
I20260709 13:08:41.706683 24208 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:41.827014 21804 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:41.867251 21804 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:41.889681 21804 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:41.891193 21804 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:41.890439 24378 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:41.904080 21756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1068) took 3391 ms. Trace:
I20260709 13:08:41.792945 24310 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:41.868845 24303 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:41.904517 21756 rpcz_store.cc:276] 0709 13:08:38.512941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.768612 (+1255671us) service_pool.cc:224] Handling call
0709 13:08:39.802683 (+ 34071us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.374094 (+571411us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.375116 (+  1022us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:40.388641 (+ 13525us) log.cc:844] Serialized 26 byte log entry
0709 13:08:40.462146 (+ 73505us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b4800002958. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b3280aa1 00007fc6b3277b37 00007fc6b32779ca 00007fc6b336f26f 00007fc6b336ef37 00007fc6b338355c 00007fc6b3383508 00007fc6b3383488 00007fc6b3383443 00007fc6b33826ec 00007fc6b22aca96
0709 13:08:41.048609 (+586463us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:41.048653 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.048740 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:41.891520 (+842780us) raft_consensus.cc:1685] finished
0709 13:08:41.891545 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:41.904002 (+ 12457us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6870,"raft.queue_time_us":328959,"raft.run_cpu_time_us":2527,"raft.run_wall_time_us":330275,"spinlock_wait_cycles":46960896,"thread_start_us":1181854,"threads_started":2,"wal-append.queue_time_us":1088486}
I20260709 13:08:41.879690 24061 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:41.917651 21660 catalog_manager.cc:5697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:41.961581 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.994800 21763 raft_consensus.cc:1240] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:41.920382 21660 catalog_manager.cc:5697] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:08:42.037459 24392 log.cc:927] Time spent T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.422s	user 0.000s	sys 0.001s
I20260709 13:08:41.897107 24405 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:41.874264 24289 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:08:41.903779 24287 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:41.898790 24202 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:41.892043 24335 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:41.787163 24213 consensus_queue.cc:260] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:41.825238 24094 consensus_queue.cc:260] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:41.914822 24378 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:42.149549 21910 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.007s	sys 0.031s
W20260709 13:08:42.071211 21908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.038s	sys 0.112s
W20260709 13:08:42.150789 21905 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.017s	sys 0.020s
W20260709 13:08:42.117743 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:41.906885 24384 raft_consensus.cc:2804] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:08:42.248334 21908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.055s	sys 0.144s
W20260709 13:08:42.048775 24383 log.cc:927] Time spent T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
W20260709 13:08:42.249655 21878 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.017s	sys 0.089s
W20260709 13:08:42.262270 21878 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.017s	sys 0.089s
I20260709 13:08:42.262705 22482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 773) took 2262 ms. Trace:
W20260709 13:08:42.251525 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:42.248334 21905 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.021s	sys 0.023s
W20260709 13:08:42.248747 21910 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.009s	sys 0.037s
W20260709 13:08:42.191377 24407 log.cc:927] Time spent T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:08:42.263126 22482 rpcz_store.cc:276] 0709 13:08:40.000141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.002265 (+  2124us) service_pool.cc:224] Handling call
0709 13:08:42.261753 (+2259488us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b5800004898. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232a22 00007fc6b414bc09 00007fc6b32a5ee0 00007fc6b336f0ab 00007fc6b336f131 00007fc6b3330fc0 00007fc6b331b929 00007fc6b331b3d2 00007fc6ac892bd4
0709 13:08:42.262025 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:42.262251 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:42.262291 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:42.262348 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:42.262391 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.262462 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.262629 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57189248}
W20260709 13:08:42.171926 24392 log.cc:927] Time spent T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:08:42.051189 24287 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:42.245309 24188 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.016s	sys 0.040s
W20260709 13:08:42.194489 24393 log.cc:927] Time spent T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.499s	user 0.000s	sys 0.001s
I20260709 13:08:42.043031 24320 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:42.150789 24360 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:42.059175 24202 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.245994 24376 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:42.088310 24061 raft_consensus.cc:697] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:42.050369 24388 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:42.273108 21910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 369) took 2963 ms. Trace:
I20260709 13:08:42.272243 24287 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:42.256009 24384 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:42.280560 21910 rpcz_store.cc:276] 0709 13:08:39.303295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.771790 (+468495us) service_pool.cc:224] Handling call
0709 13:08:39.772016 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:39.772354 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:40.402805 (+630451us) log.cc:844] Serialized 14 byte log entry
0709 13:08:42.264376 (+1861571us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:42.264422 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:42.264466 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.264587 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.266536 (+  1949us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1593,"prepare.queue_time_us":333143,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":233878,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48,"thread_start_us":2444287,"threads_started":3,"wal-append.queue_time_us":1230546}
W20260709 13:08:42.277768 21906 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.033s	sys 0.066s
I20260709 13:08:42.082789 24208 consensus_queue.cc:1048] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.191s
I20260709 13:08:42.262660 24213 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:42.262830 24094 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:42.271708 24188 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.016s	sys 0.041s
I20260709 13:08:42.277403 24360 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:42.286566 21835 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38348 (request call id 1642) took 3980 ms (client timeout 2228 ms). Trace:
I20260709 13:08:42.271982 24335 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.290441 21764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 265) took 3866 ms. Trace:
W20260709 13:08:42.291916 21906 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.033s	sys 0.066s
I20260709 13:08:42.048691 24405 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:42.315905 24405 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:42.317749 21840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2462) took 2876 ms. Trace:
I20260709 13:08:42.318151 21840 rpcz_store.cc:276] 0709 13:08:39.441029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.670751 (+229722us) service_pool.cc:224] Handling call
0709 13:08:39.671076 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:39.671425 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:40.449460 (+778035us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.117104 (+667644us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:41.198557 (+ 81453us) log.cc:844] Serialized 52 byte log entry
0709 13:08:41.198773 (+   216us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:41.198821 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.198907 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:42.317505 (+1118598us) raft_consensus.cc:1685] finished
0709 13:08:42.317526 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.317688 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32509,"prepare.queue_time_us":457512,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":9342,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":76003,"thread_start_us":1348083,"threads_started":2,"wal-append.queue_time_us":1026808}
I20260709 13:08:42.276402 24202 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:42.303671 21764 rpcz_store.cc:276] 0709 13:08:38.424016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.351598 (+927582us) service_pool.cc:224] Handling call
0709 13:08:39.446509 (+ 94911us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:40.377626 (+931117us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.377652 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:40.378052 (+   400us) log.cc:844] Serialized 26 byte log entry
0709 13:08:40.668200 (+290148us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:40.668241 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.668315 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:42.290155 (+1621840us) raft_consensus.cc:1685] finished
0709 13:08:42.290182 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.290357 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":506832,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"thread_start_us":1220507,"threads_started":2,"wal-append.queue_time_us":1529102}
W20260709 13:08:42.301024 21835 rpcz_store.cc:269] 0709 13:08:38.306346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.646873 (+340527us) service_pool.cc:224] Handling call
0709 13:08:42.286338 (+3639465us) spinlock_profiling.cc:243] Waited 2.69 s on lock 0x7b54000bdbd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:42.286462 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6178699648}
W20260709 13:08:42.306599 24329 log.cc:927] Time spent T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 2.103s	user 0.008s	sys 0.014s
I20260709 13:08:42.307108 24360 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:42.337386 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:42.338106 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.345602 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:42.348491 21834 raft_consensus.cc:1240] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:08:42.349965 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:42.351228 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:42.351748 21838 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:08:42.356009 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:42.356156 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:42.357021 21835 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:42.357722 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:42.358490 21831 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:42.362519 24184 consensus_queue.cc:260] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:42.363873 24184 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:42.364568 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2393) took 4289 ms. Trace:
I20260709 13:08:42.365051 21765 rpcz_store.cc:276] 0709 13:08:38.080818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.121234 (+ 40416us) service_pool.cc:224] Handling call
0709 13:08:38.572991 (+451757us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.018315 (+445324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.018363 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.051040 (+ 32677us) log.cc:844] Serialized 26 byte log entry
0709 13:08:39.734352 (+683312us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:39.734402 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:39.734561 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:42.306004 (+2571443us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:42.361213 (+ 55209us) raft_consensus.cc:1685] finished
0709 13:08:42.361252 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.364488 (+  3236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4096,"raft.queue_time_us":272528,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":26066688,"thread_start_us":1019067,"threads_started":2,"wal-append.queue_time_us":897962}
W20260709 13:08:42.369480 24353 log.cc:927] Time spent T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 1.286s	user 0.009s	sys 0.007s
I20260709 13:08:42.370837 24202 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:42.371917 21837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2463) took 2930 ms. Trace:
I20260709 13:08:42.372314 21837 rpcz_store.cc:276] 0709 13:08:39.441309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.668381 (+227072us) service_pool.cc:224] Handling call
0709 13:08:39.668708 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:39.669033 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:39.669064 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:39.695270 (+ 26206us) log.cc:844] Serialized 26 byte log entry
0709 13:08:40.634115 (+938845us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:40.634162 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:40.634247 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:42.368800 (+1734553us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:42.371605 (+  2805us) raft_consensus.cc:1685] finished
0709 13:08:42.371627 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.371853 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":579,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":90,"spinlock_wait_cycles":675375872,"thread_start_us":938411,"threads_started":1,"wal-append.queue_time_us":1351375}
I20260709 13:08:42.373330 24352 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:42.373742 24202 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:42.375438 24106 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.375996 24106 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:42.396667 21840 raft_consensus.cc:1240] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:42.344808 24345 consensus_meta.cc:287] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 1.619s	user 0.011s	sys 0.002s
I20260709 13:08:42.399435 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:42.401147 21834 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:42.401731 21838 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
W20260709 13:08:42.412484 24379 log.cc:927] Time spent T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 13:08:42.416692 24363 consensus_meta.cc:287] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.905s	user 0.008s	sys 0.000s
I20260709 13:08:42.417115 24363 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:42.417831 24389 log.cc:927] Time spent T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:08:42.422991 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1057) took 1037 ms. Trace:
I20260709 13:08:42.426753 24224 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:42.432046 24282 consensus_meta.cc:287] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.000s
W20260709 13:08:42.436355 24365 consensus_meta.cc:287] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 1.000s	user 0.007s	sys 0.000s
I20260709 13:08:42.436626 24222 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:42.437862 24106 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:42.444629 21728 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.027s	sys 0.036s
I20260709 13:08:42.299034 24384 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:42.441632 21907 rpcz_store.cc:276] 0709 13:08:41.385727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.385879 (+   152us) service_pool.cc:224] Handling call
0709 13:08:41.386269 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:41.394176 (+  7907us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:41.513053 (+118877us) log.cc:844] Serialized 14 byte log entry
0709 13:08:42.058079 (+545026us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:42.078064 (+ 19985us) log.cc:844] Serialized 26 byte log entry
0709 13:08:42.078247 (+   183us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:42.078293 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.078384 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:42.281849 (+203465us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b48000b1258. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b3280aa1 00007fc6b3277b37 00007fc6b32779ca 00007fc6b336f26f 00007fc6b336ef37 00007fc6b338355c 00007fc6b3383508 00007fc6b3383488 00007fc6b3383443 00007fc6b33826ec 00007fc6b22aca96
0709 13:08:42.422678 (+140829us) raft_consensus.cc:1685] finished
0709 13:08:42.422780 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.422927 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":59383,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":5558,"raft.queue_time_us":67711,"raft.run_cpu_time_us":11379,"raft.run_wall_time_us":827014,"spinlock_wait_cycles":86793984,"thread_start_us":458778,"threads_started":1,"wal-append.queue_time_us":867431}
W20260709 13:08:42.451891 21728 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.027s	sys 0.036s
W20260709 13:08:42.457780 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 773621us
W20260709 13:08:42.499051 21879 connection.cc:256] RPC call timeout handler was delayed by -2.1790564319999248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3151s for a response
W20260709 13:08:42.499647 21879 connection.cc:256] RPC call timeout handler was delayed by -2.1300408949998655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
W20260709 13:08:42.500003 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:42.501144 21879 connection.cc:256] RPC call timeout handler was delayed by -1.9981640880000668s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2696s for a response
W20260709 13:08:42.501856 21879 connection.cc:256] RPC call timeout handler was delayed by -1.4575985330000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3587s for a response
W20260709 13:08:42.502262 21879 connection.cc:256] RPC call timeout handler was delayed by -1.351256903000035s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
I20260709 13:08:42.503885 24320 consensus_queue.cc:1059] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:42.505234 24320 raft_consensus.cc:3055] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:42.505683 24320 raft_consensus.cc:740] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:42.506656 24320 consensus_queue.cc:260] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:42.508168 24320 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:42.445535 24214 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:42.457653 24332 consensus_meta.cc:287] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 2.098s	user 0.015s	sys 0.000s
I20260709 13:08:42.330554 24335 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:42.457911 24365 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7.
I20260709 13:08:42.460822 24412 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:42.378135 24061 consensus_queue.cc:237] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:42.438696 24345 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:42.525076 21762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1067) took 4099 ms. Trace:
I20260709 13:08:42.531211 21762 rpcz_store.cc:276] 0709 13:08:38.489547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.608510 (+1118963us) service_pool.cc:224] Handling call
0709 13:08:39.608847 (+   337us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:40.347373 (+738526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.347418 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:40.348074 (+   656us) log.cc:844] Serialized 52 byte log entry
0709 13:08:40.704631 (+356557us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:41.466574 (+761943us) log.cc:844] Serialized 14 byte log entry
0709 13:08:41.694718 (+228144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.694831 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:42.411874 (+717043us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:42.520010 (+108136us) raft_consensus.cc:1685] finished
0709 13:08:42.524844 (+  4834us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.525013 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":112,"prepare.queue_time_us":889776,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":644017,"raft.run_cpu_time_us":429,"raft.run_wall_time_us":91999,"spinlock_wait_cycles":5459200,"thread_start_us":1988103,"threads_started":4,"wal-append.queue_time_us":1726624}
I20260709 13:08:42.533874 24367 raft_consensus.cc:3055] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:42.534298 24367 raft_consensus.cc:740] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:42.535110 24367 consensus_queue.cc:260] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:42.536303 24367 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:42.536929 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1069) took 3929 ms. Trace:
I20260709 13:08:42.537777 24235 raft_consensus.cc:3055] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:42.538194 24235 raft_consensus.cc:740] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:42.539062 24235 consensus_queue.cc:260] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:42.540387 24235 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:42.540827 24361 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:42.514005 24282 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:42.523268 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 2.14621e+06us
I20260709 13:08:42.542786 21729 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:42.529058 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.530071 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:42.537283 21761 rpcz_store.cc:276] 0709 13:08:38.607245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.857345 (+1250100us) service_pool.cc:224] Handling call
0709 13:08:39.857794 (+   449us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:40.402154 (+544360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:40.402200 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:40.421681 (+ 19481us) log.cc:844] Serialized 52 byte log entry
0709 13:08:41.005155 (+583474us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:08:41.005231 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:41.005399 (+   168us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:42.535846 (+1530447us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b240017e2f8. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab0f09c4 00007fc6ab0eeacb 00007fc6ab2a9dc9 00007fc6ab2a9a55 00007fc6ab2a8fb0 00007fc6adf1f488 00007fc6adf1fbe8 00007fc6adef7398 00007fc6adef276a 00007fc6adef1bb6
0709 13:08:42.536620 (+   774us) raft_consensus.cc:1685] finished
0709 13:08:42.536639 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.536867 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":271347,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":70,"spinlock_wait_cycles":46019968,"thread_start_us":1104707,"threads_started":2,"wal-append.queue_time_us":1238853}
I20260709 13:08:42.547487 21729 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:42.557165 21758 raft_consensus.cc:1240] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:08:42.558751 21729 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:42.464318 24287 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:42.561494 24352 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:42.567569 21729 leader_election.cc:400] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8.
I20260709 13:08:42.568780 21729 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:42.572973 21880 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.031s	sys 0.067s
I20260709 13:08:42.553086 24378 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:42.576721 21880 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.031s	sys 0.067s
I20260709 13:08:42.555029 24188 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:08:42.583250 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 616983us
I20260709 13:08:42.521071 24332 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:42.585384 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:42.585872 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.596448 24110 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:42.600672 21660 catalog_manager.cc:5697] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.603655 21836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2467) took 2476 ms. Trace:
I20260709 13:08:42.637404 21836 rpcz_store.cc:276] 0709 13:08:40.127318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.137932 (+ 10614us) service_pool.cc:224] Handling call
0709 13:08:40.138310 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.004302 (+865992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.603321 (+1599019us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b540043d5d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:42.603573 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1901622016}
W20260709 13:08:42.612231 21879 leader_election.cc:336] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.584s (SENT)
I20260709 13:08:42.638826 21879 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:42.640594 21879 leader_election.cc:336] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.790s (SENT)
I20260709 13:08:42.641099 21879 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:42.642976 21879 leader_election.cc:336] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.797s (SENT)
I20260709 13:08:42.643558 21879 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:42.612449 24310 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:42.614439 22448 connection.cc:256] RPC call timeout handler was delayed by -1.3414847430000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
W20260709 13:08:42.624878 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.633759 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:42.519942 24214 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:42.555084 24282 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:42.677242 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.697973 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:42.530910 24412 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:42.698973 21839 raft_consensus.cc:2393] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:42.700636 22483 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:08:42.712307 21832 raft_consensus.cc:1275] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:08:42.649760 24100 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.020s	sys 0.029s
W20260709 13:08:42.650417 24238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.023s	sys 0.035s
I20260709 13:08:42.573357 24344 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:42.654764 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:42.583961 24398 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:42.682116 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:42.653074 22448 connection.cc:256] RPC call timeout handler was delayed by -1.3066795790000469s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 13:08:42.729691 22448 connection.cc:256] RPC call timeout handler was delayed by -1.0841061770000806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
W20260709 13:08:42.682608 21805 connection.cc:256] RPC call timeout handler was delayed by -1.4779621270000689s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
I20260709 13:08:42.730331 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:42.717214 21838 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:42.686879 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 43927.9us
I20260709 13:08:42.629846 24360 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:42.629904 24402 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:42.654868 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:42.657565 24303 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:42.730645 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.654393 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:42.740386 22482 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:42.732344 21879 leader_election.cc:336] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.836s (SENT)
I20260709 13:08:42.743832 21879 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:42.745659 21879 leader_election.cc:336] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.854s (SENT)
I20260709 13:08:42.731016 22483 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:42.659618 24325 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:42.630035 24352 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.584416 24188 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:42.716914 24387 consensus_meta.cc:287] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.963s	user 0.009s	sys 0.003s
I20260709 13:08:42.650971 24409 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:42.739734 21805 connection.cc:256] RPC call timeout handler was delayed by -1.3879621270000371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
I20260709 13:08:42.737576 22448 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:42.678552 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 89097.8us
I20260709 13:08:42.685609 24223 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:08:42.721755 24238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.025s	sys 0.035s
I20260709 13:08:42.716270 24231 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:42.756872 21880 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:42.775249 21806 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:42.775363 22448 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:42.775825 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:42.761390 21728 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:42.759107 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:42.776923 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:42.777770 21906 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:42.778184 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:42.779201 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:42.759107 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.779954 21908 raft_consensus.cc:2393] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:08:42.780138 21805 connection.cc:256] RPC call timeout handler was delayed by -1.0531621270000642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 13:08:42.780471 21805 connection.cc:256] RPC call timeout handler was delayed by -1.0396621270000423s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 13:08:42.780822 21805 connection.cc:256] RPC call timeout handler was delayed by -1.0387621270000409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21050000000000002s for a response
I20260709 13:08:42.779153 21907 raft_consensus.cc:2410] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:08:42.764506 21879 leader_election.cc:336] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.855s (SENT)
I20260709 13:08:42.766330 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:42.767961 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:42.781472 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:42.782199 21840 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
W20260709 13:08:42.768373 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.714865 24403 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:08:42.748062 24230 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.032s	sys 0.072s
W20260709 13:08:42.732769 24267 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.001s	sys 0.012s
I20260709 13:08:42.747792 24378 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:42.757970 24188 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:42.758225 24387 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:08:42.800882 24230 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.033s	sys 0.072s
I20260709 13:08:42.752589 24360 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:42.755640 24410 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:42.797482 24213 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:42.802246 24224 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:42.802569 24110 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:42.757776 24352 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:42.747061 24398 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:42.756668 24402 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:42.832113 24369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.395s	user 0.049s	sys 0.080s
I20260709 13:08:42.797822 24223 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:42.800140 24231 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:42.835047 24319 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:42.853178 24213 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:42.873052 24369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.443s	user 0.049s	sys 0.081s
W20260709 13:08:42.836112 24267 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.001s	sys 0.013s
W20260709 13:08:42.877952 24288 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.010s	sys 0.023s
I20260709 13:08:42.889628 24335 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:42.889828 24288 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.011s	sys 0.023s
I20260709 13:08:42.884613 24369 raft_consensus.cc:697] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:42.894727 24369 consensus_queue.cc:237] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:42.897637 24345 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:42.884739 24213 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:42.849900 24378 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:42.882400 24319 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:42.916311 24322 consensus_meta.cc:287] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 1.872s	user 0.006s	sys 0.009s
I20260709 13:08:43.010758 24322 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.012694 24231 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:42.801122 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.806097 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:43.019011 21834 raft_consensus.cc:2393] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 4: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:42.801754 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:42.966266 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 204711us
I20260709 13:08:43.004060 21758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1078) took 4199 ms. Trace:
I20260709 13:08:43.022017 21758 rpcz_store.cc:276] 0709 13:08:38.804101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:40.601847 (+1797746us) service_pool.cc:224] Handling call
0709 13:08:40.602294 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:42.557864 (+1955570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.003382 (+445518us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b5400359154. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:43.003828 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4494970240}
W20260709 13:08:42.968160 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:42.967944 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:42.973562 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1058) took 1586 ms. Trace:
I20260709 13:08:42.979146 21836 raft_consensus.cc:1240] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:08:43.026266 21660 catalog_manager.cc:5697] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.027405 21907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:08:43.028455 21907 raft_consensus.cc:606] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:42.981820 21912 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.006s	sys 0.022s
W20260709 13:08:43.029654 21912 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.006s	sys 0.022s
W20260709 13:08:43.030164 24184 consensus_meta.cc:287] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.666s	user 0.005s	sys 0.018s
W20260709 13:08:42.973618 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.030090 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:43.031044 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1081) took 4226 ms. Trace:
I20260709 13:08:42.812561 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:43.005141 21759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1079) took 4200 ms. Trace:
I20260709 13:08:43.032617 22478 raft_consensus.cc:2410] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:08:43.031388 21763 rpcz_store.cc:276] 0709 13:08:38.804954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.577271 (+2772317us) service_pool.cc:224] Handling call
0709 13:08:41.607380 (+ 30109us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.995490 (+388110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.030533 (+1035043us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b540028da54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:43.030879 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":890299648}
I20260709 13:08:42.795006 22482 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:42.798081 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:42.855646 24071 consensus_meta.cc:287] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 1.793s	user 0.014s	sys 0.000s
W20260709 13:08:42.838387 24094 consensus_meta.cc:287] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.002s
I20260709 13:08:43.028667 24213 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.038908 22477 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:43.038612 21660 catalog_manager.cc:5697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:43.040359 22477 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36270 (request call id 489) took 1982 ms (client timeout 1935 ms). Trace:
I20260709 13:08:43.040585 24213 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:42.863946 24110 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:42.990540 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:43.041886 24110 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:43.042223 22483 raft_consensus.cc:2393] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 8: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:43.032244 21759 rpcz_store.cc:276] 0709 13:08:38.804384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.227340 (+2422956us) service_pool.cc:224] Handling call
0709 13:08:41.227746 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:41.584687 (+356941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.004631 (+1419944us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b540020b7d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:43.004943 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":704493440}
I20260709 13:08:43.045627 24169 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.046244 24169 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.012710 24188 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:43.047863 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:43.048944 22482 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
W20260709 13:08:43.054044 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.054615 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.055919 24213 consensus_queue.cc:1059] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:43.058182 24167 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:43.058667 24306 raft_consensus.cc:3055] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:43.058841 24167 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:43.059195 24306 raft_consensus.cc:740] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:43.060902 24306 consensus_queue.cc:260] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.062887 24306 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:43.063076 21806 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:42.827003 23977 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:42.902460 24287 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:43.066581 24287 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:43.067148 24287 raft_consensus.cc:697] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:43.067955 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:43.069906 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:43.070278 21913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1067) took 1620 ms. Trace:
I20260709 13:08:43.070683 21913 rpcz_store.cc:276] 0709 13:08:41.450258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.668359 (+218101us) service_pool.cc:224] Handling call
0709 13:08:41.668775 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:41.788089 (+119314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.069697 (+1281608us) spinlock_profiling.cc:243] Waited 98.6 ms on lock 0x7b54003af7d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:43.070126 (+   429us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226848128}
I20260709 13:08:43.006783 24321 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:08:42.997388 24223 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:42.901646 24214 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:42.923341 24319 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:42.869858 24224 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.076676 24224 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:42.991672 24282 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:42.993386 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:43.036895 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:43.077576 24282 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:43.053912 24188 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:43.077713 22480 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.078687 24188 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.072548 24321 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:43.079481 24321 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:43.079293 24188 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:43.026331 21905 rpcz_store.cc:276] 0709 13:08:41.386960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.387097 (+   137us) service_pool.cc:224] Handling call
0709 13:08:41.387410 (+   313us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:42.264392 (+876982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:42.264418 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:42.274987 (+ 10569us) log.cc:844] Serialized 52 byte log entry
0709 13:08:42.419309 (+144322us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b48000b1258. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b3280aa1 00007fc6b3277b37 00007fc6b32779ca 00007fc6b336f26f 00007fc6b336ef37 00007fc6b338355c 00007fc6b3383508 00007fc6b3383488 00007fc6b3383443 00007fc6b33826ec 00007fc6b22aca96
0709 13:08:42.582721 (+163412us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:42.582763 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:42.582851 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:42.972521 (+389670us) raft_consensus.cc:1685] finished
0709 13:08:42.972638 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:42.973237 (+   599us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6721,"raft.queue_time_us":126559,"raft.run_cpu_time_us":14433,"raft.run_wall_time_us":902082,"spinlock_wait_cycles":8647040,"thread_start_us":1165008,"threads_started":2,"wal-append.queue_time_us":575942}
I20260709 13:08:43.070688 22482 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:43.081979 24188 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:43.040844 22477 rpcz_store.cc:269] 0709 13:08:41.060181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.081711 (+ 21530us) service_pool.cc:224] Handling call
0709 13:08:43.040056 (+1958345us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b540018b354. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:43.040217 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4484735872}
W20260709 13:08:43.009385 21839 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56424 (request call id 231) took 1674 ms (client timeout 1598 ms). Trace:
I20260709 13:08:43.090489 24319 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.068797 24287 consensus_queue.cc:237] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:43.082118 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.093288 24098 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.094069 24098 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:42.937868 24412 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:43.156070 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.090305 21839 rpcz_store.cc:269] 0709 13:08:41.334686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.335082 (+   396us) service_pool.cc:224] Handling call
0709 13:08:43.008901 (+1673819us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540033a4d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:43.009135 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3079627136}
W20260709 13:08:43.053176 22450 connection.cc:256] RPC call timeout handler was delayed by -1.3184094060000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
W20260709 13:08:43.158325 22450 connection.cc:256] RPC call timeout handler was delayed by -1.3166452770000205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
W20260709 13:08:43.158933 24361 consensus_meta.cc:287] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.618s	user 0.012s	sys 0.000s
W20260709 13:08:43.159245 22450 leader_election.cc:336] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.800s (SENT)
I20260709 13:08:43.159801 21832 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:43.160549 24361 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.095701 21660 catalog_manager.cc:5697] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 4 to 6, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 6 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.163215 24378 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:43.164155 24398 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:43.163930 24361 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.164587 24363 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:43.165218 24363 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.165879 24363 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:42.922770 24332 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:43.150066 21880 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:43.168462 24361 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:43.170337 24337 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:43.171257 24360 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:43.171783 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:43.173770 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:43.174561 22477 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
W20260709 13:08:43.175779 24347 log.cc:927] Time spent T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 1.956s	user 0.005s	sys 0.008s
I20260709 13:08:43.176731 24402 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:43.178243 24169 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:43.030054 24322 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:43.179580 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:43.180660 21839 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:43.182451 22476 raft_consensus.cc:1240] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:43.160648 22450 connection.cc:256] RPC call timeout handler was delayed by -1.2028680449999456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33690000000000003s for a response
W20260709 13:08:43.184067 22450 connection.cc:256] RPC call timeout handler was delayed by -1.1083058169999731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260709 13:08:43.184924 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:43.078451 24282 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.185817 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:43.186396 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:43.187036 22484 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.187171 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:43.187811 24098 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:43.162408 21660 catalog_manager.cc:5697] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 4 to 5, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 5 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.190479 21660 catalog_manager.cc:5697] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 2 to 5, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 5 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.187418 24282 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:43.195533 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:43.196429 21912 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
W20260709 13:08:43.196483 21647 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 291227c6f9914476b4363d40f7cfebb8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:08:43.151443 24352 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:43.159528 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.204842 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:43.205610 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 109955us
I20260709 13:08:43.204807 21660 catalog_manager.cc:5697] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:08:43.212334 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.212919 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.213407 21880 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:43.212064 22477 raft_consensus.cc:1240] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:43.216078 22480 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
W20260709 13:08:43.137934 24320 consensus_meta.cc:287] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.585s	user 0.011s	sys 0.003s
I20260709 13:08:43.218633 21880 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:43.232776 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.246632 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:43.232402 24098 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:43.255033 21711 placement_policy_util.cc:248] tablet a218be1e72294b138c21b46dfa317d11: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
W20260709 13:08:43.256814 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 459988us
W20260709 13:08:43.257450 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 481995us
W20260709 13:08:43.258661 21805 leader_election.cc:336] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.617s (SENT)
I20260709 13:08:43.258739 22448 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:43.259912 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 439216us
W20260709 13:08:43.260681 21805 leader_election.cc:336] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.717s (SENT)
W20260709 13:08:43.261528 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.255247 24098 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.262099 24098 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:43.261766 21660 catalog_manager.cc:5697] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 1 to 4, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 4 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:43.263792 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:43.264456 24325 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:43.266126 21806 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:43.267171 21806 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:43.268597 24433 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:43.269080 24433 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.269531 24433 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:43.269620 24303 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:43.270656 24069 consensus_queue.cc:1059] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:43.272297 24282 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:43.272806 24282 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.273854 24102 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:43.274452 24102 raft_consensus.cc:697] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:43.273169 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:43.276546 24364 consensus_meta.cc:287] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 1.665s	user 0.018s	sys 0.000s
I20260709 13:08:43.276868 22478 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:43.273195 24282 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:43.281991 24409 consensus_queue.cc:1048] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:43.234988 24378 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:43.284231 24378 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.287905 24403 raft_consensus.cc:993] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:08:43.288080 24378 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:43.277029 24364 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:43.275687 24102 consensus_queue.cc:237] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.272512 22480 raft_consensus.cc:1240] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:43.296088 22449 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:43.261263 21805 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:43.239725 24398 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.298346 24361 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:43.298426 24398 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.300590 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:43.302145 24369 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:43.302418 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:43.302769 24369 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:43.303287 22478 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:43.306195 24319 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:43.306977 24319 raft_consensus.cc:1081] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:08:43.308877 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:43.309211 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.315784 22484 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
W20260709 13:08:43.311738 21805 leader_election.cc:336] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.089s (SENT)
I20260709 13:08:43.322036 21805 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:43.301149 24398 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:43.309175 21663 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45778 (request call id 282) took 18937 ms (client timeout 15000 ms). Trace:
I20260709 13:08:43.324755 21806 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:43.309804 21907 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:43.303301 24369 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:43.273165 24110 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.310997 24071 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:43.314893 24325 raft_consensus.cc:3055] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:43.311273 24267 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.349411 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:43.350546 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:43.323041 24098 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.371677 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:43.338788 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:43.377815 22484 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
W20260709 13:08:43.379161 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 120572us
W20260709 13:08:43.373853 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 113063us
I20260709 13:08:43.374962 21731 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:43.376399 21836 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:43.379951 21839 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:43.346992 24325 raft_consensus.cc:740] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:43.384265 24325 consensus_queue.cc:260] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.386112 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:43.389451 21897 tablet_service.cc:1558] Processing DeleteTablet for tablet a218be1e72294b138c21b46dfa317d11 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 5)) from {username='slave'} at 127.0.0.1:49532
W20260709 13:08:43.390640 24235 consensus_meta.cc:287] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.850s	user 0.012s	sys 0.009s
W20260709 13:08:43.392143 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 80495us
W20260709 13:08:43.393240 21805 leader_election.cc:336] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.104s (SENT)
I20260709 13:08:43.393749 21805 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:43.393563 24282 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:43.395069 21805 leader_election.cc:336] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.105s (SENT)
I20260709 13:08:43.395448 21805 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:43.395921 24282 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:43.398185 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.398768 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.399960 24361 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:43.400817 24361 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:43.402000 21826 tablet_service.cc:1558] Processing DeleteTablet for tablet bfdda4b9a4f14b5c90c55134ebfd6303 with delete_type TABLET_DATA_TOMBSTONED (TS 6fadfd81c5a645f1806a284ddbb6bf0d not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38332
I20260709 13:08:43.397660 24267 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:43.418259 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 381567us
I20260709 13:08:43.424714 22479 raft_consensus.cc:1240] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:43.421741 21880 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:43.425060 22448 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:43.401353 24167 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:43.427168 24418 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:43.427618 24418 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.427963 24418 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:43.428098 24167 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:43.430034 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:43.430444 24110 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:43.430684 21840 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
W20260709 13:08:43.431532 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 86965.1us
I20260709 13:08:43.435513 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:43.436116 22480 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:43.431708 24167 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:43.378921 24320 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:43.456682 21837 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:43.462723 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 247563us
W20260709 13:08:43.464869 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 206214us
I20260709 13:08:43.432760 24361 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:43.483748 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 58810.7us
I20260709 13:08:43.467940 24282 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:08:43.489092 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 44428.3us
I20260709 13:08:43.514053 22448 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:43.517725 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:43.519381 22479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36270 (request call id 491) took 1834 ms. Trace:
I20260709 13:08:43.519788 22479 rpcz_store.cc:276] 0709 13:08:41.685113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:41.685270 (+   157us) service_pool.cc:224] Handling call
0709 13:08:41.754419 (+ 69149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:43.425234 (+1670815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.519121 (+ 93887us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54004fd8d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:43.519307 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3634581376}
I20260709 13:08:43.520303 22448 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:43.521387 22448 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:43.521867 24458 tablet_replica.cc:333] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:08:43.522890 24169 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:43.523511 24169 raft_consensus.cc:697] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:43.523742 24306 raft_consensus.cc:2804] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:43.524431 24306 raft_consensus.cc:697] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
W20260709 13:08:43.526099 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.517788 21728 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:43.539609 21837 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:43.492550 24167 raft_consensus.cc:697] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:08:43.499106 24346 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.756s	user 0.006s	sys 0.024s
I20260709 13:08:43.495970 24282 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.495704 24071 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:43.557260 22485 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
W20260709 13:08:43.559154 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.325155 21663 rpcz_store.cc:269] 0709 13:08:24.372168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:24.372347 (+   179us) service_pool.cc:224] Handling call
0709 13:08:43.308913 (+18936566us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:36.519002 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:36.691180 (+172178us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:36.692920 (+  1740us) write_op.cc:435] Acquired schema lock
0709 13:08:36.699122 (+  6202us) tablet.cc:662] Decoding operations
0709 13:08:36.766386 (+ 67264us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:36.766467 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:36.766494 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:08:36.767346 (+   852us) tablet.cc:701] Row locks acquired
0709 13:08:36.767371 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:08:36.767556 (+   185us) write_op.cc:270] Start()
0709 13:08:36.767703 (+   147us) write_op.cc:276] Timestamp: P: 1783602516767500 usec, L: 0
0709 13:08:36.767729 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:08:36.768757 (+  1028us) log.cc:844] Serialized 3563 byte log entry
0709 13:08:36.787782 (+ 19025us) spinlock_profiling.cc:243] Waited 6.69 ms on lock 0x7b180030af00. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6adeff4bc 00007fc6ab24d48b 00007fc6b40a7ab9 00007fc6ab26969b 00007fc6ab26793f 00007fc6ab267455 00007fc6b1d8c16c 00007fc6b1d4cc18 00007fc6b424d2d1
0709 13:08:37.749636 (+961854us) op_driver.cc:464] REPLICATION: finished
0709 13:08:38.130019 (+380383us) write_op.cc:301] APPLY: starting
0709 13:08:38.130126 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:38.130504 (+   378us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:38.130535 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:38.334834 (+204299us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:38.335151 (+   317us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 13:08:38.335221 (+    70us) write_op.cc:312] APPLY: finished
0709 13:08:38.335617 (+   396us) log.cc:844] Serialized 71 byte log entry
0709 13:08:38.335860 (+   243us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:38.336019 (+   159us) write_op.cc:454] Released schema lock
0709 13:08:38.336083 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:38.336589 (+   506us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:38.336630 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":997655,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":380089,"apply.run_cpu_time_us":4163,"apply.run_wall_time_us":206495,"num_ops":9,"prepare.queue_time_us":150253,"prepare.run_cpu_time_us":19046,"prepare.run_wall_time_us":573894,"raft.queue_time_us":85147,"raft.run_cpu_time_us":127114,"raft.run_wall_time_us":166388,"replication_time_us":981619,"spinlock_wait_cycles":15398144,"thread_start_us":624449,"threads_started":4,"wal-append.queue_time_us":531359,"wal-append.run_cpu_time_us":12400,"wal-append.run_wall_time_us":2036302}]]}
I20260709 13:08:43.522927 24098 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:43.587231 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.603749 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.572006 22480 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
W20260709 13:08:43.597790 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 80136.9us
W20260709 13:08:43.561558 22450 leader_election.cc:336] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.995s (SENT)
I20260709 13:08:43.524673 24169 consensus_queue.cc:237] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:43.616500 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 59505us
W20260709 13:08:43.560571 24346 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.971s	user 0.006s	sys 0.025s
I20260709 13:08:43.562798 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:08:43.625723 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.621833 22450 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:43.625612 21880 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:43.627689 22479 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:43.485769 24320 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:43.563282 24282 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:43.631733 21728 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:43.635874 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 114596us
I20260709 13:08:43.634101 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:43.621467 24071 raft_consensus.cc:697] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:43.548157 24306 consensus_queue.cc:237] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.627909 24378 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:43.556535 24398 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:08:43.637827 24184 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:43.650380 21912 raft_consensus.cc:2410] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:43.563328 24433 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.554385 24363 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.650851 24450 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:43.630000 24346 raft_consensus.cc:697] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:43.646772 24378 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:43.663025 24446 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:43.665459 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.654511 24445 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.653550 24184 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:43.654824 24235 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:43.666697 24378 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.663762 24450 raft_consensus.cc:697] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:08:43.676710 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 190418us
I20260709 13:08:43.677371 22448 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:43.678277 24384 consensus_meta.cc:287] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 1.127s	user 0.018s	sys 0.000s
W20260709 13:08:43.682654 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 143284us
I20260709 13:08:43.670768 24184 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.683858 24094 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:43.683923 24235 raft_consensus.cc:697] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:43.685684 24423 consensus_queue.cc:1059] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 13:08:43.686697 24427 log.cc:927] Time spent T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:08:43.690181 24320 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:43.689762 24071 consensus_queue.cc:237] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:43.683545 24321 consensus_meta.cc:287] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.604s	user 0.013s	sys 0.000s
I20260709 13:08:43.690135 24450 consensus_queue.cc:237] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.691218 21728 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:43.732059 24433 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:43.665256 24444 consensus_queue.cc:1059] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.168s
I20260709 13:08:43.693804 24364 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:43.753610 24364 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:43.731081 24282 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.698143 24346 consensus_queue.cc:237] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:43.770682 21806 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:43.772648 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:43.773288 22480 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:43.773541 24369 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.691226 24446 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:43.776741 24446 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:43.699050 21911 raft_consensus.cc:1240] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 2. Current term is 3. Ops: []
I20260709 13:08:43.778384 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:43.778854 24369 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:43.701864 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:43.779668 21912 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:43.707590 21877 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:43.780886 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 73388.8us
I20260709 13:08:43.781087 24069 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:43.782250 21877 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:43.709995 24439 log.cc:927] Time spent T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 13:08:43.710428 24384 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:43.783931 21831 raft_consensus.cc:1240] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:08:43.784593 24282 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:43.784878 24384 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:43.785073 22485 raft_consensus.cc:1240] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:43.671983 24443 consensus_queue.cc:1059] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.125s
I20260709 13:08:43.715447 24267 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:43.731092 24325 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:43.786259 24398 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:43.786664 24345 raft_consensus.cc:3055] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:43.787129 24345 raft_consensus.cc:740] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:43.788096 24345 consensus_queue.cc:260] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.672454 21879 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:43.789394 24345 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:08:43.790071 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 131716us
I20260709 13:08:43.697018 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:43.748448 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 57351.6us
I20260709 13:08:43.793794 24069 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:43.793941 24405 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:43.794238 21728 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:43.795367 24443 raft_consensus.cc:2764] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:08:43.795679 21728 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:43.796663 24443 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:43.797228 24443 raft_consensus.cc:697] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:43.798305 24443 consensus_queue.cc:237] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.799659 24361 consensus_queue.cc:1059] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:43.800079 24429 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:43.756424 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:43.754390 21908 raft_consensus.cc:1275] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:43.752903 24184 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:43.761879 24364 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:43.697993 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:43.756862 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:43.758034 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:43.670902 24445 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.755369 24423 raft_consensus.cc:3055] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:43.754176 24444 raft_consensus.cc:3055] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:43.761394 21914 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:43.756202 24235 consensus_queue.cc:237] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:43.667853 24167 consensus_queue.cc:237] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.740093 24321 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:43.774397 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:43.840302 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 54059.8us
I20260709 13:08:43.700150 24418 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.780066 21911 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:43.711249 24449 consensus_queue.cc:1048] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:43.786755 24398 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:43.793152 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:43.804108 22480 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:43.753810 24320 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:43.814169 24446 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.818097 21912 raft_consensus.cc:2410] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:08:43.820083 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:43.853915 22485 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:43.831277 21909 raft_consensus.cc:2368] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5.
W20260709 13:08:43.831210 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.774578 24102 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:08:43.844487 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.819625 24378 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.825282 21648 catalog_manager.cc:5028] TS 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): tablet a218be1e72294b138c21b46dfa317d11 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:08:43.852804 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:43.824506 24423 raft_consensus.cc:740] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:43.830982 24444 raft_consensus.cc:740] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:43.875097 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:43.883471 21911 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:43.883821 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:43.884130 21806 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:43.884425 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.881283 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:43.881608 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:43.888679 21910 raft_consensus.cc:2368] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8.
I20260709 13:08:43.889495 21908 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
W20260709 13:08:43.890321 21648 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 65186.9us
I20260709 13:08:43.876740 21913 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:43.877986 24458 raft_consensus.cc:2243] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:43.894155 24363 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:43.887409 24446 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:43.895325 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:43.851537 24303 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:43.916823 21909 raft_consensus.cc:2368] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7.
I20260709 13:08:43.897769 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:43.843686 24188 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:43.915663 24102 raft_consensus.cc:697] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:43.938720 24188 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:43.879477 24445 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:43.939831 24102 consensus_queue.cc:237] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.940672 24188 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:43.852991 24320 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:43.941687 24320 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.942479 24378 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:43.943151 24378 consensus_queue.cc:1048] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:43.892203 21906 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:43.852679 24398 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:43.909531 22479 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:08:43.914942 21905 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
W20260709 13:08:43.914846 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.917070 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1663) took 1141 ms. Trace:
I20260709 13:08:43.954942 21880 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:43.917686 22484 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:43.956010 21913 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:08:43.956732 21837 raft_consensus.cc:1240] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:43.922609 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:43.924145 22485 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:43.926043 24321 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:43.964900 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:43.964998 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:43.965587 21910 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:43.927590 24184 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:43.928498 24444 consensus_queue.cc:260] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.894196 24423 consensus_queue.cc:260] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:43.929654 24303 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.932096 24446 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:43.934077 21711 auto_rebalancer.cc:629] Failed to schedule move for tablet d28f4c429d54450dbbeb1ac9f6b7cd55: Illegal state: Replica 3843e9b794a245dd8608e04ec7915239 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:43.938012 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:43.965519 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:43.964510 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:43.909759 24267 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:43.964519 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:43.950261 24458 raft_consensus.cc:2272] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:43.964856 22482 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:43.973838 21880 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:43.954495 21831 rpcz_store.cc:276] 0709 13:08:42.768808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:42.768963 (+   155us) service_pool.cc:224] Handling call
0709 13:08:42.977689 (+208726us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:43.784273 (+806584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:43.909542 (+125269us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b54003c1254. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:43.909724 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1853335808}
I20260709 13:08:43.856492 24384 consensus_queue.cc:1059] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 13:08:43.966529 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:43.903460 24402 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:43.970930 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:43.972426 22477 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:43.964017 24410 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:43.977415 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:43.967538 22478 raft_consensus.cc:1240] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:43.976130 21835 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:43.975502 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:43.976763 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:44.001648 21911 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
W20260709 13:08:44.009545 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 274125us
I20260709 13:08:44.035039 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:44.036075 21913 raft_consensus.cc:2368] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7.
I20260709 13:08:44.036973 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:43.977070 24449 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:44.043862 22449 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:44.045871 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 46871.3us
I20260709 13:08:44.045167 21832 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:44.047595 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:44.051061 21906 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:44.052629 22480 raft_consensus.cc:1240] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:44.054608 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:43.967458 24364 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:43.995826 24267 raft_consensus.cc:697] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:44.042009 24444 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.057641 21833 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.057696 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:43.998057 24410 raft_consensus.cc:697] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:44.065136 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:44.043309 24406 raft_consensus.cc:3055] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:44.001518 24184 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:44.072921 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:44.076071 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:43.997253 24402 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:44.077067 22482 raft_consensus.cc:1240] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:44.081094 24458 ts_tablet_manager.cc:1916] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:44.081550 21835 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:44.082001 21911 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:44.059491 24449 raft_consensus.cc:697] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:44.066890 24423 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:44.088814 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:44.089274 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.094260 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:44.088929 24184 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:44.090329 24267 consensus_queue.cc:237] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:44.069034 24406 raft_consensus.cc:740] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:44.094836 21913 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:44.097394 21911 raft_consensus.cc:1813] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Handling vote request from an unknown peer 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:44.106690 21911 raft_consensus.cc:2393] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:44.100284 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:44.100950 21837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38352
I20260709 13:08:44.101612 24446 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.076613 24418 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:44.108594 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:44.109319 22485 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:44.115175 21833 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:44.118144 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:44.120827 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:44.121065 21911 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:44.121492 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:44.088845 24410 consensus_queue.cc:237] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:44.137274 21913 pending_rounds.cc:85] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 2
I20260709 13:08:44.140908 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:44.139174 21831 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:44.142865 24061 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:08:44.146001 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.146628 21759 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:44.134505 24235 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:44.147799 24235 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:44.115257 24325 consensus_queue.cc:1059] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:08:44.149878 24364 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:44.149976 24325 raft_consensus.cc:3055] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:44.150457 24325 raft_consensus.cc:740] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:44.151383 24325 consensus_queue.cc:260] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:44.152705 24325 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:44.153257 21833 raft_consensus.cc:1240] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:44.156325 21804 leader_election.cc:400] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8.
I20260709 13:08:44.141456 21913 pending_rounds.cc:107] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:08:44.161899 21913 raft_consensus.cc:2889] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:44.162865 21832 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:08:44.132216 24429 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:44.152916 24320 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:44.174986 22485 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:44.176702 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:44.179471 21806 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:44.131431 24446 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:44.184427 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:44.196534 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:44.158651 24469 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:44.201035 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.208614 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:44.209839 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:44.211107 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:44.211647 21832 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:44.212757 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:44.213017 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:44.213883 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:44.214570 21832 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:08:44.215767 24466 log.cc:927] Time spent T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:08:44.217706 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.218466 21758 raft_consensus.cc:2410] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:08:44.222210 21832 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:44.223141 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:44.224123 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:44.224560 21832 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:44.166026 24061 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:08:44.206781 24429 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:44.226603 24469 raft_consensus.cc:697] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:44.227931 24429 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:44.227653 24469 consensus_queue.cc:237] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:44.176966 24449 consensus_queue.cc:237] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:44.233174 21906 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:08:44.234447 21910 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:44.229409 22477 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:44.242031 21763 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:44.190253 24303 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:44.254727 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 75356.1us
W20260709 13:08:44.249655 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 208354us
I20260709 13:08:44.258411 24429 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:44.259114 24429 raft_consensus.cc:697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:44.260341 24446 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:44.258347 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.260006 24429 consensus_queue.cc:237] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:44.269559 21759 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:44.213205 24398 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:44.272912 21832 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:44.273049 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:44.274755 21833 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 3.
I20260709 13:08:44.279430 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:44.278527 22448 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:44.282987 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:44.284011 21833 raft_consensus.cc:2393] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 7: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:08:44.275862 24475 log.cc:927] Time spent T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:08:44.289115 22448 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:44.294950 22448 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:44.272399 24235 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:44.296396 21837 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:44.290544 21758 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:44.297013 21837 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:44.294067 21728 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:44.298974 21832 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
W20260709 13:08:44.302107 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.301265 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.309659 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:44.191170 24406 consensus_queue.cc:260] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:44.312371 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.310746 21759 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:44.314275 21831 raft_consensus.cc:1240] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:44.316104 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:44.316927 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:44.318296 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:44.312733 21728 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:44.292356 24435 raft_consensus.cc:2804] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:44.320405 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:44.323647 21728 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:44.324649 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:44.325793 21728 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:44.309063 24364 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:44.310070 24235 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:44.338783 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.342026 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:44.342371 21879 leader_election.cc:336] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.704s (SENT)
I20260709 13:08:44.342067 21835 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:44.342854 21879 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:44.320827 24167 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:44.345882 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:44.324900 24346 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:44.325850 24435 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.348268 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:44.348562 21763 raft_consensus.cc:2393] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 7: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:44.339358 21837 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:44.348801 21835 raft_consensus.cc:1240] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:44.351089 21759 raft_consensus.cc:2468] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:44.327833 24184 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:44.327539 24443 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:44.331730 24321 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:44.335999 24188 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:44.357014 21758 raft_consensus.cc:2376] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5. Re-sending same reply.
I20260709 13:08:44.313457 24446 consensus_queue.cc:1059] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:08:44.345767 24167 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:44.364919 22483 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:08:44.362102 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.351744 24435 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:44.372390 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.378423 21758 raft_consensus.cc:2376] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8. Re-sending same reply.
I20260709 13:08:44.358786 24346 raft_consensus.cc:697] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:44.378232 21761 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:44.391597 24321 raft_consensus.cc:697] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:44.392689 24321 consensus_queue.cc:237] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:44.393079 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:44.394889 24468 log.cc:927] Time spent T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:08:44.396066 24467 log.cc:927] Time spent T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:08:44.397382 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.397246 24470 consensus_queue.cc:1059] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:08:44.398003 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:44.398136 21763 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:44.398661 21765 raft_consensus.cc:2376] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6. Re-sending same reply.
I20260709 13:08:44.399233 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.362533 24188 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:44.399489 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.399786 24188 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:44.398234 24479 log.cc:927] Time spent T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:08:44.400193 21838 raft_consensus.cc:1275] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:44.369607 24167 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:44.400805 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:44.400064 21765 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:44.362433 24319 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:44.366622 24443 raft_consensus.cc:697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:44.409502 21763 raft_consensus.cc:2393] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 5: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:44.354504 24235 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:44.418486 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 87978.2us
I20260709 13:08:44.429764 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.430068 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:44.431247 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.432963 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.435725 21762 raft_consensus.cc:2393] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 7: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:44.435783 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.436527 21765 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:44.433624 21761 raft_consensus.cc:2376] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3. Re-sending same reply.
I20260709 13:08:44.436721 21758 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:44.440949 21759 raft_consensus.cc:2376] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8. Re-sending same reply.
I20260709 13:08:44.446486 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:44.413856 24485 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:44.447196 21762 raft_consensus.cc:2376] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3. Re-sending same reply.
I20260709 13:08:44.450719 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.443619 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.451825 21763 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:44.456704 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.435324 24364 raft_consensus.cc:697] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:44.459666 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.457677 21765 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:44.463311 21758 raft_consensus.cc:2393] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 7: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:44.467767 21761 raft_consensus.cc:2468] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:44.475936 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:44.480517 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.481691 21763 raft_consensus.cc:2410] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:08:44.492688 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.495137 21762 raft_consensus.cc:2393] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 5: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:44.493870 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.497349 21763 raft_consensus.cc:1275] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:44.498711 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.499213 21765 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
W20260709 13:08:44.502472 21879 leader_election.cc:336] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.987s (SENT)
I20260709 13:08:44.537312 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.537791 21758 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:08:44.538378 24481 log.cc:927] Time spent T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.210s	user 0.005s	sys 0.000s
I20260709 13:08:44.539494 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:44.540125 21760 raft_consensus.cc:2376] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8. Re-sending same reply.
W20260709 13:08:44.541096 24473 log.cc:927] Time spent T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:08:44.543982 24490 log.cc:927] Time spent T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:44.545058 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.545763 21756 raft_consensus.cc:2376] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8. Re-sending same reply.
W20260709 13:08:44.546066 24488 log.cc:927] Time spent T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:08:44.546232 21911 raft_consensus.cc:1240] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:44.547237 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.548189 21762 raft_consensus.cc:2410] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 13:08:44.551277 24482 log.cc:927] Time spent T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
W20260709 13:08:44.553519 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 57162.7us
I20260709 13:08:44.540890 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.560268 24435 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:44.573477 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.574517 21761 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 6: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:44.589691 21757 raft_consensus.cc:2410] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:44.604679 21763 raft_consensus.cc:1240] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:44.592469 24433 raft_consensus.cc:3055] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:44.612632 21909 raft_consensus.cc:1240] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:44.490072 24346 consensus_queue.cc:237] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:44.642534 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.642967 21912 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:44.643401 24235 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:44.646229 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:44.647181 22482 raft_consensus.cc:2393] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:44.535957 24443 consensus_queue.cc:237] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:44.653548 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:44.620163 24433 raft_consensus.cc:740] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:44.598826 24364 consensus_queue.cc:237] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:44.651306 24435 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:44.686312 21879 leader_election.cc:336] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.068s (SENT)
I20260709 13:08:44.690912 21763 raft_consensus.cc:1240] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:44.705919 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:44.697696 24423 consensus_meta.cc:287] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.600s	user 0.008s	sys 0.004s
I20260709 13:08:44.706557 21762 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:08:44.689010 24494 raft_consensus.cc:3055] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:08:44.700120 21805 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.575s (SENT) [suppressed 53 similar messages]
I20260709 13:08:44.703188 24188 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:44.691555 24444 consensus_meta.cc:287] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.003s
I20260709 13:08:44.715482 21879 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:44.714267 24494 raft_consensus.cc:740] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
W20260709 13:08:44.735543 21805 leader_election.cc:336] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.618s (SENT)
I20260709 13:08:44.736698 21805 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:44.737613 24402 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:44.737767 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:44.738843 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.737848 24214 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:44.716925 24433 consensus_queue.cc:260] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:44.769001 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.770258 21764 raft_consensus.cc:2393] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 5: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:44.783500 21756 raft_consensus.cc:1240] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:44.793021 21762 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:08:44.750859 24167 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:44.796494 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:44.797242 21765 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:08:44.803841 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.806993 21758 raft_consensus.cc:1240] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
W20260709 13:08:44.807861 22450 leader_election.cc:336] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.598s (SENT)
I20260709 13:08:44.810196 22450 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:44.795575 24433 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:44.813692 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:44.842002 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.860526 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.862879 21762 raft_consensus.cc:2410] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:08:44.890209 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:44.891196 21756 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
W20260709 13:08:44.922084 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:44.817363 24320 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:44.951145 21805 leader_election.cc:336] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.871s (SENT)
I20260709 13:08:44.951655 21805 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:44.952844 24214 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:44.824051 24512 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:44.994539 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 164457us
W20260709 13:08:45.029652 22450 leader_election.cc:336] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.787s (SENT)
I20260709 13:08:44.992746 24188 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:44.812400 24494 consensus_queue.cc:260] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:45.070042 24519 log.cc:927] Time spent T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 13:08:45.094718 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 150636us
I20260709 13:08:45.095240 21765 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
W20260709 13:08:45.096313 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 100797us
I20260709 13:08:45.101697 24494 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:45.112830 21764 raft_consensus.cc:1240] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 4. Current term is 6. Ops: []
I20260709 13:08:45.119916 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:45.122572 22478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 797) took 1407 ms. Trace:
I20260709 13:08:45.122888 24458 ts_tablet_manager.cc:1929] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:08:45.123641 24458 log.cc:1199] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-1-root/wals/bfdda4b9a4f14b5c90c55134ebfd6303
I20260709 13:08:45.123000 22478 rpcz_store.cc:276] 0709 13:08:43.715204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.715364 (+   160us) service_pool.cc:224] Handling call
0709 13:08:43.717212 (+  1848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.001786 (+284574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.122291 (+1120505us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b540051fc54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:45.122510 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456337792}
I20260709 13:08:45.118454 24167 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:45.126600 24458 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38332 (request call id 79) took 1803 ms. Trace:
I20260709 13:08:45.127779 24378 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.126981 24458 rpcz_store.cc:276] 0709 13:08:43.346888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.401567 (+ 54679us) service_pool.cc:224] Handling call
0709 13:08:43.521258 (+119691us) ts_tablet_manager.cc:1151] Deleting tablet bfdda4b9a4f14b5c90c55134ebfd6303
0709 13:08:43.521355 (+    97us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:08:44.744674 (+1223319us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:45.122749 (+378075us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:45.126486 (+  3737us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":362044,"tablet-delete.queue_time_us":118480,"thread_start_us":62731,"threads_started":1}
I20260709 13:08:45.129288 24378 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:45.131536 24378 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:45.141263 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1080) took 1350 ms. Trace:
I20260709 13:08:45.141734 21908 rpcz_store.cc:276] 0709 13:08:43.791034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:43.921628 (+130594us) service_pool.cc:224] Handling call
0709 13:08:45.140813 (+1219185us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54004164d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:45.140907 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":639042304}
I20260709 13:08:45.143374 21912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 393) took 1182 ms. Trace:
I20260709 13:08:45.143718 21912 rpcz_store.cc:276] 0709 13:08:43.961176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.643885 (+682709us) service_pool.cc:224] Handling call
0709 13:08:44.644269 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:44.644737 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:44.644774 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:44.645271 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:08:44.819987 (+174716us) spinlock_profiling.cc:243] Waited 5.93 ms on lock 0x7b1800435dc0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab24ce07 00007fc6b40a7ab9 00007fc6ab26969b 00007fc6ab26793f 00007fc6ab269c02 00007fc6adef120b 00007fc6adef6d23 00007fc6adef70d1 00007fc6ae312a0f
0709 13:08:45.053930 (+233943us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:45.053991 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.054094 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:45.139822 (+ 85728us) raft_consensus.cc:1685] finished
0709 13:08:45.139870 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:45.143314 (+  3444us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6947,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":22406,"spinlock_wait_cycles":13629184,"thread_start_us":233663,"threads_started":1,"wal-append.queue_time_us":442246}
W20260709 13:08:45.144852 21805 leader_election.cc:336] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.038s (SENT)
I20260709 13:08:45.147651 21805 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:45.156837 21805 leader_election.cc:336] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.133s (SENT)
I20260709 13:08:45.153232 24384 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:08:45.160063 22480 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:45.161069 24494 consensus_queue.cc:1048] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:45.166617 21837 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:45.171849 24398 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:45.173574 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:45.174243 21834 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:45.174765 21832 raft_consensus.cc:1275] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:45.174515 21837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:38352 (request call id 2497) took 1072 ms. Trace:
I20260709 13:08:45.175807 21837 rpcz_store.cc:276] 0709 13:08:44.100463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.100806 (+   343us) service_pool.cc:224] Handling call
0709 13:08:45.165458 (+1064652us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b5400339fd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae34ea3d 00007fc6b331ecd0 00007fc6ac8a3254 00007fc6ac8a31e2 00007fc6ac8a3111 00007fc6ac8a308c 00007fc6ac8a2342 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:45.173094 (+  7636us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434419072}
I20260709 13:08:45.177416 24364 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:08:45.182180 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.179556 21647 catalog_manager.cc:5028] TS 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): tablet bfdda4b9a4f14b5c90c55134ebfd6303 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:08:45.190785 21834 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:45.192373 22448 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:45.193792 24364 raft_consensus.cc:2804] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:08:45.197804 24472 log.cc:927] Time spent T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.870s	user 0.009s	sys 0.003s
W20260709 13:08:45.202538 24523 log.cc:927] Time spent T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:08:45.194952 24364 raft_consensus.cc:697] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:45.210938 24445 raft_consensus.cc:3055] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:45.210265 24364 consensus_queue.cc:237] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:45.211445 24445 raft_consensus.cc:740] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:45.212327 24445 consensus_queue.cc:260] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:45.211042 22450 leader_election.cc:336] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.146s (SENT)
W20260709 13:08:45.217917 24528 log.cc:927] Time spent T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.088s	user 0.000s	sys 0.002s
W20260709 13:08:45.220288 24497 log.cc:927] Time spent T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.537s	user 0.006s	sys 0.007s
W20260709 13:08:45.217262 24510 log.cc:927] Time spent T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.481s	user 0.000s	sys 0.013s
I20260709 13:08:45.230463 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.231205 21761 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:45.233489 24445 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:45.234269 21913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1094) took 1415 ms. Trace:
W20260709 13:08:45.236018 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.234625 21913 rpcz_store.cc:276] 0709 13:08:43.818813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.551396 (+732583us) service_pool.cc:224] Handling call
0709 13:08:44.551766 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.552114 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:44.552497 (+   383us) log.cc:844] Serialized 14 byte log entry
0709 13:08:44.651875 (+ 99378us) log.cc:844] Serialized 14 byte log entry
0709 13:08:45.216469 (+564594us) spinlock_profiling.cc:243] Waited 5.25 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:45.233790 (+ 17321us) spinlock_profiling.cc:243] Waited 8.75 ms on lock 0x7b180047faa0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab1e4c0a 00007fc6b4924219 00007fc6ab26ca40 00007fc6ab2674e4 00007fc6ab267455 00007fc6ae34f060 00007fc6ae361716 00007fc6ae372287 00007fc6ae372208
0709 13:08:45.233945 (+   155us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:45.233990 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:45.234033 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.234094 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:45.234203 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":693,"prepare.queue_time_us":4154,"prepare.run_wall_time_us":1269,"raft.queue_time_us":6367,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":27107,"spinlock_wait_cycles":41737728,"thread_start_us":50810,"threads_started":1,"wal-append.queue_time_us":165370}
I20260709 13:08:45.237684 21911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1091) took 1426 ms. Trace:
I20260709 13:08:45.238056 21911 rpcz_store.cc:276] 0709 13:08:43.810930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.547305 (+736375us) service_pool.cc:224] Handling call
0709 13:08:44.547694 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.548000 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:08:44.594754 (+ 46754us) log.cc:844] Serialized 14 byte log entry
0709 13:08:45.237321 (+642567us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:45.237371 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:45.237416 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.237516 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:45.237631 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":554503,"prepare.queue_time_us":960,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"thread_start_us":115182,"threads_started":2,"wal-append.queue_time_us":87455}
W20260709 13:08:45.269119 21805 leader_election.cc:336] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.500s (SENT)
W20260709 13:08:45.298309 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.301820 24502 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:45.302500 24502 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:45.317086 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 48032.9us
W20260709 13:08:45.317938 21805 leader_election.cc:336] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.527s (SENT)
I20260709 13:08:45.319768 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:45.322896 24502 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:45.331053 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:45.331718 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.334503 21837 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:45.343741 21837 raft_consensus.cc:1275] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:45.346719 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:45.349534 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:45.350235 21836 raft_consensus.cc:2393] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:45.352095 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:45.352150 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:45.354110 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:45.358676 21836 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:45.357143 21832 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:45.363026 22478 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:45.364421 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.364727 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.365291 21764 raft_consensus.cc:2393] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:45.365372 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.365945 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.366071 21762 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:45.366607 21765 raft_consensus.cc:2368] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7.
I20260709 13:08:45.367450 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.357905 21835 raft_consensus.cc:1275] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:45.368252 21759 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:08:45.369303 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.369983 21761 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:45.371222 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.371806 21763 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:45.372713 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:45.372927 21836 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:08:45.373396 21757 raft_consensus.cc:2368] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 7. Current term is 8.
I20260709 13:08:45.373400 21837 raft_consensus.cc:2393] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:08:45.379838 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.379896 24214 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:45.380625 24214 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:45.382568 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 700100us
I20260709 13:08:45.383411 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1099) took 1491 ms. Trace:
W20260709 13:08:45.383780 21879 leader_election.cc:336] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.192s (SENT)
I20260709 13:08:45.384258 21879 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:45.384781 24325 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:45.385706 24410 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:45.386502 24410 consensus_queue.cc:1059] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:45.387933 24449 raft_consensus.cc:3055] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:45.388382 24449 raft_consensus.cc:740] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:45.389598 24325 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.389386 24449 consensus_queue.cc:260] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:45.390101 24325 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:45.390985 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2501) took 1289 ms. Trace:
I20260709 13:08:45.391346 21831 rpcz_store.cc:276] 0709 13:08:44.101625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.157824 (+ 56199us) service_pool.cc:224] Handling call
0709 13:08:44.183987 (+ 26163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.314827 (+130840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.390764 (+1075937us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540025dad4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:45.390927 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288818944}
I20260709 13:08:45.392158 24325 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:45.394747 21805 leader_election.cc:336] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.689s (SENT)
I20260709 13:08:45.400595 24445 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.400537 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:45.401407 21761 raft_consensus.cc:2368] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7.
I20260709 13:08:45.383882 21909 rpcz_store.cc:276] 0709 13:08:43.892136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.640233 (+748097us) service_pool.cc:224] Handling call
0709 13:08:44.644525 (+  4292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.644757 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:44.645050 (+   293us) log.cc:844] Serialized 14 byte log entry
0709 13:08:45.383077 (+738027us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:45.383122 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:45.383197 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.383260 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:45.383360 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":624797,"prepare.queue_time_us":809,"prepare.run_cpu_time_us":115,"prepare.run_wall_time_us":23410,"raft.queue_time_us":625872,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":112804,"threads_started":1,"wal-append.queue_time_us":348179}
I20260709 13:08:45.403692 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.404276 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:45.405002 21913 raft_consensus.cc:2393] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:45.405292 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:45.406158 22449 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:45.382790 24214 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:45.408872 21879 leader_election.cc:336] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.235s (SENT)
I20260709 13:08:45.407255 21728 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:45.409489 21879 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:45.381865 21806 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:45.412050 24470 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:45.412807 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1085) took 1620 ms. Trace:
I20260709 13:08:45.413026 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:45.413178 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.413162 21906 rpcz_store.cc:276] 0709 13:08:43.792474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.255638 (+463164us) service_pool.cc:224] Handling call
0709 13:08:44.257249 (+  1611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.289590 (+ 32341us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:08:44.385849 (+ 96259us) log.cc:844] Serialized 14 byte log entry
0709 13:08:45.406606 (+1020757us) spinlock_profiling.cc:243] Waited 4.66 ms on lock 0x7b18003836e0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6adeff4bc 00007fc6ab24d48b 00007fc6b40a7ab9 00007fc6ab26969b 00007fc6ab26793f 00007fc6ab269c02 00007fc6adef120b 00007fc6adef6d23 00007fc6adef723a
0709 13:08:45.412449 (+  5843us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:45.412497 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:08:45.412547 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.412619 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:45.412727 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12891,"prepare.queue_time_us":201124,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"spinlock_wait_cycles":13951616,"thread_start_us":221201,"threads_started":2,"wal-append.queue_time_us":280336}
W20260709 13:08:45.416110 24465 log.cc:927] Time spent T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 1.162s	user 0.005s	sys 0.007s
I20260709 13:08:45.417725 24450 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:45.418267 24450 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:45.418660 21879 leader_election.cc:336] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.244s (SENT)
I20260709 13:08:45.420262 24406 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:45.420336 24398 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:08:45.401194 24445 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:45.422454 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:45.423046 21763 raft_consensus.cc:2376] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6. Re-sending same reply.
I20260709 13:08:45.423594 24445 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:45.425195 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:45.427488 21831 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:08:45.428479 24498 log.cc:927] Time spent T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.688s	user 0.003s	sys 0.010s
I20260709 13:08:45.420295 24450 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:45.429831 21877 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:45.430725 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 48936.1us
I20260709 13:08:45.434046 21877 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:45.440109 21756 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:45.440479 21877 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:45.442535 24450 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:45.442682 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.443761 24538 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:45.443935 21757 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:45.444249 24444 consensus_queue.cc:1048] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:45.445197 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1086) took 1652 ms. Trace:
I20260709 13:08:45.442464 24474 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:45.445565 21907 rpcz_store.cc:276] 0709 13:08:43.792830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.316848 (+524018us) service_pool.cc:224] Handling call
0709 13:08:44.331489 (+ 14641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:44.367772 (+ 36283us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:44.498642 (+130870us) log.cc:844] Serialized 14 byte log entry
0709 13:08:45.441743 (+943101us) log.cc:844] Serialized 14 byte log entry
0709 13:08:45.444829 (+  3086us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:45.444873 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:45.444921 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.445043 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:45.445147 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":649416,"prepare.queue_time_us":212399,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":76,"raft.queue_time_us":650325,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":153,"thread_start_us":328039,"threads_started":3,"wal-append.queue_time_us":213909}
I20260709 13:08:45.448366 24474 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.448510 24433 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.448725 24450 consensus_queue.cc:1059] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:08:45.449941 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 64771.2us
I20260709 13:08:45.451589 21731 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:45.454717 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.452894 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:45.462931 22485 raft_consensus.cc:1240] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:45.453562 21728 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:45.464507 21804 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:45.467617 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:45.467700 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:45.469883 21909 raft_consensus.cc:2393] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 7: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:45.474854 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:45.475451 22477 raft_consensus.cc:1275] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:45.449052 24433 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:45.471218 21731 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:45.452427 24398 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:45.448786 24474 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:45.439747 24418 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:45.506518 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 56285us
I20260709 13:08:45.495045 21906 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:45.449654 24320 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:08:45.517877 24433 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:45.518476 24320 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:45.520262 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.521070 21758 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:45.468421 24167 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:45.539239 22449 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:45.476557 24443 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:45.478442 24446 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:45.440028 24445 consensus_queue.cc:1059] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
W20260709 13:08:45.547629 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 127854us
I20260709 13:08:45.511142 24398 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.468611 24444 consensus_queue.cc:1048] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 13:08:45.541991 24410 consensus_queue.cc:1059] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:08:45.565388 24398 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:45.563550 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:45.567659 21757 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:45.463797 24346 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:08:45.568878 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.571324 21759 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:45.571480 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.532673 24418 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.577761 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:45.552371 24485 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.060s	user 0.039s	sys 0.043s
I20260709 13:08:45.554222 24433 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:08:45.588270 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 122247us
W20260709 13:08:45.589593 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:45.590682 22450 leader_election.cc:336] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.578s (SENT)
I20260709 13:08:45.591056 24433 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:45.585336 24485 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.039s	sys 0.043s
I20260709 13:08:45.591490 24433 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:45.591558 24485 raft_consensus.cc:697] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:45.554550 24495 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:45.593714 24507 log.cc:927] Time spent T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.854s	user 0.013s	sys 0.000s
I20260709 13:08:45.575547 24470 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:45.569047 24443 raft_consensus.cc:697] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:45.592581 24223 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:08:45.600441 21879 leader_election.cc:336] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.249s (SENT)
I20260709 13:08:45.601826 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:45.577265 24418 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:45.603320 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 120301us
I20260709 13:08:45.604993 21757 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:08:45.605464 21758 raft_consensus.cc:1275] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:08:45.607343 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 95175.2us
W20260709 13:08:45.611337 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.614591 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:45.614620 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 150209us
I20260709 13:08:45.616930 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.621475 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:45.622169 22480 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:45.622098 22449 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:45.622792 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:45.628108 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.630725 21759 raft_consensus.cc:2376] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8. Re-sending same reply.
I20260709 13:08:45.623176 21761 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:45.637967 21758 raft_consensus.cc:2368] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7.
I20260709 13:08:45.638163 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:45.638814 21837 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:45.651499 21831 raft_consensus.cc:3055] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:45.653337 21804 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:45.659583 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.652021 21831 raft_consensus.cc:740] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:45.670627 21759 raft_consensus.cc:1240] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:45.672101 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:45.682890 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.685263 21759 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:45.687894 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.696751 21758 raft_consensus.cc:1240] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:45.691725 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.699357 21759 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:45.700426 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.707464 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:45.707659 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.698607 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.710472 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:45.711783 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:45.713759 21758 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:45.606154 24495 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:45.715222 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 125527us
I20260709 13:08:45.623862 24536 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:45.638295 24405 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.734123 21912 raft_consensus.cc:1275] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:08:45.739687 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 147114us
I20260709 13:08:45.733067 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:45.733495 21909 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:45.734823 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:45.744197 21906 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:45.713093 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.623603 24543 raft_consensus.cc:3055] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:45.724356 21831 consensus_queue.cc:260] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:45.748656 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:45.725401 21804 raft_consensus.cc:2686] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6fadfd81c5a645f1806a284ddbb6bf0d: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:08:45.748843 21831 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:45.748828 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:08:45.749392 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 123710us
I20260709 13:08:45.749811 21905 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:45.754030 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:45.754596 21912 raft_consensus.cc:3055] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:45.755002 21912 raft_consensus.cc:740] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:45.756155 21912 consensus_queue.cc:260] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:45.757122 21912 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:45.759887 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 281496us
I20260709 13:08:45.747176 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:45.766323 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:45.768838 21759 raft_consensus.cc:2393] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 5: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:45.770246 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:45.759851 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:45.770882 21759 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.771076 21914 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:45.771831 21758 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:45.771783 21880 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:45.772971 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.776152 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:45.776952 21913 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:08:45.780498 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:45.748399 24536 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:45.786392 21906 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:08:45.783291 21837 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:45.750833 24546 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.788995 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:45.748240 24543 raft_consensus.cc:740] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:45.793005 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.799217 22480 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:45.807921 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.848479 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:45.849776 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:45.811939 22450 leader_election.cc:336] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.796s (SENT)
I20260709 13:08:45.798507 24546 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:45.814499 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:45.815917 21914 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:45.778752 24443 consensus_queue.cc:237] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:45.819635 24541 log.cc:927] Time spent T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:08:45.820268 24398 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:45.826398 24547 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:45.826709 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:45.795396 22478 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:08:45.831060 24410 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.770344 24405 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:45.833611 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:45.817281 24167 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:45.834558 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.791702 24536 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:45.722633 24485 consensus_queue.cc:237] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:45.878526 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.839062 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:45.847951 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 55585.5us
I20260709 13:08:45.811141 24433 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:45.853943 21906 raft_consensus.cc:2376] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4. Re-sending same reply.
I20260709 13:08:45.852839 21912 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:45.897941 21756 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:45.858219 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:45.899207 21914 raft_consensus.cc:2376] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7. Re-sending same reply.
I20260709 13:08:45.860059 21837 raft_consensus.cc:1240] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:45.858772 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.865535 21831 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:08:45.900966 21831 pending_rounds.cc:85] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 7
I20260709 13:08:45.901279 21831 pending_rounds.cc:107] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:08:45.901578 21831 raft_consensus.cc:2889] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:45.901741 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.872682 21760 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 3.
I20260709 13:08:45.873059 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:45.902743 21758 raft_consensus.cc:2393] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 8: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:45.903117 21913 raft_consensus.cc:2368] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7.
I20260709 13:08:45.874291 21836 raft_consensus.cc:1240] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:45.874357 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 62448.5us
I20260709 13:08:45.905149 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:45.905998 21757 raft_consensus.cc:2376] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5. Re-sending same reply.
I20260709 13:08:45.906136 21907 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 3.
I20260709 13:08:45.761008 24545 consensus_queue.cc:1059] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:08:45.880275 21908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:08:45.781656 24544 consensus_queue.cc:1059] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:08:45.871526 24494 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.907986 21759 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:45.914893 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:45.917619 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:45.918457 21906 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:45.918668 21764 raft_consensus.cc:2410] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:45.919356 24512 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:45.923532 24512 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:45.926119 21913 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:45.930820 21910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1083) took 2139 ms. Trace:
I20260709 13:08:45.931360 21910 rpcz_store.cc:276] 0709 13:08:43.791884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:44.253739 (+461855us) service_pool.cc:224] Handling call
0709 13:08:44.254062 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:44.277695 (+ 23633us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:44.277735 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:45.367052 (+1089317us) spinlock_profiling.cc:243] Waited 7.16 ms on lock 0x7b1800060c40. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab2382a6 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6acc50a11 00007fc6acc60372 00007fc6ae392a01 00007fc6ae35743a
0709 13:08:45.393933 (+ 26881us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b2c00021ff8. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6acc50a11 00007fc6acc60372 00007fc6ae392a01 00007fc6ae35743a 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2
0709 13:08:45.412918 (+ 18985us) log.cc:844] Serialized 26 byte log entry
0709 13:08:45.458430 (+ 45512us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:45.458470 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:45.458539 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:45.930593 (+472054us) raft_consensus.cc:1685] finished
0709 13:08:45.930615 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:45.930749 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19621,"raft.queue_time_us":23563,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":6017,"spinlock_wait_cycles":22191232,"thread_start_us":36195,"threads_started":1,"wal-append.queue_time_us":83820}
W20260709 13:08:45.954013 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 182298us
I20260709 13:08:45.994598 24546 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:45.995568 24495 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:45.996090 24495 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:45.996546 24495 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:46.004065 24405 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:46.004756 24474 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:46.008630 24474 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:45.917537 24545 consensus_queue.cc:1243] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer 6fadfd81c5a645f1806a284ddbb6bf0d log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:08:45.926119 24494 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:46.011169 24547 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:45.897063 24410 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:46.013164 21763 raft_consensus.cc:2368] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 5. Current term is 6.
W20260709 13:08:46.094633 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 153073us
W20260709 13:08:46.020282 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.034520 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.031157 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.096506 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.048030 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.095395 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:46.102283 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 79478.8us
I20260709 13:08:46.102789 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.103894 21758 raft_consensus.cc:2393] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 4: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
W20260709 13:08:46.086546 21805 leader_election.cc:336] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.094s (SENT)
I20260709 13:08:46.104826 21805 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:46.113869 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 158185us
W20260709 13:08:46.079515 21660 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52326 (request call id 151) took 11418 ms (client timeout 15000 ms). Trace:
I20260709 13:08:46.095392 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:46.128870 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.129621 21905 raft_consensus.cc:2410] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:46.130324 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.131392 21760 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:46.132747 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.133630 21759 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:46.134583 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.135294 21759 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
W20260709 13:08:46.136587 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.145220 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:46.145833 21762 raft_consensus.cc:1275] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:46.145937 21761 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:46.147171 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 60677.7us
W20260709 13:08:46.147933 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.139775 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.138301 24449 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.152164 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.152765 24512 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:46.138131 24406 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:08:46.153503 24512 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:46.081805 24543 consensus_queue.cc:260] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:46.156860 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.157205 24543 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:46.157992 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.159384 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.159529 21908 raft_consensus.cc:606] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:46.160051 21908 raft_consensus.cc:614] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:46.086802 24544 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.073078 24223 raft_consensus.cc:3055] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:46.031049 24446 raft_consensus.cc:3055] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:46.071807 24378 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.160933 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:46.134205 24224 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.023s	sys 0.036s
I20260709 13:08:46.160944 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:46.166232 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.153002 21763 raft_consensus.cc:2410] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:46.167572 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.187377 21764 raft_consensus.cc:2368] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7.
I20260709 13:08:46.167959 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:46.185024 21879 leader_election.cc:336] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.676s (SENT)
I20260709 13:08:46.188045 21756 raft_consensus.cc:2368] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6.
I20260709 13:08:46.168360 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.188789 21760 raft_consensus.cc:2376] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5. Re-sending same reply.
I20260709 13:08:46.014140 24267 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.090751 24494 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:46.022859 24398 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:46.138389 24538 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.134487 24384 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:46.179669 24405 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:46.180092 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.181293 21758 raft_consensus.cc:2393] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 4: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:46.181515 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:46.146814 24470 consensus_meta.cc:287] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.000s
W20260709 13:08:46.185555 24224 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.024s	sys 0.036s
I20260709 13:08:46.202705 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.188076 21879 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:46.172962 24223 raft_consensus.cc:740] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:46.152215 24410 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:46.125095 21660 rpcz_store.cc:269] 0709 13:08:34.661245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.687089 (+ 25844us) service_pool.cc:224] Handling call
0709 13:08:46.079377 (+11392288us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:43.775806 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:43.776542 (+   736us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:43.776606 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:08:43.776634 (+    28us) tablet.cc:662] Decoding operations
0709 13:08:43.778082 (+  1448us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:43.778191 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:43.778230 (+    39us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:08:43.779275 (+  1045us) tablet.cc:701] Row locks acquired
0709 13:08:43.779335 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:08:43.779517 (+   182us) write_op.cc:270] Start()
0709 13:08:43.779666 (+   149us) write_op.cc:276] Timestamp: P: 1783602523779458 usec, L: 0
0709 13:08:43.779692 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:08:43.780634 (+   942us) log.cc:844] Serialized 3920 byte log entry
0709 13:08:44.743842 (+963208us) op_driver.cc:464] REPLICATION: finished
0709 13:08:45.054655 (+310813us) write_op.cc:301] APPLY: starting
0709 13:08:45.061969 (+  7314us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:45.077847 (+ 15878us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:45.096146 (+ 18299us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:45.114800 (+ 18654us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:45.115131 (+   331us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:08:45.115182 (+    51us) write_op.cc:312] APPLY: finished
0709 13:08:45.115577 (+   395us) log.cc:844] Serialized 77 byte log entry
0709 13:08:45.116702 (+  1125us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.116845 (+   143us) write_op.cc:454] Released schema lock
0709 13:08:45.116914 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:45.117366 (+   452us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:45.117401 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3011141,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":204808,"apply.run_cpu_time_us":4529,"apply.run_wall_time_us":162011,"num_ops":10,"prepare.queue_time_us":451828,"prepare.run_cpu_time_us":73596,"prepare.run_wall_time_us":390129,"raft.queue_time_us":90323,"raft.run_cpu_time_us":17784,"raft.run_wall_time_us":60101,"replication_time_us":963881,"thread_start_us":704763,"threads_started":4,"wal-append.queue_time_us":588072,"wal-append.run_cpu_time_us":21566,"wal-append.run_wall_time_us":1758385}]]}
I20260709 13:08:46.207453 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:46.139570 24320 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:08:46.211784 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.216382 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.216733 21758 raft_consensus.cc:2410] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 9 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:46.212399 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.216907 21764 raft_consensus.cc:1813] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Handling vote request from an unknown peer 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:46.177348 24446 raft_consensus.cc:740] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:46.211835 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.203296 21761 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:08:46.215166 21757 raft_consensus.cc:2376] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4. Re-sending same reply.
I20260709 13:08:46.209532 24470 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:46.231454 21757 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:46.232131 24223 consensus_queue.cc:260] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:46.232760 21757 raft_consensus.cc:1275] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:46.233116 24223 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:46.194654 24378 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:46.233883 21761 raft_consensus.cc:1275] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:08:46.234985 24378 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:46.234985 21761 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:46.218096 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:46.221405 21805 leader_election.cc:336] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.201s (SENT)
I20260709 13:08:46.222218 21758 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:08:46.207027 24494 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.226155 21759 raft_consensus.cc:1240] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:46.226225 21756 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:46.205662 24267 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:46.227207 21760 raft_consensus.cc:1275] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:46.178033 24544 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:46.208871 24433 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:46.228508 24446 consensus_queue.cc:260] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:46.224949 21764 raft_consensus.cc:2393] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 3: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:46.236277 21758 pending_rounds.cc:85] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 3
I20260709 13:08:46.256510 21758 pending_rounds.cc:107] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:08:46.222422 24398 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:46.224292 24418 consensus_meta.cc:287] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.000s
I20260709 13:08:46.249796 24544 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:46.256791 21758 raft_consensus.cc:2889] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:46.241253 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:46.267025 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 82040.8us
I20260709 13:08:46.223670 24495 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:46.208102 24538 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:46.326280 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.359575 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.223362 24554 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
W20260709 13:08:46.326506 21877 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.017s	sys 0.052s
W20260709 13:08:46.412196 21877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.024s	sys 0.052s
W20260709 13:08:46.324499 22450 leader_election.cc:336] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.014s (SENT)
I20260709 13:08:46.219815 24405 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:46.278975 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 66040.9us
W20260709 13:08:46.390817 21835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.028s	sys 0.031s
W20260709 13:08:46.435493 21835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.029s	sys 0.031s
W20260709 13:08:46.435742 21805 leader_election.cc:336] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.304s (SENT)
W20260709 13:08:46.272688 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.412920 21760 raft_consensus.cc:1240] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:46.431761 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:46.438165 21834 raft_consensus.cc:2393] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:08:46.439491 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.353049 24559 log.cc:927] Time spent T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:08:46.433943 21877 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:46.446450 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.298827 24378 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.247627 24494 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:46.441387 22450 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:46.442972 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:46.269464 24446 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.448824 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.451628 21760 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:46.450518 21836 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:08:46.452379 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:46.453226 21832 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:46.449554 24557 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:46.460644 21877 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:46.435240 24325 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.016s	sys 0.050s
I20260709 13:08:46.480831 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:46.481473 21764 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:46.483042 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.483647 21763 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
W20260709 13:08:46.484006 21805 leader_election.cc:336] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.575s (SENT)
I20260709 13:08:46.486407 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.479404 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.490206 21761 raft_consensus.cc:2393] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 8: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:46.468350 24545 consensus_queue.cc:1059] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:08:46.486059 24557 raft_consensus.cc:697] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:46.492012 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.492326 24557 consensus_queue.cc:237] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:46.477860 24325 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.016s	sys 0.050s
W20260709 13:08:46.494448 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 169985us
I20260709 13:08:46.279676 24418 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:46.463824 24378 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:46.492717 21758 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
W20260709 13:08:46.492244 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.502311 21910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:08:46.502879 21910 raft_consensus.cc:606] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:46.503182 21910 raft_consensus.cc:614] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:46.501201 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 294865us
I20260709 13:08:46.466303 24495 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:46.483395 24544 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.507447 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:46.509778 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 413725us
I20260709 13:08:46.509997 21758 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:08:46.511590 21761 raft_consensus.cc:2376] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7. Re-sending same reply.
I20260709 13:08:46.515671 21760 raft_consensus.cc:1240] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:08:46.510708 21836 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:08:46.513589 21834 raft_consensus.cc:2393] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 8: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:46.486048 24556 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:46.467851 24410 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 13:08:46.516647 22450 leader_election.cc:336] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.195s (SENT)
I20260709 13:08:46.498651 24325 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:46.480226 24550 consensus_queue.cc:1059] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:08:46.543879 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.544787 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:46.546909 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:46.547607 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:46.547797 22483 raft_consensus.cc:2410] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:08:46.524653 24470 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.517795 24556 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:46.556406 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:46.561898 24536 consensus_meta.cc:287] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.658s	user 0.007s	sys 0.003s
I20260709 13:08:46.562355 21764 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
W20260709 13:08:46.562947 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.543460 24545 raft_consensus.cc:3055] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:46.530803 24267 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:46.572669 21758 raft_consensus.cc:2393] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:46.573383 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:46.581923 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.582870 21764 raft_consensus.cc:2393] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 4: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:46.518420 24544 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:46.529474 24325 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:46.611619 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:46.566661 24556 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:46.576038 24545 raft_consensus.cc:740] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:46.572552 24433 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:08:46.634840 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:46.635854 21761 raft_consensus.cc:2410] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:46.622499 22478 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:08:46.637355 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.584131 24536 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:46.641445 21909 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:08:46.641870 21909 pending_rounds.cc:85] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 6
I20260709 13:08:46.642117 21909 pending_rounds.cc:107] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:08:46.642419 21909 raft_consensus.cc:2889] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:46.567118 24470 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:46.589174 24547 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:08:46.647467 21911 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:08:46.649106 24562 log.cc:927] Time spent T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:08:46.651599 21911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 399) took 1202 ms. Trace:
I20260709 13:08:46.651985 21911 rpcz_store.cc:276] 0709 13:08:45.448904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.449650 (+   746us) service_pool.cc:224] Handling call
0709 13:08:45.466838 (+ 17188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:46.647852 (+1181014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.651385 (+  3533us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400420ed4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:46.651546 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2714491136}
W20260709 13:08:46.653373 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.666229 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:46.667934 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 260801us
I20260709 13:08:46.667092 21761 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
W20260709 13:08:46.682384 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 152703us
I20260709 13:08:46.688126 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:46.690368 21879 leader_election.cc:336] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.517s (SENT)
I20260709 13:08:46.691617 21879 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:46.697835 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.697305 21804 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:46.677718 24494 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:46.681159 24538 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:46.693643 24418 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:46.704216 24449 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:46.730569 21804 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:46.740581 21879 leader_election.cc:336] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.656s (SENT)
I20260709 13:08:46.741326 21879 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:46.721247 24214 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:46.770439 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:46.779546 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:46.723670 24378 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:46.723316 24558 raft_consensus.cc:3055] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:46.705773 24543 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:08:46.770159 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:08:46.790817 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 71019.7us
I20260709 13:08:46.764298 24538 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:46.678905 24545 consensus_queue.cc:260] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:46.801141 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 171734us
I20260709 13:08:46.801221 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:46.767551 24418 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:46.769560 24405 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:46.808562 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 78389.2us
I20260709 13:08:46.767283 24570 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:46.781728 24214 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:46.816895 21804 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:46.801920 24563 log.cc:927] Time spent T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 13:08:46.790925 24558 raft_consensus.cc:740] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:46.825894 21804 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:46.800730 24398 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:46.827350 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 253995us
W20260709 13:08:46.828310 21879 leader_election.cc:336] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.546s (SENT)
I20260709 13:08:46.831564 21879 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:46.826713 21804 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:46.833148 21877 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:46.817750 24214 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:46.842525 21804 leader_election.cc:400] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7.
I20260709 13:08:46.842886 21804 leader_election.cc:403] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:46.819988 24443 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:46.845103 21879 leader_election.cc:336] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.660s (SENT)
W20260709 13:08:46.846359 21879 leader_election.cc:336] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.834s (SENT)
I20260709 13:08:46.846805 21879 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:46.835000 21914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1119) took 1047 ms. Trace:
I20260709 13:08:46.849021 21914 rpcz_store.cc:276] 0709 13:08:45.787782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.911197 (+123415us) service_pool.cc:224] Handling call
0709 13:08:46.095463 (+184266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:46.133082 (+ 37619us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:08:46.172710 (+ 39628us) log.cc:844] Serialized 14 byte log entry
0709 13:08:46.590176 (+417466us) log.cc:844] Serialized 14 byte log entry
0709 13:08:46.834679 (+244503us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:46.834730 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:46.834770 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.834841 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:46.834950 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14303,"prepare.queue_time_us":31741,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":9394,"raft.queue_time_us":64733,"raft.run_wall_time_us":11381,"spinlock_wait_cycles":21843584,"thread_start_us":603985,"threads_started":2,"wal-append.queue_time_us":542801}
I20260709 13:08:46.852499 22481 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:46.823979 24325 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:46.834235 24580 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:46.868333 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:46.874907 21911 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:46.835649 24470 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:46.834173 24545 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:46.833583 24405 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:46.872042 21804 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:46.860841 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:46.830892 24544 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:46.886216 21711 auto_rebalancer.cc:629] Failed to schedule move for tablet afc4a5871719461787d91a97d59582af: Illegal state: Replica 6d698a5544b946939790e7a3972db9fb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:46.834344 24549 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:46.846649 24546 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:46.823308 24418 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:46.892150 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.837548 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:46.894052 24406 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7.
W20260709 13:08:46.903333 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.911077 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:46.926842 24576 log.cc:927] Time spent T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:46.930307 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:46.917121 24582 log.cc:927] Time spent T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:08:46.932687 22484 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:46.932838 21909 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:46.917212 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 60355.4us
I20260709 13:08:46.917779 21661 catalog_manager.cc:5697] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 5 to 6, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 6 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.886505 24267 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.154s
I20260709 13:08:46.926064 24550 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:46.921162 24223 consensus_meta.cc:287] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.675s	user 0.012s	sys 0.000s
I20260709 13:08:46.854202 24538 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:46.962396 24565 log.cc:927] Time spent T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 13:08:46.956192 24405 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:46.869509 24443 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:47.093279 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:47.093964 24446 consensus_meta.cc:287] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.001s
I20260709 13:08:47.094872 21762 raft_consensus.cc:2410] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:47.094933 24443 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:46.963408 24558 consensus_queue.cc:260] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:46.966060 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:08:46.965234 24568 log.cc:927] Time spent T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.265s	user 0.005s	sys 0.000s
I20260709 13:08:47.095763 22481 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:46.834372 24398 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:46.974658 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.956396 24580 raft_consensus.cc:697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:47.098420 24398 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:46.980135 22450 leader_election.cc:336] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.728s (SENT)
I20260709 13:08:47.098207 24580 consensus_queue.cc:237] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:47.099391 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 119311us
W20260709 13:08:47.009757 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.868644 24378 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
W20260709 13:08:46.871191 24571 log.cc:927] Time spent T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
W20260709 13:08:46.985112 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.093300 24405 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:47.104372 22449 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:46.890846 24384 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:47.072247 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:46.925596 24585 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:46.959721 24536 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:47.078902 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:47.107390 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:47.079417 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 207470us
W20260709 13:08:47.108057 21805 leader_election.cc:336] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 3.061s (SENT)
W20260709 13:08:47.070647 24572 log.cc:927] Time spent T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:08:47.078109 24549 raft_consensus.cc:697] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:47.078303 24546 raft_consensus.cc:697] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:47.082095 21757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1134) took 1237 ms. Trace:
I20260709 13:08:47.081688 21661 catalog_manager.cc:5697] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 4 to 5, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 5 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.084239 24544 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:08:47.087220 21908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:08:47.087289 24325 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:47.088161 21909 raft_consensus.cc:2410] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260709 13:08:47.093616 24573 log.cc:927] Time spent T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 13:08:47.076494 22476 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
W20260709 13:08:47.044759 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 198413us
W20260709 13:08:47.072649 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:47.127288 21879 leader_election.cc:336] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.841s (SENT)
I20260709 13:08:47.127671 21879 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:47.127867 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.108541 21805 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:47.118245 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:47.112792 21757 rpcz_store.cc:276] 0709 13:08:45.844797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.236040 (+391243us) service_pool.cc:224] Handling call
0709 13:08:46.251975 (+ 15935us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:46.323000 (+ 71025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:46.323045 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:46.411084 (+ 88039us) log.cc:844] Serialized 26 byte log entry
0709 13:08:46.750861 (+339777us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:46.776396 (+ 25535us) log.cc:844] Serialized 14 byte log entry
0709 13:08:46.777027 (+   631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:46.777127 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:47.081886 (+304759us) raft_consensus.cc:1685] finished
0709 13:08:47.081905 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:47.082042 (+   137us) inbound_call.cc:177] Queueing success response
0709 13:08:47.087740 (+  5698us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b1800313f60. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab26a3f3 00007fc6ab26c7c1 00007fc6ab26c779 00007fc6ab26c709 00007fc6ab26c6d1 00007fc6ab26b9cd 000000000038f354 000000000038f199 00007fc6ab24d83a
Metrics: {"prepare.queue_time_us":27780,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":12027,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":30742,"spinlock_wait_cycles":13502208,"thread_start_us":272575,"threads_started":1,"wal-append.queue_time_us":362262}
I20260709 13:08:47.128960 21912 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:47.115603 21908 raft_consensus.cc:606] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:47.115334 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:47.124323 21661 catalog_manager.cc:5697] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 3 to 6, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 6 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.130143 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:47.131537 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:47.132278 21911 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:47.133358 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:47.134459 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:47.136644 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:47.137346 21914 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:47.145268 24546 consensus_queue.cc:237] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:47.133453 24224 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:08:47.145887 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:47.152027 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:47.153949 21913 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:08:47.115473 24538 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.124588 24544 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.146270 24570 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:47.160894 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:47.162339 22481 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:47.154990 21914 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:47.142176 21661 catalog_manager.cc:5697] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:47.164676 22483 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.009s	sys 0.054s
I20260709 13:08:47.130229 24378 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:47.171609 22483 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.009s	sys 0.054s
I20260709 13:08:47.176002 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:47.177065 21906 raft_consensus.cc:2410] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:08:47.177218 21912 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:47.108691 24384 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:47.181053 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 137763us
I20260709 13:08:47.130169 24325 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:47.183156 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:47.187513 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:47.189193 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:47.190121 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:08:47.191147 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:47.192286 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 65022.9us
I20260709 13:08:47.160609 24320 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.190234 21806 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:47.166006 24544 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:47.160960 24547 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:08:47.195433 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:47.196605 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:47.196919 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:47.197402 21905 raft_consensus.cc:2393] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:47.198244 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:47.199542 21879 leader_election.cc:336] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.869s (SENT)
I20260709 13:08:47.199951 21879 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:47.200357 21912 raft_consensus.cc:2393] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 7: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:47.198621 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:47.208148 21907 raft_consensus.cc:2410] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:08:47.209507 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:47.210232 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:47.210537 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:47.211097 21905 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:47.211838 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:47.213102 24405 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:47.212790 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:47.214524 21911 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:47.214828 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:47.215565 21909 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:47.216727 21909 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:08:47.220328 24569 log.cc:927] Time spent T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.496s	user 0.012s	sys 0.029s
I20260709 13:08:47.223704 21909 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:47.157656 24512 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:08:47.228400 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:47.179148 24570 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:47.233633 21912 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:08:47.234560 21906 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:47.173671 24538 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:47.241175 21879 leader_election.cc:336] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.241s (SENT)
I20260709 13:08:47.246526 21879 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:47.248271 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 49317.8us
I20260709 13:08:47.238330 21661 catalog_manager.cc:5697] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:47.243052 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:47.251816 21836 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:47.253345 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:47.254186 21834 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:47.261123 22450 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:47.257208 21661 catalog_manager.cc:5697] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 3 to 5, leader changed from <none> to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 5 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.228114 24306 consensus_queue.cc:1048] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:08:47.160825 24549 consensus_queue.cc:237] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:47.205583 24320 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:47.269677 21913 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:47.270941 21877 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:47.282524 21877 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:47.279598 21661 catalog_manager.cc:5697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 3 to 4, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 4 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.291270 21906 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
W20260709 13:08:47.319062 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 46188.1us
I20260709 13:08:47.269177 24223 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:47.327800 24398 raft_consensus.cc:2804] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:47.340699 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:47.346328 21840 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:47.270236 24547 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:47.338702 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 104237us
I20260709 13:08:47.356585 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:47.341918 21661 catalog_manager.cc:5697] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 1 to 3, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 3 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.271301 24494 raft_consensus.cc:2804] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:47.310658 24418 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:47.310297 24410 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:47.308954 24449 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.329270 24536 consensus_queue.cc:1048] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:08:47.368463 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:47.371960 21833 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:08:47.376533 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:47.373689 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:47.375900 24405 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.379410 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:47.379524 24405 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:47.380066 21839 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:47.368222 24446 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.380702 24325 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:47.381474 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:47.383556 21880 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:47.383884 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:47.383961 24378 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.376421 24602 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.385887 24446 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:47.385946 24602 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:47.389248 24446 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:47.389557 24384 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:47.345201 24398 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.384509 24378 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.360574 24223 raft_consensus.cc:697] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:47.388953 24602 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:47.390739 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:47.389865 24600 consensus_queue.cc:1059] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:47.360287 24550 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.393395 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:47.394064 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:47.402383 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:47.396574 21840 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:47.404104 21804 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:47.404811 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 84622.2us
I20260709 13:08:47.417037 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:47.417788 21832 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:47.402297 22448 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:47.271633 24586 consensus_queue.cc:1059] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 13:08:47.405892 21880 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:47.360368 24494 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:47.423861 21804 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:47.421617 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 128214us
I20260709 13:08:47.428694 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:47.371449 24410 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:47.514599 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.514423 21661 catalog_manager.cc:5697] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 2 to 6, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 6 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:47.393692 24398 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:47.416852 24587 log.cc:927] Time spent T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:08:47.418536 24547 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:47.522764 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:47.532573 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 290739us
I20260709 13:08:47.537192 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:47.538013 21834 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:47.513657 24494 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:47.521605 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 119387us
I20260709 13:08:47.398168 24570 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:47.402078 24224 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.524641 21661 catalog_manager.cc:5697] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 2 to 4, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 4 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:47.522481 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 98725.4us
I20260709 13:08:47.376833 24449 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:47.518851 24405 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:47.555558 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:47.422617 24470 consensus_queue.cc:1059] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 13:08:47.531824 24581 raft_consensus.cc:2804] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:47.526244 24443 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.531812 24384 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:47.429240 24557 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.122s
I20260709 13:08:47.559607 21661 catalog_manager.cc:5697] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 1 to 4, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 4 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.395449 24223 consensus_queue.cc:237] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:47.561482 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:47.522361 24410 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.565330 21661 catalog_manager.cc:5697] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 2 to 6, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 6 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:47.567054 21804 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:47.397261 24550 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:47.538156 24512 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:08:47.578629 21661 catalog_manager.cc:5697] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 3 to 5, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 5 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:47.560408 24581 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.562667 24384 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.556244 24619 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:47.574100 24214 consensus_meta.cc:287] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.000s
W20260709 13:08:47.593741 21879 leader_election.cc:336] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.696s (SENT)
I20260709 13:08:47.594235 21879 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:47.593967 21661 catalog_manager.cc:5697] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 2 to 3, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 3 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:47.595939 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 48296.5us
I20260709 13:08:47.596052 21661 catalog_manager.cc:5697] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 2 to 4, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 4 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:47.578809 24550 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:47.599171 21804 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:47.597082 22448 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:47.600054 21909 raft_consensus.cc:1240] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:47.584956 24470 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:47.602079 21729 connection.cc:256] RPC call timeout handler was delayed by -2.5018371250000655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
W20260709 13:08:47.607170 21729 connection.cc:256] RPC call timeout handler was delayed by -2.4964371250000568s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 13:08:47.607477 21729 connection.cc:256] RPC call timeout handler was delayed by -2.3569371250000586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
W20260709 13:08:47.607753 21729 connection.cc:256] RPC call timeout handler was delayed by -2.0815371249999544s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
W20260709 13:08:47.607993 21729 connection.cc:256] RPC call timeout handler was delayed by -2.0680371250000462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
W20260709 13:08:47.608240 21729 connection.cc:256] RPC call timeout handler was delayed by -2.0041371250000566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
I20260709 13:08:47.584865 24306 raft_consensus.cc:3055] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:08:47.605928 24613 log.cc:927] Time spent T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:47.589777 24581 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:47.610285 21804 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:47.615521 21729 connection.cc:256] RPC call timeout handler was delayed by -1.9330371250000553s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2235s for a response
W20260709 13:08:47.615907 21729 connection.cc:256] RPC call timeout handler was delayed by -1.9267371250000451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2242s for a response
I20260709 13:08:47.615844 21805 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:47.616389 21729 connection.cc:256] RPC call timeout handler was delayed by -1.908737125000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2262s for a response
I20260709 13:08:47.592654 24384 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:47.566447 24443 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:47.626458 24611 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:47.627074 24615 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:47.627884 24443 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:47.610088 22448 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:47.616703 21729 connection.cc:256] RPC call timeout handler was delayed by -1.6045371249999789s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26s for a response
W20260709 13:08:47.629956 21729 connection.cc:256] RPC call timeout handler was delayed by -1.4281371250000348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2796s for a response
W20260709 13:08:47.611521 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.592466 24619 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.593147 24538 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:47.555342 24224 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:47.621712 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 101086us
W20260709 13:08:47.623769 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 109788us
I20260709 13:08:47.611874 24306 raft_consensus.cc:740] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:47.663516 21729 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:47.663926 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:47.665359 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.629472 24570 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:47.598279 24214 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:47.663311 22449 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:47.665517 21661 catalog_manager.cc:5697] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 1 to 2, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 2 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:47.630630 24618 raft_consensus.cc:3055] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:47.670562 21840 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
W20260709 13:08:47.671406 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 61823.3us
W20260709 13:08:47.671541 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 63945.9us
W20260709 13:08:47.633610 24604 log.cc:927] Time spent T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:08:47.618114 24584 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:47.632983 24320 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:47.714675 21834 raft_consensus.cc:1275] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:47.633817 24627 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:47.704099 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:47.705191 21805 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:47.706862 21728 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:47.674427 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 80768.1us
I20260709 13:08:47.632730 24619 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.716275 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:47.713269 22448 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:47.716922 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:47.720119 21838 raft_consensus.cc:2410] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:08:47.719408 21879 leader_election.cc:336] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.917s (SENT)
I20260709 13:08:47.667760 24418 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:47.672369 24570 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.724033 21840 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:47.723922 21805 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:47.726104 21879 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:47.726799 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.700960 24536 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:47.714126 24512 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:08:47.711865 24554 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:47.710389 24580 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.737155 24224 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:47.742547 24580 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:47.710956 24618 raft_consensus.cc:740] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:47.732270 24449 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:47.743588 22483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36278 (request call id 352) took 1181 ms. Trace:
I20260709 13:08:47.720184 24443 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:47.728236 24585 consensus_meta.cc:287] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.613s	user 0.010s	sys 0.000s
W20260709 13:08:47.755723 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:47.756215 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:47.736764 21879 leader_election.cc:336] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.994s (SENT)
I20260709 13:08:47.728149 24546 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:47.737680 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 79760.7us
I20260709 13:08:47.738116 24630 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:47.740303 24586 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:47.768069 21729 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:47.768294 24586 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:47.768817 24586 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:47.768906 24610 log.cc:927] Time spent T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:08:47.769783 24595 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:47.740649 24556 consensus_meta.cc:287] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 1.094s	user 0.012s	sys 0.000s
I20260709 13:08:47.770186 24595 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:47.770509 24214 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:47.770463 24556 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:47.772881 24556 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:47.741714 24598 log.cc:927] Time spent T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.653s	user 0.005s	sys 0.000s
I20260709 13:08:47.773878 24614 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:47.773973 24512 raft_consensus.cc:697] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:47.774900 21908 raft_consensus.cc:2368] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
W20260709 13:08:47.775020 24612 log.cc:927] Time spent T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:08:47.775174 24512 consensus_queue.cc:237] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:47.744609 21833 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:47.777413 24605 log.cc:927] Time spent T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:08:47.722107 24627 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:47.778568 24627 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:47.780077 21836 raft_consensus.cc:1240] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:08:47.780409 24595 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.746892 24470 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:47.746603 21838 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:08:47.722857 24320 raft_consensus.cc:2804] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:47.781421 21836 raft_consensus.cc:1275] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:08:47.773057 21729 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:47.783824 21836 raft_consensus.cc:1240] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 5. Current term is 6. Ops: [4.5-5.6]
I20260709 13:08:47.735389 24306 consensus_queue.cc:260] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:47.765136 21879 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:47.729856 24570 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:47.775741 22482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 807) took 1258 ms. Trace:
I20260709 13:08:47.732175 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:47.743957 22483 rpcz_store.cc:276] 0709 13:08:46.562158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.563208 (+  1050us) service_pool.cc:224] Handling call
0709 13:08:46.578720 (+ 15512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:46.578910 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:08:47.175795 (+596885us) log.cc:844] Serialized 14 byte log entry
0709 13:08:47.743153 (+567358us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b1800364840. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6adeff4bc 00007fc6ab24d48b 00007fc6b40a7ab9 00007fc6ab26969b 00007fc6ab26793f 00007fc6ab267455 00007fc6ae34f060 00007fc6ae361716 00007fc6ae372287
0709 13:08:47.743248 (+    95us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:47.743292 (+    44us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:47.743336 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:47.743411 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:47.743526 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":346312,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":81533,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":2306,"spinlock_wait_cycles":53721856,"thread_start_us":782875,"threads_started":3,"wal-append.queue_time_us":560095}
I20260709 13:08:47.730541 24536 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:47.792263 24536 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:47.796782 24583 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:47.790488 24624 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:47.807305 24558 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:47.811471 24580 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:47.750149 24618 consensus_queue.cc:260] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:47.814095 24618 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:47.790050 22482 rpcz_store.cc:276] 0709 13:08:46.525604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:46.526143 (+   539us) service_pool.cc:224] Handling call
0709 13:08:46.526540 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:46.533346 (+  6806us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:46.768171 (+234825us) log.cc:844] Serialized 14 byte log entry
0709 13:08:46.974471 (+206300us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:47.041027 (+ 66556us) log.cc:844] Serialized 26 byte log entry
0709 13:08:47.041218 (+   191us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:47.041265 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:47.041356 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:47.741161 (+699805us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:47.775447 (+ 34286us) raft_consensus.cc:1685] finished
0709 13:08:47.775550 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:47.775686 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":358895,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":6912,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":104958,"spinlock_wait_cycles":8748416,"thread_start_us":382862,"threads_started":2,"wal-append.queue_time_us":294931}
I20260709 13:08:47.743979 24615 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:08:47.787753 24320 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:47.832247 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 59274.6us
I20260709 13:08:47.834033 24320 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:47.788087 24585 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:47.837807 21729 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:47.838644 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 125433us
I20260709 13:08:47.870721 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:47.872170 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 88234.4us
I20260709 13:08:47.873281 24546 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:47.874769 24546 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:47.875171 24580 consensus_queue.cc:1048] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:47.875814 24214 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:47.876049 24546 consensus_queue.cc:1048] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:08:47.877548 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:47.872478 24623 log.cc:927] Time spent T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.080s	user 0.000s	sys 0.002s
I20260709 13:08:47.878022 24624 consensus_queue.cc:1059] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:47.880927 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:47.881721 21840 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:47.873277 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:47.894327 22448 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:47.782004 24470 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:47.883466 21839 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:47.906458 24624 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:47.907259 24446 raft_consensus.cc:3055] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:47.911979 24446 raft_consensus.cc:740] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:47.912919 21906 raft_consensus.cc:1240] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:47.912815 24446 consensus_queue.cc:260] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:47.907922 24443 consensus_queue.cc:1048] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:47.913040 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:47.921257 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:47.915417 21731 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:47.960866 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:47.961799 22482 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
W20260709 13:08:47.965006 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 50848.3us
I20260709 13:08:47.968959 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:47.969704 21840 raft_consensus.cc:2376] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6. Re-sending same reply.
W20260709 13:08:47.985749 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 148051us
W20260709 13:08:47.987072 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 92862.2us
I20260709 13:08:47.990597 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:48.038580 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 163909us
W20260709 13:08:48.044087 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 53170.5us
I20260709 13:08:48.044982 21905 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:48.045404 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:48.040515 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 160393us
I20260709 13:08:48.049198 21912 raft_consensus.cc:1240] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4. Ops: []
I20260709 13:08:48.044823 21880 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:48.056068 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 319295us
W20260709 13:08:48.056939 21879 leader_election.cc:336] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 3.151s (SENT)
I20260709 13:08:48.057385 21879 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:48.060317 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 100084us
I20260709 13:08:48.061597 21805 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:48.062407 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:48.063023 21908 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:47.985216 24446 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:48.069509 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:48.071563 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 80634.4us
I20260709 13:08:48.065564 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:48.073074 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:48.046963 24224 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:48.051776 24583 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:48.083128 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:48.119598 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 204274us
I20260709 13:08:48.084143 21839 raft_consensus.cc:1275] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:48.124637 21729 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:48.076884 24545 consensus_meta.cc:287] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 1.137s	user 0.018s	sys 0.029s
I20260709 13:08:48.138571 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:48.139278 21910 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:08:48.135885 21909 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:48.136235 21805 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:48.061668 24600 consensus_queue.cc:1059] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.063s
W20260709 13:08:48.185837 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.103996 24449 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:48.072934 24624 consensus_queue.cc:1059] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:08:48.122560 24406 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:48.203066 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 72610.8us
I20260709 13:08:48.207495 24621 consensus_queue.cc:1059] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.161s
I20260709 13:08:48.207911 24561 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:48.208352 24561 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.208734 24561 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:48.210435 24634 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.170s
I20260709 13:08:48.078104 24214 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.081s
W20260709 13:08:48.216163 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 159261us
I20260709 13:08:48.081866 24615 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:08:48.134246 24642 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:48.143287 24443 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:48.142832 24584 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.151702 24433 raft_consensus.cc:3055] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:08:48.191193 24544 consensus_meta.cc:287] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.957s	user 0.022s	sys 0.011s
W20260709 13:08:48.224172 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 102021us
I20260709 13:08:48.236423 21805 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:48.224310 24620 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:48.229303 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.221901 21877 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:48.231910 24624 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:48.221052 24378 consensus_meta.cc:287] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.826s	user 0.030s	sys 0.020s
I20260709 13:08:48.130546 24583 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:48.233685 24494 consensus_meta.cc:287] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.673s	user 0.007s	sys 0.010s
I20260709 13:08:48.204998 24617 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:48.270650 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.212932 24406 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:48.142251 24224 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:48.214143 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:48.188217 24418 consensus_queue.cc:1059] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:08:48.235215 24433 raft_consensus.cc:740] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:48.233162 24627 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:48.267799 24545 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:48.315313 21879 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:48.276023 24378 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:48.333231 24601 consensus_queue.cc:1059] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:08:48.337622 21909 raft_consensus.cc:1275] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:08:48.341596 24619 consensus_meta.cc:287] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.615s	user 0.010s	sys 0.006s
I20260709 13:08:48.342121 24619 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:48.345592 24581 consensus_meta.cc:287] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.686s	user 0.012s	sys 0.001s
I20260709 13:08:48.276925 24470 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:48.275861 24443 raft_consensus.cc:3055] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:48.294566 24223 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:48.289708 24406 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:48.251614 24544 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:48.289283 24650 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:48.356778 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.335366 24545 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.238410 24584 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:48.257854 24620 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:48.352061 24223 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:48.349720 24585 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:48.381795 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:48.352511 24443 raft_consensus.cc:740] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:48.432217 24443 consensus_queue.cc:260] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:48.433570 24443 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:48.379990 24378 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:48.238173 24642 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:48.266575 24624 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:48.424644 24223 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:48.426200 24433 consensus_queue.cc:260] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:48.478554 24433 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:48.480178 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.427510 24627 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:48.428649 24652 log.cc:927] Time spent T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:08:48.483108 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1699) took 1097 ms. Trace:
I20260709 13:08:48.483491 21831 rpcz_store.cc:276] 0709 13:08:47.385670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.771587 (+385917us) service_pool.cc:224] Handling call
0709 13:08:47.771905 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:47.835101 (+ 63196us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:47.955775 (+120674us) log.cc:844] Serialized 14 byte log entry
0709 13:08:48.144682 (+188907us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:48.217833 (+ 73151us) log.cc:844] Serialized 26 byte log entry
0709 13:08:48.218004 (+   171us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:48.218061 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.218150 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:48.481437 (+263287us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b1800060dc0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab26a3f3 00007fc6ab26c7c1 00007fc6ab26c779 00007fc6ab26c709 00007fc6ab26c6d1 00007fc6ab26b9cd 000000000038f354 000000000038f199 00007fc6ab24d83a
0709 13:08:48.482793 (+  1356us) raft_consensus.cc:1685] finished
0709 13:08:48.482905 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.483044 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":167299,"prepare.queue_time_us":114282,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":79985,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":11119,"spinlock_wait_cycles":3951488,"thread_start_us":70246,"threads_started":1,"wal-append.queue_time_us":241092}
I20260709 13:08:48.378772 24545 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:48.439437 21833 raft_consensus.cc:1240] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:08:48.440174 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1141) took 1030 ms. Trace:
I20260709 13:08:48.494261 21906 rpcz_store.cc:276] 0709 13:08:47.409484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.913977 (+504493us) service_pool.cc:224] Handling call
0709 13:08:47.914316 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:47.988083 (+ 73767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:47.988113 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:47.988558 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:08:48.243968 (+255410us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:48.244000 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.244052 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:48.439893 (+195841us) raft_consensus.cc:1685] finished
0709 13:08:48.439923 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.440099 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78343,"raft.queue_time_us":129088,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":10198,"thread_start_us":183343,"threads_started":1,"wal-append.queue_time_us":311427}
I20260709 13:08:48.350334 24619 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:48.299288 24617 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:48.292702 24494 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:48.518733 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:08:48.539813 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:48.542919 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 418351us
I20260709 13:08:48.532446 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:48.542022 22483 raft_consensus.cc:2393] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 5: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:48.347605 24581 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:48.547602 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 231769us
I20260709 13:08:48.523820 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1701) took 1137 ms. Trace:
I20260709 13:08:48.566826 22477 raft_consensus.cc:1240] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:48.570758 21879 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:48.562453 21832 rpcz_store.cc:276] 0709 13:08:47.386258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.778300 (+392042us) service_pool.cc:224] Handling call
0709 13:08:47.778619 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:47.866974 (+ 88355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:47.867024 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:47.867627 (+   603us) log.cc:844] Serialized 52 byte log entry
0709 13:08:48.044686 (+177059us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:48.523028 (+478342us) log.cc:844] Serialized 14 byte log entry
0709 13:08:48.523351 (+   323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.523460 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:48.523519 (+    59us) raft_consensus.cc:1685] finished
0709 13:08:48.523538 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.523740 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104613,"prepare.queue_time_us":171858,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":89905,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":185,"thread_start_us":548268,"threads_started":2,"wal-append.queue_time_us":464096}
I20260709 13:08:48.580160 24624 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:48.532804 24625 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:48.580425 24581 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:48.585916 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 370617us
I20260709 13:08:48.595446 21728 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:48.638721 24410 consensus_meta.cc:287] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 1.050s	user 0.034s	sys 0.013s
W20260709 13:08:48.639459 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 44141.3us
I20260709 13:08:48.640401 21728 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:48.639215 24410 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:48.642722 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 56238.5us
I20260709 13:08:48.570369 24224 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:48.647437 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:48.652422 21729 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:48.645571 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:48.642975 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 406646us
I20260709 13:08:48.654000 21840 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
W20260709 13:08:48.659997 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 90590.8us
W20260709 13:08:48.641693 24536 consensus_meta.cc:287] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.845s	user 0.006s	sys 0.039s
W20260709 13:08:48.641573 24384 consensus_meta.cc:287] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 1.007s	user 0.018s	sys 0.051s
I20260709 13:08:48.666390 21805 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:48.576001 24544 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:48.661396 22448 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:48.650146 24586 consensus_meta.cc:287] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.881s	user 0.016s	sys 0.010s
W20260709 13:08:48.676187 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.668494 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:48.569886 24619 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 13:08:48.574717 24556 consensus_queue.cc:1048] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:08:48.680647 21911 raft_consensus.cc:1240] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:08:48.575209 24543 consensus_queue.cc:1059] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 13:08:48.685356 21729 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:48.574870 24449 consensus_queue.cc:1059] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.101s
I20260709 13:08:48.677749 24405 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:48.659482 24624 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:48.698112 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 443003us
W20260709 13:08:48.702481 21908 consensus_meta.cc:287] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.636s	user 0.004s	sys 0.015s
I20260709 13:08:48.653812 24659 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:48.677578 24650 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:48.689692 24644 log.cc:927] Time spent T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.609s	user 0.004s	sys 0.000s
I20260709 13:08:48.697815 24615 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:48.684940 24536 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:48.696564 22482 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.011s	sys 0.023s
I20260709 13:08:48.716015 24642 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:48.699209 24586 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:48.695564 21805 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:48.693926 24583 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:48.689539 24384 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:48.748729 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1700) took 1362 ms. Trace:
W20260709 13:08:48.799504 22482 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.011s	sys 0.024s
W20260709 13:08:48.795648 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:48.760735 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:48.758002 21910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1455) took 1608 ms. Trace:
W20260709 13:08:48.801057 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 105599us
I20260709 13:08:48.754654 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1134) took 1551 ms. Trace:
I20260709 13:08:48.712915 21908 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
W20260709 13:08:48.742252 24658 log.cc:927] Time spent T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260709 13:08:48.713980 24618 consensus_meta.cc:287] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.893s	user 0.010s	sys 0.014s
I20260709 13:08:48.803395 21805 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:48.801803 21833 rpcz_store.cc:276] 0709 13:08:47.385961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.777904 (+391943us) service_pool.cc:224] Handling call
0709 13:08:47.778205 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:48.493915 (+715710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.748317 (+254402us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b54003f1e54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:48.748654 (+   337us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1519997824}
I20260709 13:08:48.804546 21905 rpcz_store.cc:276] 0709 13:08:47.203233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.212589 (+  9356us) service_pool.cc:224] Handling call
0709 13:08:48.754461 (+1541872us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b5400100c54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:48.754585 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1531350400}
I20260709 13:08:48.803622 21910 rpcz_store.cc:276] 0709 13:08:47.149347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.180798 (+ 31451us) service_pool.cc:224] Handling call
0709 13:08:48.745280 (+1564482us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b5400111f54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:48.757923 (+ 12643us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2165690752}
W20260709 13:08:48.736644 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 75887.2us
W20260709 13:08:48.833377 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:48.744230 24632 log.cc:927] Time spent T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.689s	user 0.000s	sys 0.002s
I20260709 13:08:48.836376 22484 raft_consensus.cc:2410] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:08:48.800751 24614 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:08:48.848811 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 163584us
I20260709 13:08:48.877707 21729 leader_election.cc:400] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5.
I20260709 13:08:48.878149 21729 leader_election.cc:403] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:08:48.803115 24570 consensus_meta.cc:287] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.982s	user 0.016s	sys 0.006s
I20260709 13:08:48.729524 24630 raft_consensus.cc:3055] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:08:48.802615 24446 consensus_meta.cc:287] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.728s	user 0.008s	sys 0.012s
W20260709 13:08:48.887005 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 164320us
W20260709 13:08:48.760635 24398 consensus_meta.cc:287] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 1.202s	user 0.012s	sys 0.012s
I20260709 13:08:48.800058 24615 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:48.720901 24649 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:48.730557 24620 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:48.740056 24624 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:08:48.882436 24658 log.cc:927] Time spent T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:08:48.756922 24611 raft_consensus.cc:3055] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:48.787129 24627 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:48.800544 24485 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:48.887056 24648 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5.
I20260709 13:08:48.882813 24630 raft_consensus.cc:740] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:48.894532 24615 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:48.711030 24600 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.142s
I20260709 13:08:48.834779 24659 raft_consensus.cc:697] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:48.882171 24306 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:48.890475 24621 consensus_queue.cc:1059] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:08:48.850423 24494 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:48.837411 24583 consensus_queue.cc:1048] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:08:48.896091 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:48.896983 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:48.880976 24619 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:48.824965 24595 consensus_meta.cc:287] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 1.044s	user 0.023s	sys 0.042s
I20260709 13:08:48.898072 21804 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:48.900200 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:48.884266 24543 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.901261 24649 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:48.870121 21835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2524) took 1634 ms. Trace:
W20260709 13:08:48.835090 24561 consensus_meta.cc:287] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.626s	user 0.016s	sys 0.004s
I20260709 13:08:48.943116 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:48.875839 21805 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:48.897159 24418 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:48.921202 24586 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:48.900803 24611 raft_consensus.cc:740] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:48.893356 24398 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:48.924597 24558 consensus_meta.cc:287] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 1.117s	user 0.021s	sys 0.014s
I20260709 13:08:48.889249 24570 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:48.852394 24601 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:48.887574 24680 consensus_queue.cc:1059] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:08:48.911831 24410 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:48.934820 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:48.935945 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:08:48.935377 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 106357us
I20260709 13:08:48.910015 21729 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:48.913169 24627 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:48.941344 21835 rpcz_store.cc:276] 0709 13:08:47.235843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.235942 (+    99us) service_pool.cc:224] Handling call
0709 13:08:47.236209 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:47.551462 (+315253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:47.553751 (+  2289us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:47.574604 (+ 20853us) log.cc:844] Serialized 26 byte log entry
0709 13:08:47.789869 (+215265us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:47.790556 (+   687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:47.790626 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:48.485742 (+695116us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:48.843624 (+357882us) raft_consensus.cc:1685] finished
0709 13:08:48.843646 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:48.870036 (+ 26390us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5374,"raft.queue_time_us":108622,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":14040,"spinlock_wait_cycles":44095232,"thread_start_us":512509,"threads_started":2,"wal-append.queue_time_us":462759}
I20260709 13:08:48.952670 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:48.955536 21906 raft_consensus.cc:2393] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 4: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:48.955946 21910 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:48.960757 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 85220.6us
I20260709 13:08:48.962028 21805 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:48.964798 21914 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:48.966174 21905 raft_consensus.cc:2393] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:08:48.969761 21711 auto_rebalancer.cc:629] Failed to schedule move for tablet 4e45c5ba8a1f4b0c958677540c41b258: Illegal state: Replica 6d698a5544b946939790e7a3972db9fb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
W20260709 13:08:48.972064 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 62149us
W20260709 13:08:49.022802 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.069234 21836 raft_consensus.cc:1240] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 13:08:48.980571 21879 connection.cc:256] RPC call timeout handler was delayed by -1.3139515049999773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
I20260709 13:08:48.939596 24619 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:48.969537 24648 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:48.945541 24669 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:49.077788 21729 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:48.944996 24543 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:49.092021 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 130067us
I20260709 13:08:48.940750 24595 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:49.083227 21879 connection.cc:256] RPC call timeout handler was delayed by -1.058351504999905s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
I20260709 13:08:49.077543 24384 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:49.105010 21910 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
W20260709 13:08:49.102814 24666 log.cc:927] Time spent T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:08:48.947026 24561 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:49.086710 24536 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:49.075621 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:08:49.123515 21805 connection.cc:256] RPC call timeout handler was delayed by -2.1319752140000219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
W20260709 13:08:49.124591 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 46923.3us
I20260709 13:08:49.126498 22482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 817) took 1163 ms. Trace:
I20260709 13:08:49.136476 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:49.094446 24581 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:49.134604 24627 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:49.134742 24543 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:49.104172 24611 consensus_queue.cc:260] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:49.136623 24320 consensus_meta.cc:287] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 1.299s	user 0.007s	sys 0.014s
I20260709 13:08:49.166577 24320 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:49.168072 24223 consensus_meta.cc:287] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.691s	user 0.016s	sys 0.003s
I20260709 13:08:49.168678 24320 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:49.168460 24223 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:49.169584 24601 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:08:49.170073 24676 log.cc:927] Time spent T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:08:49.170147 24570 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:49.170603 24223 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:49.072432 24659 consensus_queue.cc:237] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:49.172359 24595 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:49.139209 24545 consensus_meta.cc:287] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.653s	user 0.007s	sys 0.011s
I20260709 13:08:49.173779 24545 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:49.176347 24545 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:49.139371 24443 consensus_meta.cc:287] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.705s	user 0.014s	sys 0.001s
I20260709 13:08:49.140786 24619 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:48.957882 24630 consensus_queue.cc:260] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:49.141359 24433 consensus_meta.cc:287] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.662s	user 0.011s	sys 0.005s
I20260709 13:08:49.074796 24580 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:08:49.112116 24664 log.cc:927] Time spent T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 13:08:49.177613 24630 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.179232 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1143) took 1768 ms. Trace:
I20260709 13:08:49.180266 24405 raft_consensus.cc:3055] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:49.180681 24405 raft_consensus.cc:740] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:49.179697 21907 rpcz_store.cc:276] 0709 13:08:47.410381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.043772 (+633391us) service_pool.cc:224] Handling call
0709 13:08:48.059694 (+ 15922us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:48.122533 (+ 62839us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:48.122567 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:48.135245 (+ 12678us) log.cc:844] Serialized 52 byte log entry
0709 13:08:48.653132 (+517887us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:48.693167 (+ 40035us) log.cc:844] Serialized 14 byte log entry
0709 13:08:48.694457 (+  1290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.694530 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:49.179046 (+484516us) raft_consensus.cc:1685] finished
0709 13:08:49.179063 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.179183 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62437,"prepare.queue_time_us":36363,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":3978,"raft.queue_time_us":90520,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":16593,"spinlock_wait_cycles":60288,"thread_start_us":433498,"threads_started":1,"wal-append.queue_time_us":624526}
I20260709 13:08:49.168816 24615 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:49.181473 24405 consensus_queue.cc:260] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:49.153211 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 82670.9us
W20260709 13:08:49.155071 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.185074 24619 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:49.127346 24398 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:49.200688 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 43800.8us
I20260709 13:08:49.201944 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:49.208062 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:49.207115 21877 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:49.156929 21908 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:49.154196 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:49.158973 21729 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:49.211822 21910 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:08:49.141607 24406 consensus_meta.cc:287] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.767s	user 0.011s	sys 0.011s
I20260709 13:08:49.115960 24680 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:49.115830 24669 raft_consensus.cc:697] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:49.185554 24583 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:49.154158 22482 rpcz_store.cc:276] 0709 13:08:47.963344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.963473 (+   129us) service_pool.cc:224] Handling call
0709 13:08:47.963840 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:47.992271 (+ 28431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:48.043950 (+ 51679us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:48.060104 (+ 16154us) log.cc:844] Serialized 26 byte log entry
0709 13:08:48.800114 (+740010us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:48.800148 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.800217 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:49.126274 (+326057us) raft_consensus.cc:1685] finished
0709 13:08:49.126294 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.126440 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22088,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":62953,"thread_start_us":676752,"threads_started":1,"wal-append.queue_time_us":871130}
I20260709 13:08:49.185308 24683 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:49.186254 21913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1464) took 1806 ms. Trace:
I20260709 13:08:49.226148 24683 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:49.226603 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:49.187059 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2535) took 1132 ms. Trace:
I20260709 13:08:49.187237 24536 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.188138 22483 raft_consensus.cc:1240] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:49.188345 24549 raft_consensus.cc:3055] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:49.186283 24615 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:49.189241 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36278 (request call id 362) took 1083 ms. Trace:
I20260709 13:08:49.230690 22477 rpcz_store.cc:276] 0709 13:08:48.105368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.105538 (+   170us) service_pool.cc:224] Handling call
0709 13:08:48.137885 (+ 32347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.567371 (+429486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.189045 (+621674us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b54007d2154. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:49.189191 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986031360}
I20260709 13:08:49.189533 22481 raft_consensus.cc:1240] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:49.227190 21834 rpcz_store.cc:276] 0709 13:08:48.055080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.062706 (+  7626us) service_pool.cc:224] Handling call
0709 13:08:48.078846 (+ 16140us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.546158 (+467312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:48.546189 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:48.546232 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:48.546276 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.186873 (+640597us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54003c0ad4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:49.186912 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.187011 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":593154944}
I20260709 13:08:49.190053 21911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 419) took 1982 ms. Trace:
I20260709 13:08:49.232015 21911 rpcz_store.cc:276] 0709 13:08:47.207376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.621978 (+414602us) service_pool.cc:224] Handling call
0709 13:08:47.622297 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:48.698217 (+1075920us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.189830 (+491613us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400420ed4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:49.189997 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2433320832}
I20260709 13:08:49.232465 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:49.233112 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:49.234195 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:49.179294 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:49.212167 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 53248.8us
I20260709 13:08:49.212136 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:49.192055 24619 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:49.213835 24398 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:49.227212 21837 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:49.235276 21729 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:49.226332 21913 rpcz_store.cc:276] 0709 13:08:47.380083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.801909 (+421826us) service_pool.cc:224] Handling call
0709 13:08:48.746060 (+944151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.746416 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:48.746455 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:48.746513 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:48.746568 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:48.746644 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:49.186100 (+439456us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b5400111f50. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:49.186199 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102669,"spinlock_wait_cycles":2181091968}
I20260709 13:08:49.236567 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:49.238035 22449 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:49.238385 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:49.238653 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:49.220073 24595 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:49.239441 21913 raft_consensus.cc:2393] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:49.239311 21910 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:49.239601 21908 raft_consensus.cc:2393] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 8: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:08:49.238999 21879 leader_election.cc:336] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.249s (SENT)
I20260709 13:08:49.241957 21879 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:49.243177 21912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1463) took 1863 ms. Trace:
I20260709 13:08:49.243464 21912 rpcz_store.cc:276] 0709 13:08:47.379691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.663057 (+283366us) service_pool.cc:224] Handling call
0709 13:08:48.049024 (+385967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.049616 (+   592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.243042 (+1193426us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b5400288050. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:49.243134 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886941056}
I20260709 13:08:49.246058 22449 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:49.246274 24443 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:49.246986 24558 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:49.247956 21911 raft_consensus.cc:2393] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:49.248458 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:49.247797 24683 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:49.230517 24549 raft_consensus.cc:740] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:49.224320 24406 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:49.251533 21729 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:49.256093 21729 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:49.252259 24642 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:49.261602 24443 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:49.256325 24586 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:49.262022 21729 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:49.262328 24561 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:49.263046 24320 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:49.263824 24406 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:49.262108 24443 raft_consensus.cc:697] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:49.264945 21729 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:49.265784 24320 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:49.265915 24443 consensus_queue.cc:237] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:49.267045 21729 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:49.267729 24320 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:49.268886 21729 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:49.244668 24618 consensus_queue.cc:1059] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 13:08:49.271090 21879 leader_election.cc:336] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.457s (SENT)
I20260709 13:08:49.271557 21879 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:49.273753 24629 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:49.273921 24669 consensus_queue.cc:237] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:49.275069 21914 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1451) took 2126 ms (client timeout 2168 ms). Trace:
W20260709 13:08:49.275537 21914 rpcz_store.cc:269] 0709 13:08:47.148200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:47.175731 (+ 27531us) service_pool.cc:224] Handling call
0709 13:08:49.274866 (+2099135us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b54002d8a54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:49.274986 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4060503936}
I20260709 13:08:49.276655 21905 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:49.276966 24618 raft_consensus.cc:3055] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:49.277370 24618 raft_consensus.cc:740] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:49.278735 24584 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:49.231153 24583 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:49.236179 24536 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:49.282286 21729 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:49.285398 24320 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:49.285352 21837 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:08:49.268985 24595 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:49.286578 24595 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:49.286990 24595 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:49.289137 24619 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:49.289685 24680 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:49.289811 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:49.286572 21728 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:49.293671 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:49.294765 22477 raft_consensus.cc:2393] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 8: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:49.296723 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:49.297412 22479 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:49.298579 24536 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:49.300819 24583 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:49.301658 24549 consensus_queue.cc:260] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:49.302779 24617 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:49.303725 24680 raft_consensus.cc:2804] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:49.304422 24680 raft_consensus.cc:697] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:49.305676 24680 consensus_queue.cc:237] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:49.307888 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:49.278357 24618 consensus_queue.cc:260] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:49.310858 24618 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.311342 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:49.311905 21838 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:49.313769 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:49.314961 21805 leader_election.cc:336] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.016s (SENT)
I20260709 13:08:49.316387 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:49.318629 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:49.319067 21838 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:08:49.319880 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:49.325057 24675 log.cc:927] Time spent T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260709 13:08:49.326308 22448 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:49.327359 24672 log.cc:927] Time spent T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.444s	user 0.000s	sys 0.001s
W20260709 13:08:49.327950 21879 leader_election.cc:336] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.686s (SENT)
W20260709 13:08:49.330010 21879 leader_election.cc:336] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.734s (SENT)
I20260709 13:08:49.330441 21879 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:49.330552 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 48385.8us
I20260709 13:08:49.333053 21729 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:49.334491 24584 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:49.336933 22484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36278 (request call id 366) took 1195 ms. Trace:
I20260709 13:08:49.337533 22484 rpcz_store.cc:276] 0709 13:08:48.141810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.141963 (+   153us) service_pool.cc:224] Handling call
0709 13:08:48.381571 (+239608us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b5800004898. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232a22 00007fc6b414bc09 00007fc6b32a5ee0 00007fc6b336f0ab 00007fc6b336f131 00007fc6b331d0a0 00007fc6b331c984 00007fc6ac8976d4 00007fc6ac897662
0709 13:08:49.336664 (+955093us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b54006022d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:49.336857 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":993834624}
I20260709 13:08:49.344333 21729 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:49.345746 24320 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:49.345950 24678 log.cc:927] Time spent T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
I20260709 13:08:49.354892 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:49.355329 21729 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:49.346568 24405 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:49.362129 24446 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:49.364220 24655 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:49.364974 24655 raft_consensus.cc:697] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:49.366261 21837 raft_consensus.cc:1240] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:08:49.366138 24655 consensus_queue.cc:237] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:49.368115 24443 consensus_queue.cc:1059] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:49.338338 24635 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:49.369866 24635 raft_consensus.cc:697] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:49.370777 24635 consensus_queue.cc:237] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:49.373065 21729 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:49.346336 24320 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:49.383714 21729 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:49.383662 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 64832.2us
I20260709 13:08:49.396847 21912 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:49.397092 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:49.398047 21914 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:08:49.399433 22449 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:49.354773 24470 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.372125 24624 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:49.373831 24443 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:49.347700 24659 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:08:49.389510 24446 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:49.416241 24586 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:49.417541 24470 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:49.407898 24680 consensus_queue.cc:1059] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:08:49.439244 24446 raft_consensus.cc:3055] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:49.439746 24446 raft_consensus.cc:740] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:49.440789 24446 consensus_queue.cc:260] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:49.445834 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.432224 24624 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:49.433606 24586 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:49.477934 24586 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:49.478324 24650 raft_consensus.cc:3055] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:08:49.478873 24650 raft_consensus.cc:740] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:49.479921 24650 consensus_queue.cc:260] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:49.464705 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1147) took 1422 ms. Trace:
I20260709 13:08:49.483560 21909 rpcz_store.cc:276] 0709 13:08:48.042122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:48.149321 (+107199us) service_pool.cc:224] Handling call
0709 13:08:48.149733 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:48.338114 (+188381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:49.464353 (+1126239us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b5400196ed4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:49.464617 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390288256}
W20260709 13:08:49.467792 24684 log.cc:927] Time spent T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.322s	user 0.001s	sys 0.001s
I20260709 13:08:49.474171 21804 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:49.485829 21879 leader_election.cc:336] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.895s (SENT)
I20260709 13:08:49.486341 24595 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:49.488018 24267 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:49.489892 24406 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:08:49.492213 21711 auto_rebalancer.cc:629] Failed to schedule move for tablet c096033d73b64750a7e09d89d0a70c7b: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:08:49.493729 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:49.494402 21837 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:49.494655 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:49.495329 21839 raft_consensus.cc:2393] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:49.475663 24470 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:49.477273 24320 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:49.496978 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:49.489010 24595 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:49.497860 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:49.522748 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 142254us
W20260709 13:08:49.629115 21879 leader_election.cc:336] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.917s (SENT)
I20260709 13:08:49.639464 21831 raft_consensus.cc:1240] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:49.521885 24546 consensus_queue.cc:1059] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:08:49.627175 24470 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:49.488596 24267 raft_consensus.cc:697] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:08:49.618074 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 116056us
W20260709 13:08:49.631958 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 248269us
I20260709 13:08:49.620493 21839 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:49.633893 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:49.626495 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:49.635401 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:49.619868 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:49.620438 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:49.562559 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 61005.4us
W20260709 13:08:49.647848 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.648859 21877 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:49.618534 21804 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:49.637923 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:49.628311 24406 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:49.641417 21831 raft_consensus.cc:1240] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:49.644908 21729 leader_election.cc:400] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 3 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 3. Current term is 4.
I20260709 13:08:49.647504 21835 raft_consensus.cc:2393] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 8: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:49.652861 24630 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:49.653268 24630 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:49.652719 22450 leader_election.cc:336] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.204s (SENT)
W20260709 13:08:49.659982 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.660400 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.661172 21762 raft_consensus.cc:2468] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:49.662272 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.663110 21763 raft_consensus.cc:2468] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:49.645035 24650 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:49.665496 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.665782 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:49.663365 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.653644 24630 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:49.664494 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.670239 21756 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:49.668445 21763 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:49.665526 21757 raft_consensus.cc:1275] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:49.664758 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.665462 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.665645 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.671819 21760 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:49.653393 24702 consensus_queue.cc:1059] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:08:49.668959 21759 raft_consensus.cc:2410] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:08:49.644507 24405 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:49.670372 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:49.651664 24470 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:49.678048 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.678753 21765 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:49.678043 21909 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:49.679577 24470 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:49.675091 21758 raft_consensus.cc:2376] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6. Re-sending same reply.
I20260709 13:08:49.681777 22481 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:08:49.682145 22481 pending_rounds.cc:85] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: Aborting all ops after (but not including) 5
I20260709 13:08:49.682364 22481 pending_rounds.cc:107] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:08:49.662644 24585 consensus_queue.cc:1059] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:08:49.683633 24583 raft_consensus.cc:3055] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:49.684168 24583 raft_consensus.cc:740] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:49.685339 24583 consensus_queue.cc:260] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:49.682600 22481 raft_consensus.cc:2889] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:49.686861 24583 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:49.689393 24702 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:49.690196 24586 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:49.711301 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.711989 21758 raft_consensus.cc:2376] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8. Re-sending same reply.
I20260709 13:08:49.679647 24655 raft_consensus.cc:3055] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:49.720682 24655 raft_consensus.cc:740] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:49.726619 24586 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:49.726955 24655 consensus_queue.cc:260] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:49.728276 24655 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:49.729367 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:49.729667 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.730048 21909 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:49.730291 21758 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:49.729386 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:49.732507 21765 raft_consensus.cc:2376] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8. Re-sending same reply.
W20260709 13:08:49.734570 22450 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 3.105s (SENT) [suppressed 46 similar messages]
I20260709 13:08:49.736835 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.740015 21909 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:08:49.741317 22449 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:49.701862 24405 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:49.745723 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.746501 21765 raft_consensus.cc:2410] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:08:49.746685 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.751672 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.752272 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.753098 21758 raft_consensus.cc:2410] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:49.753142 21765 raft_consensus.cc:2410] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:49.745601 24635 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:49.760135 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:49.717592 24267 consensus_queue.cc:237] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:49.767305 21765 raft_consensus.cc:1275] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:49.762167 24635 raft_consensus.cc:697] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:49.775492 21762 raft_consensus.cc:2410] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:49.776671 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:49.777004 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:49.785172 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.785653 21839 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:08:49.785547 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.787317 21758 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:08:49.786397 21765 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:49.803517 24649 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:49.803244 24630 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:49.806147 24635 consensus_queue.cc:237] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:49.779121 24405 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:49.810986 24611 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:49.811296 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:49.812126 21760 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:49.818184 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:49.823031 21760 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:49.826315 21765 raft_consensus.cc:1240] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:49.827911 24630 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:49.828814 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:49.832334 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.833001 21760 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:49.844259 24446 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:49.845769 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:49.846050 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.846835 21765 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 3.
I20260709 13:08:49.856887 21905 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:08:49.860597 21879 leader_election.cc:336] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.199s (SENT)
W20260709 13:08:49.862691 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 219625us
I20260709 13:08:49.863734 24546 raft_consensus.cc:3055] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:49.864108 24546 raft_consensus.cc:740] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:49.866003 21877 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:49.867368 21877 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:49.868638 21877 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:49.869407 24619 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:49.870086 24619 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:08:49.870569 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 252124us
I20260709 13:08:49.870841 24629 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:49.871445 24629 raft_consensus.cc:697] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:49.872012 22479 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:08:49.872294 24629 consensus_queue.cc:237] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:49.864956 24546 consensus_queue.cc:260] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:49.874390 24546 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:49.874811 24625 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:49.875597 24625 raft_consensus.cc:697] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:49.877069 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:49.879052 24406 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:49.880687 24406 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:49.881830 24544 raft_consensus.cc:476] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Not starting pre-election -- already a leader
W20260709 13:08:49.884418 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:49.888043 24601 consensus_queue.cc:1059] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:49.888674 24549 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:49.888893 24601 consensus_queue.cc:1243] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer 8c6c2207af3d47b3acf352d81959f4dd log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:08:49.889685 24418 raft_consensus.cc:3055] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:49.890038 24418 raft_consensus.cc:740] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:49.890796 24418 consensus_queue.cc:260] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:49.870615 24619 consensus_queue.cc:1059] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:08:49.892354 24619 raft_consensus.cc:3055] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:49.892700 24619 raft_consensus.cc:740] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:49.888077 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:49.894065 21836 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:49.893697 24619 consensus_queue.cc:260] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:49.894819 24619 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.873364 21804 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:49.897743 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.898036 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.898407 21765 raft_consensus.cc:2468] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:49.899238 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.899398 24580 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:49.900005 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.899422 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.900997 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.901584 21761 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:49.900027 24580 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:49.902217 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.902383 24580 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:49.902796 21756 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:49.903667 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.904182 21756 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:08:49.904892 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.900389 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:49.905864 21763 raft_consensus.cc:2410] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:49.905874 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:49.918867 21760 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:49.906157 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.922145 21758 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:49.923346 21877 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:49.906327 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.925156 21762 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:49.907182 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.927621 21761 raft_consensus.cc:2410] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:08:49.928589 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:49.929195 21758 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:08:49.925877 24583 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:49.907918 21757 raft_consensus.cc:2410] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:08:49.912007 24418 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:49.905395 21756 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
W20260709 13:08:49.944088 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 56598.4us
I20260709 13:08:49.898625 21804 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:49.947803 21836 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
W20260709 13:08:49.949707 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 76407.9us
I20260709 13:08:49.876744 24625 consensus_queue.cc:237] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:49.950858 21757 raft_consensus.cc:1275] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:49.951671 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:49.952442 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 53917.3us
I20260709 13:08:49.952805 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:49.963732 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:49.962977 24536 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:08:49.966686 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:49.972887 21760 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:08:49.956835 21758 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:49.991127 21877 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:49.992357 24550 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:49.992882 24550 raft_consensus.cc:697] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:49.993685 24550 consensus_queue.cc:237] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:50.000869 21758 raft_consensus.cc:1240] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:08:50.003667 21765 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:08:50.014686 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:50.015615 21839 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
W20260709 13:08:50.009348 22450 leader_election.cc:336] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.572s (SENT)
I20260709 13:08:50.019071 22450 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:49.958030 24601 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:50.020908 24611 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:08:50.024245 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:50.023676 21765 raft_consensus.cc:1240] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:50.032016 21760 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:50.026751 24617 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:50.044564 21763 raft_consensus.cc:2410] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:08:50.044359 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:50.045624 21836 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:50.020901 21756 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:50.051775 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:50.056195 21756 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:50.058763 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:50.063468 21760 raft_consensus.cc:2410] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:08:50.059036 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:50.067543 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:50.068631 21758 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:50.070267 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:50.070297 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:50.073180 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:50.086125 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:50.088963 21660 catalog_manager.cc:5697] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 4 to 5, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 5 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.114202 21660 catalog_manager.cc:5697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 2 to 7, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 7 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:50.116487 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:50.115777 21660 catalog_manager.cc:5697] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 5 to 6, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 6 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:50.117851 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:50.144538 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.141820 21660 catalog_manager.cc:5697] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:50.153684 21758 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:08:50.156358 21909 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:50.157817 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:50.158602 21838 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:08:50.139601 24655 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.159276 21838 raft_consensus.cc:606] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:50.159811 21838 raft_consensus.cc:614] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:50.159778 24655 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:50.162388 24655 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:50.162494 21758 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:08:50.164639 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:50.165325 21760 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:08:50.166213 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:50.166317 21831 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:08:50.112998 24406 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.170567 22448 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:50.144546 24629 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:50.281611 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 398435us
I20260709 13:08:50.239274 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:50.242002 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:50.238273 21910 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 13:08:50.242389 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:50.284078 21831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:08:50.283187 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:50.241595 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:50.290839 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:50.291493 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.289544 21913 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
W20260709 13:08:50.261288 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.292394 21831 raft_consensus.cc:606] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
W20260709 13:08:50.242408 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.233227 21909 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:50.297540 21836 raft_consensus.cc:1275] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:50.228484 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:50.263985 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:50.276638 21661 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45762 (request call id 242) took 14037 ms (client timeout 15000 ms). Trace:
W20260709 13:08:50.341728 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.251178 21765 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:50.230721 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:50.149916 21660 catalog_manager.cc:5697] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:50.337116 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:50.348042 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:08:50.349015 24717 log.cc:927] Time spent T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:08:50.349625 21907 raft_consensus.cc:1240] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:08:50.340112 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:50.350335 21905 raft_consensus.cc:1240] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:08:50.345842 21660 catalog_manager.cc:5697] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 5 to 8, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 8 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:50.297084 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 126592us
W20260709 13:08:50.295403 24712 log.cc:927] Time spent T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:08:50.177846 21832 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:08:50.295401 24715 log.cc:927] Time spent T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:08:50.354251 21879 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:50.337049 21756 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:08:50.354231 21660 catalog_manager.cc:5697] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:50.355773 22448 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:50.358584 21907 raft_consensus.cc:1275] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:08:50.361832 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.295827 24629 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:50.342146 21661 rpcz_store.cc:269] 0709 13:08:36.245798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:36.251761 (+  5963us) service_pool.cc:224] Handling call
0709 13:08:50.276521 (+14024760us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:48.914999 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:49.119148 (+204149us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:49.141478 (+ 22330us) write_op.cc:435] Acquired schema lock
0709 13:08:49.141502 (+    24us) tablet.cc:662] Decoding operations
0709 13:08:49.143346 (+  1844us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:49.143426 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:49.143474 (+    48us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:08:49.145272 (+  1798us) tablet.cc:701] Row locks acquired
0709 13:08:49.145296 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:08:49.152201 (+  6905us) write_op.cc:270] Start()
0709 13:08:49.158267 (+  6066us) write_op.cc:276] Timestamp: P: 1783602529150142 usec, L: 0
0709 13:08:49.158291 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:08:49.170991 (+ 12700us) log.cc:844] Serialized 6232 byte log entry
0709 13:08:49.418314 (+247323us) op_driver.cc:464] REPLICATION: finished
0709 13:08:49.641607 (+223293us) write_op.cc:301] APPLY: starting
0709 13:08:49.641699 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:49.667802 (+ 26103us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:49.669964 (+  2162us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:49.681203 (+ 11239us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:49.681480 (+   277us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 13:08:49.681531 (+    51us) write_op.cc:312] APPLY: finished
0709 13:08:49.681839 (+   308us) log.cc:844] Serialized 113 byte log entry
0709 13:08:49.681996 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:49.682163 (+   167us) write_op.cc:454] Released schema lock
0709 13:08:49.682217 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:49.725478 (+ 43261us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:49.725517 (+    39us) write_op.cc:454] Released schema lock
0709 13:08:49.829147 (+103630us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b54002ae254. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35432a 00007fc6ae2d9f14 00007fc6ae2d9ec3 00007fc6ae2d9e38 00007fc6ae2d9df3 00007fc6ae2d90dc 00007fc6ae302e16 00007fc6ae2eacbb 00007fc6ae2d539d 00007fc6ae2d8d75
Metrics: {"mutex_wait_us":58539,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":221372,"apply.run_cpu_time_us":4347,"apply.run_wall_time_us":67887,"num_ops":16,"prepare.queue_time_us":680165,"prepare.run_cpu_time_us":20625,"prepare.run_wall_time_us":321990,"raft.queue_time_us":70813,"raft.run_cpu_time_us":72242,"raft.run_wall_time_us":470647,"replication_time_us":236985,"spinlock_wait_cycles":33188736,"thread_start_us":629320,"threads_started":4,"wal-append.queue_time_us":74703}]]}
I20260709 13:08:50.365373 24630 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:08:50.352591 24583 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.340435 24635 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:50.393607 21660 catalog_manager.cc:5697] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 2 to 5, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 5 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:50.397730 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:50.398648 21832 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:50.339196 24406 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:50.400806 21660 catalog_manager.cc:5697] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 1 to 4, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 4 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:50.402786 21908 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:50.444227 21660 catalog_manager.cc:5697] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.446700 21660 catalog_manager.cc:5697] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:08:50.449877 21660 catalog_manager.cc:5697] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 1 to 5, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 5 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:50.453346 21660 catalog_manager.cc:5697] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
W20260709 13:08:50.442788 24710 log.cc:927] Time spent T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:50.478624 21660 catalog_manager.cc:5697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 2 to 4, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 4 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:50.390635 24635 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.403477 24617 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:50.483373 21835 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:50.449568 24649 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:08:50.393369 24583 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:50.486334 24635 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:50.506543 24713 log.cc:927] Time spent T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.475s	user 0.004s	sys 0.000s
I20260709 13:08:50.393569 24680 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:08:50.385357 24580 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:50.517983 21761 raft_consensus.cc:1217] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Deduplicated request from leader. Original: 4.5->[5.6-5.6]   Dedup: 5.6->[]
I20260709 13:08:50.518548 21761 raft_consensus.cc:1240] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:08:50.519404 21660 catalog_manager.cc:5697] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 3 to 4, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 4 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.522881 21660 catalog_manager.cc:5697] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 6 to 8, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 8 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:50.524494 21660 catalog_manager.cc:5697] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 2 to 6, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 6 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:50.527565 21660 catalog_manager.cc:5697] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 5 to 7, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 7 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:50.530968 21660 catalog_manager.cc:5697] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 5 to 8, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 8 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.534191 21660 catalog_manager.cc:5697] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:50.536931 21660 catalog_manager.cc:5697] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 3 to 4, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 4 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.487205 24550 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:50.484575 24617 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:50.495584 21910 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:50.540297 21660 catalog_manager.cc:5697] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 1 to 5, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 5 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:50.487475 21908 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
W20260709 13:08:50.539321 24712 log.cc:927] Time spent T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:08:50.489233 24718 log.cc:927] Time spent T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:08:50.494506 24418 consensus_meta.cc:287] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.000s
W20260709 13:08:50.556646 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:50.557202 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.495249 24583 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:50.492336 24629 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:50.558228 21839 raft_consensus.cc:2410] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:08:50.541749 24617 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:50.500890 24406 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:50.553964 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 199774us
W20260709 13:08:50.558677 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 202961us
I20260709 13:08:50.568624 22448 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:50.570116 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:50.570829 21836 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:50.495814 24655 consensus_queue.cc:1048] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:08:50.546942 24536 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:08:50.576558 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:50.578279 21832 raft_consensus.cc:2393] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 7: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:50.579953 21879 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:50.581384 21879 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:50.582051 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 177114us
I20260709 13:08:50.582751 21879 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:50.584666 21879 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:50.591954 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 220174us
I20260709 13:08:50.597478 21879 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:50.600162 24619 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:50.602285 21879 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:50.602088 24585 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:50.603133 21877 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:50.600929 24619 consensus_queue.cc:1048] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
W20260709 13:08:50.645653 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 250266us
W20260709 13:08:50.649322 24724 log.cc:927] Time spent T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:08:50.664327 24536 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:50.667263 21909 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:50.656359 24583 raft_consensus.cc:2804] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:50.660648 24730 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:50.635914 24580 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:50.633931 24728 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:50.761957 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.712426 24730 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.714231 24728 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:50.778702 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 207850us
I20260709 13:08:50.715298 24583 raft_consensus.cc:697] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:08:50.787614 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 403039us
I20260709 13:08:50.788347 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:50.789011 21764 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:50.791185 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:50.791882 21764 raft_consensus.cc:2393] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 7: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:50.777258 24730 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:50.802626 21756 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:08:50.803090 21756 pending_rounds.cc:85] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 2
I20260709 13:08:50.803337 21756 pending_rounds.cc:107] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:08:50.803543 21756 raft_consensus.cc:2889] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:50.808776 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:50.811708 24725 log.cc:927] Time spent T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.410s	user 0.000s	sys 0.011s
I20260709 13:08:50.813019 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:50.813372 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:50.780138 24728 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:50.818691 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:50.851878 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:50.854782 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:50.855850 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:50.856382 21764 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:50.819269 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:50.822736 21762 raft_consensus.cc:1240] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 8. Ops: [6.5-6.5]
I20260709 13:08:50.859462 21757 raft_consensus.cc:1275] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:08:50.860764 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:50.862357 21757 raft_consensus.cc:2410] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:50.864531 21728 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:50.865396 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:50.865449 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 282689us
I20260709 13:08:50.867970 22450 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:50.866611 21759 raft_consensus.cc:2410] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:08:50.870546 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:50.871853 21910 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:50.877051 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:50.878223 21762 raft_consensus.cc:2393] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 5: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:50.884231 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:50.857744 24619 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.896489 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:50.889358 21756 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:50.814356 24550 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:50.913932 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:50.915349 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.916550 21764 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:50.928467 21764 raft_consensus.cc:1240] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: [3.5-6.6]
I20260709 13:08:50.926381 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:50.932821 21762 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:50.933746 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:50.936760 21757 raft_consensus.cc:2393] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 5: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
W20260709 13:08:50.934351 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 265009us
I20260709 13:08:50.903143 24418 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:50.960472 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 357415us
I20260709 13:08:50.959789 21762 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:50.933290 24737 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:50.922269 24635 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:50.922996 24619 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:50.882792 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 280579us
W20260709 13:08:50.918413 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 268272us
I20260709 13:08:50.923686 21839 raft_consensus.cc:1240] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:50.930116 21760 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:50.932374 24583 consensus_queue.cc:237] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:50.913697 24670 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:08:50.972882 21760 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:50.971987 21762 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:50.979910 21762 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:50.917819 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:50.981068 21756 raft_consensus.cc:2393] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:08:50.988893 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:50.992219 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:50.994791 21908 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:50.998551 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:51.008246 21908 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:50.949811 24485 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:08:50.964167 24737 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:50.949002 24418 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:50.963971 24739 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:51.011528 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 225955us
I20260709 13:08:51.016202 24617 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.004593 24267 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:51.017691 24405 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.021595 24546 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:50.983783 24729 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:51.018220 24720 log.cc:927] Time spent T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:51.060177 24267 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.059993 24405 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:51.061193 24546 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:51.062266 24635 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:51.049901 24742 consensus_queue.cc:1059] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:08:51.052158 24739 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.063328 24485 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:51.046737 24737 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:51.033036 24738 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:51.071957 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 207506us
W20260709 13:08:51.075925 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 207167us
I20260709 13:08:51.076653 22450 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:51.093995 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.110206 21910 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:51.142396 22481 raft_consensus.cc:1240] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5. Ops: []
W20260709 13:08:51.150103 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:51.153568 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 169277us
I20260709 13:08:51.079566 24738 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:51.067307 24729 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:51.103806 24655 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
W20260709 13:08:51.165663 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.167536 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:51.169203 24611 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.169921 24611 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:51.156005 24738 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:51.180720 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:51.182965 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:51.199393 21839 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:51.200407 21729 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:51.247193 24751 log.cc:927] Time spent T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:08:51.174558 24680 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.160771 24727 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:51.179158 24736 consensus_queue.cc:1059] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
W20260709 13:08:51.293612 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 93508.8us
W20260709 13:08:51.296296 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 219706us
I20260709 13:08:51.310484 21836 raft_consensus.cc:1275] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:51.310550 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:51.322219 21840 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:08:51.323405 21729 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:51.315570 24752 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:51.331709 24726 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:51.333969 22450 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:51.335291 21804 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:51.341097 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 373506us
I20260709 13:08:51.342219 21879 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:51.351517 21840 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:08:51.358261 21879 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:51.359437 21879 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:51.361107 21879 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:51.361930 22450 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:51.362654 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.334832 24485 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.339535 24729 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:51.377079 21805 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:51.336258 24731 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:51.364143 22450 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:51.381388 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:51.328017 24680 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.356386 24754 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.389081 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:51.389816 21837 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:51.390338 21805 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:51.386153 24732 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:51.379782 24629 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:51.382887 24742 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:51.366582 24418 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:51.378854 24617 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:51.365813 24763 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:51.353214 24614 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:08:51.332499 24727 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.387003 24670 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:51.409742 24546 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:51.431480 24742 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:51.394358 24764 raft_consensus.cc:2804] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:51.407074 24729 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:51.438645 24625 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:08:51.438427 24732 raft_consensus.cc:697] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:51.426051 24267 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:51.433745 24405 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:51.434106 24763 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:51.439752 24750 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:51.387768 24485 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.481123 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1182) took 1243 ms. Trace:
W20260709 13:08:51.483588 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 160407us
I20260709 13:08:51.489279 21729 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:51.490767 21729 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:51.492146 21729 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:51.445026 24742 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:51.488075 21906 rpcz_store.cc:276] 0709 13:08:50.238284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.338880 (+100596us) service_pool.cc:224] Handling call
0709 13:08:50.339151 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:50.638550 (+299399us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:50.641677 (+  3127us) log.cc:844] Serialized 14 byte log entry
0709 13:08:51.308517 (+666840us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:51.322691 (+ 14174us) log.cc:844] Serialized 26 byte log entry
0709 13:08:51.322828 (+   137us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:51.322865 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.322935 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:51.480839 (+157904us) raft_consensus.cc:1685] finished
0709 13:08:51.480866 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:51.481042 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20614,"prepare.queue_time_us":2887,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":137232,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":27397,"thread_start_us":799790,"threads_started":3,"wal-append.queue_time_us":363318}
I20260709 13:08:51.482826 24546 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:51.480125 24778 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:51.479876 24766 log.cc:927] Time spent T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:08:51.444437 24764 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:51.453241 24739 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:51.511489 24728 consensus_meta.cc:287] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.004s
I20260709 13:08:51.516377 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:51.530133 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.410246 24754 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:51.482684 24763 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:51.498245 24670 raft_consensus.cc:697] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:51.506846 24750 raft_consensus.cc:697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
W20260709 13:08:51.583141 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 91067.4us
I20260709 13:08:51.583978 21839 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:08:51.513491 24764 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:51.583947 21729 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:51.577436 24730 consensus_meta.cc:287] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.762s	user 0.009s	sys 0.004s
I20260709 13:08:51.513711 24756 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:51.529646 24778 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.591760 24750 consensus_queue.cc:237] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:51.601646 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:51.607053 21805 leader_election.cc:336] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.055s (SENT)
I20260709 13:08:51.609305 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:51.568111 24728 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:51.620702 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.600116 24778 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.625077 24680 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:51.628880 21837 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:08:51.629383 21837 pending_rounds.cc:85] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 8
I20260709 13:08:51.629698 21837 pending_rounds.cc:107] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:08:51.629988 21837 raft_consensus.cc:2889] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:51.583089 24737 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:51.598776 24730 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:51.633526 24755 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:51.640117 24755 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:51.640614 24770 log.cc:927] Time spent T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:08:51.636050 24670 consensus_queue.cc:237] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:51.642904 24727 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:51.644992 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:51.645576 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 317) took 1687 ms. Trace:
I20260709 13:08:51.646445 24754 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:51.649667 24785 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:51.650422 24785 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:51.650554 24446 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:51.651036 24785 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:51.651100 24446 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:51.652697 24758 log.cc:927] Time spent T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.328s	user 0.000s	sys 0.002s
I20260709 13:08:51.654906 24601 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:51.600061 24756 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:51.655499 24601 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.656517 24702 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.657090 24756 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:51.593700 24732 consensus_queue.cc:237] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.657022 24702 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:51.659134 24702 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:51.655158 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:51.634040 24680 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:51.660804 24680 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.661369 24614 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:51.662492 24611 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:51.662848 24680 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:51.663400 21839 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:08:51.664074 24619 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:51.664255 24738 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.665362 24737 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:51.666424 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:51.667881 22481 raft_consensus.cc:1240] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:51.641160 24485 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:51.666445 22482 raft_consensus.cc:1240] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:51.669272 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:51.671813 24757 log.cc:927] Time spent T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.253s	user 0.001s	sys 0.001s
I20260709 13:08:51.645996 21761 rpcz_store.cc:276] 0709 13:08:49.958229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.964880 (+  6651us) service_pool.cc:224] Handling call
0709 13:08:49.965177 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:50.517909 (+552732us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b5400309ba0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae2cedc0 00007fc6ae3591c0 00007fc6ae35a231 00007fc6ae356d8f 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c
0709 13:08:50.518881 (+   972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.294456 (+775575us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b5400309ba0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae2cedc0 00007fc6ae35aa02 00007fc6ae356dd6 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2
0709 13:08:51.645311 (+350855us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b54003da254. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:51.645511 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":822849024}
I20260709 13:08:51.673516 21913 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 7: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:51.673810 24730 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:51.638870 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:51.677536 22448 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:51.663636 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:51.640569 24755 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:51.653241 24446 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:51.688313 24702 consensus_queue.cc:1059] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:51.679683 22483 raft_consensus.cc:2393] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 7: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:51.690948 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:51.691497 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:51.688625 24601 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:51.691596 21910 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:51.692684 21908 raft_consensus.cc:2410] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:51.686954 22448 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:51.704031 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:51.704383 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:51.705075 21838 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:51.725263 21910 raft_consensus.cc:1240] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:51.702302 21731 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:51.739755 21838 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:08:51.741935 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:51.746502 21839 raft_consensus.cc:2393] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:08:51.748986 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.753683 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:51.702587 24485 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:51.760161 21728 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:51.754501 21905 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
I20260709 13:08:51.734275 24536 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:51.759454 21804 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:51.750984 24761 log.cc:927] Time spent T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:08:51.743227 24785 raft_consensus.cc:3055] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:51.688957 24734 consensus_queue.cc:1059] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:08:51.703164 24754 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:08:51.690923 24753 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 13:08:51.725246 24742 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.755276 24730 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:51.799974 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:51.787261 24786 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:51.752163 24702 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:08:51.787559 24788 log.cc:927] Time spent T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
I20260709 13:08:51.797322 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:51.804663 21711 auto_rebalancer.cc:629] Failed to schedule move for tablet f5bb431cadec4a5d9440b6c8743b7b47: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:08:51.792248 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:51.793627 21835 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:51.797806 21804 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:51.802654 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:51.782071 24536 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.800781 21833 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:08:51.807744 21838 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:51.786090 24785 raft_consensus.cc:740] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:51.791801 24418 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:51.796931 24581 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:51.796166 24485 raft_consensus.cc:697] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:51.825881 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:51.831429 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 247541us
I20260709 13:08:51.817104 24536 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:51.832599 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:51.870471 21839 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:51.829823 24728 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:51.830005 24777 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:51.832187 24418 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.872808 24777 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:51.878232 24777 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:51.795852 24773 consensus_queue.cc:1059] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:08:51.828816 24581 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:51.857157 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.816684 24786 raft_consensus.cc:697] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:51.802561 24791 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 13:08:51.884042 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 50706.5us
I20260709 13:08:51.831776 24446 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.805264 24730 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.869257 24635 raft_consensus.cc:3055] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:51.887631 24581 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:51.892823 24446 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:51.924415 24755 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:51.925509 24635 raft_consensus.cc:740] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:51.926461 24446 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:51.886279 24764 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.926608 24635 consensus_queue.cc:260] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.927690 24635 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:51.928633 24764 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:51.904915 24777 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:51.897954 24727 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:51.931072 24727 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.932090 24777 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:51.934283 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:51.934429 24763 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.934850 24536 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.936208 24727 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:51.898785 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:51.937386 24536 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:51.883469 24732 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:51.938001 24786 consensus_queue.cc:237] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:51.939095 24732 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.940868 24732 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:51.941556 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:51.895273 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:51.929944 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:08:51.958966 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 71874.5us
W20260709 13:08:51.922732 24761 log.cc:927] Time spent T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:08:51.960144 21729 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:52.015504 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 55497.5us
I20260709 13:08:51.945256 24763 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:51.921651 24742 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:51.894860 24730 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:51.889168 24737 consensus_queue.cc:1059] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.118s
I20260709 13:08:51.894474 24778 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:52.020426 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:51.921906 24738 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:51.840651 24485 consensus_queue.cc:237] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:51.954789 24734 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:51.954886 24702 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:08:51.960110 24583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.030s	sys 0.032s
W20260709 13:08:52.006954 24736 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.007s	sys 0.016s
I20260709 13:08:51.960026 24796 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:52.051815 24764 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.053332 21909 raft_consensus.cc:1240] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:52.054183 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:52.055377 24630 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.061920 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:52.076623 21912 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:52.064132 21910 raft_consensus.cc:1240] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:52.064839 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1727) took 1164 ms. Trace:
I20260709 13:08:52.082820 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:52.084360 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:52.085031 21909 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:52.086076 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:52.034626 24680 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:52.068938 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:52.096352 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:52.070976 24583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.033s	sys 0.042s
I20260709 13:08:52.097892 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:52.099300 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:52.061170 24737 consensus_queue.cc:1243] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer 6d698a5544b946939790e7a3972db9fb log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:08:52.073450 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:51.922511 24785 consensus_queue.cc:260] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:52.065348 24754 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:08:52.078007 21832 rpcz_store.cc:276] 0709 13:08:50.900104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.900231 (+   127us) service_pool.cc:224] Handling call
0709 13:08:50.917446 (+ 17215us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:50.923413 (+  5967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.923444 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:50.934247 (+ 10803us) log.cc:844] Serialized 52 byte log entry
0709 13:08:51.293303 (+359056us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:51.570078 (+276775us) log.cc:844] Serialized 14 byte log entry
0709 13:08:51.757060 (+186982us) log.cc:844] Serialized 14 byte log entry
0709 13:08:51.781579 (+ 24519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.781683 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.064551 (+282868us) raft_consensus.cc:1685] finished
0709 13:08:52.064580 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.064765 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32317,"prepare.queue_time_us":317905,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":2389,"raft.queue_time_us":79793,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":10969,"spinlock_wait_cycles":39377024,"thread_start_us":731894,"threads_started":3,"wal-append.queue_time_us":716922}
W20260709 13:08:52.107864 21879 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.011s	sys 0.013s
I20260709 13:08:52.091369 21910 raft_consensus.cc:1275] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:08:52.108273 21879 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.011s	sys 0.013s
I20260709 13:08:52.014782 24753 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.092824 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:52.073737 24736 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.008s	sys 0.021s
I20260709 13:08:52.106171 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:52.115794 22449 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:52.109894 21905 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:08:52.116561 21907 raft_consensus.cc:2410] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:52.071307 24728 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:52.108829 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 747759us
I20260709 13:08:52.072046 24702 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:52.155382 24702 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:52.157140 24702 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:52.157611 24803 log.cc:927] Time spent T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:08:52.095809 24630 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:52.159152 21912 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:52.158116 24702 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:52.160151 24630 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:52.072181 24734 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:52.171849 24734 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:52.119994 24753 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:52.175118 24735 consensus_queue.cc:1059] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:08:52.176347 24753 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:52.178237 24755 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:52.109144 24792 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
W20260709 13:08:52.180625 24760 log.cc:927] Time spent T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.572s	user 0.000s	sys 0.002s
I20260709 13:08:52.151305 24446 consensus_queue.cc:1059] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:08:52.165237 24731 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:52.162560 24752 raft_consensus.cc:2804] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:52.182164 24794 raft_consensus.cc:3055] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:52.182454 24752 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.182610 24794 raft_consensus.cc:740] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:52.183029 24752 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:52.183563 24794 consensus_queue.cc:260] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:52.184870 24794 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:52.188570 24759 log.cc:927] Time spent T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.747s	user 0.001s	sys 0.001s
I20260709 13:08:52.192698 24702 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:52.173312 24581 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:52.198474 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 379872us
W20260709 13:08:52.152987 24757 log.cc:927] Time spent T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:52.114729 24730 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:52.207176 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1171) took 1388 ms. Trace:
I20260709 13:08:52.167779 21879 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:52.211433 21909 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:08:52.096396 24764 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:52.222824 21833 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:52.223184 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:52.202977 21877 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:52.222047 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:52.230177 21837 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:52.230597 21877 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:52.163470 24761 log.cc:927] Time spent T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:08:52.225569 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 61353.8us
I20260709 13:08:52.121500 24726 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:52.224390 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 44910.3us
W20260709 13:08:52.250996 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.224390 21765 rpcz_store.cc:276] 0709 13:08:50.819218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.823283 (+  4065us) service_pool.cc:224] Handling call
0709 13:08:50.823672 (+   389us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:50.853758 (+ 30086us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:50.853791 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:50.861748 (+  7957us) log.cc:844] Serialized 52 byte log entry
0709 13:08:51.147217 (+285469us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:51.175521 (+ 28304us) log.cc:844] Serialized 14 byte log entry
0709 13:08:51.671275 (+495754us) spinlock_profiling.cc:243] Waited 7.16 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:52.067295 (+396020us) spinlock_profiling.cc:243] Waited 61.3 ms on lock 0x7b1800125bc0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab1e4c0a 00007fc6b4924219 00007fc6ab26ca40 00007fc6ab2674e4 00007fc6ab267455 00007fc6b1d4f3c7 00007fc6ae3619a7 00007fc6ae3710bf 00007fc6ae371038
0709 13:08:52.067585 (+   290us) log.cc:844] Serialized 14 byte log entry
0709 13:08:52.206887 (+139302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.206955 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.206995 (+    40us) raft_consensus.cc:1685] finished
0709 13:08:52.207006 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.207124 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":830931,"prepare.queue_time_us":976048,"prepare.run_cpu_time_us":1848,"prepare.run_wall_time_us":19979,"raft.queue_time_us":272508,"raft.run_cpu_time_us":847,"raft.run_wall_time_us":68872,"spinlock_wait_cycles":157410560,"thread_start_us":351105,"threads_started":2,"wal-append.queue_time_us":446688}
I20260709 13:08:52.256907 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:52.091473 24796 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:52.258536 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:52.221853 24763 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.258515 21879 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:52.162745 24750 consensus_queue.cc:1059] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:08:52.268132 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:52.268278 21913 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:52.269531 21879 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:52.231858 24744 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:52.224067 24742 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:52.227626 24728 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:52.231520 24730 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:52.262506 24727 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:08:52.324152 24755 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:08:52.327678 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.257987 24625 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:52.365584 24755 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:52.259146 24791 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:52.330829 24818 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:08:52.355650 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 104212us
W20260709 13:08:52.327934 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 102077us
I20260709 13:08:52.368260 24818 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:52.285791 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:52.369071 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:52.299474 24702 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.370427 24818 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:52.280527 24630 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:52.324398 24753 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.336658 24752 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:52.332496 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.299228 24734 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:52.324576 24736 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:52.280241 21837 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:52.324647 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:52.286116 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:52.370124 24702 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:52.371560 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:52.262185 24583 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:52.422264 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1173) took 1596 ms. Trace:
I20260709 13:08:52.424513 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:52.425074 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:52.427325 21764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1176) took 1600 ms. Trace:
I20260709 13:08:52.436199 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:52.444906 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:08:52.372851 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 103454us
I20260709 13:08:52.291018 21833 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:52.693063 21907 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.271669 24267 raft_consensus.cc:3055] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:52.379833 21805 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:52.591846 21759 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:52.592262 21756 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
W20260709 13:08:52.696069 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 316308us
I20260709 13:08:52.372779 24734 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:52.696619 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:52.692734 21831 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:52.592718 21729 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:52.260082 24726 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:52.477849 24791 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.280977 24744 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:52.396319 24730 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:52.300077 24748 raft_consensus.cc:3055] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:52.376971 24796 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:52.367882 24755 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:52.371884 24753 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:52.421640 24818 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:52.632445 24702 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:52.372373 24630 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:52.324743 24792 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.394934 24728 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:52.379345 24731 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:52.640803 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 359531us
I20260709 13:08:52.366724 24727 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:52.657886 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:52.621899 24779 log.cc:927] Time spent T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
W20260709 13:08:52.641346 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 203173us
I20260709 13:08:52.684819 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:52.497910 21757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1186) took 1655 ms. Trace:
I20260709 13:08:52.452637 22481 raft_consensus.cc:1240] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:08:52.693310 21879 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:52.697260 21756 raft_consensus.cc:2376] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8. Re-sending same reply.
W20260709 13:08:52.611373 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.692354 21764 rpcz_store.cc:276] 0709 13:08:50.827002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.931367 (+104365us) service_pool.cc:224] Handling call
0709 13:08:50.931630 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:50.932159 (+   529us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:50.949999 (+ 17840us) log.cc:844] Serialized 14 byte log entry
0709 13:08:51.176668 (+226669us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:51.185289 (+  8621us) log.cc:844] Serialized 26 byte log entry
0709 13:08:51.198439 (+ 13150us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:51.329154 (+130715us) log.cc:844] Serialized 14 byte log entry
0709 13:08:51.338524 (+  9370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:51.338614 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:51.641003 (+302389us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b180001bd00. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab26a3f3 00007fc6ab26c7c1 00007fc6ab26c779 00007fc6ab26c709 00007fc6ab26c6d1 00007fc6ab26b9cd 000000000038f354 000000000038f199 00007fc6ab24d83a
0709 13:08:52.180142 (+539139us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:52.427081 (+246939us) raft_consensus.cc:1685] finished
0709 13:08:52.427108 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.427257 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33413,"prepare.queue_time_us":930344,"prepare.run_cpu_time_us":133,"prepare.run_wall_time_us":32681,"raft.queue_time_us":225007,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":210,"spinlock_wait_cycles":18712576,"thread_start_us":345696,"threads_started":2,"wal-append.queue_time_us":644813}
I20260709 13:08:52.770885 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:52.771047 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:52.771447 21756 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.771703 21764 raft_consensus.cc:2393] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 7: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:52.772553 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:52.511821 24816 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:52.702225 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 251322us
I20260709 13:08:52.270782 24763 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:52.366353 24625 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:52.782032 21835 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:08:52.690781 21763 rpcz_store.cc:276] 0709 13:08:50.826119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.826282 (+   163us) service_pool.cc:224] Handling call
0709 13:08:50.880586 (+ 54304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:51.074065 (+193479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.074110 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:51.074547 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:08:51.336212 (+261665us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:52.383417 (+1047205us) log.cc:844] Serialized 14 byte log entry
0709 13:08:52.421943 (+ 38526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.422030 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.422075 (+    45us) raft_consensus.cc:1685] finished
0709 13:08:52.422085 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.422209 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":773398,"prepare.queue_time_us":821731,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":37,"raft.queue_time_us":133226,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":92098,"thread_start_us":623280,"threads_started":3,"wal-append.queue_time_us":304189}
I20260709 13:08:52.784193 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:52.707085 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:52.710904 21806 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:52.785149 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:52.785789 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 74948.4us
W20260709 13:08:52.713225 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 173046us
I20260709 13:08:52.787444 21729 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:52.373009 24742 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:52.714668 21908 raft_consensus.cc:1275] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:08:52.714967 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.783092 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:52.514338 24485 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.154s
I20260709 13:08:52.674346 24581 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:52.692720 24583 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:52.739574 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:52.374918 24764 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:52.716802 21715 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.370s	user 0.020s	sys 0.033s
I20260709 13:08:52.712632 24791 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:52.695400 24267 raft_consensus.cc:740] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:08:52.752710 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.869163 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:52.869923 21763 raft_consensus.cc:2376] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6. Re-sending same reply.
I20260709 13:08:52.761212 21759 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:08:52.717585 24549 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:52.712877 24744 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.713192 24748 raft_consensus.cc:740] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:52.891152 24748 consensus_queue.cc:260] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:52.892243 24748 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.767112 21832 raft_consensus.cc:2393] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 6: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:52.773165 21764 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:52.738291 24795 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
W20260709 13:08:52.777686 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 84448.9us
I20260709 13:08:52.736295 24796 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:52.749140 24630 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:52.783571 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:52.373044 24736 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:52.738119 24819 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.817927 21729 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:52.740803 24777 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:08:52.769708 21757 rpcz_store.cc:276] 0709 13:08:50.842796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.947337 (+104541us) service_pool.cc:224] Handling call
0709 13:08:50.947699 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:50.948081 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:08:51.031879 (+ 83798us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b4800002958. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b3280aa1 00007fc6b3277b37 00007fc6b32779ca 00007fc6b336f26f 00007fc6b336ef37 00007fc6b338355c 00007fc6b3383508 00007fc6b3383488 00007fc6b3383443 00007fc6b33826ec 00007fc6b22aca96
0709 13:08:51.293980 (+262101us) log.cc:844] Serialized 14 byte log entry
0709 13:08:51.421617 (+127637us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:51.422265 (+   648us) log.cc:844] Serialized 26 byte log entry
0709 13:08:51.422427 (+   162us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:52.386753 (+964326us) log.cc:844] Serialized 14 byte log entry
0709 13:08:52.435251 (+ 48498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.435350 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.497636 (+ 62286us) raft_consensus.cc:1685] finished
0709 13:08:52.497662 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.497833 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":819936,"prepare.queue_time_us":775174,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":102024,"raft.run_cpu_time_us":1015,"raft.run_wall_time_us":103838,"spinlock_wait_cycles":10143616,"thread_start_us":680171,"threads_started":3,"wal-append.queue_time_us":343353}
I20260709 13:08:52.791194 21911 raft_consensus.cc:1240] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:08:52.942276 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:52.942898 21757 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:52.896862 24702 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:52.819686 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:52.859697 21756 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:52.898561 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:52.866328 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 50348.4us
W20260709 13:08:52.819604 21715 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.494s	user 0.020s	sys 0.033s
I20260709 13:08:52.765878 24224 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:08:52.750051 24818 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:52.820199 24826 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:52.769234 24727 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:52.934306 21764 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:08:52.819803 24583 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.768988 24601 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.128s
I20260709 13:08:52.936899 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:53.085577 21763 raft_consensus.cc:2410] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:52.790223 24728 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:52.817819 24580 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:52.943552 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:53.098445 21757 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:52.896762 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:52.946303 21879 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:52.951470 21761 raft_consensus.cc:2393] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 5: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:52.965168 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:53.100576 21756 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:52.898900 24603 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:52.922467 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:53.102056 21759 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
W20260709 13:08:52.982170 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 164328us
I20260709 13:08:52.985584 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:53.104398 21764 raft_consensus.cc:2393] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 6: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:52.983579 24756 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:52.766268 24792 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:53.104128 21729 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:52.773919 24731 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:53.106158 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 269416us
I20260709 13:08:53.129294 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:53.107030 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 160756us
W20260709 13:08:52.994270 24817 log.cc:927] Time spent T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.498s	user 0.000s	sys 0.001s
I20260709 13:08:52.790529 24816 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:53.130867 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:53.149034 21764 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.108554 22448 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:53.134400 21834 raft_consensus.cc:1275] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:52.989492 24727 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:53.176151 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:53.177026 21763 raft_consensus.cc:2376] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8. Re-sending same reply.
W20260709 13:08:53.181510 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 230620us
I20260709 13:08:53.183122 21877 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:53.183691 21757 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:08:53.137359 21756 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:53.245748 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:53.246224 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:53.245958 21764 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
W20260709 13:08:53.245718 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 59790.6us
I20260709 13:08:53.250047 21761 raft_consensus.cc:2393] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:53.247644 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:53.252063 21759 raft_consensus.cc:2368] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8.
W20260709 13:08:53.260847 21805 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.009s	sys 0.011s
W20260709 13:08:53.262063 21805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.010s	sys 0.011s
W20260709 13:08:53.262732 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 514759us
I20260709 13:08:53.263986 21764 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:08:53.266095 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 157668us
I20260709 13:08:53.279132 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:53.268290 21759 raft_consensus.cc:1240] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:53.144244 24730 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:53.271329 21756 raft_consensus.cc:1240] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:53.245210 24742 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:53.254298 24824 log.cc:927] Time spent T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.511s	user 0.001s	sys 0.001s
I20260709 13:08:53.187098 24756 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:08:53.287072 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 183031us
I20260709 13:08:53.113004 24728 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:52.948218 24819 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:53.290671 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 159467us
I20260709 13:08:53.291795 21759 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:53.293087 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:53.296033 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:53.296983 21911 raft_consensus.cc:2393] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:53.299388 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:53.144904 24830 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.155s
I20260709 13:08:53.284343 21764 raft_consensus.cc:1240] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:53.274820 24735 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:53.127828 24702 consensus_queue.cc:1048] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.141s
W20260709 13:08:53.306856 21907 consensus_meta.cc:287] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.613s	user 0.011s	sys 0.000s
I20260709 13:08:53.285171 24730 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:53.313880 21907 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:53.129596 24603 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:53.305212 24826 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:53.288663 24841 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:53.307103 24753 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:53.306844 24734 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:53.316831 24625 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:53.290159 24756 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:53.370745 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 90847.5us
I20260709 13:08:53.311151 24752 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:53.315563 24730 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:53.304967 24786 consensus_queue.cc:1059] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:08:53.315392 24585 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:53.328650 24735 raft_consensus.cc:697] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:53.365962 24763 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:53.365262 24753 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:53.368070 24580 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:53.354002 24826 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:53.379812 24730 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:53.346205 24840 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:08:53.397898 24736 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:53.418084 24849 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:53.422008 24849 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:53.422456 24819 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:53.412391 24838 log.cc:927] Time spent T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:08:53.424412 24849 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:53.429085 24851 raft_consensus.cc:3055] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:53.429355 24792 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:53.429795 24851 raft_consensus.cc:740] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:53.431039 24851 consensus_queue.cc:260] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:53.418356 24830 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.434031 24830 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:53.436897 24748 consensus_meta.cc:287] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.000s
I20260709 13:08:53.416088 24734 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.437803 24734 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:53.439101 24826 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:53.439929 24734 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:53.418781 24829 log.cc:927] Time spent T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.432s	user 0.002s	sys 0.000s
I20260709 13:08:53.362155 24841 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:53.441334 24816 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:53.457535 24834 log.cc:927] Time spent T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.152s	user 0.001s	sys 0.001s
I20260709 13:08:53.443872 24791 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:53.448771 24851 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:53.507071 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 218029us
W20260709 13:08:53.508958 21836 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.002s	sys 0.019s
W20260709 13:08:53.618054 21836 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.002s	sys 0.019s
I20260709 13:08:53.525045 21804 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:53.535950 21806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.007s	sys 0.008s
I20260709 13:08:53.542212 24865 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.551517 24869 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:53.621279 24791 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:53.561506 21910 raft_consensus.cc:1240] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:53.562995 21911 raft_consensus.cc:2368] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10.
W20260709 13:08:53.577651 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.391103 24585 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:53.404803 24580 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:53.609184 24549 consensus_meta.cc:287] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.719s	user 0.008s	sys 0.006s
I20260709 13:08:53.470443 24841 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:53.615259 24826 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:53.621795 24728 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:53.622197 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:53.623497 24731 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:53.626349 24869 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:53.627967 24865 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:53.629112 21806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.007s	sys 0.008s
W20260709 13:08:53.555142 21762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.000s	sys 0.011s
I20260709 13:08:53.404624 24738 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:08:53.323434 24611 consensus_queue.cc:1048] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:08:53.633961 24735 consensus_queue.cc:237] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:53.655588 21762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.001s	sys 0.011s
I20260709 13:08:53.662895 24865 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:53.664204 24601 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:53.666884 24601 raft_consensus.cc:697] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:08:53.669579 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 882927us
W20260709 13:08:53.670493 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.671890 24580 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:53.671924 24546 consensus_queue.cc:1059] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:53.672567 24418 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:53.674283 24868 raft_consensus.cc:3055] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:53.674782 24868 raft_consensus.cc:740] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:08:53.657591 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 133090us
W20260709 13:08:53.686515 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 310844us
I20260709 13:08:53.680107 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:53.688206 21910 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:08:53.692040 24860 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.692763 24731 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.693717 24731 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:53.697644 24826 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:53.697677 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:53.700692 24791 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.701632 24791 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:53.702358 21758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:44764 (request call id 10) took 1815 ms. Trace:
I20260709 13:08:53.703189 24731 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:53.702960 21758 rpcz_store.cc:276] 0709 13:08:51.839355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.845884 (+  6529us) service_pool.cc:224] Handling call
0709 13:08:53.635206 (+1789322us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b54001b99d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35d735 00007fc6b331dd29 00007fc6ac89c1d4 00007fc6ac89c162 00007fc6ac89c091 00007fc6ac89c00c 00007fc6ac89b2c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:53.654713 (+ 19507us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1268581760}
I20260709 13:08:53.693717 21757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 344) took 1408 ms. Trace:
I20260709 13:08:53.705785 21757 rpcz_store.cc:276] 0709 13:08:52.285033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.260761 (+975728us) service_pool.cc:224] Handling call
0709 13:08:53.261149 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:53.261396 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:53.261451 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:53.274711 (+ 13260us) log.cc:844] Serialized 26 byte log entry
0709 13:08:53.691297 (+416586us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:53.691845 (+   548us) log.cc:844] Serialized 14 byte log entry
0709 13:08:53.693154 (+  1309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.693257 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:53.693301 (+    44us) raft_consensus.cc:1685] finished
0709 13:08:53.693314 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.693487 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9,"prepare.queue_time_us":4897,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":131,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":139,"thread_start_us":375232,"threads_started":1,"wal-append.queue_time_us":384252}
I20260709 13:08:53.650964 24549 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:53.676229 24868 consensus_queue.cc:260] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:53.734978 21711 auto_rebalancer.cc:629] Failed to schedule move for tablet 6c77d056b72142dbaf44be22749d2024: Illegal state: Replica 3843e9b794a245dd8608e04ec7915239 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:53.737833 24406 consensus_queue.cc:1059] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:53.741101 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:53.742255 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:53.743263 21838 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:53.744638 21877 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:53.746300 24869 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:53.746917 24869 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:53.748782 21804 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:53.749019 24869 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:53.751281 22481 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44346
I20260709 13:08:53.752089 24869 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:53.752408 22481 raft_consensus.cc:606] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:53.693065 24860 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:53.668967 24601 consensus_queue.cc:237] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:53.766556 24580 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:53.767127 24580 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:53.767565 24580 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:53.770620 24859 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:53.714617 24827 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:53.780468 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.781869 24738 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.782581 24738 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:53.780527 24863 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:53.774766 24791 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:53.791522 21762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 338) took 1515 ms. Trace:
I20260709 13:08:53.796952 24860 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:53.798197 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:53.806011 21838 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:08:53.800268 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:53.786229 24863 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:53.808899 22481 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:53.809576 21757 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:08:53.810014 21757 pending_rounds.cc:85] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 3
I20260709 13:08:53.810333 21757 pending_rounds.cc:107] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:08:53.810657 21757 raft_consensus.cc:2889] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:53.790649 24738 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:53.814020 24655 raft_consensus.cc:3055] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:53.814507 21834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a740500460ba465faaeb007be4b83108"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:08:53.815218 21834 raft_consensus.cc:606] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:53.815577 21834 raft_consensus.cc:614] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:53.814515 24655 raft_consensus.cc:740] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:53.819968 24868 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.821230 24655 consensus_queue.cc:260] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:53.822645 24655 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:53.823326 21834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afc4a5871719461787d91a97d59582af"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:44058
W20260709 13:08:53.817190 24583 consensus_meta.cc:287] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.716s	user 0.008s	sys 0.012s
W20260709 13:08:53.829085 24872 log.cc:927] Time spent T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:08:53.824085 21834 raft_consensus.cc:606] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:53.852398 21834 raft_consensus.cc:614] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:53.792062 21762 rpcz_store.cc:276] 0709 13:08:52.276179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.276504 (+   325us) service_pool.cc:224] Handling call
0709 13:08:52.276902 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:52.325009 (+ 48107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.325038 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:52.325569 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:08:52.689834 (+364265us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:52.746011 (+ 56177us) log.cc:844] Serialized 14 byte log entry
0709 13:08:53.700377 (+954366us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b18000b32c0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab26a3f3 00007fc6ab26c7c1 00007fc6ab26c779 00007fc6ab26c709 00007fc6ab26c6d1 00007fc6ab26b9cd 000000000038f354 000000000038f199 00007fc6ab24d83a
0709 13:08:53.768711 (+ 68334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.777734 (+  9023us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:53.779541 (+  1807us) raft_consensus.cc:1685] finished
0709 13:08:53.788591 (+  9050us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.791297 (+  2706us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135094,"prepare.queue_time_us":78359,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":199268,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":386,"spinlock_wait_cycles":77874048,"thread_start_us":1092769,"threads_started":2,"wal-append.queue_time_us":485364}
I20260709 13:08:53.854661 24737 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:53.855288 24737 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:53.857810 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:53.859375 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 98031.3us
I20260709 13:08:53.865764 24585 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:53.868638 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:53.814073 24603 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:53.876889 21834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:08:53.869262 21905 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
W20260709 13:08:53.871304 24828 log.cc:927] Time spent T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.497s	user 0.001s	sys 0.001s
W20260709 13:08:53.876549 24727 consensus_meta.cc:287] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.609s	user 0.012s	sys 0.005s
I20260709 13:08:53.900476 24727 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:53.903270 24830 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:53.903713 21909 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:53.876681 24744 consensus_meta.cc:287] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.934s	user 0.013s	sys 0.008s
W20260709 13:08:53.879346 24835 log.cc:927] Time spent T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.601s	user 0.001s	sys 0.000s
I20260709 13:08:53.895813 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:53.874569 24826 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:53.869411 24580 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:53.884733 24737 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:53.906126 21834 raft_consensus.cc:606] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:53.919688 21912 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1484) took 1839 ms (client timeout 1675 ms). Trace:
I20260709 13:08:53.920588 24680 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:53.905033 24744 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:53.920907 22479 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36278 (request call id 389) took 2405 ms (client timeout 1672 ms). Trace:
W20260709 13:08:53.921674 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:53.929289 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:53.936534 21912 rpcz_store.cc:269] 0709 13:08:52.080411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.092474 (+ 12063us) service_pool.cc:224] Handling call
0709 13:08:53.919242 (+1826768us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b540021aa54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:53.919425 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105268992}
W20260709 13:08:53.944576 22479 rpcz_store.cc:269] 0709 13:08:51.515160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.516076 (+   916us) service_pool.cc:224] Handling call
0709 13:08:53.920393 (+2404317us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b540018b354. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:53.920664 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":642750720}
W20260709 13:08:53.949343 21761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 1209) took 1635 ms (client timeout 2094 ms). Trace:
W20260709 13:08:53.952404 21761 rpcz_store.cc:269] 0709 13:08:52.313548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.128925 (+815377us) service_pool.cc:224] Handling call
0709 13:08:53.948781 (+819856us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54001b94d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:53.949056 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":274963328}
I20260709 13:08:53.953282 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 337) took 1677 ms. Trace:
I20260709 13:08:53.950191 24680 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:53.953753 21765 rpcz_store.cc:276] 0709 13:08:52.275822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.290380 (+ 14558us) service_pool.cc:224] Handling call
0709 13:08:52.298759 (+  8379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:52.380402 (+ 81643us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:08:52.435614 (+ 55212us) log.cc:844] Serialized 14 byte log entry
0709 13:08:52.783054 (+347440us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:52.784028 (+   974us) log.cc:844] Serialized 26 byte log entry
0709 13:08:52.784239 (+   211us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:52.784468 (+   229us) log.cc:844] Serialized 14 byte log entry
0709 13:08:52.784690 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.784777 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:53.876008 (+1091231us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b4800002958. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b3280aa1 00007fc6b3277b37 00007fc6b32779ca 00007fc6b336f26f 00007fc6b336ef37 00007fc6b338355c 00007fc6b3383508 00007fc6b3383488 00007fc6b3383443 00007fc6b33826ec 00007fc6b22aca96
0709 13:08:53.878201 (+  2193us) spinlock_profiling.cc:243] Waited 6.68 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:53.933976 (+ 55775us) raft_consensus.cc:1685] finished
0709 13:08:53.934003 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:53.950435 (+ 16432us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b1800391420. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab26a3f3 00007fc6ab26c7c1 00007fc6ab26c779 00007fc6ab26c709 00007fc6ab26c6d1 00007fc6ab26b9cd 000000000038f354 000000000038f199 00007fc6ab24d83a
0709 13:08:53.953091 (+  2656us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":156294,"prepare.queue_time_us":1222593,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":91,"raft.queue_time_us":164174,"raft.run_cpu_time_us":2790,"raft.run_wall_time_us":1114488,"spinlock_wait_cycles":152630400,"thread_start_us":122991,"threads_started":1,"wal-append.queue_time_us":581064}
I20260709 13:08:53.862372 24583 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:53.973078 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 53032us
I20260709 13:08:53.950237 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:53.809563 24827 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:54.008140 24863 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:54.030684 21838 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:54.100670 21806 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:54.061645 24747 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:54.101702 24601 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:54.102587 24601 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:54.026942 24585 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:54.103015 24601 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:54.103804 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:54.103523 24585 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:54.025533 24869 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:54.105412 24869 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:54.106034 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:54.101888 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.107287 21764 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:08:54.108528 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:54.117386 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:54.066110 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:54.027243 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.026058 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.126317 21805 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:54.138594 24869 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:54.130897 21832 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:54.129452 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.129516 24730 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:54.066849 24680 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:54.142661 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.143370 24730 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:54.143710 24793 raft_consensus.cc:3055] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:54.144243 24793 raft_consensus.cc:740] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:54.129917 24747 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:54.130559 24580 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:54.131309 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:54.132774 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:54.133749 21906 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:54.135349 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:54.136304 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:54.137218 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:54.138206 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:54.099025 24744 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:54.128957 21840 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:08:54.147962 22485 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:54.128213 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.151688 21804 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:54.155982 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:54.157020 21764 raft_consensus.cc:2393] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 7: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
W20260709 13:08:54.140161 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 223468us
I20260709 13:08:54.151247 24549 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:54.167330 24549 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:54.167688 24224 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:54.167896 24549 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.168197 24224 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:54.168722 24224 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:54.169052 24875 log.cc:927] Time spent T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 13:08:54.170589 21839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2583) took 1746 ms. Trace:
I20260709 13:08:54.171043 21839 rpcz_store.cc:276] 0709 13:08:52.423736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.424656 (+   920us) service_pool.cc:224] Handling call
0709 13:08:52.440183 (+ 15527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:52.496803 (+ 56620us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.496848 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:53.669961 (+1173113us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b180001cc00. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab26a522 00007fc6ab26c7c1 00007fc6ab26c779 00007fc6ab26c709 00007fc6ab26c6d1 00007fc6ab26b9cd 000000000038f354 000000000038f199 00007fc6ab24d83a
0709 13:08:53.705443 (+ 35482us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b2c0000e678. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6acc50a11 00007fc6acc60372 00007fc6ae392a01 00007fc6ae35743a 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2
0709 13:08:53.706171 (+   728us) log.cc:844] Serialized 26 byte log entry
0709 13:08:53.756987 (+ 50816us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:53.757086 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.757202 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:54.170195 (+412993us) raft_consensus.cc:1685] finished
0709 13:08:54.170217 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.170383 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9501,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":95422,"spinlock_wait_cycles":69804672,"thread_start_us":14615,"threads_started":1,"wal-append.queue_time_us":73903}
I20260709 13:08:54.173625 21757 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:54.183481 21805 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:54.177996 22477 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:54.186950 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.145344 24793 consensus_queue.cc:260] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:54.191581 24818 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:54.193856 21839 raft_consensus.cc:1240] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:54.195758 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:54.197408 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.204926 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.200307 24603 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:54.208570 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:54.207500 24583 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:54.213338 21757 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:54.212661 24603 raft_consensus.cc:697] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:54.216225 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.215284 21840 raft_consensus.cc:1240] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:08:54.218948 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.220055 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:54.220718 21764 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.220496 24603 consensus_queue.cc:237] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:54.221628 24756 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:54.228113 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:54.217614 24726 consensus_meta.cc:287] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 1.439s	user 0.016s	sys 0.006s
I20260709 13:08:54.231729 24726 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:54.232941 21905 raft_consensus.cc:1240] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8. Ops: []
W20260709 13:08:54.233984 21913 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45202 (request call id 461) took 2180 ms (client timeout 1926 ms). Trace:
W20260709 13:08:54.234443 21913 rpcz_store.cc:269] 0709 13:08:52.053738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.053901 (+   163us) service_pool.cc:224] Handling call
0709 13:08:54.233573 (+2179672us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400420ed4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:54.233770 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":447884544}
I20260709 13:08:54.234179 24747 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:54.250440 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 85358.3us
I20260709 13:08:54.242734 24793 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.278591 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:54.285136 24879 log.cc:927] Time spent T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:08:54.295245 24846 log.cc:927] Time spent T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.892s	user 0.002s	sys 0.000s
I20260709 13:08:54.296654 24756 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:54.297048 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1740) took 1516 ms. Trace:
I20260709 13:08:54.297454 24756 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:54.297691 21833 rpcz_store.cc:276] 0709 13:08:52.780892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.783879 (+  2987us) service_pool.cc:224] Handling call
0709 13:08:52.784157 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:52.784475 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:52.784503 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:52.784857 (+   354us) log.cc:844] Serialized 26 byte log entry
0709 13:08:53.262811 (+477954us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:08:53.263025 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:53.263207 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:54.294411 (+1031204us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:54.296442 (+  2031us) raft_consensus.cc:1685] finished
0709 13:08:54.296476 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.296823 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1636,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":29256,"spinlock_wait_cycles":5955968,"thread_start_us":356340,"threads_started":1,"wal-append.queue_time_us":541931}
I20260709 13:08:54.299798 24756 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:54.277372 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:54.304478 21840 raft_consensus.cc:1275] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:54.308827 21757 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:08:54.309746 21805 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:54.310307 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.314622 21764 raft_consensus.cc:2468] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:54.316470 21837 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
W20260709 13:08:54.305644 24630 consensus_meta.cc:287] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 1.267s	user 0.017s	sys 0.008s
I20260709 13:08:54.322263 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:54.320890 21839 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:54.310874 24827 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:54.332773 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:54.363703 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 59708.5us
I20260709 13:08:54.363448 24267 consensus_queue.cc:260] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:54.364928 24267 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:54.365968 21805 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:54.367300 24783 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.369017 21805 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:54.311795 24224 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:54.314397 24549 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:54.333824 24580 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:08:54.383419 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:54.335069 24726 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:54.318400 24601 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:54.389699 21840 raft_consensus.cc:1240] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:54.334609 24630 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:54.395267 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:54.395552 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.396867 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:08:54.397533 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.399364 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:54.397617 21905 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:08:54.400198 21907 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 4.
I20260709 13:08:54.416095 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:54.419162 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:54.420863 21757 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:54.419816 21914 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:54.387727 24795 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:54.426607 21914 raft_consensus.cc:1240] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:54.428109 24795 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:54.431944 24795 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:54.434998 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.435494 21905 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:08:54.435657 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:54.436687 21759 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:08:54.436766 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:54.437372 21880 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:54.437525 22484 raft_consensus.cc:1240] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:54.437877 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:54.438385 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:54.400132 24549 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:54.443186 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.443516 21757 raft_consensus.cc:2393] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 8: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:54.445757 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:54.446604 21759 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:54.448889 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:54.449415 22482 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:54.452193 21764 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:54.457628 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.444630 24768 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:54.518818 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:54.519934 21757 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
W20260709 13:08:54.530058 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 161209us
I20260709 13:08:54.534695 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.541514 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:54.542241 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:54.545881 21711 auto_rebalancer.cc:629] Failed to schedule move for tablet d76fbf464db84dbeb90facb1538a9ca1: Illegal state: Replica 6d698a5544b946939790e7a3972db9fb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:54.547824 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:54.556068 21764 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
W20260709 13:08:54.557825 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:54.567831 24884 log.cc:927] Time spent T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:08:54.571447 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1213) took 2127 ms. Trace:
I20260709 13:08:54.572137 21758 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:54.572017 21909 rpcz_store.cc:276] 0709 13:08:52.444275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.444382 (+   107us) service_pool.cc:224] Handling call
0709 13:08:52.444701 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:53.904383 (+1459682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.571055 (+666672us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540032c654. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:54.571349 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3354384256}
I20260709 13:08:54.575485 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:54.576812 21765 raft_consensus.cc:2410] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:08:54.578918 21762 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:08:54.581941 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:54.583065 21761 raft_consensus.cc:2393] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 5: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:54.586405 24785 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:54.594069 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 156899us
W20260709 13:08:54.594664 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.595439 21880 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:54.628475 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:54.636914 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.533408 24768 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:54.607134 24726 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:54.648116 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:54.651829 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 111800us
I20260709 13:08:54.652964 21805 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:54.654140 24630 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:54.665742 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1216) took 2167 ms. Trace:
I20260709 13:08:54.666569 21765 raft_consensus.cc:1275] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:08:54.623190 24827 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:54.641178 24224 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:54.671782 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:54.677714 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.666281 21906 rpcz_store.cc:276] 0709 13:08:52.498378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.498619 (+   241us) service_pool.cc:224] Handling call
0709 13:08:52.499007 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.155270 (+1656263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.655186 (+499916us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54000ff354. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:54.665668 (+ 10482us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3450548608}
I20260709 13:08:54.657204 24726 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:54.657809 24601 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:54.695889 21761 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.699661 24863 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.706861 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.692395 24826 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.696758 24726 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:54.715817 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 120471us
I20260709 13:08:54.713371 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:54.717329 21764 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.709722 24863 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:54.723711 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:54.721712 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.709031 24224 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:54.728140 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:54.733529 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:54.715600 24601 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:54.735790 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:54.731439 21765 raft_consensus.cc:1240] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:54.736662 21832 consensus_meta.cc:287] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.572s	user 0.012s	sys 0.000s
I20260709 13:08:54.737038 21832 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:08:54.712040 24827 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:54.743187 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.743884 21880 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:54.739931 24868 consensus_meta.cc:287] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.919s	user 0.016s	sys 0.000s
I20260709 13:08:54.752552 21757 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:54.739674 24546 raft_consensus.cc:2764] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
W20260709 13:08:54.747125 22449 connection.cc:256] RPC call timeout handler was delayed by -1.0326789320000671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
I20260709 13:08:54.758286 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:54.759171 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 287829us
I20260709 13:08:54.763360 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.765053 24630 consensus_queue.cc:1059] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:54.766884 24886 log.cc:927] Time spent T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:08:54.772177 22450 connection.cc:256] RPC call timeout handler was delayed by -1.6416443090000712s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19210000000000002s for a response
W20260709 13:08:54.772816 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.775740 24827 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:54.776361 24827 raft_consensus.cc:3055] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:54.776760 24827 raft_consensus.cc:740] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:08:54.773149 22450 connection.cc:256] RPC call timeout handler was delayed by -1.2935349209999458s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
W20260709 13:08:54.785713 22450 connection.cc:256] RPC call timeout handler was delayed by -1.2224349209999446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
I20260709 13:08:54.785485 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:54.786517 22450 connection.cc:256] RPC call timeout handler was delayed by -1.1038143129999298s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
I20260709 13:08:54.781414 21761 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:54.787760 21757 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:08:54.789093 21711 auto_rebalancer.cc:629] Failed to schedule move for tablet c2c5cb2b121749798f01933921c01ed6: Illegal state: Replica 6d698a5544b946939790e7a3972db9fb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:54.790630 21764 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:54.796690 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:54.797497 21756 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:54.792603 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:54.799300 21758 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:54.805075 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:54.806308 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:54.808672 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:54.809381 21764 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:54.810339 21838 raft_consensus.cc:2410] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:08:54.757017 24601 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:54.792644 24744 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:54.819231 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.821064 21765 raft_consensus.cc:1275] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:54.821977 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.822700 24585 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:54.823674 24768 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:54.828100 21909 raft_consensus.cc:1240] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:54.840528 21759 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:08:54.836483 21763 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:54.840570 24783 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:54.854619 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:54.856772 21877 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:54.858054 21840 raft_consensus.cc:2410] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:54.859704 24747 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:54.860126 24747 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:54.860508 24747 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:54.842047 24583 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.862018 24583 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:54.864310 24583 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:54.867134 24601 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:54.860414 24580 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.821060 24826 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:54.829094 24744 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.871510 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:54.872627 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:54.882059 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 229228us
I20260709 13:08:54.872750 24744 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:54.853142 21757 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:08:54.887984 21806 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:54.894696 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 105647us
I20260709 13:08:54.898350 21840 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:54.872925 24580 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:54.904409 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:54.843315 24827 consensus_queue.cc:260] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:54.909742 21805 leader_election.cc:400] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8.
I20260709 13:08:54.910202 21805 leader_election.cc:403] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:08:54.908815 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 249286us
I20260709 13:08:54.890321 24863 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:54.895915 24783 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:54.914434 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 152581us
I20260709 13:08:54.917518 21880 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:54.919075 22449 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:54.921540 21756 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:08:54.911201 24868 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8.
W20260709 13:08:54.936769 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 133539us
W20260709 13:08:54.937759 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 47417.3us
I20260709 13:08:54.938941 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:54.941083 21840 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:54.943339 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:54.944096 22481 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:54.944397 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:54.945366 21909 raft_consensus.cc:2393] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:54.946408 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:54.947192 21910 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:54.944096 24889 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:54.956344 24785 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.956916 24785 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:54.958096 24727 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:54.958796 24727 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:54.959138 24727 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:54.959606 24727 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:54.927062 24583 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.960877 24583 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:54.963555 21879 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.820s (SENT) [suppressed 16 similar messages]
W20260709 13:08:54.965481 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 106571us
I20260709 13:08:54.923419 24827 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:54.987556 21910 raft_consensus.cc:1240] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:08:54.991536 24793 consensus_meta.cc:287] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.690s	user 0.007s	sys 0.006s
I20260709 13:08:54.991675 24726 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:54.992795 21911 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1496) took 1693 ms (client timeout 1946 ms). Trace:
W20260709 13:08:54.993201 21911 rpcz_store.cc:269] 0709 13:08:53.299020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.299177 (+   157us) service_pool.cc:224] Handling call
0709 13:08:54.992568 (+1693391us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54001eb4d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:54.992738 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590233472}
W20260709 13:08:54.998396 24887 log.cc:927] Time spent T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.237s	user 0.004s	sys 0.001s
I20260709 13:08:54.999998 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1232) took 1228 ms. Trace:
I20260709 13:08:55.000443 21908 rpcz_store.cc:276] 0709 13:08:53.771485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:54.181806 (+410321us) service_pool.cc:224] Handling call
0709 13:08:54.195722 (+ 13916us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:54.201303 (+  5581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.201346 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:54.209094 (+  7748us) log.cc:844] Serialized 26 byte log entry
0709 13:08:54.596087 (+386993us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:08:54.596132 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.596201 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:54.956721 (+360520us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:54.999664 (+ 42943us) raft_consensus.cc:1685] finished
0709 13:08:54.999688 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:54.999936 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":1636,"spinlock_wait_cycles":28929920,"thread_start_us":351501,"threads_started":1,"wal-append.queue_time_us":507165}
I20260709 13:08:55.009718 21912 raft_consensus.cc:1240] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:55.013702 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:55.015368 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 99044.1us
W20260709 13:08:55.016429 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.018905 21908 raft_consensus.cc:2393] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 9: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:55.019949 21758 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:08:55.020799 21761 raft_consensus.cc:1240] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:55.023736 21832 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:55.022552 22449 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:55.027297 22449 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:55.023393 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:55.028872 21908 raft_consensus.cc:2393] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:55.029482 21760 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:08:55.033538 24865 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.033934 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:55.034192 24865 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.035815 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:55.038303 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:55.041558 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:55.042217 21834 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 4.
I20260709 13:08:55.046185 22450 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:55.047139 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:55.048977 24863 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:55.055645 24863 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:55.056236 24863 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:55.063151 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:55.063565 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:55.063954 21910 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:08:55.064651 21906 raft_consensus.cc:2393] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:55.067077 21910 raft_consensus.cc:1275] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:08:55.068076 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:55.068789 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:55.069305 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:55.069955 21905 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:55.070890 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:55.073917 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:55.075286 21760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44772 (request call id 342) took 2790 ms (client timeout 1921 ms). Trace:
W20260709 13:08:55.075680 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 97943.2us
W20260709 13:08:55.075829 21760 rpcz_store.cc:269] 0709 13:08:52.284433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:52.285512 (+  1079us) service_pool.cc:224] Handling call
0709 13:08:55.075002 (+2789490us) spinlock_profiling.cc:243] Waited 2.54 s on lock 0x7b54003da254. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:55.075174 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5834212224}
I20260709 13:08:55.077867 21835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2595) took 1147 ms. Trace:
I20260709 13:08:55.078508 21805 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:55.078444 21835 rpcz_store.cc:276] 0709 13:08:53.930157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:53.930381 (+   224us) service_pool.cc:224] Handling call
0709 13:08:54.101024 (+170643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:54.101254 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:54.101281 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:54.101335 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:54.101362 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:54.101416 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:55.077530 (+976114us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54003c0ad0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:55.077656 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391542656}
I20260709 13:08:55.081624 24418 consensus_queue.cc:1059] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:55.082603 21728 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:55.082856 24418 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:55.082619 24868 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:55.084151 24868 consensus_queue.cc:1059] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:55.084615 24418 raft_consensus.cc:3055] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:55.085044 24418 raft_consensus.cc:740] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:55.085242 24868 raft_consensus.cc:3055] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:55.085635 24868 raft_consensus.cc:740] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:08:55.087621 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 60419.3us
I20260709 13:08:55.049953 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:55.053907 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:55.084295 21728 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:55.055001 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:55.086506 24868 consensus_queue.cc:260] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:55.103389 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 140036us
W20260709 13:08:55.104137 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.105722 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:55.009706 24785 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:55.108994 21805 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:55.107690 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:55.115402 24583 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:55.115732 24868 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.116565 24865 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:55.117134 24785 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:55.117578 24750 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:55.114205 22449 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:55.117707 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:55.118059 24750 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.118511 24750 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.120138 24794 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:55.120025 24649 consensus_queue.cc:1059] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:55.120584 24794 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:55.120982 24794 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.122501 24649 raft_consensus.cc:3055] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:55.122922 24649 raft_consensus.cc:740] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:55.125658 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:55.136772 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.150089 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 104095us
I20260709 13:08:55.123854 24649 consensus_queue.cc:260] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.156441 21880 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:55.162747 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:55.126358 24768 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:55.129227 24601 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:55.180845 21880 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:55.182018 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.166625 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.190047 22450 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:55.190817 21729 connection.cc:256] RPC call timeout handler was delayed by -1.2172894950000455s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
I20260709 13:08:55.161974 24897 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:55.195860 21729 connection.cc:256] RPC call timeout handler was delayed by -1.2028894950000222s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
W20260709 13:08:55.199059 21729 connection.cc:256] RPC call timeout handler was delayed by -1.0171406340000431s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
I20260709 13:08:55.197770 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:55.198282 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:55.200150 21908 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 4.
I20260709 13:08:55.207769 24635 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:55.154870 24418 consensus_queue.cc:260] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.185741 24585 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:55.189831 24832 raft_consensus.cc:2804] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:55.211793 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:55.210582 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:55.152869 24727 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.213932 24908 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:55.214630 24793 consensus_queue.cc:1059] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:55.215507 24635 raft_consensus.cc:2804] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:55.216241 22450 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:55.186457 24768 raft_consensus.cc:697] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 9 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:55.191941 24795 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.235165 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:55.210597 24726 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:55.211934 24649 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:55.209192 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:55.242522 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:55.243626 22480 raft_consensus.cc:2410] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:08:55.228435 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.218652 24585 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:55.246277 21729 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:55.232621 24619 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:55.250974 21877 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:55.236268 24635 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:55.209824 24897 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.243171 24418 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:55.259793 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:55.247185 24580 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:55.261869 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 177741us
I20260709 13:08:55.250070 24585 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:55.264535 21877 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:55.266824 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 48799.5us
W20260709 13:08:55.267330 24910 log.cc:927] Time spent T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:08:55.268647 21729 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:55.269567 24768 consensus_queue.cc:237] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.270213 24727 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:55.270478 24908 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:55.270967 24908 raft_consensus.cc:697] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:55.271911 24908 consensus_queue.cc:237] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.275816 24897 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:55.259539 24635 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:55.278527 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.264710 21662 catalog_manager.cc:5697] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 6 to 7, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 7 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.291658 21879 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:55.296458 24794 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.272953 24744 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.300818 21910 raft_consensus.cc:1240] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 6. Ops: [4.7-4.7]
I20260709 13:08:55.261827 24785 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:55.301878 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:55.302194 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:55.302436 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:55.302964 24905 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.299983 24747 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.303431 24905 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.304991 24747 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:55.302528 22483 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:08:55.293285 21879 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:55.318090 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:55.244536 24795 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.328971 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:55.305533 24826 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:55.331106 21731 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:55.307279 24907 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:55.336146 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 71669us
I20260709 13:08:55.299892 24863 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.324900 24630 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:55.329028 24785 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:55.343274 24907 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.358471 24907 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:55.359262 24907 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:55.359965 24907 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:55.360363 24907 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.360745 24907 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:55.362553 24911 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:08:55.367347 24744 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:55.368570 24905 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:55.369398 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 171020us
I20260709 13:08:55.373665 24549 consensus_queue.cc:1059] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:55.374619 24546 raft_consensus.cc:993] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d: : Instructing follower 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:08:55.375092 24546 raft_consensus.cc:1081] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Signalling peer 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:08:55.375308 24795 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:55.376188 24549 raft_consensus.cc:3055] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:55.376528 24549 raft_consensus.cc:740] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:55.377362 24549 consensus_queue.cc:260] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:55.377797 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 84634.6us
I20260709 13:08:55.378499 24549 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:55.378806 21879 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:55.380820 21879 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:55.381991 24836 raft_consensus.cc:3055] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:55.382388 24794 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:55.343302 24619 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:55.383180 24267 consensus_queue.cc:1059] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:55.384222 24891 raft_consensus.cc:3055] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:55.384577 24891 raft_consensus.cc:740] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:55.346743 24826 raft_consensus.cc:697] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:55.384984 24750 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.385489 24891 consensus_queue.cc:260] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.385901 24826 consensus_queue.cc:237] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.383214 24619 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.387121 24619 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.387356 24750 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:55.388110 22478 raft_consensus.cc:2368] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 5. Current term is 6.
I20260709 13:08:55.392298 21909 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:55.393021 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:55.382450 24836 raft_consensus.cc:740] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:55.393631 21907 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.393692 22481 raft_consensus.cc:2393] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 7: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:55.329388 24865 consensus_queue.cc:1059] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:08:55.345288 24747 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:55.400130 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:55.400156 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:55.392539 24585 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:55.401274 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 116059us
I20260709 13:08:55.400892 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:55.412838 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 144339us
W20260709 13:08:55.412580 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 196035us
I20260709 13:08:55.427757 21837 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:55.434180 21906 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:55.437676 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:55.438081 21910 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:55.439808 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:55.446288 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:55.446288 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:55.447502 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 66768.8us
I20260709 13:08:55.401875 24744 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:55.447225 21837 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:55.454550 21912 raft_consensus.cc:2393] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 7: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:55.446316 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:08:55.455497 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 124458us
I20260709 13:08:55.458451 21911 raft_consensus.cc:1240] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:55.411820 24747 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:55.405407 24832 raft_consensus.cc:697] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:55.412371 24726 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:55.464799 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 154505us
I20260709 13:08:55.457922 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:08:55.460194 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 153681us
I20260709 13:08:55.458139 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:55.462003 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:55.464123 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:55.459697 22449 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:55.465169 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.411576 24750 consensus_queue.cc:1059] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:08:55.470551 21835 raft_consensus.cc:2393] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 9: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:55.470634 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:55.470196 21914 raft_consensus.cc:2393] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 9: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:55.469980 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:55.483994 21880 leader_election.cc:400] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 5. Current term is 6.
I20260709 13:08:55.484400 21880 leader_election.cc:403] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:08:55.483839 22478 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:55.491437 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:55.492261 22482 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.461632 24747 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:55.493610 21879 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:55.499423 24841 consensus_queue.cc:1059] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:08:55.500075 24785 raft_consensus.cc:3055] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:55.500569 24785 raft_consensus.cc:740] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:55.501590 21836 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:55.499624 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:55.428130 24635 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.504124 21728 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:55.506986 21729 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:55.507642 21905 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:08:55.517262 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:55.493471 24793 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:55.522469 24793 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.523001 24793 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.526696 24585 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:55.513057 24785 consensus_queue.cc:260] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.531409 24785 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:55.545547 21731 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:55.545977 22484 raft_consensus.cc:1240] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:55.547680 24635 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:55.547361 24832 consensus_queue.cc:237] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.549022 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:08:55.549755 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 85242us
I20260709 13:08:55.550963 21879 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:55.503490 24924 consensus_queue.cc:1059] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:08:55.559818 21913 raft_consensus.cc:1240] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:55.562125 24773 raft_consensus.cc:3055] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:55.561297 24836 consensus_queue.cc:260] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.562536 24773 raft_consensus.cc:740] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:55.514905 24826 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:08:55.564606 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 48432.4us
I20260709 13:08:55.571116 22480 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:55.571946 22449 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:55.563491 24773 consensus_queue.cc:260] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.574499 24773 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.574973 24826 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:55.574817 24619 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.575467 24826 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:55.575954 24826 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:55.577597 21909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:49554
I20260709 13:08:55.577839 24915 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:55.579303 21914 raft_consensus.cc:1275] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:55.579361 24865 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:08:55.580561 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.581665 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.582973 24635 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:55.584383 22482 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:55.589141 21877 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:55.590667 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:55.574666 21879 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:55.592545 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 88512.1us
I20260709 13:08:55.591493 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:55.592881 24926 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:55.593295 21836 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:08:55.593992 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 100990us
I20260709 13:08:55.594849 21729 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:55.577292 24619 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:55.572135 21907 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:55.596392 21879 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:55.596683 24726 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 5. Current term is 6.
I20260709 13:08:55.598443 21880 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:55.599274 24726 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:55.599800 24726 raft_consensus.cc:697] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:55.599951 24744 consensus_queue.cc:1059] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:55.601270 24895 raft_consensus.cc:3055] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:55.600764 24726 consensus_queue.cc:237] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.601711 24895 raft_consensus.cc:740] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:55.602560 24891 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.603044 24926 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:55.602649 24895 consensus_queue.cc:260] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.604206 24895 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:55.604688 24619 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:55.604957 21879 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:55.605154 24619 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:55.605698 24619 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.605860 24585 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:55.606490 24585 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:55.606891 24585 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.609567 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:55.610373 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:55.611146 22449 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:55.591722 24907 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.613160 21879 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:55.640039 21804 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:55.641209 21836 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:55.563508 24836 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:55.246666 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:55.649542 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 60501.3us
I20260709 13:08:55.650832 21877 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:55.656562 21804 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:55.658519 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 65125.8us
I20260709 13:08:55.655742 21877 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:55.661183 21804 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:55.662912 24635 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:55.663717 24580 consensus_queue.cc:1059] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:08:55.666827 24907 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:55.648733 24744 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:55.648717 24915 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:55.672633 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:55.651842 24794 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:55.654939 24905 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:55.669174 21662 catalog_manager.cc:5697] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 4 to 5, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 5 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.681454 22480 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:55.659917 24418 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:55.682794 21728 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:55.667740 24841 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:55.667690 24865 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:55.690960 21804 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:55.696615 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 111387us
I20260709 13:08:55.683501 24585 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.689831 24549 raft_consensus.cc:3055] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:55.702411 24549 raft_consensus.cc:740] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:55.702566 24585 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:55.676474 24744 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:55.703408 24744 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.703372 24549 consensus_queue.cc:260] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.703685 24619 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.693784 24915 raft_consensus.cc:697] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:55.704823 24549 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.649358 24267 consensus_queue.cc:1059] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:08:55.705344 24915 consensus_queue.cc:237] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.697031 24911 consensus_queue.cc:1059] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:08:55.683911 24921 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:55.709190 24826 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.710364 21909 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:55.710759 21909 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:55.711503 24826 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:55.655071 24583 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:08:55.680559 24925 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:55.690585 24905 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.717819 24905 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:55.726310 24893 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.693332 24603 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:08:55.727757 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 133064us
I20260709 13:08:55.729282 21729 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:55.730737 24267 raft_consensus.cc:3055] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:55.731178 24267 raft_consensus.cc:740] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:55.732123 24267 consensus_queue.cc:260] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.683619 24794 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.734511 24794 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:55.682945 24726 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:55.737598 24418 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:55.737911 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:55.737509 24795 consensus_queue.cc:1175] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8c6c2207af3d47b3acf352d81959f4dd" responder_term: 7 status { last_received { term: 6 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:55.738211 24418 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.683408 24581 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:55.738806 24418 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:55.739208 24868 consensus_queue.cc:1048] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:55.739027 24581 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.692587 21662 catalog_manager.cc:5697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 4 to 6, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 6 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.741990 24893 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.744522 24893 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:55.745507 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 67711.2us
I20260709 13:08:55.745316 24744 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.749012 24744 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:55.751387 24747 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.743695 21909 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.753753 24747 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:55.754407 24581 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:55.754817 24928 log.cc:927] Time spent T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:55.755532 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:55.756913 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.757570 24267 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:55.768280 22480 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
W20260709 13:08:55.769537 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 86881.4us
I20260709 13:08:55.769747 24619 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:55.770170 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:55.771306 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 71847.9us
I20260709 13:08:55.772277 21877 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:55.770680 24865 consensus_queue.cc:1048] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
W20260709 13:08:55.777012 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.770376 21728 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:55.788818 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 59654.9us
I20260709 13:08:55.789810 21729 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:55.792423 24925 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:55.792913 24925 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.793063 24933 raft_consensus.cc:2764] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:08:55.793356 24925 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:55.793968 24933 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:55.793864 21879 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:55.794410 24933 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.794793 24933 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.795373 24726 consensus_queue.cc:1048] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:55.796825 24726 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:55.782174 24863 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:55.797597 22482 raft_consensus.cc:1240] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:55.798357 21879 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:55.792443 21728 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:55.799582 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.800298 21877 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:55.809209 21879 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:55.803285 24585 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:55.810158 24418 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.810684 24907 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:55.803471 24893 consensus_queue.cc:1059] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:08:55.787513 24581 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:55.813845 24546 raft_consensus.cc:3055] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:55.820879 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:55.822659 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:55.803357 24865 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:55.825875 24585 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:55.829710 24726 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:55.836257 24726 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:55.818255 24546 raft_consensus.cc:740] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:55.834455 24580 consensus_queue.cc:1059] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:08:55.816215 24911 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:55.838326 21729 leader_election.cc:400] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10.
I20260709 13:08:55.828270 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:55.838784 21729 leader_election.cc:403] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:55.827069 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:55.831609 24630 raft_consensus.cc:3055] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:55.840968 24630 raft_consensus.cc:740] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:55.840601 24794 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.836683 24726 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:55.858091 24934 log.cc:927] Time spent T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:08:55.817843 24581 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.841895 24630 consensus_queue.cc:260] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.827374 21835 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:55.868510 24933 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.870786 24933 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:55.871035 24581 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:55.850229 24418 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:55.850047 24793 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:55.827955 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:55.853785 24905 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.855731 24897 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:55.856169 24585 raft_consensus.cc:697] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:08:55.834725 24932 log.cc:927] Time spent T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.125s	user 0.004s	sys 0.000s
I20260709 13:08:55.888880 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:55.889612 21835 raft_consensus.cc:2393] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:55.890091 24585 consensus_queue.cc:237] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.890823 24546 consensus_queue.cc:260] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:55.893970 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.876533 21836 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:08:55.880752 24943 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10.
I20260709 13:08:55.885107 21907 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 10. Ops: []
I20260709 13:08:55.881597 24865 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:55.909379 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:55.886593 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:55.887343 24897 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:55.904316 21909 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:55.904878 21912 raft_consensus.cc:1240] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:55.907655 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:55.938952 21908 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:55.885639 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:55.939567 21832 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:08:55.909281 21910 raft_consensus.cc:1240] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:55.912303 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:55.943042 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:55.943809 21834 raft_consensus.cc:3055] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:55.944367 21907 raft_consensus.cc:2393] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:08:55.926178 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 87983.4us
I20260709 13:08:55.945318 21729 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:55.944201 21834 raft_consensus.cc:740] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:55.945673 21905 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:08:55.946442 21911 raft_consensus.cc:1240] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:55.948586 21731 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:55.952955 24546 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:55.946663 21839 raft_consensus.cc:2393] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:55.883459 24895 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:55.970253 21662 catalog_manager.cc:5697] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:55.990688 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:55.993820 21906 raft_consensus.cc:2393] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 7: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:55.877084 24907 consensus_queue.cc:1059] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 13:08:55.879845 24924 consensus_queue.cc:1059] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.094s
W20260709 13:08:55.997587 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 49098.8us
W20260709 13:08:56.002939 24930 log.cc:927] Time spent T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.261s	user 0.000s	sys 0.002s
I20260709 13:08:55.996567 24895 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:56.005050 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:55.893194 24744 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:56.006235 21911 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:08:55.996939 21834 consensus_queue.cc:260] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.001495 21804 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:55.978334 24933 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:55.909055 24747 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:55.992223 24727 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:08:56.006105 24580 consensus_queue.cc:1059] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:08:56.010699 24267 consensus_queue.cc:1059] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:08:56.019662 21662 catalog_manager.cc:5697] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 4 to 5, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 5 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.021960 24933 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:56.024068 24933 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:56.017030 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 71812.5us
I20260709 13:08:56.024598 24890 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.025349 21729 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:56.023387 21662 catalog_manager.cc:5697] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:56.026338 24931 log.cc:927] Time spent T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:08:56.026132 24747 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:56.027123 21662 catalog_manager.cc:5697] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 2 to 4, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 4 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.029611 24891 consensus_queue.cc:1059] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:08:56.030532 24891 raft_consensus.cc:3055] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:56.030874 24891 raft_consensus.cc:740] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:56.031687 24891 consensus_queue.cc:260] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.029817 21662 catalog_manager.cc:5697] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 6 to 7, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 7 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.032843 24891 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:56.000442 24418 consensus_queue.cc:1059] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:08:56.034577 21662 catalog_manager.cc:5697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 2 to 3, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 3 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:56.036320 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.007764 24865 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:56.040279 21660 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45778 (request call id 283) took 6815 ms. Trace:
I20260709 13:08:56.041169 21912 raft_consensus.cc:1275] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:56.041292 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:56.045198 21906 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:56.051771 21907 raft_consensus.cc:1240] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:56.020051 24938 log.cc:927] Time spent T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:08:56.034389 24418 raft_consensus.cc:3055] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:56.038038 24893 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:56.025189 24890 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:56.066674 24941 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:56.024997 24726 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.067669 21834 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:56.068594 24890 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:56.066350 24418 raft_consensus.cc:740] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:56.066579 24893 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.021067 24793 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:56.073202 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.063791 21832 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
W20260709 13:08:56.077699 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.063280 21662 catalog_manager.cc:5697] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 3 to 4, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 4 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.083266 21662 catalog_manager.cc:5697] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 2 to 3, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 3 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:56.084997 24726 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:56.069891 24418 consensus_queue.cc:260] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.085546 24785 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:56.085980 24785 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:56.086076 24941 raft_consensus.cc:3055] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:56.086553 24785 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:56.086604 24941 raft_consensus.cc:740] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:56.087615 24941 consensus_queue.cc:260] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.054993 24826 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:56.094257 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 68999.4us
I20260709 13:08:56.099359 21834 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:08:56.013960 24744 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.102890 24905 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:56.086017 24418 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:56.108187 24925 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:56.040676 21660 rpcz_store.cc:276] 0709 13:08:49.246802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:49.250825 (+  4023us) service_pool.cc:224] Handling call
0709 13:08:56.040091 (+6789266us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:50.943734 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:51.031566 (+ 87832us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:51.031603 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:08:51.031624 (+    21us) tablet.cc:662] Decoding operations
0709 13:08:51.178609 (+146985us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:51.201810 (+ 23201us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:51.295130 (+ 93320us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:08:51.331877 (+ 36747us) tablet.cc:701] Row locks acquired
0709 13:08:51.331901 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:08:51.332051 (+   150us) write_op.cc:270] Start()
0709 13:08:51.339830 (+  7779us) write_op.cc:276] Timestamp: P: 1783602531331999 usec, L: 0
0709 13:08:51.345520 (+  5690us) op_driver.cc:348] REPLICATION: starting
0709 13:08:51.440007 (+ 94487us) log.cc:844] Serialized 8584 byte log entry
0709 13:08:52.057607 (+617600us) op_driver.cc:464] REPLICATION: finished
0709 13:08:52.264481 (+206874us) write_op.cc:301] APPLY: starting
0709 13:08:52.270055 (+  5574us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:52.621032 (+350977us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:52.632550 (+ 11518us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:53.296895 (+664345us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:53.297342 (+   447us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 13:08:53.313456 (+ 16114us) write_op.cc:312] APPLY: finished
0709 13:08:53.465942 (+152486us) log.cc:844] Serialized 152 byte log entry
0709 13:08:53.613686 (+147744us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:53.614436 (+   750us) write_op.cc:454] Released schema lock
0709 13:08:53.614580 (+   144us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:53.615566 (+   986us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:53.615608 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39388,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":171851,"apply.run_cpu_time_us":16208,"apply.run_wall_time_us":1361735,"num_ops":22,"prepare.queue_time_us":319276,"prepare.run_cpu_time_us":19685,"prepare.run_wall_time_us":648819,"raft.queue_time_us":218177,"raft.run_cpu_time_us":34913,"raft.run_wall_time_us":49043,"replication_time_us":711934,"thread_start_us":618767,"threads_started":5,"wal-append.queue_time_us":239187,"wal-append.run_cpu_time_us":67832,"wal-append.run_wall_time_us":2528958}]]}
I20260709 13:08:56.138873 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:56.099820 21906 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:56.118641 21729 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:56.119432 21908 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:08:56.119076 21877 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:56.140744 24924 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:56.117847 24826 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:56.143656 24744 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:56.124557 24601 raft_consensus.cc:3055] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:56.145895 24601 raft_consensus.cc:740] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:56.146878 24601 consensus_queue.cc:260] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.148061 24601 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:56.126631 24794 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:56.150030 22448 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:56.100363 24893 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:56.152228 21914 raft_consensus.cc:2468] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:56.132531 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:56.153203 22482 raft_consensus.cc:2393] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 7: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:08:56.070013 24865 raft_consensus.cc:697] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 8 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:56.108347 24785 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.142726 24897 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:56.163602 24785 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:56.163632 24630 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:56.131675 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:56.160244 24794 consensus_queue.cc:1048] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:56.160662 24941 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:56.166551 21837 raft_consensus.cc:1275] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:08:56.161053 21729 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:56.157385 24832 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:56.164924 22480 raft_consensus.cc:2393] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:56.167996 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:56.170665 24895 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:56.171598 24937 raft_consensus.cc:3055] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:56.172042 24937 raft_consensus.cc:740] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:08:56.173698 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.176136 24865 consensus_queue.cc:237] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:56.172884 24937 consensus_queue.cc:260] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.178974 24937 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:56.182248 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 63301.3us
I20260709 13:08:56.182341 24905 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:56.183200 24905 raft_consensus.cc:697] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:56.184057 24905 consensus_queue.cc:237] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.170110 24785 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:56.187157 24925 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:56.187628 24832 raft_consensus.cc:697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:56.189018 24747 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:56.188827 24832 consensus_queue.cc:237] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:56.189963 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:56.188655 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:08:56.192816 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.193688 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:56.193885 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:56.194273 21836 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:56.195966 21804 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:56.198482 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:56.198886 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:56.199030 21839 raft_consensus.cc:1240] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:56.199186 21835 raft_consensus.cc:2393] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 7: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:56.200026 24549 consensus_queue.cc:1059] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:56.201145 24546 raft_consensus.cc:3055] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:56.202008 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:56.203161 21877 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:56.202313 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:56.207139 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.207320 21877 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:56.209878 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 48908.4us
I20260709 13:08:56.210739 21729 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:56.213289 21728 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:56.213368 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:56.214272 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.209966 24418 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:56.217882 24418 raft_consensus.cc:697] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:56.209749 24922 consensus_queue.cc:1048] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:08:56.218756 24418 consensus_queue.cc:237] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.217905 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:56.204902 24546 raft_consensus.cc:740] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:56.221652 24546 consensus_queue.cc:260] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.222779 24546 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:56.216405 24895 consensus_queue.cc:1059] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:08:56.226925 24895 raft_consensus.cc:3055] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:56.227365 24895 raft_consensus.cc:740] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:56.213142 24583 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:56.230334 24924 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:08:56.227646 24826 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:56.228617 24895 consensus_queue.cc:260] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.238469 24925 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:56.238981 24893 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.244643 24785 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:56.212296 24585 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:08:56.263849 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 53176.8us
I20260709 13:08:56.264611 21729 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:56.265709 21729 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:56.266695 21729 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:56.272287 21729 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:56.273494 21729 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:56.274266 24893 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:56.275611 21729 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:56.276224 24941 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:56.277925 24794 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:56.278213 24941 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.278661 24941 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:56.276686 24907 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:56.277078 24924 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:56.277505 24925 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:56.284152 24939 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:56.285820 24895 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:56.285858 21729 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:56.264130 24585 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:56.290390 24925 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:56.290872 24585 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:56.290300 21729 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:56.292030 24925 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:56.292387 24925 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:56.292717 24925 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:56.296797 22480 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:56.299293 21729 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:56.302274 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:56.302960 21907 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:56.310240 21840 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:56.310913 21729 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:56.311560 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.316072 21913 raft_consensus.cc:1240] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:56.321322 21911 raft_consensus.cc:1275] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:08:56.321861 22449 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:56.326783 21912 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:56.326957 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.327788 21760 raft_consensus.cc:2410] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:08:56.328701 21758 raft_consensus.cc:1240] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:08:56.326103 24922 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:08:56.333750 24863 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:56.334961 21762 raft_consensus.cc:1275] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:56.335914 22449 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:56.315583 24924 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:56.313302 24581 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:56.337042 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.337313 24581 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.338336 24918 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:56.338853 24918 raft_consensus.cc:697] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:56.333812 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.340915 21761 raft_consensus.cc:2410] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:08:56.346030 24918 consensus_queue.cc:237] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:56.317603 24907 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:56.349540 24768 raft_consensus.cc:2804] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:56.349970 24768 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.350296 24768 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:56.350939 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.353534 24836 consensus_queue.cc:1048] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:56.358203 21907 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:56.360355 21762 raft_consensus.cc:1240] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:08:56.317129 24747 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 13:08:56.391422 21711 auto_rebalancer.cc:629] Failed to schedule move for tablet 773a4e5c42d942629a59d30efb0870f6: Illegal state: Replica 6d698a5544b946939790e7a3972db9fb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:56.356813 24635 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:08:56.397548 24955 log.cc:927] Time spent T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 13:08:56.398598 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.406435 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.407084 21760 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:56.408368 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.408933 21760 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:56.410065 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.410588 21760 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:56.416196 21804 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:56.416822 24601 consensus_queue.cc:1059] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:08:56.417294 24418 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:56.419711 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.419418 24581 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:56.373687 24915 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:08:56.431504 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:56.432188 21909 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:56.433049 21757 raft_consensus.cc:1275] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:56.433264 21804 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:56.435871 24893 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:56.436507 24893 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:56.443921 21756 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:56.449497 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.450582 21756 raft_consensus.cc:2393] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 6: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:56.451416 24267 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:56.451824 24267 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.451897 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.452215 24267 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:56.452620 21757 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:56.454131 21757 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:56.458060 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.458634 21759 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
W20260709 13:08:56.491907 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.496637 21765 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:56.434374 24418 raft_consensus.cc:697] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:08:56.499280 21711 auto_rebalancer.cc:629] Failed to schedule move for tablet c2c5cb2b121749798f01933921c01ed6: Illegal state: Replica 6d698a5544b946939790e7a3972db9fb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:56.501418 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.499817 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.500800 21763 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:56.504920 21756 raft_consensus.cc:2410] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:08:56.508473 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.509049 21756 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:56.517112 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.518019 21765 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 4.
W20260709 13:08:56.519748 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.520062 21764 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:56.520478 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.521003 21756 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:56.523763 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.524376 21759 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:56.527006 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.530761 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.531867 21765 raft_consensus.cc:1240] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:56.532517 21761 raft_consensus.cc:2376] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8. Re-sending same reply.
I20260709 13:08:56.532750 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.533340 21764 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:56.537742 21756 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:56.525355 24581 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.543239 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.541100 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.547521 21765 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:56.549446 21759 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:08:56.550658 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.551656 21764 raft_consensus.cc:2393] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 5: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:56.521164 24941 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:56.570214 24793 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.570833 24793 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:56.540217 24925 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.573743 21760 raft_consensus.cc:1240] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:56.549759 24581 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.534231 24768 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:56.598321 24546 raft_consensus.cc:3055] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:56.598905 24546 raft_consensus.cc:740] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:56.599030 24768 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:56.602545 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:56.603186 21840 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:08:56.604764 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:56.607101 22448 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:56.608932 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:56.612967 21911 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:08:56.616626 24267 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.619274 24267 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:56.580271 24581 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:56.635891 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:56.636484 21914 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
W20260709 13:08:56.631664 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.631770 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:56.633617 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:56.639647 21908 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:56.595219 24793 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:56.600064 24546 consensus_queue.cc:260] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.595503 24893 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:56.642642 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:56.643244 21906 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:56.644598 21805 leader_election.cc:336] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.992s (SENT)
I20260709 13:08:56.645028 21805 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:56.651428 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.652971 21908 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:08:56.561862 24418 consensus_queue.cc:237] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:56.679447 24965 log.cc:927] Time spent T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:08:56.682091 24969 log.cc:927] Time spent T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:08:56.654486 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:56.630251 24915 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:56.658807 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.660151 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.685766 21761 raft_consensus.cc:2368] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 9. Current term is 10.
I20260709 13:08:56.663167 21840 raft_consensus.cc:1275] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:08:56.661347 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.686755 21756 raft_consensus.cc:2393] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 8: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:56.665354 21804 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:56.685170 21765 raft_consensus.cc:2376] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6. Re-sending same reply.
I20260709 13:08:56.688709 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.690650 21804 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:56.667917 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.691527 21764 raft_consensus.cc:2368] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 5. Current term is 6.
W20260709 13:08:56.691594 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 51721.8us
I20260709 13:08:56.668432 24546 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:56.693346 21804 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:56.694373 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:56.673530 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.673820 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.674237 24941 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:56.684397 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.698788 21840 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:08:56.698944 21757 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
W20260709 13:08:56.692204 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.700201 21906 raft_consensus.cc:2468] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:08:56.701421 21879 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:56.702106 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.704427 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.705000 21760 raft_consensus.cc:2376] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6. Re-sending same reply.
I20260709 13:08:56.705356 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.706105 21761 raft_consensus.cc:2393] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 5: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:56.707276 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.707352 24865 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:08:56.708123 21757 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:56.709515 24630 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:56.709667 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.710057 24630 raft_consensus.cc:697] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:56.710227 21762 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:56.711004 24630 consensus_queue.cc:237] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:56.714232 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.714965 24832 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:56.717821 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.701413 24580 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:56.719035 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.719310 24580 raft_consensus.cc:697] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:56.720211 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.720139 24580 consensus_queue.cc:237] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.720566 21913 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:56.701552 24795 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:56.720785 21763 raft_consensus.cc:2376] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8. Re-sending same reply.
I20260709 13:08:56.721390 24795 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.721834 24795 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:56.721958 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.722555 21765 raft_consensus.cc:2376] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10. Re-sending same reply.
W20260709 13:08:56.723569 21711 auto_rebalancer.cc:629] Failed to schedule move for tablet 5e295b8b73874adcb77878c1ca4897ea: Illegal state: Replica 3843e9b794a245dd8608e04ec7915239 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:08:56.723739 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:56.690249 24893 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:56.689330 24915 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:56.725386 24915 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:56.727557 21756 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:56.731230 21834 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:56.732139 21762 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:56.733851 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.720623 24585 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.736810 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:56.739161 24585 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:56.701288 24895 consensus_queue.cc:1048] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:08:56.744081 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.745044 21765 raft_consensus.cc:2393] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 6: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:56.706943 22449 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:56.690256 24267 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:56.754606 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:56.764202 21728 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:56.761776 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.764838 21909 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:08:56.753777 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:56.751988 21913 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:56.762136 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:56.769627 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.780546 21909 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:08:56.781067 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:56.786082 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.787014 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.786082 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:56.788497 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.789058 21759 raft_consensus.cc:2376] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6. Re-sending same reply.
I20260709 13:08:56.789681 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:56.795364 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.796716 21834 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:56.796716 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.797475 21761 raft_consensus.cc:2376] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6. Re-sending same reply.
I20260709 13:08:56.801352 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:56.802335 21765 raft_consensus.cc:2393] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 5: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:56.746158 24925 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:56.795984 21760 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:08:56.805039 21764 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:08:56.807562 21906 raft_consensus.cc:1240] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:08:56.761812 24863 raft_consensus.cc:2804] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:56.811244 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.817225 21764 raft_consensus.cc:1275] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:08:56.785746 24941 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:08:56.818349 21764 pending_rounds.cc:85] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 2
I20260709 13:08:56.829942 21760 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:08:56.823383 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:56.830331 21760 pending_rounds.cc:85] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 6
I20260709 13:08:56.830684 21760 pending_rounds.cc:107] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:08:56.786459 24585 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:56.822587 21765 raft_consensus.cc:1240] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:56.830123 21764 pending_rounds.cc:107] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:08:56.834668 21764 raft_consensus.cc:2889] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:56.794865 24793 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:56.785898 24549 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:08:56.774737 24915 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:56.830971 21760 raft_consensus.cc:2889] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:56.813231 24939 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:08:56.862756 24970 log.cc:927] Time spent T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:08:56.870883 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.844254 24924 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:56.898700 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.839330 24585 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:56.842303 24793 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:56.927863 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.934765 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:56.938005 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:56.908799 24907 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.860399 24939 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:57.002498 24907 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:57.029054 24630 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:56.900188 24924 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:56.938760 24793 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:57.038869 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:57.041750 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:57.059648 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.038728 24918 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:08:57.074013 21764 raft_consensus.cc:1240] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:57.076186 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:57.076881 21756 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:08:57.077951 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 178092us
I20260709 13:08:57.091499 21831 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:57.066180 24863 raft_consensus.cc:697] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:57.096560 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:57.098640 21760 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:08:57.094364 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:57.099969 21765 raft_consensus.cc:2393] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 6: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:57.035914 24630 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:57.106770 21756 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:08:57.107936 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:57.109081 21756 raft_consensus.cc:3060] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:57.111841 21911 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:57.114178 21907 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:08:57.116683 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.140919 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:57.141881 21760 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:57.147259 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:57.152633 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:57.169890 21911 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:08:57.174928 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:57.175519 21757 raft_consensus.cc:2376] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8. Re-sending same reply.
I20260709 13:08:57.176697 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:57.177534 21836 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:57.182886 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:57.191059 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 78729.1us
I20260709 13:08:57.191222 21836 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:08:57.196317 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:57.146780 24580 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.218093 21837 raft_consensus.cc:2393] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 9: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:08:57.224537 24973 log.cc:927] Time spent T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:08:57.174122 24915 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:57.182519 24977 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.228253 21760 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:08:57.228720 21805 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:57.231483 21756 raft_consensus.cc:2468] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:08:57.238798 21760 raft_consensus.cc:1275] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:57.347040 21757 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:08:57.219240 24978 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.244407 21759 raft_consensus.cc:1275] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:08:57.251181 21805 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:57.365680 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 124530us
W20260709 13:08:57.246469 24980 log.cc:927] Time spent T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:08:57.250296 24982 log.cc:927] Time spent T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:08:57.451335 21756 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:57.231828 24585 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:08:57.249115 24795 consensus_meta.cc:287] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.001s
I20260709 13:08:57.245524 24418 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:57.344444 24267 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:57.250021 24981 log.cc:927] Time spent T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:08:57.381265 24915 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.220553 24580 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:57.366617 24939 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:57.475960 22480 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:08:57.478008 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:57.343969 24601 consensus_queue.cc:1048] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.123s
I20260709 13:08:57.250594 24977 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:57.414124 24994 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:08:57.452893 24924 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:57.468327 24795 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:57.483901 24907 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:57.485020 24993 log.cc:927] Time spent T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:08:57.465253 24418 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:57.489053 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:57.515491 21758 raft_consensus.cc:2376] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8. Re-sending same reply.
I20260709 13:08:57.490741 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:57.516667 21914 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:57.480343 24918 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.241415 24863 consensus_queue.cc:237] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:57.520735 22449 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:57.521783 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 100029us
I20260709 13:08:57.522356 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:57.530050 21765 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:57.532884 21877 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:57.441483 24978 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:57.471858 24267 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:57.545946 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:57.550439 21765 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:57.479874 24915 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:57.557590 21729 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:57.525154 24418 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:57.578193 21729 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:57.579627 24924 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:57.581059 21729 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:57.582269 24924 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:57.583994 21729 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:57.585803 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 65196.4us
I20260709 13:08:57.587160 21729 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:57.543756 24630 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:57.582870 24924 raft_consensus.cc:697] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:57.499255 24991 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:08:57.607120 24580 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:57.593376 24937 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:57.576344 24601 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:57.609591 24601 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:57.610184 24601 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:57.534489 24918 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:57.597885 24865 consensus_queue.cc:1059] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:08:57.614547 24865 raft_consensus.cc:3055] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:57.615029 24865 raft_consensus.cc:740] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:57.592059 24939 raft_consensus.cc:2764] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:08:57.616161 24865 consensus_queue.cc:260] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:57.617635 24267 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:57.619943 24978 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:57.623934 22450 leader_election.cc:336] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.656s (SENT)
W20260709 13:08:57.570713 24836 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.011s	sys 0.031s
W20260709 13:08:57.637809 24836 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.011s	sys 0.031s
W20260709 13:08:57.639897 24998 log.cc:927] Time spent T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
W20260709 13:08:57.641561 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 54503.9us
I20260709 13:08:57.597263 24992 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:08:57.636608 24966 log.cc:927] Time spent T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:08:57.654111 22450 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:57.635237 24630 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:08:57.658041 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.633348 24918 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:57.668864 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 208545us
I20260709 13:08:57.643746 21729 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:08:57.673702 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.644079 24992 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:57.643952 24937 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:57.671756 21765 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:08:57.674307 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:57.676301 21758 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:08:57.689579 22450 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:57.659463 24865 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:57.691596 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:57.695602 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:57.689625 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:57.703382 21765 raft_consensus.cc:2393] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 5: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:57.701321 21913 raft_consensus.cc:2393] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:57.703914 21838 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:57.704840 21757 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:08:57.705243 21832 raft_consensus.cc:2393] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 8: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:57.704193 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:57.673617 24793 raft_consensus.cc:2804] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:57.662474 24995 consensus_queue.cc:1059] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:08:57.708437 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:57.722574 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:57.690842 24925 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:57.689105 24992 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:57.724525 21758 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:57.691962 24630 raft_consensus.cc:697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:08:57.734053 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 44545.2us
I20260709 13:08:57.737478 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:57.715281 25008 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.738361 21833 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
W20260709 13:08:57.740461 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 489373us
W20260709 13:08:57.749298 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:57.754168 21833 raft_consensus.cc:1240] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
W20260709 13:08:57.756582 25002 log.cc:927] Time spent T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:08:57.754155 24915 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:57.760150 21833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:08:57.766474 21833 raft_consensus.cc:606] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
W20260709 13:08:57.812515 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 121555us
I20260709 13:08:57.742165 24836 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:57.740502 24953 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:57.839145 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 95055.9us
I20260709 13:08:57.742010 24795 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:57.854959 24630 consensus_queue.cc:237] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:57.857965 24999 log.cc:927] Time spent T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
I20260709 13:08:57.765554 24267 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.860148 24267 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:57.848719 21729 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:57.870350 21914 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:08:57.724535 24924 consensus_queue.cc:237] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:57.845415 24941 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.991s	user 0.010s	sys 0.020s
I20260709 13:08:57.880439 21805 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:57.757650 24978 consensus_queue.cc:1059] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
W20260709 13:08:57.886567 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 145050us
I20260709 13:08:57.749089 25008 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:57.880884 24925 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:57.870607 25017 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.901911 21805 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:57.902132 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:08:57.886628 24941 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.011s	sys 0.020s
W20260709 13:08:57.888878 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 186728us
I20260709 13:08:57.905689 21839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:08:57.907861 21839 raft_consensus.cc:606] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:57.908277 21839 raft_consensus.cc:614] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:57.908674 21805 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:57.888612 24937 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:57.863312 24953 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:57.906646 21758 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:08:57.915942 21805 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:57.894687 24785 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:57.921634 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2569) took 1260 ms. Trace:
W20260709 13:08:57.913530 24546 consensus_meta.cc:287] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 1.210s	user 0.012s	sys 0.002s
I20260709 13:08:57.903787 24793 raft_consensus.cc:697] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:57.907799 24979 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:57.929643 22450 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:57.895236 24836 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:08:57.896540 24915 consensus_queue.cc:1048] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:08:57.896852 24832 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:08:57.922145 21763 rpcz_store.cc:276] 0709 13:08:56.661670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.792690 (+131020us) service_pool.cc:224] Handling call
0709 13:08:56.812238 (+ 19548us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:57.066721 (+254483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.066759 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:57.067207 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:08:57.257246 (+190039us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:57.380772 (+123526us) log.cc:844] Serialized 14 byte log entry
0709 13:08:57.381827 (+  1055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.381936 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:57.921376 (+539440us) raft_consensus.cc:1685] finished
0709 13:08:57.921397 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:57.921572 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6038,"prepare.queue_time_us":135305,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":7177,"raft.queue_time_us":63542,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":21989,"thread_start_us":357275,"threads_started":2,"wal-append.queue_time_us":496828}
I20260709 13:08:57.913934 24795 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:57.909384 24941 raft_consensus.cc:697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:08:57.920686 25007 raft_consensus.cc:2804] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:08:57.933758 24978 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:57.934191 24267 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:57.904729 25014 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:08:57.938402 25021 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:08:57.950304 24987 log.cc:927] Time spent T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.497s	user 0.004s	sys 0.000s
I20260709 13:08:57.951074 24953 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:57.951942 25016 log.cc:927] Time spent T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:57.960439 21758 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:08:57.936316 25018 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.944392 24768 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:57.964622 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:57.964795 24768 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.965298 24768 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:57.968061 25008 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:57.910508 25017 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:57.969769 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:57.935920 24989 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:57.970415 21760 raft_consensus.cc:2376] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8. Re-sending same reply.
I20260709 13:08:57.970773 24989 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:57.971352 25017 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:57.921376 24937 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:57.939750 24795 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:57.980818 22449 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:57.955870 25004 log.cc:927] Time spent T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 13:08:57.975343 25021 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:57.991247 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2578) took 1327 ms. Trace:
I20260709 13:08:57.991928 24768 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:57.992738 25021 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:57.962186 24546 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.993796 24546 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:57.996214 24546 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:57.996994 25012 log.cc:927] Time spent T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260709 13:08:58.000525 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.001116 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:58.004007 21832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:08:58.004856 21832 raft_consensus.cc:606] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:58.005292 21832 raft_consensus.cc:614] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:58.006604 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:58.007448 22481 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:08:58.009874 24977 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:58.012393 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:57.982192 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:58.014351 22482 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
W20260709 13:08:57.952630 25013 log.cc:927] Time spent T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:08:57.942355 25007 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:57.932713 24785 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:57.981856 25018 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:57.986086 24601 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.026700 25017 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.953336 24941 consensus_queue.cc:237] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:57.988392 25026 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:58.024016 25007 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:58.034837 24953 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.048010 24953 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.048194 24793 consensus_queue.cc:237] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.050360 24953 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:58.052052 21912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:08:58.052714 21912 raft_consensus.cc:606] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:58.053071 21912 raft_consensus.cc:614] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:58.053274 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:58.029536 21840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1783) took 1316 ms. Trace:
I20260709 13:08:58.030827 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.055315 21914 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:08:58.036378 21806 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:58.015674 21880 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:57.991672 21761 rpcz_store.cc:276] 0709 13:08:56.664135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.798060 (+133925us) service_pool.cc:224] Handling call
0709 13:08:56.814264 (+ 16204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:57.064708 (+250444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.064757 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:57.089041 (+ 24284us) log.cc:844] Serialized 26 byte log entry
0709 13:08:57.498281 (+409240us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:57.530323 (+ 32042us) log.cc:844] Serialized 14 byte log entry
0709 13:08:57.530709 (+   386us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.530859 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:57.955311 (+424452us) spinlock_profiling.cc:243] Waited 6.69 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:57.990947 (+ 35636us) raft_consensus.cc:1685] finished
0709 13:08:57.991043 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:57.991183 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19222,"prepare.queue_time_us":33110,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":55862,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"spinlock_wait_cycles":23971968,"thread_start_us":546883,"threads_started":2,"wal-append.queue_time_us":526653}
I20260709 13:08:58.019832 21879 leader_election.cc:400] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 9. Current term is 10.
I20260709 13:08:57.935309 25003 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:08:58.013492 24795 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:08:57.973196 24989 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:58.023690 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:57.959729 24978 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:08:58.119999 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.110756 21762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 377) took 1008 ms. Trace:
I20260709 13:08:58.123689 21879 leader_election.cc:403] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:08:58.009858 25006 log.cc:927] Time spent T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:08:58.116217 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:58.084116 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:58.123942 21835 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:58.024951 21731 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:58.069703 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.062217 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:58.155674 21914 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:08:58.027236 24601 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:58.156884 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:58.157403 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 132578us
I20260709 13:08:58.072870 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:58.154044 21760 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:58.152580 21756 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
W20260709 13:08:58.158228 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 121960us
I20260709 13:08:58.172048 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:58.075101 21877 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:58.159289 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:58.173179 21765 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:58.156843 24989 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:58.080284 25028 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:08:58.052078 24937 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:58.061729 24979 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:58.054656 24977 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:58.024267 24988 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.195604 21764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 362) took 1106 ms. Trace:
I20260709 13:08:58.195478 24988 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.073194 24785 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:58.195998 21764 rpcz_store.cc:276] 0709 13:08:57.089582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.089718 (+   136us) service_pool.cc:224] Handling call
0709 13:08:57.090075 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:57.097185 (+  7110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.097232 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:57.112363 (+ 15131us) log.cc:844] Serialized 26 byte log entry
0709 13:08:57.670670 (+558307us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:57.692108 (+ 21438us) log.cc:844] Serialized 14 byte log entry
0709 13:08:57.695032 (+  2924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.695134 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.195305 (+500171us) raft_consensus.cc:1685] finished
0709 13:08:58.195327 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.195546 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2613,"prepare.queue_time_us":31003,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":3082,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":7542,"spinlock_wait_cycles":4864,"thread_start_us":436063,"threads_started":1,"wal-append.queue_time_us":682104}
I20260709 13:08:58.132589 24978 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.197600 25022 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:58.198065 25022 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.198417 25022 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:58.071111 25026 raft_consensus.cc:697] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:58.202095 25026 consensus_queue.cc:237] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.204589 24795 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.162192 24768 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:58.159729 24267 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:58.162423 22449 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:08:58.206946 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 44622.1us
I20260709 13:08:58.207897 21764 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:58.159781 24549 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:58.034404 24865 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.135s
I20260709 13:08:58.212809 21832 raft_consensus.cc:2410] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:58.125139 21762 rpcz_store.cc:276] 0709 13:08:57.102483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.657477 (+554994us) service_pool.cc:224] Handling call
0709 13:08:57.657868 (+   391us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:57.670244 (+ 12376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:57.670278 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:57.673924 (+  3646us) log.cc:844] Serialized 52 byte log entry
0709 13:08:57.900412 (+226488us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:57.906275 (+  5863us) log.cc:844] Serialized 14 byte log entry
0709 13:08:57.910881 (+  4606us) log.cc:844] Serialized 14 byte log entry
0709 13:08:57.913391 (+  2510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.913486 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:58.026422 (+112936us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b1800340720. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab26a3f3 00007fc6ab26c7c1 00007fc6ab26c779 00007fc6ab26c709 00007fc6ab26c6d1 00007fc6ab26b9cd 000000000038f354 000000000038f199 00007fc6ab24d83a
0709 13:08:58.027573 (+  1151us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b1800340720. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab26a522 00007fc6ab26c7c1 00007fc6ab26c779 00007fc6ab26c709 00007fc6ab26c6d1 00007fc6ab26b9cd 000000000038f354 000000000038f199 00007fc6ab24d83a
0709 13:08:58.110464 (+ 82891us) raft_consensus.cc:1685] finished
0709 13:08:58.110494 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.110676 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17270,"prepare.queue_time_us":25296,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":11420,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":21142,"spinlock_wait_cycles":23926656,"thread_start_us":178269,"threads_started":1,"wal-append.queue_time_us":272501}
I20260709 13:08:58.054654 21840 rpcz_store.cc:276] 0709 13:08:56.713090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:56.713210 (+   120us) service_pool.cc:224] Handling call
0709 13:08:56.713585 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:56.713884 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:56.713916 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:56.791717 (+ 77801us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b2c0000e678. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6acc50a11 00007fc6acc60372 00007fc6ae392a01 00007fc6ae35743a 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2
0709 13:08:56.812929 (+ 21212us) log.cc:844] Serialized 26 byte log entry
0709 13:08:57.149648 (+336719us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:08:57.149713 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:57.149820 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:57.949666 (+799846us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:08:58.029240 (+ 79574us) raft_consensus.cc:1685] finished
0709 13:08:58.029272 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:58.029457 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4615,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"spinlock_wait_cycles":51947136,"thread_start_us":319586,"threads_started":1,"wal-append.queue_time_us":557594}
I20260709 13:08:58.027283 25017 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.068090 24992 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.192809 24601 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:58.185896 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:58.122190 25018 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:58.206523 24267 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.053421 25007 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.193989 24937 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:08:58.194038 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 178561us
I20260709 13:08:58.228955 21879 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:58.194595 24977 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.194936 25010 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:58.208439 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:58.231261 21914 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:58.209854 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 134839us
I20260709 13:08:58.048038 24418 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.114679 25020 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.192492 24630 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 9. Current term is 10.
I20260709 13:08:58.216528 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:58.250855 21762 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:58.218572 21756 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
W20260709 13:08:58.188228 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 172599us
I20260709 13:08:58.251471 25018 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:58.253634 25030 consensus_queue.cc:1059] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:08:58.254760 25030 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.255452 25021 raft_consensus.cc:3055] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:58.255889 25021 raft_consensus.cc:740] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:58.256713 25021 consensus_queue.cc:260] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.222388 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:58.224865 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:58.225651 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:58.189213 24989 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.226518 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:58.259004 21837 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:08:58.240110 21914 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:08:58.213541 24585 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:58.227850 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:58.229240 22480 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:08:58.220214 21765 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:08:58.249228 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:58.255177 25030 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.211615 24785 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.251430 21879 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:58.226497 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:58.261799 21764 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:58.263115 22449 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:58.283903 21835 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:58.283550 21831 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:08:58.263500 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.284935 21835 raft_consensus.cc:1240] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 4. Current term is 5. Ops: []
I20260709 13:08:58.284991 21908 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:58.212759 24549 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.257681 25010 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.267038 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:58.223863 24267 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:58.267644 25021 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:58.267711 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:58.268808 25001 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:58.222414 24601 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.270159 21837 raft_consensus.cc:1240] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:58.270771 21838 raft_consensus.cc:2410] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:08:58.270578 24585 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.272424 21728 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:58.287506 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:58.312609 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:58.289989 21764 raft_consensus.cc:1275] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:58.265885 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.294179 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.313817 21908 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
W20260709 13:08:58.298974 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 47633.3us
I20260709 13:08:58.313861 21914 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:08:58.314837 21879 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:58.210438 24979 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.293825 24953 raft_consensus.cc:2764] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:08:58.287710 25026 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:58.309028 21906 raft_consensus.cc:1275] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:08:58.222532 24988 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:58.314000 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:58.317365 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:08:58.319617 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 47297.4us
I20260709 13:08:58.324674 21728 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:58.324002 21837 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:08:58.325798 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.326370 21908 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:58.327306 21837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:08:58.328204 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.327797 21837 raft_consensus.cc:606] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:08:58.329226 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.329721 21837 raft_consensus.cc:614] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:58.329846 21913 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:58.332078 21840 raft_consensus.cc:2410] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:08:58.334544 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.335232 21913 raft_consensus.cc:2393] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:58.334977 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.336308 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:58.337934 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.338364 21837 raft_consensus.cc:1240] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:58.338456 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:58.339285 21765 raft_consensus.cc:2410] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:08:58.339267 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.340689 25015 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:58.341207 25015 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.342769 24979 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:58.343176 25015 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:58.343294 24979 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:58.343861 24979 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.329113 24937 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:58.331130 24988 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.344664 24937 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:58.345152 24937 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:58.344916 24988 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.345893 21908 raft_consensus.cc:2393] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 7: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:58.345960 21763 raft_consensus.cc:1240] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:58.346971 24988 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:58.315778 25001 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.317570 24585 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:58.349792 21764 raft_consensus.cc:2393] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 8: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:58.352118 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:58.323024 24630 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:58.354765 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.355562 21909 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:58.288403 24785 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.271271 25020 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.357996 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:58.358975 21838 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:08:58.315718 25014 consensus_queue.cc:1059] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:08:58.361268 21728 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:58.362520 24418 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:58.363598 25007 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:58.364260 24795 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:58.338107 24941 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:58.364449 24978 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.366511 25010 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:58.319042 24768 consensus_queue.cc:1059] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:08:58.367614 24768 raft_consensus.cc:3055] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:58.367926 24768 raft_consensus.cc:740] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:58.368703 24768 consensus_queue.cc:260] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.353663 25001 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:58.371121 24939 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:58.372188 25017 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:58.373229 24549 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:58.375088 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:58.357630 25042 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.375792 25005 raft_consensus.cc:3055] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:08:58.364915 24941 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:58.381870 21835 raft_consensus.cc:1240] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 5. Current term is 6. Ops: []
I20260709 13:08:58.339564 25026 raft_consensus.cc:697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
W20260709 13:08:58.361173 25033 log.cc:927] Time spent T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:08:58.391104 21759 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:58.393455 24941 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.396055 24989 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:58.388923 24939 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.393244 25005 raft_consensus.cc:740] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:58.405875 21908 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:08:58.423233 24549 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.424945 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:58.417743 25043 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:08:58.413661 25026 consensus_queue.cc:237] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.402606 24939 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:58.424460 24989 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:08:58.441905 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 114392us
I20260709 13:08:58.445683 21805 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:58.447314 21805 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
W20260709 13:08:58.448228 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 133473us
I20260709 13:08:58.448942 21879 leader_election.cc:400] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 5. Current term is 6.
W20260709 13:08:58.442024 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 122155us
I20260709 13:08:58.442227 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.449548 21879 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:58.450863 21879 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:58.451161 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:58.451686 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:58.424010 24785 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:58.453804 24630 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:58.453990 25010 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:58.454393 25010 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:58.454763 25010 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:58.452253 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:58.455974 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:58.459074 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:58.453485 21805 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:58.460373 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:58.448470 24995 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.020s	sys 0.024s
I20260709 13:08:58.451401 24418 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:58.467824 24267 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.395015 25042 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.473145 21836 raft_consensus.cc:2393] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 8: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:58.473192 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:58.474088 21913 raft_consensus.cc:2393] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 5: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:58.478436 21879 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:58.452179 25018 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:08:58.464242 24995 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.020s	sys 0.024s
I20260709 13:08:58.480923 24630 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:58.458643 25017 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:58.447829 24989 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.440055 24549 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.482074 24267 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:58.479483 21879 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:58.482446 25001 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:58.486750 25046 log.cc:927] Time spent T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:08:58.487025 24941 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.488085 21805 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:58.488515 25054 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:58.462692 24601 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:58.490856 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.494217 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:58.491756 21804 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:58.494227 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:58.496094 21909 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:58.498023 25020 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:58.499850 24549 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:58.506950 24581 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:58.490638 24630 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:58.490422 24907 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:58.511963 25049 log.cc:927] Time spent T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:08:58.512183 24907 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.512813 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:58.513669 21831 raft_consensus.cc:2410] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:08:58.502142 25017 raft_consensus.cc:697] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:58.514261 24907 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:58.514748 21831 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:08:58.511991 24630 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.515184 25017 consensus_queue.cc:237] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.516996 25009 raft_consensus.cc:3055] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:58.510671 24581 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.518029 24581 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.521049 24585 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.521679 25018 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:58.510156 22478 raft_consensus.cc:2393] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 8: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
W20260709 13:08:58.511487 25047 log.cc:927] Time spent T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:58.511420 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:58.525345 21914 raft_consensus.cc:2410] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:08:58.525640 24585 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:58.505807 24989 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:58.526684 24989 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.527159 24989 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.517416 25009 raft_consensus.cc:740] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:08:58.529982 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:58.530926 22484 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:58.483808 24937 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.505124 21805 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:58.529381 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:58.514266 25030 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:58.533599 25015 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:58.508898 24418 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:08:58.536808 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 57412us
I20260709 13:08:58.509343 21877 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:58.538995 21877 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:58.535038 21805 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:58.541472 21879 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:58.510560 24978 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:58.533995 25015 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.544343 21879 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:58.546367 25021 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:08:58.541153 21805 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:58.552737 25054 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:58.577543 21805 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:58.538734 24418 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.580447 21879 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:58.528030 25022 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.542623 25030 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:58.582450 21877 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:58.607856 24630 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.490381 25005 consensus_queue.cc:260] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.609910 21911 raft_consensus.cc:2393] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 8: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:58.610255 21879 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:58.577219 25015 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:58.583192 25054 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.616695 21879 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:58.578047 25018 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:08:58.617671 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 281655us
I20260709 13:08:58.726998 21729 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:58.583060 21805 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:58.539602 24549 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:08:58.579154 25051 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:58.587204 24905 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:08:58.730834 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 114223us
I20260709 13:08:58.730894 21729 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:58.584523 24418 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:58.614571 25021 raft_consensus.cc:2764] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:08:58.587450 24978 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:58.610280 24924 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:58.614233 25020 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:58.728766 24865 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:58.743904 21879 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:58.726317 25018 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.754338 25018 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.754678 24937 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:58.754794 21879 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:58.730149 24925 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:58.579305 25053 consensus_queue.cc:1059] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.153s
I20260709 13:08:58.726339 24267 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:58.648027 25054 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:58.775393 24267 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.746742 24924 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.749046 25020 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.749606 25001 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:58.752828 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:58.780754 21763 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:58.727326 25008 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:58.758329 21879 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:58.759476 24986 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:58.760316 24941 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:58.760751 25024 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:58.761780 24989 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:58.765506 24907 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.765990 25038 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.766336 25021 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:58.745033 24580 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:58.774068 22484 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:08:58.744278 25051 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.742755 24905 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:08:58.782034 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 164943us
I20260709 13:08:58.755931 24865 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.838742 21877 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:58.839675 21763 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
W20260709 13:08:58.840898 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 257867us
I20260709 13:08:58.786748 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.841782 21913 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:08:58.795655 21761 raft_consensus.cc:1275] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:58.799921 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.796164 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.793270 25053 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:58.823556 25021 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:58.780495 24937 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:58.814852 24907 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.821542 25042 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:58.813568 25038 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.830924 21880 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:08:58.734659 25030 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:58.850417 21805 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:58.855228 21835 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:58.855996 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:58.728874 25009 consensus_queue.cc:260] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.836355 24989 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:08:58.866086 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.863731 24905 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:58.837893 25051 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:58.871989 21760 raft_consensus.cc:1275] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:58.796525 25024 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:58.875337 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:58.831475 24580 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:58.836488 24585 raft_consensus.cc:3055] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:58.822949 25058 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:58.867923 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:58.912806 21831 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:58.868541 24986 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:58.869115 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:08:58.891522 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 109029us
I20260709 13:08:58.896248 21837 raft_consensus.cc:2393] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 8: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:58.871850 24941 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:08:58.906082 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:58.883747 25022 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:58.916860 21879 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:58.893698 25042 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:58.884559 24925 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:58.898957 24580 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:58.932901 21879 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:58.933216 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:58.935899 21913 raft_consensus.cc:2393] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:58.880306 24937 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:58.936118 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 105156us
I20260709 13:08:58.896908 25024 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:58.899102 24585 raft_consensus.cc:740] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:58.941833 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:58.946771 21831 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:08:58.944585 21879 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:58.891651 25032 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:08:58.915974 25030 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:58.948753 24924 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:58.927532 24941 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.955122 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.894306 25010 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.977710 24908 raft_consensus.cc:3055] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:58.899511 24989 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.972518 24267 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:58.973829 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.973905 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:58.988636 21913 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:08:58.989173 21914 raft_consensus.cc:2393] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 7: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:58.897135 25017 consensus_queue.cc:1048] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:08:58.936395 25009 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:58.991207 25053 raft_consensus.cc:697] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:58.971606 25008 raft_consensus.cc:697] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:58.993094 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.994138 21914 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:08:58.997072 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 52543.7us
I20260709 13:08:58.999616 21729 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:59.010293 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:58.988245 24953 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:58.941592 24925 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:58.982517 24908 raft_consensus.cc:740] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:58.918169 25058 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:58.945760 24581 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:59.026667 21879 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:58.924230 24986 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:59.014098 25020 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:59.001825 24863 consensus_queue.cc:1048] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:08:59.032748 25061 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:59.057996 24979 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:08:59.033751 25060 log.cc:927] Time spent T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 13:08:59.035220 25064 log.cc:927] Time spent T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:08:59.081553 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:59.035787 25072 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:59.019727 25022 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:59.056412 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 519) took 1028 ms. Trace:
I20260709 13:08:59.064898 25038 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:59.034471 25065 log.cc:927] Time spent T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:08:59.013644 25068 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:08:59.075874 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:59.037364 25056 log.cc:927] Time spent T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:08:59.089323 21907 rpcz_store.cc:276] 0709 13:08:58.028269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.029716 (+  1447us) service_pool.cc:224] Handling call
0709 13:08:58.030114 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:58.191621 (+161507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.191667 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:58.206113 (+ 14446us) log.cc:844] Serialized 26 byte log entry
0709 13:08:58.304119 (+ 98006us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:58.308794 (+  4675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.056025 (+747231us) spinlock_profiling.cc:243] Waited 41.1 ms on lock 0x7b54003af7d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:59.056077 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:59.056120 (+    43us) raft_consensus.cc:1685] finished
0709 13:08:59.056133 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:59.056347 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":119912,"raft.queue_time_us":126409,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":74,"spinlock_wait_cycles":94597376,"thread_start_us":92572,"threads_started":1,"wal-append.queue_time_us":126666}
I20260709 13:08:59.093040 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:59.093523 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:59.094488 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 67898.8us
I20260709 13:08:59.069344 24941 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:59.059062 24907 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:59.045492 24977 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:59.064155 25010 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:59.116904 25069 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:59.117753 25069 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:59.120210 24865 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:59.092586 25022 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:59.121836 25022 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:59.122269 25058 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:59.124713 24925 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:59.127893 24986 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:59.041145 25053 consensus_queue.cc:237] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:59.130306 24418 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:59.101063 25061 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:08:59.134547 25061 consensus_queue.cc:1048] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:08:59.136420 25061 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:08:59.026285 24585 consensus_queue.cc:260] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:59.061378 25015 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:59.061568 25024 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:59.140885 25015 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:59.142470 25024 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:59.142701 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:59.143589 25024 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:08:59.150650 24581 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:59.047279 24905 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:59.154937 24905 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:59.068255 25051 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:59.156580 24601 raft_consensus.cc:993] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:08:59.158718 25051 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:08:59.159329 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 652601us
I20260709 13:08:59.162612 24937 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:59.088796 25020 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:08:59.112382 25068 raft_consensus.cc:697] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:59.165354 25068 consensus_queue.cc:237] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:59.166874 24630 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:59.062474 24989 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:59.178792 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:08:59.183310 21804 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:59.107829 21838 raft_consensus.cc:2393] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 7: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:59.073755 24953 raft_consensus.cc:697] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:59.063247 25008 consensus_queue.cc:237] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:59.082329 25041 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:59.100884 25076 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:59.044157 25071 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:08:59.084844 24939 consensus_meta.cc:287] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.637s	user 0.010s	sys 0.000s
I20260709 13:08:59.157364 24601 raft_consensus.cc:1081] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:08:59.069741 24908 consensus_queue.cc:260] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:59.243325 21908 raft_consensus.cc:1240] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 5. Current term is 6. Ops: []
W20260709 13:08:59.243698 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 151773us
I20260709 13:08:59.254026 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:59.257970 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:59.208890 25009 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:59.230842 25041 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.198058 24546 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:08:59.265021 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:59.265259 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:59.238327 25072 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:59.243400 24941 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.277350 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:59.282763 21835 raft_consensus.cc:2393] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 8: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:59.279501 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:59.283231 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:59.281461 21912 raft_consensus.cc:1240] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7. Ops: []
W20260709 13:08:59.285182 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 213841us
I20260709 13:08:59.286180 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:59.286180 21840 raft_consensus.cc:2368] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 9. Current term is 10.
I20260709 13:08:59.239900 24635 consensus_queue.cc:1059] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:08:59.268220 25041 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:08:59.289204 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 280747us
I20260709 13:08:59.257962 25051 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:59.263394 24581 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.295816 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:59.241775 24939 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:59.296200 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:59.274294 24418 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:59.302745 21912 raft_consensus.cc:1275] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:59.297163 21838 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:59.297395 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:59.303251 21877 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:59.300143 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:59.304512 21765 raft_consensus.cc:2393] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 7: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:08:59.296800 21835 raft_consensus.cc:2393] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:59.305912 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:08:59.292649 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 163017us
I20260709 13:08:59.301657 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:59.302176 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:59.306807 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:59.309561 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:59.310194 21757 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:59.311939 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:59.312316 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:59.312953 21760 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:59.313453 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:59.324878 21762 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:59.327208 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:59.328058 21914 raft_consensus.cc:2410] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:08:59.331012 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:59.239648 25076 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:59.331615 21761 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:08:59.330542 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:59.333606 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:59.333288 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:59.336247 21840 raft_consensus.cc:2368] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8.
I20260709 13:08:59.333988 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:59.337242 21835 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:08:59.335538 21765 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:59.332226 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:59.240381 25071 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:59.342116 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:59.347568 21912 raft_consensus.cc:1275] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:08:59.336898 21914 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
W20260709 13:08:59.312633 25018 consensus_meta.cc:287] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.558s	user 0.012s	sys 0.000s
I20260709 13:08:59.346053 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:59.346344 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:59.350958 21763 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.353853 25083 raft_consensus.cc:3055] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:59.354319 25083 raft_consensus.cc:740] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:59.355444 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:59.355643 21839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56424 (request call id 369) took 1124 ms. Trace:
I20260709 13:08:59.355257 25083 consensus_queue.cc:260] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:59.356648 25083 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.357936 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:59.293486 24953 consensus_queue.cc:237] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:59.361040 25018 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:59.363003 25076 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:59.363274 25018 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:08:59.363801 25069 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:59.364069 21910 raft_consensus.cc:2393] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:08:59.365653 25054 consensus_meta.cc:287] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.590s	user 0.007s	sys 0.004s
I20260709 13:08:59.366099 25054 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:59.292749 24580 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:59.287355 25072 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:59.371302 24580 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:59.371742 25072 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:59.302807 25051 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:59.364043 21760 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:08:59.374429 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:59.374599 24939 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:59.374826 25051 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:59.302699 24581 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:59.356065 21839 rpcz_store.cc:276] 0709 13:08:58.231441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.283065 (+ 51624us) service_pool.cc:224] Handling call
0709 13:08:58.304867 (+ 21802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.318078 (+ 13211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.318121 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:58.318180 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:58.318228 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.355413 (+1037185us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b540005fad4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:59.355459 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:59.355584 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29767040}
I20260709 13:08:59.377785 24581 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:59.377933 25071 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:59.330700 24924 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.378875 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:59.379545 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:59.380285 21914 raft_consensus.cc:2393] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:08:59.380704 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:59.288795 24941 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:59.352835 21729 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:59.389289 21765 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:08:59.385799 21763 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:59.378626 24924 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:59.308681 25061 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 13:08:59.425462 21762 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
W20260709 13:08:59.560110 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 207338us
W20260709 13:08:59.416113 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 112935us
I20260709 13:08:59.579362 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:59.487305 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 144960us
I20260709 13:08:59.580390 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:59.608085 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:59.608659 21762 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:59.435055 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38352 (request call id 2672) took 1397 ms. Trace:
I20260709 13:08:59.392645 21838 raft_consensus.cc:2368] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 6. Current term is 7.
I20260709 13:08:59.379474 21912 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:08:59.646734 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:59.647662 21765 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:08:59.649120 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:59.611425 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:59.616112 21731 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:59.650838 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:59.584201 21879 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:59.416620 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:59.646286 24939 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.428154 25076 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:08:59.658674 25038 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:59.659221 25038 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:59.612617 21911 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1295) took 1289 ms (client timeout 1705 ms). Trace:
W20260709 13:08:59.623521 21905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1532) took 1932 ms (client timeout 2294 ms). Trace:
I20260709 13:08:59.652727 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:59.661617 25082 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:08:59.661944 21905 rpcz_store.cc:269] 0709 13:08:57.690717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:57.691747 (+  1030us) service_pool.cc:224] Handling call
0709 13:08:59.623289 (+1931542us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b54001f31d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:59.623447 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1005639552}
I20260709 13:08:59.662329 25082 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:59.658715 24939 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:59.461476 24918 consensus_queue.cc:1048] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.202s
W20260709 13:08:59.663371 25059 log.cc:927] Time spent T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.840s	user 0.006s	sys 0.000s
I20260709 13:08:59.661161 25038 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:59.653940 21729 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:08:59.655103 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:08:59.666816 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:59.667372 21728 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:59.667898 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:59.669087 21760 raft_consensus.cc:2393] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:59.669286 24989 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.669597 24986 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:59.670101 25080 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:59.669921 24989 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:59.670298 24937 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:08:59.671770 24937 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:59.672178 24937 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.672215 24989 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:59.672691 24937 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:59.672837 24863 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:59.670137 24986 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:59.675266 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:08:59.675836 25022 consensus_meta.cc:287] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.000s
I20260709 13:08:59.676266 21836 raft_consensus.cc:2393] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:59.676822 24986 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:59.677055 25041 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:08:59.655478 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.679427 25041 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:59.669162 21728 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:08:59.653736 21764 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59102 (request call id 2599) took 1285 ms (client timeout 1698 ms). Trace:
W20260709 13:08:59.681906 21764 rpcz_store.cc:269] 0709 13:08:58.335121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.336028 (+   907us) service_pool.cc:224] Handling call
0709 13:08:59.620333 (+1284305us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b54003d9d54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:59.620501 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28662144}
I20260709 13:08:59.665037 24939 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:59.685724 21759 raft_consensus.cc:2368] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6.
I20260709 13:08:59.685804 24939 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:59.661669 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:59.689358 21728 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:59.676288 25022 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:08:59.692040 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 107961us
I20260709 13:08:59.651533 21832 rpcz_store.cc:276] 0709 13:08:58.022851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.023030 (+   179us) service_pool.cc:224] Handling call
0709 13:08:59.419719 (+1396689us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b540021c5d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:59.419920 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364417920}
I20260709 13:08:59.658102 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:08:59.664785 21911 rpcz_store.cc:269] 0709 13:08:58.323532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.323905 (+   373us) service_pool.cc:224] Handling call
0709 13:08:59.612369 (+1288464us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b540032d554. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:08:59.612541 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":572782336}
I20260709 13:08:59.625700 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:59.694641 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:08:59.414744 21761 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:08:59.596700 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:08:59.698369 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 349132us
I20260709 13:08:59.707355 21879 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:59.707934 21762 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:08:59.709640 21762 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:08:59.699932 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 83912.7us
I20260709 13:08:59.704931 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:59.712791 21835 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:08:59.368175 25054 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:59.713300 21914 raft_consensus.cc:1240] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:59.345860 25015 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:59.703686 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:59.710959 21877 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:59.700569 21728 leader_election.cc:400] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8.
I20260709 13:08:59.716248 21728 leader_election.cc:403] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:08:59.700958 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:59.711505 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:59.562166 24941 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:59.716964 21879 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:59.717684 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:59.719259 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:59.721000 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:59.721201 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:59.721863 21833 raft_consensus.cc:2393] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 9: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:59.722023 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:59.719566 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:59.722860 21879 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:59.722539 21877 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:59.429598 25084 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.724169 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:59.725875 21879 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:59.725903 21728 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:59.723522 21835 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:08:59.721894 21840 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:08:59.698870 25068 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:08:59.733191 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.705317 25075 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:59.729461 21913 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:08:59.736174 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:59.739784 21728 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:59.406487 24635 consensus_queue.cc:1059] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.312s
I20260709 13:08:59.728466 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:59.703883 25089 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:08:59.747449 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:59.712730 25051 consensus_queue.cc:1048] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:08:59.698765 25073 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:59.741262 21728 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:59.755105 21728 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:08:59.730857 21840 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: []
I20260709 13:08:59.742292 21877 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:59.720669 25076 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:59.735931 25030 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:08:59.744275 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1299) took 1352 ms. Trace:
I20260709 13:08:59.720790 25015 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:08:59.760761 21909 rpcz_store.cc:276] 0709 13:08:58.391442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.391567 (+   125us) service_pool.cc:224] Handling call
0709 13:08:58.391798 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.507159 (+115361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.743998 (+1236839us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b5400100754. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:59.744188 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239555456}
I20260709 13:08:59.762135 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:59.762743 21909 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:59.747042 25058 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:59.763240 25082 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:59.763535 24635 raft_consensus.cc:3055] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:08:59.763952 24635 raft_consensus.cc:740] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:59.726325 24953 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:59.765493 24953 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.765897 24953 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:59.766173 25022 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:08:59.747344 24986 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:59.746078 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:59.735569 24941 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:08:59.730500 24925 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8.
I20260709 13:08:59.760504 24992 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:59.777017 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:59.752385 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:59.777684 21906 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:59.674428 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:08:59.762686 25015 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:59.777959 25087 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:08:59.535300 25086 consensus_queue.cc:1059] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.270s
I20260709 13:08:59.778589 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:59.778996 25086 raft_consensus.cc:3055] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:08:59.779369 25086 raft_consensus.cc:740] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:08:59.730763 25072 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:59.758633 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:08:59.780262 25086 consensus_queue.cc:260] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:59.781803 25086 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:08:59.781890 24924 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:08:59.778688 25066 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:59.786193 21728 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:59.776194 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:59.785207 21760 raft_consensus.cc:2393] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:08:59.744275 25038 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:08:59.791006 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:59.779795 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:59.792346 21907 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:08:59.735466 25069 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:08:59.737920 25084 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:59.799676 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:59.800930 21833 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:08:59.804946 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:59.805835 21908 raft_consensus.cc:2393] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 7: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:08:59.806075 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 63867.7us
I20260709 13:08:59.810599 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:08:59.811396 21833 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.784006 24989 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:59.814381 21804 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:59.816741 21804 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:08:59.817296 21728 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:59.826752 21909 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:08:59.812064 21906 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:59.830446 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:59.831239 21836 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:08:59.818324 21804 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:08:59.764956 24635 consensus_queue.cc:260] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:08:59.833395 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1788) took 1609 ms. Trace:
I20260709 13:08:59.796905 25038 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:08:59.869895 21834 rpcz_store.cc:276] 0709 13:08:58.224206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.224336 (+   130us) service_pool.cc:224] Handling call
0709 13:08:58.248649 (+ 24313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.345613 (+ 96964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.345644 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:58.345684 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:08:58.345715 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:59.833076 (+1487361us) spinlock_profiling.cc:243] Waited 96.8 ms on lock 0x7b54003c1254. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:08:59.833145 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:59.833320 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222544256}
I20260709 13:08:59.794000 24925 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:59.854025 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:59.877413 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:59.878415 21908 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:08:59.879668 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:08:59.821791 25087 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:08:59.820034 24989 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.819340 25015 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:08:59.819758 24546 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:59.906744 21907 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:08:59.822103 25030 raft_consensus.cc:697] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:08:59.836602 24924 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:59.930480 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:08:59.908697 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 242539us
I20260709 13:08:59.887177 21728 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:08:59.932000 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 44936.5us
I20260709 13:08:59.871829 24581 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:08:59.925724 25015 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:59.904495 24978 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.155s	user 0.010s	sys 0.020s
I20260709 13:08:59.876730 24925 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:08:59.946498 24939 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:59.946868 24581 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.947530 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:08:59.949939 24635 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.950537 22448 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:08:59.903877 24977 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:08:59.880887 24580 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:08:59.871973 25072 consensus_queue.cc:1059] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:08:59.907644 24989 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:59.987813 21879 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:00.011363 21907 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:09:00.011915 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 181218us
W20260709 13:09:00.012719 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 62268.4us
I20260709 13:09:00.018091 22448 leader_election.cc:400] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 9. Current term is 10.
I20260709 13:09:00.018360 22448 leader_election.cc:403] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:08:59.955008 25015 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:08:59.990774 25076 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:59.943585 24924 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:08:59.986454 24978 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.206s	user 0.010s	sys 0.020s
I20260709 13:08:59.989197 24939 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:59.990147 24925 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:00.032764 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 45074.7us
I20260709 13:09:00.033974 21879 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:00.015292 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:59.994307 24581 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:00.090099 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 54488.9us
W20260709 13:09:00.043128 21806 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.40.4:37983 timed out after 1.559s (SENT) [suppressed 17 similar messages]
W20260709 13:09:00.119989 22478 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36278 (request call id 430) took 1612 ms (client timeout 1559 ms). Trace:
I20260709 13:09:00.030908 25099 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:00.130484 25099 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:00.029014 24580 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:00.127946 25098 log.cc:927] Time spent T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:09:00.098034 25092 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:00.026135 25097 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 9. Current term is 10.
I20260709 13:09:00.097400 25068 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:00.128647 25001 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:00.031546 25076 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:00.027441 24924 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:00.037941 25053 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:09:00.123631 22478 rpcz_store.cc:269] 0709 13:08:58.483301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.483454 (+   153us) service_pool.cc:224] Handling call
0709 13:09:00.095683 (+1612229us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b54003c5d54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:00.095877 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9163520}
I20260709 13:09:00.022174 25100 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:00.137081 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:00.138394 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:00.138944 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.027657 24978 raft_consensus.cc:697] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:00.144728 21756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 386) took 1373 ms. Trace:
I20260709 13:09:00.146855 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:00.015542 24977 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:00.036984 24939 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:00.154073 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:00.144495 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:00.030560 24992 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
I20260709 13:09:00.178287 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:00.178949 21756 rpcz_store.cc:276] 0709 13:08:58.771379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:58.778102 (+  6723us) service_pool.cc:224] Handling call
0709 13:08:58.778416 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:58.884127 (+105711us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:58.884166 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:58.884206 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:08:58.884241 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.144499 (+1260258us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540031ddd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:00.144548 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.144673 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242662272}
I20260709 13:09:00.184942 21911 raft_consensus.cc:2393] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:00.194418 21731 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:00.197125 21731 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:00.211341 24941 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:00.213907 24937 consensus_meta.cc:287] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.004s
I20260709 13:09:00.214447 24937 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:00.215708 21764 raft_consensus.cc:1240] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 13:09:00.218004 25101 log.cc:927] Time spent T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:09:00.221695 25066 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:00.222434 25041 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:00.120064 25030 consensus_queue.cc:237] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:00.225172 21913 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:00.225855 21833 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:09:00.232901 25076 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:00.235020 21758 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:00.237725 24978 consensus_queue.cc:237] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:00.238629 25099 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:00.242410 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:00.173024 25001 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:00.157168 25092 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:00.247725 21760 raft_consensus.cc:1240] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:00.263266 21913 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:00.275318 25041 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:00.276068 21760 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:00.276005 25041 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:00.261703 25100 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:09:00.280421 25020 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:00.281013 25020 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:00.283188 25020 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:00.261354 25038 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:00.285533 25038 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:00.286711 24585 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:00.287829 25038 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:00.291204 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:00.291558 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:00.292021 22480 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:09:00.294334 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:00.295593 24953 consensus_meta.cc:287] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 13:09:00.252105 25102 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:09:00.297794 25041 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:00.299861 21731 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:00.305720 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:00.306291 21760 raft_consensus.cc:1275] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:00.306428 21832 raft_consensus.cc:2393] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:09:00.316946 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 273852us
I20260709 13:09:00.324856 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:00.325903 21832 raft_consensus.cc:2393] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:00.333972 21838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38348 (request call id 1801) took 1024 ms. Trace:
I20260709 13:09:00.331962 24977 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:00.322006 25041 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:00.334481 21838 rpcz_store.cc:276] 0709 13:08:59.309949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.310091 (+   142us) service_pool.cc:224] Handling call
0709 13:09:00.333768 (+1023677us) spinlock_profiling.cc:243] Waited 32.6 ms on lock 0x7b540021cad4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:00.333899 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75060096}
I20260709 13:09:00.341804 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:00.302809 24953 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:00.346939 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:00.351159 21838 raft_consensus.cc:1240] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:00.327551 25009 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:00.356915 24953 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:00.360273 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:00.348208 25041 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:09:00.386006 25121 log.cc:927] Time spent T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:09:00.387300 25001 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:00.388799 25084 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:00.389819 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.390172 25092 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:00.362754 25038 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:00.398187 25038 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:00.399091 24977 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:00.399822 24977 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:00.409274 24977 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:00.420233 24925 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:00.357758 24580 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:00.381853 25041 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:00.361876 25009 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:00.461557 25030 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:00.462311 25030 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:00.464866 25030 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:00.465390 24978 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:00.461337 25028 raft_consensus.cc:476] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Not starting pre-election -- already a leader
I20260709 13:09:00.468153 25038 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:00.473500 25028 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.474052 25028 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:00.482002 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:00.489420 24939 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:00.491804 24939 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:00.444032 24581 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:00.492516 21758 raft_consensus.cc:2393] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 9: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:00.483197 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:00.494010 25015 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:00.494550 24581 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:00.494717 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:00.495410 21910 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:00.496299 25015 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:00.496460 24939 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.500339 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:00.497555 25086 consensus_meta.cc:287] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.715s	user 0.013s	sys 0.001s
I20260709 13:09:00.499716 24939 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:00.498502 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:00.501933 22479 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:00.502470 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:00.502504 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:00.505748 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:00.508630 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:00.646430 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.506773 21833 raft_consensus.cc:1240] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:09:00.543309 21805 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:00.482191 21914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 537) took 1148 ms. Trace:
I20260709 13:09:00.659616 21913 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:09:00.664769 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:00.668541 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:00.506165 21880 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:00.506145 21911 raft_consensus.cc:1240] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:00.666622 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 123448us
I20260709 13:09:00.674546 21805 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:00.663806 21914 rpcz_store.cc:276] 0709 13:08:59.333984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.380740 (+ 46756us) service_pool.cc:224] Handling call
0709 13:08:59.380984 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.713763 (+332779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.481946 (+768183us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b540032da54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:00.482120 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":763915136}
W20260709 13:09:00.501350 25111 log.cc:927] Time spent T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.250s	user 0.000s	sys 0.003s
I20260709 13:09:00.683019 24924 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:00.683698 21910 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:09:00.687211 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:00.705991 21840 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:00.478096 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:00.466025 24978 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:00.701809 25015 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:00.702543 25105 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:00.641400 24939 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:00.520706 25071 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:00.709888 21805 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:00.477823 24925 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:00.707844 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:00.476281 25028 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:00.708608 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 202547us
I20260709 13:09:00.457073 24989 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:00.704245 25066 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:00.719609 21805 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:00.712080 24979 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:00.722851 24924 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:00.714267 25105 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:00.715916 25009 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:00.728112 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:00.704416 25093 consensus_queue.cc:1059] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:09:00.727527 21913 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:00.725896 25015 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:00.732437 21836 raft_consensus.cc:2368] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 6. Current term is 7.
I20260709 13:09:00.728536 21880 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:00.733469 21805 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:00.735525 21762 raft_consensus.cc:1240] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:00.758311 21840 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:00.735466 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:00.736219 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:00.736991 24989 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:00.737670 25105 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:00.738983 21758 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59108
I20260709 13:09:00.742738 24979 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:00.745850 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:00.785624 21758 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:00.785926 21757 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:00.786118 21758 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:00.787055 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:00.747704 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:00.748922 21729 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:00.750245 24581 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:00.751893 24978 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:00.710734 24984 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:09:00.759405 21760 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:00.759361 21759 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:00.759173 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:00.782296 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:00.729554 25053 consensus_queue.cc:1059] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:09:00.729349 25084 consensus_queue.cc:1059] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 13:09:00.783972 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:09:00.813297 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.720270 25071 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:00.821869 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:00.832051 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:00.823704 25015 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:09:00.865229 24989 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:01.015393 25093 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:00.852038 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:01.017843 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:01.018425 21840 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:00.932361 21758 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:01.019699 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 286295us
I20260709 13:09:01.043673 21805 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:01.020383 21836 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:01.020936 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:09:01.012075 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 263927us
I20260709 13:09:01.045372 21729 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:01.045403 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:01.047043 21729 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:01.047335 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:01.048059 21759 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
W20260709 13:09:00.912465 25111 log.cc:927] Time spent T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:09:01.047648 24924 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:01.048390 21765 raft_consensus.cc:2393] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 9: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
W20260709 13:09:01.026602 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 299570us
I20260709 13:09:01.057539 21805 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:01.037286 25028 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.048693 21729 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:00.823325 21756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 398) took 1122 ms. Trace:
I20260709 13:09:01.049666 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:01.059669 21759 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:01.060020 21729 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:01.060969 24989 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:01.060918 25136 consensus_queue.cc:1048] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:01.061822 24989 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:01.062278 24989 raft_consensus.cc:697] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:01.059487 21756 rpcz_store.cc:276] 0709 13:08:59.701048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.188033 (+486985us) service_pool.cc:224] Handling call
0709 13:09:00.188440 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.188775 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.188806 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:00.224933 (+ 36127us) log.cc:844] Serialized 26 byte log entry
0709 13:09:00.642429 (+417496us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:00.642468 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.642582 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:00.823043 (+180461us) raft_consensus.cc:1685] finished
0709 13:09:00.823071 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:00.823253 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":9638,"thread_start_us":381161,"threads_started":1,"wal-append.queue_time_us":535765}
I20260709 13:09:01.063230 24989 consensus_queue.cc:237] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.063877 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:01.047324 24585 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:01.042937 25093 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:01.069025 25093 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:01.055739 24925 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:01.071414 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:01.071477 21805 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:01.072664 21805 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:01.050357 21760 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:09:01.060571 25015 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:01.054478 21840 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:01.078548 21805 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:01.080080 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:01.080567 21805 leader_election.cc:400] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6.
I20260709 13:09:01.080657 21840 raft_consensus.cc:3055] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:01.081012 21805 leader_election.cc:403] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:09:01.081116 21840 raft_consensus.cc:740] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:09:01.070566 25041 consensus_meta.cc:287] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.000s
I20260709 13:09:01.090080 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2608) took 1744 ms. Trace:
I20260709 13:09:01.084115 25009 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:01.081806 24978 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:01.092926 21763 rpcz_store.cc:276] 0709 13:08:59.345642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.733545 (+387903us) service_pool.cc:224] Handling call
0709 13:08:59.753222 (+ 19677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:59.754059 (+   837us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:59.754105 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:59.755620 (+  1515us) log.cc:844] Serialized 26 byte log entry
0709 13:09:00.098022 (+342402us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:00.206420 (+108398us) log.cc:844] Serialized 14 byte log entry
0709 13:09:00.217879 (+ 11459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.217978 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:00.500827 (+282849us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:09:01.089713 (+588886us) raft_consensus.cc:1685] finished
0709 13:09:01.089832 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.090003 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44746,"prepare.queue_time_us":162695,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":11974,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":12449,"spinlock_wait_cycles":5221120,"thread_start_us":342941,"threads_started":2,"wal-append.queue_time_us":430908}
I20260709 13:09:01.096892 21758 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:01.083166 21840 consensus_queue.cc:260] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.098201 21840 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:01.081911 24581 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:01.078104 25015 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:08:59.435984 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:01.115922 21759 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:09:01.118693 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:01.082952 24979 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:01.123443 21840 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:09:01.133442 21836 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:01.123145 25015 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:01.081763 25028 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:01.159042 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 430595us
I20260709 13:09:01.100278 25041 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:01.140043 24635 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.161615 21880 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:01.158226 24925 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.200168 21914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 543) took 1128 ms. Trace:
I20260709 13:09:01.223354 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:01.224004 21905 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
W20260709 13:09:01.224385 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 62844.4us
I20260709 13:09:01.225503 21880 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:01.232872 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:01.233752 21760 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:01.234387 21758 raft_consensus.cc:1240] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: [4.3-6.5]
I20260709 13:09:01.236241 21757 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:09:01.238705 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:01.239619 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:01.240626 22478 raft_consensus.cc:2393] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 8: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:09:01.222402 21914 rpcz_store.cc:276] 0709 13:09:00.071320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.679272 (+607952us) service_pool.cc:224] Handling call
0709 13:09:00.697921 (+ 18649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.698191 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:00.708470 (+ 10279us) log.cc:844] Serialized 14 byte log entry
0709 13:09:01.199697 (+491227us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.199776 (+    79us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:01.199837 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.199924 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.200094 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96232,"prepare.queue_time_us":12687,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":108762,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":9358,"thread_start_us":394460,"threads_started":2,"wal-append.queue_time_us":373883}
I20260709 13:09:01.247447 21880 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:01.170228 25009 raft_consensus.cc:697] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:01.199100 24924 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:09:01.252264 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 171847us
I20260709 13:09:01.253196 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:01.200233 24915 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:01.221522 24939 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:01.242674 25141 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:01.276086 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 196400us
I20260709 13:09:01.277272 25140 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:01.284258 25009 consensus_queue.cc:237] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.222523 24925 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.172502 24635 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:01.251850 25071 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:01.259812 24978 raft_consensus.cc:697] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:09:01.294567 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.265605 24979 raft_consensus.cc:697] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:09:01.309820 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 62656.3us
I20260709 13:09:01.286752 24989 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:01.267583 24924 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.294510 22450 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:09:01.311522 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 68204.8us
I20260709 13:09:01.274158 24915 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:01.290131 25142 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6.
I20260709 13:09:01.293385 24581 raft_consensus.cc:697] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:01.279827 24939 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.338138 25028 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:01.339119 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:01.312078 25135 log.cc:927] Time spent T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.194s	user 0.001s	sys 0.001s
I20260709 13:09:01.311684 25071 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:01.335104 24918 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.335937 22479 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:09:01.339789 21839 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:09:01.341898 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:01.343595 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:01.346544 21759 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:01.329353 21806 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:01.369380 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:01.346340 25145 log.cc:927] Time spent T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:09:01.334448 25093 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:01.344324 24939 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:01.376227 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 98100.6us
I20260709 13:09:01.323030 24989 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:01.383484 21805 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:01.371619 25143 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:09:01.391646 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 144298us
I20260709 13:09:01.367821 24918 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:01.384855 25137 log.cc:927] Time spent T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:09:01.398346 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:01.403630 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:01.404446 21836 raft_consensus.cc:2393] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:01.399338 21729 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:01.400452 25158 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.387174 24768 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:01.419207 24918 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:01.374711 24979 consensus_queue.cc:237] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.425820 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:01.372179 24978 consensus_queue.cc:237] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.407684 25142 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:01.433326 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:01.435168 21765 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
W20260709 13:09:01.428220 25138 log.cc:927] Time spent T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260709 13:09:01.437628 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 47932.6us
I20260709 13:09:01.446587 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:01.447194 21905 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:01.422724 24581 consensus_queue.cc:237] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.448580 25149 consensus_queue.cc:1059] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:01.449601 25160 raft_consensus.cc:3055] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:01.427508 25022 raft_consensus.cc:3055] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:01.450105 25086 raft_consensus.cc:3055] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:01.450531 25022 raft_consensus.cc:740] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:01.450652 25086 raft_consensus.cc:740] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:01.450996 25156 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:01.451615 25022 consensus_queue.cc:260] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.451674 25086 consensus_queue.cc:260] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:01.452834 25022 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:01.453683 24925 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:01.454129 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:01.454833 21907 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:09:01.455742 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:01.456415 21907 raft_consensus.cc:2393] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:01.450968 21805 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:01.458911 24989 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:01.460206 21729 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:01.460621 21805 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:01.414901 24915 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:01.442225 21765 raft_consensus.cc:1275] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:01.442819 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:01.443324 25142 raft_consensus.cc:697] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:09:01.443606 25133 log.cc:927] Time spent T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.758s	user 0.000s	sys 0.008s
I20260709 13:09:01.433543 25041 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:01.450047 25160 raft_consensus.cc:740] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:01.441802 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:01.408289 25028 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:09:01.457105 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:01.462364 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:01.465662 24989 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:01.465970 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.466356 25143 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:01.413498 25158 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.629369 22481 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:01.556753 22450 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:01.530754 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:01.632652 22481 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36270 (request call id 554) took 2356 ms (client timeout 1980 ms). Trace:
W20260709 13:09:01.633204 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 76533.7us
W20260709 13:09:01.633162 22481 rpcz_store.cc:269] 0709 13:08:59.276784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.285524 (+  8740us) service_pool.cc:224] Handling call
0709 13:09:01.632469 (+2346945us) spinlock_profiling.cc:243] Waited 2.34 s on lock 0x7b5400463f54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:01.632579 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5387382528}
I20260709 13:09:01.634140 25158 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:01.634735 25026 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:01.635183 25026 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.635735 25026 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:01.566828 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1822) took 1763 ms. Trace:
I20260709 13:09:01.632081 25014 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.504369 21835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56424 (request call id 382) took 1801 ms. Trace:
I20260709 13:09:01.483297 24937 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:01.450155 25139 log.cc:927] Time spent T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:09:01.638607 21835 rpcz_store.cc:276] 0709 13:08:59.703138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.729732 (+ 26594us) service_pool.cc:224] Handling call
0709 13:08:59.730060 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.298995 (+568935us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:00.305281 (+  6286us) log.cc:844] Serialized 14 byte log entry
0709 13:09:00.384508 (+ 79227us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:00.384556 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:00.384602 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.489411 (+1104809us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b54002bff54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:01.504186 (+ 14775us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.504315 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8517,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":5273,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"spinlock_wait_cycles":1307904384,"thread_start_us":56150,"threads_started":1,"wal-append.queue_time_us":149312,"wal-append.run_cpu_time_us":1047,"wal-append.run_wall_time_us":1044191}
I20260709 13:09:01.640861 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:01.637832 25014 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:01.550302 25084 raft_consensus.cc:3055] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:01.487926 21804 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:01.642616 25084 raft_consensus.cc:740] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:01.643224 25149 raft_consensus.cc:2804] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:01.643700 25149 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:01.644196 25149 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:01.641611 21913 raft_consensus.cc:2393] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 10: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:01.645036 25014 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:01.565155 24908 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:01.491281 25005 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:01.645632 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:01.612603 25076 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:01.647899 25076 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.492242 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:01.650972 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:01.607878 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.506494 21837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56424 (request call id 375) took 2245 ms. Trace:
I20260709 13:09:01.481796 21838 raft_consensus.cc:1240] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:01.503696 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1309) took 1855 ms. Trace:
I20260709 13:09:01.434120 24939 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:01.469015 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:01.538504 21764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1281) took 2228 ms. Trace:
I20260709 13:09:01.467517 21805 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:01.500869 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36270 (request call id 557) took 1360 ms. Trace:
I20260709 13:09:01.486315 21911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1323) took 1677 ms. Trace:
I20260709 13:09:01.552655 22449 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:01.488050 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:01.520219 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:01.473740 24635 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:01.643699 25084 consensus_queue.cc:260] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.556977 25061 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.658432 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2699) took 1848 ms. Trace:
I20260709 13:09:01.667007 24905 consensus_queue.cc:1059] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:01.526665 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:01.668066 24905 consensus_queue.cc:1243] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Peer 6fadfd81c5a645f1806a284ddbb6bf0d log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:09:01.527585 25010 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.632045 25160 consensus_queue.cc:260] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.651885 24989 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:01.669936 25160 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:01.553279 21879 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
W20260709 13:09:01.670773 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 118219us
W20260709 13:09:01.671360 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 118197us
I20260709 13:09:01.672358 25148 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:01.578657 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:01.672868 25148 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:09:01.673131 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 205709us
I20260709 13:09:01.673364 25148 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:01.673626 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:01.673887 21805 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:01.674189 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:01.469558 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:01.635123 25143 raft_consensus.cc:697] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:01.656352 21760 raft_consensus.cc:1240] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:01.499081 25015 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:01.670953 24905 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:01.577723 25086 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:01.670018 24989 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:01.594419 21663 catalog_manager.cc:5697] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 6 to 8, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 8 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:01.538784 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:01.735455 21834 raft_consensus.cc:2410] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:01.655318 21905 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:01.610837 25066 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.652143 21836 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:09:01.676337 21764 rpcz_store.cc:276] 0709 13:08:59.309777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.683227 (+373450us) service_pool.cc:224] Handling call
0709 13:08:59.683630 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.216064 (+532434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.538228 (+1322164us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b54000ddc54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:01.538443 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1223167232}
I20260709 13:09:01.678534 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:01.740465 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:01.740962 21758 raft_consensus.cc:2393] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 9: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:01.636590 25142 consensus_queue.cc:237] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.679601 21912 raft_consensus.cc:2393] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:01.679540 21729 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:01.497215 25126 log.cc:927] Time spent T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.100s	user 0.004s	sys 0.000s
I20260709 13:09:01.460067 24924 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:01.668572 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:01.750222 21906 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:01.667266 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:01.751204 25084 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:01.652755 22484 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:01.752559 21731 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:01.641215 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:01.492959 25150 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:01.754330 25150 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:01.754526 21839 raft_consensus.cc:1240] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:01.691702 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:01.754818 25150 raft_consensus.cc:697] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:01.755213 21914 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:01.755299 22485 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:09:01.755951 25150 consensus_queue.cc:237] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.652257 21908 rpcz_store.cc:276] 0709 13:08:59.648436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.975787 (+327351us) service_pool.cc:224] Handling call
0709 13:08:59.976203 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.976478 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:00.185977 (+209499us) log.cc:844] Serialized 14 byte log entry
0709 13:09:01.492907 (+1306930us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b18003b5000. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6adeff4bc 00007fc6ab24d48b 00007fc6b40a7ab9 00007fc6ab26969b 00007fc6ab26793f 00007fc6ab269c02 00007fc6adef120b 00007fc6adef6d23 00007fc6adef723a
0709 13:09:01.493123 (+   216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.493182 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:01.493233 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.493315 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.503620 (+ 10305us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":226699,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":5915,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"spinlock_wait_cycles":37119872,"thread_start_us":232217,"threads_started":2,"wal-append.queue_time_us":114344,"wal-append.run_cpu_time_us":2033,"wal-append.run_wall_time_us":1085616}
I20260709 13:09:01.757931 21908 raft_consensus.cc:1240] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:01.758057 25076 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:01.678614 21911 rpcz_store.cc:276] 0709 13:08:59.809077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.189881 (+380804us) service_pool.cc:224] Handling call
0709 13:09:00.505919 (+316038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.671389 (+165470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.486063 (+814674us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b5400111f50. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:01.486251 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":677993728}
I20260709 13:09:01.667752 21832 rpcz_store.cc:276] 0709 13:08:59.809789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.332371 (+522582us) service_pool.cc:224] Handling call
0709 13:09:00.346123 (+ 13752us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.351430 (+  5307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.351460 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:00.358494 (+  7034us) log.cc:844] Serialized 26 byte log entry
0709 13:09:00.447851 (+ 89357us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:00.447897 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:00.447968 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:01.442983 (+995015us) spinlock_profiling.cc:243] Waited 5.13 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:09:01.658136 (+215153us) raft_consensus.cc:1685] finished
0709 13:09:01.658162 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.658374 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":337,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":7405,"spinlock_wait_cycles":11808128,"thread_start_us":5613,"threads_started":1,"wal-append.queue_time_us":236581}
I20260709 13:09:01.708750 21838 raft_consensus.cc:2393] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 9: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:01.636941 21833 rpcz_store.cc:276] 0709 13:08:59.803403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.249731 (+446328us) service_pool.cc:224] Handling call
0709 13:09:00.250408 (+   677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.661991 (+411583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.566552 (+904561us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b5400021f54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:01.566754 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":588914432}
I20260709 13:09:01.760205 21911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:45192 (request call id 22) took 2427 ms. Trace:
W20260709 13:09:01.724795 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.760618 21911 rpcz_store.cc:276] 0709 13:08:59.334906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.759669 (+2424763us) service_pool.cc:224] Handling call
0709 13:09:01.760130 (+   461us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:01.695794 21831 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:01.757119 24979 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:01.674661 22477 rpcz_store.cc:276] 0709 13:09:00.141260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.141592 (+   332us) service_pool.cc:224] Handling call
0709 13:09:00.142076 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:00.274754 (+132678us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:00.426211 (+151457us) log.cc:844] Serialized 14 byte log entry
0709 13:09:00.448577 (+ 22366us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:00.448638 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:00.448682 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.500523 (+1051841us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54006022d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:01.500590 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.500745 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1146,"prepare.queue_time_us":189279,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":1266,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":6759,"spinlock_wait_cycles":304536448,"thread_start_us":161805,"threads_started":2,"wal-append.queue_time_us":38379,"wal-append.run_cpu_time_us":1085,"wal-append.run_wall_time_us":1003081}
I20260709 13:09:01.726843 21907 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:01.625180 25140 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:09:01.665576 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 177774us
W20260709 13:09:01.766157 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 86681.7us
I20260709 13:09:01.766517 21804 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:01.766939 21729 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:01.652529 21837 rpcz_store.cc:276] 0709 13:08:59.261593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.261821 (+   228us) service_pool.cc:224] Handling call
0709 13:08:59.262189 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:59.378665 (+116476us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:08:59.787364 (+408699us) log.cc:844] Serialized 14 byte log entry
0709 13:09:00.025748 (+238384us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:00.025809 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:00.025851 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.505418 (+1479567us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b180045a480. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab2382a6 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419
0709 13:09:01.506162 (+   744us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54000370d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:01.506221 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.506396 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":564068,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":32433,"raft.queue_time_us":98,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":61357,"spinlock_wait_cycles":276184320,"thread_start_us":646433,"threads_started":2,"wal-append.queue_time_us":453419,"wal-append.run_cpu_time_us":1215,"wal-append.run_wall_time_us":1046309}
I20260709 13:09:01.669236 25010 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:01.667680 25061 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:01.690928 25105 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:01.755769 21663 catalog_manager.cc:5697] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 4 to 6, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 6 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:01.493755 25089 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.767948 21729 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:01.792987 21729 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:01.793898 21729 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
W20260709 13:09:01.772223 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:01.725584 25028 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:01.803076 25028 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.725792 24905 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.805733 24905 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:01.782131 24937 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:01.806882 22483 raft_consensus.cc:2410] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:09:01.807065 24937 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:01.807379 25001 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.807552 24937 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.808037 24937 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:01.807981 25001 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:01.724370 24939 raft_consensus.cc:697] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:01.809551 24925 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:01.810216 24939 consensus_queue.cc:237] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.811632 25001 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:01.811825 22482 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:09:01.812567 25114 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:01.812889 22483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36270 (request call id 551) took 2568 ms (client timeout 3184 ms). Trace:
W20260709 13:09:01.814378 22482 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36270 (request call id 562) took 1523 ms (client timeout 1824 ms). Trace:
I20260709 13:09:01.784662 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:01.788383 21731 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:01.815117 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:01.815899 21731 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:01.786962 24924 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:01.798146 25163 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.800267 25061 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:01.800766 21913 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:09:01.794551 24907 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:01.801417 25105 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.795928 25089 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:01.795257 21879 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
W20260709 13:09:01.813304 22483 rpcz_store.cc:269] 0709 13:08:59.244476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:59.244614 (+   138us) service_pool.cc:224] Handling call
0709 13:09:01.812674 (+2568060us) spinlock_profiling.cc:243] Waited 2.53 s on lock 0x7b540018bd54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:01.812831 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5830294912}
W20260709 13:09:01.814826 22482 rpcz_store.cc:269] 0709 13:09:00.291096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.291240 (+   144us) service_pool.cc:224] Handling call
0709 13:09:01.814217 (+1522977us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b5400510c54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:01.814320 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3494448512}
I20260709 13:09:01.795743 21914 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:01.822358 21909 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:09:01.827270 21907 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:09:01.792457 25041 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:01.836660 21662 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45746 (request call id 227) took 11594 ms (client timeout 15000 ms). Trace:
I20260709 13:09:01.801702 25156 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:01.843894 21711 auto_rebalancer.cc:629] Failed to schedule move for tablet b87224fb843940c68eca74d28db8e73c: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:09:01.764580 25066 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.820531 24925 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:01.841362 21663 catalog_manager.cc:5697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:01.785817 25053 consensus_queue.cc:1059] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:09:01.813056 25114 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:01.828239 25028 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:01.834375 24953 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:01.795008 25026 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:01.848372 24924 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:01.837105 21662 rpcz_store.cc:269] 0709 13:08:50.228134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.228381 (+   247us) service_pool.cc:224] Handling call
0709 13:09:01.822841 (+11594460us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:56.431225 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:56.431865 (+   640us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:56.431917 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:08:56.431937 (+    20us) tablet.cc:662] Decoding operations
0709 13:08:56.438849 (+  6912us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:56.438924 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:56.438950 (+    26us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:08:56.439883 (+   933us) tablet.cc:701] Row locks acquired
0709 13:08:56.439944 (+    61us) write_op.cc:260] PREPARE: finished
0709 13:08:56.465418 (+ 25474us) write_op.cc:270] Start()
0709 13:08:56.520183 (+ 54765us) write_op.cc:276] Timestamp: P: 1783602536457263 usec, L: 0
0709 13:08:56.523862 (+  3679us) op_driver.cc:348] REPLICATION: starting
0709 13:08:56.579848 (+ 55986us) log.cc:844] Serialized 4337 byte log entry
0709 13:08:57.859291 (+1279443us) op_driver.cc:464] REPLICATION: finished
0709 13:08:57.985736 (+126445us) write_op.cc:301] APPLY: starting
0709 13:08:57.985848 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:57.986128 (+   280us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:57.986289 (+   161us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:57.988061 (+  1772us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:57.988564 (+   503us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:08:57.988613 (+    49us) write_op.cc:312] APPLY: finished
0709 13:08:57.989034 (+   421us) log.cc:844] Serialized 83 byte log entry
0709 13:08:57.989210 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:57.989350 (+   140us) write_op.cc:454] Released schema lock
0709 13:08:57.989417 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:58.045081 (+ 55664us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:58.045115 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":555254,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":126165,"apply.run_cpu_time_us":4229,"apply.run_wall_time_us":59296,"num_ops":11,"prepare.queue_time_us":118433,"prepare.run_cpu_time_us":52720,"prepare.run_wall_time_us":602818,"raft.queue_time_us":308453,"raft.run_cpu_time_us":18855,"raft.run_wall_time_us":104273,"replication_time_us":1335254,"thread_start_us":798981,"threads_started":4,"wal-append.queue_time_us":513537,"wal-append.run_cpu_time_us":50532,"wal-append.run_wall_time_us":1897507}]]}
I20260709 13:09:01.787551 25140 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:01.857611 25156 raft_consensus.cc:697] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:01.898284 21663 catalog_manager.cc:5697] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 3 to 4, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 4 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:01.852636 24925 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:01.830700 24907 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.785780 25143 consensus_queue.cc:237] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:01.917223 22449 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:01.843501 25136 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:09:01.909391 21663 catalog_manager.cc:5697] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 3 to 6, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 6 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:01.912246 22477 raft_consensus.cc:2393] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 7: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:09:01.914228 21877 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:01.882393 24953 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:01.883417 24978 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:01.908151 24924 raft_consensus.cc:697] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:01.832295 25163 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:01.948958 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:01.946120 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 272288us
I20260709 13:09:01.916038 24925 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:01.925053 25032 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:01.927933 24953 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:01.932955 25061 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:01.964810 21663 catalog_manager.cc:5697] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 5 to 9, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 9 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:01.973405 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 553) took 1153 ms. Trace:
I20260709 13:09:01.995594 21906 rpcz_store.cc:276] 0709 13:09:00.820309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.750911 (+930602us) service_pool.cc:224] Handling call
0709 13:09:01.751213 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:01.924180 (+172967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.924211 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:01.924252 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:01.924287 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.973109 (+ 48822us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54002d8054. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:01.973172 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:01.973336 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397366016}
I20260709 13:09:01.974985 21806 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:01.941694 25015 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:01.923324 25087 consensus_queue.cc:1059] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:09:02.005842 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:02.005888 21831 raft_consensus.cc:1275] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:01.964552 21877 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:02.012391 21837 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 13:09:02.015484 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 51046.3us
I20260709 13:09:02.016801 21877 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:02.020390 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:02.021168 21832 raft_consensus.cc:2393] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 9: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:02.021476 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:01.978236 25032 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.045006 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:02.045058 25124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.363s	user 0.043s	sys 0.038s
I20260709 13:09:02.060611 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:02.066787 21663 catalog_manager.cc:5697] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 6 to 8, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 8 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:02.073467 25170 log.cc:927] Time spent T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:09:02.073971 24937 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.076828 24937 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:02.080585 21910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1560) took 1618 ms. Trace:
W20260709 13:09:02.059158 25124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.377s	user 0.044s	sys 0.038s
I20260709 13:09:02.080982 21910 rpcz_store.cc:276] 0709 13:09:00.462497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:00.707540 (+245043us) service_pool.cc:224] Handling call
0709 13:09:00.715401 (+  7861us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:00.729208 (+ 13807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:00.729254 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:00.730106 (+   852us) log.cc:844] Serialized 26 byte log entry
0709 13:09:01.459866 (+729760us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b1800464380. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab24ce07 00007fc6b40a7ab9 00007fc6ab26969b 00007fc6ab26793f 00007fc6ab269c02 00007fc6adef120b 00007fc6adef6d23 00007fc6adef70d1 00007fc6ae312a0f
0709 13:09:01.884706 (+424840us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:01.884744 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:01.884985 (+   241us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.080309 (+195324us) raft_consensus.cc:1685] finished
0709 13:09:02.080329 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.080525 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":261332,"raft.queue_time_us":16333,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":1196,"spinlock_wait_cycles":14782848,"thread_start_us":424283,"threads_started":1,"wal-append.queue_time_us":1240775}
I20260709 13:09:02.018877 25076 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:02.021289 25157 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:02.022553 25061 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:02.049192 25032 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:02.100075 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 306230us
W20260709 13:09:02.098858 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 332451us
W20260709 13:09:02.059253 25166 log.cc:927] Time spent T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:09:02.081493 25010 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:02.125723 21877 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:02.124727 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:02.145865 21729 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:02.146446 21838 raft_consensus.cc:2393] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 7: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:02.124663 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:02.102499 21663 catalog_manager.cc:5697] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 1 to 4, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 4 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:02.147186 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:02.148388 21663 catalog_manager.cc:5697] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 2 to 4, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 4 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:02.150597 21804 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:02.084726 25148 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:02.157835 25176 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:02.161919 25181 log.cc:927] Time spent T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:09:02.144075 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 327085us
I20260709 13:09:02.094668 24924 consensus_queue.cc:237] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:02.167507 21731 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:02.055897 24979 raft_consensus.cc:697] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:02.153502 21663 catalog_manager.cc:5697] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 5 to 8, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 8 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:02.128103 25136 consensus_queue.cc:1059] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:09:02.161809 24581 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:02.183617 21663 catalog_manager.cc:5697] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:02.165788 21729 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:02.094992 25157 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:02.098148 25105 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:02.150038 24937 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:02.186182 21728 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:02.188165 22479 raft_consensus.cc:1240] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:02.136750 24905 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.196331 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:02.212029 21834 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:09:02.213263 21905 raft_consensus.cc:2393] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 10: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:02.197273 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:02.198129 25157 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:02.198262 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:09:02.204989 25149 consensus_meta.cc:287] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.560s	user 0.000s	sys 0.011s
I20260709 13:09:02.198465 24907 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:02.204128 25163 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:02.168701 25087 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:02.205057 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:02.196494 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:02.224120 21832 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:09:02.172039 25142 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:01.992573 25156 consensus_queue.cc:237] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.209981 22448 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:02.213917 21831 raft_consensus.cc:2376] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6. Re-sending same reply.
I20260709 13:09:02.198458 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:02.220402 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:02.182260 24581 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.162002 25176 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.213702 25158 raft_consensus.cc:3055] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:02.208236 24939 raft_consensus.cc:2804] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:09:02.172561 25008 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:09:02.228984 25163 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:02.224148 25026 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:02.252192 22448 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:02.248029 25152 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:02.246248 24907 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:02.249861 24939 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:02.246690 25158 raft_consensus.cc:740] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:09:02.309528 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 48018.2us
I20260709 13:09:02.310281 22448 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:02.316955 22448 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:02.276281 24984 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:02.320550 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 156342us
I20260709 13:09:02.277576 25140 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:02.260115 25163 raft_consensus.cc:697] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:02.321166 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:02.324760 21833 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:09:02.225647 25149 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:02.280083 25114 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:02.323052 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:02.326195 22448 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:09:02.326643 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 139690us
I20260709 13:09:02.324045 21728 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:02.310635 24939 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:02.245728 24979 consensus_queue.cc:237] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.336158 21728 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:02.341398 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:02.342305 21910 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:09:02.343905 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:02.323343 25152 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:02.322276 24984 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:02.322896 24907 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:02.322404 25026 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:02.329753 24905 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:02.390228 21763 raft_consensus.cc:1240] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:02.393116 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:02.402832 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:02.404045 21760 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 9: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:02.379556 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:02.404141 21757 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:02.395517 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:02.392732 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:02.405141 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:02.405660 21761 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 5.
I20260709 13:09:02.405936 21757 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:09:02.381570 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:09:02.392238 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 65415.1us
I20260709 13:09:02.336633 24937 raft_consensus.cc:697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:09:02.360602 24989 consensus_meta.cc:287] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.619s	user 0.006s	sys 0.006s
I20260709 13:09:02.438138 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:02.362017 25152 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.467191 25152 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:02.463804 25032 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:02.470269 22482 raft_consensus.cc:2393] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 8: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:09:02.471536 25032 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:02.410336 24907 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:02.465999 25008 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:09:02.474750 24907 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:02.475142 25008 consensus_queue.cc:1059] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:02.444783 24989 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:02.476758 21759 raft_consensus.cc:1240] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:02.368109 24984 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:02.338344 25015 consensus_queue.cc:1059] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 13:09:02.367225 25014 raft_consensus.cc:2804] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:02.367889 25026 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.418336 25148 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:02.360828 25158 consensus_queue.cc:260] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.501670 25176 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:02.543274 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 125203us
I20260709 13:09:02.502408 25014 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.504868 25026 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:02.564522 21877 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:02.510351 25015 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.570382 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:02.574968 21756 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:02.509326 25140 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:02.502326 25205 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:02.595050 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:02.595741 21839 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:09:02.596443 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:02.600052 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:02.501350 25163 consensus_queue.cc:237] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.562484 25196 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:02.590400 25185 log.cc:927] Time spent T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 13:09:02.574750 25014 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:02.613166 21910 raft_consensus.cc:1240] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:09:02.566079 24581 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:02.615880 21910 raft_consensus.cc:1240] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:02.617280 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:02.622539 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:02.623453 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 287397us
I20260709 13:09:02.624816 21728 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:02.602699 24905 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:02.629024 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:02.629591 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:02.630623 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:02.634642 21756 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:09:02.631240 25136 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.632037 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:02.637856 21909 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:02.639396 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:02.640430 21912 raft_consensus.cc:2393] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 6: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:02.642189 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:02.643641 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:02.645053 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:02.645810 21910 raft_consensus.cc:2376] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7. Re-sending same reply.
I20260709 13:09:02.646996 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:02.647855 21910 raft_consensus.cc:2393] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 7: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:02.644325 21913 raft_consensus.cc:2376] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8. Re-sending same reply.
I20260709 13:09:02.650696 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:02.652451 21913 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:02.605929 25205 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:02.655571 21912 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:09:02.656065 21912 pending_rounds.cc:85] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 3
I20260709 13:09:02.656428 21912 pending_rounds.cc:107] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:09:02.656723 21912 raft_consensus.cc:2889] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:02.611558 25177 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.591907 25140 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.589236 25015 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:02.687047 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 62292.5us
I20260709 13:09:02.687932 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:09:02.654548 25183 log.cc:927] Time spent T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 13:09:02.691182 21909 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
W20260709 13:09:02.693578 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 344313us
I20260709 13:09:02.693584 21728 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:02.633888 25196 raft_consensus.cc:697] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:02.699005 21728 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:02.576861 24937 consensus_queue.cc:237] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:02.692318 25160 consensus_meta.cc:287] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 1.022s	user 0.014s	sys 0.000s
W20260709 13:09:02.694674 25133 log.cc:927] Time spent T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:09:02.685109 24989 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:02.713732 21879 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:02.690972 25165 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:02.732963 21837 raft_consensus.cc:1275] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:09:02.733415 21837 pending_rounds.cc:85] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 6
I20260709 13:09:02.733700 21837 pending_rounds.cc:107] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:09:02.733970 21837 raft_consensus.cc:2889] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:02.655115 24581 consensus_queue.cc:1059] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
W20260709 13:09:02.710155 25084 consensus_meta.cc:287] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.958s	user 0.013s	sys 0.000s
I20260709 13:09:02.703465 25194 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:02.731318 25197 consensus_queue.cc:1059] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:09:02.742628 21906 raft_consensus.cc:2410] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:09:02.660918 25136 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:02.742669 21879 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:02.724807 24907 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:02.709832 25212 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:02.692543 25177 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.689297 25205 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.742656 25165 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:02.745512 25179 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:02.764027 24924 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:02.755599 25212 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:02.748134 25084 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:02.751960 25221 raft_consensus.cc:3055] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:02.781867 25205 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:02.778904 24924 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.782204 25221 raft_consensus.cc:740] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:09:02.782557 25198 log.cc:927] Time spent T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:09:02.783077 25221 consensus_queue.cc:260] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.783809 24924 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:02.774165 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:02.778838 25189 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:02.790277 25189 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:02.775220 21877 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:09:02.762596 25206 log.cc:927] Time spent T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:09:02.781517 25196 consensus_queue.cc:237] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.772619 21911 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:02.770220 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:02.796276 25208 raft_consensus.cc:3055] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:02.792446 24925 consensus_meta.cc:287] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.799s	user 0.009s	sys 0.000s
W20260709 13:09:02.774823 25201 log.cc:927] Time spent T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:09:02.799063 21729 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:02.820644 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:02.821413 21911 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:02.767270 25190 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:02.804975 25084 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:02.830585 21913 raft_consensus.cc:1275] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:02.801471 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:02.831984 21839 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:02.832377 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:02.833410 21910 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:02.804886 25208 raft_consensus.cc:740] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:02.809211 25026 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:02.809792 25177 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:02.840011 21729 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:02.810715 25197 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:02.845863 24953 consensus_meta.cc:287] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.843s	user 0.012s	sys 0.000s
I20260709 13:09:02.845700 25197 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.846467 24953 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.847797 21914 raft_consensus.cc:2393] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 10: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:02.847970 25197 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:02.837949 25202 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:02.849664 25202 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.850021 25202 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:02.850359 24984 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:02.811393 25165 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:02.812141 25157 consensus_meta.cc:287] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.000s
I20260709 13:09:02.821842 22450 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:02.805022 25152 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:02.801478 25210 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.838723 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:02.839108 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:02.861109 21912 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:09:02.841766 25140 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:02.842183 25219 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:02.841650 25208 consensus_queue.cc:260] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.806030 25189 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:02.837769 25205 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:09:02.869374 25208 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:02.870752 25173 log.cc:927] Time spent T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.666s	user 0.003s	sys 0.000s
I20260709 13:09:02.842366 24939 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:02.830332 25084 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.827306 24925 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:02.876076 25084 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:02.876928 24925 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:02.877076 25178 log.cc:927] Time spent T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.678s	user 0.003s	sys 0.000s
I20260709 13:09:02.843927 25136 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:02.844570 25015 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:02.855782 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:02.878302 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1577) took 1316 ms. Trace:
I20260709 13:09:02.878629 21763 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
W20260709 13:09:02.881302 25089 consensus_meta.cc:287] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 1.045s	user 0.000s	sys 0.012s
I20260709 13:09:02.881743 25089 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.882822 21765 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:09:02.884526 25189 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.885036 25189 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.886198 25212 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:02.878649 21908 rpcz_store.cc:276] 0709 13:09:01.561676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.758829 (+197153us) service_pool.cc:224] Handling call
0709 13:09:01.759152 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:01.768332 (+  9180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:01.768376 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:01.786145 (+ 17769us) log.cc:844] Serialized 26 byte log entry
0709 13:09:02.004059 (+217914us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:02.004112 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:02.004187 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:02.876487 (+872300us) spinlock_profiling.cc:243] Waited 8.03 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:09:02.878017 (+  1530us) raft_consensus.cc:1685] finished
0709 13:09:02.878038 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:02.878244 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28019,"raft.queue_time_us":6280,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":9211,"spinlock_wait_cycles":18505984,"thread_start_us":197226,"threads_started":1,"wal-append.queue_time_us":361662}
I20260709 13:09:02.888963 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:02.889784 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:02.890333 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:02.890610 22483 raft_consensus.cc:2368] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10.
W20260709 13:09:02.857770 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 115174us
I20260709 13:09:02.826334 25190 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:02.891258 25190 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:02.891423 21879 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:02.892392 21879 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:02.893929 21760 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 5.
I20260709 13:09:02.895634 21731 leader_election.cc:400] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10.
I20260709 13:09:02.895972 21731 leader_election.cc:403] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:09:02.896528 25163 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:02.897497 24939 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:02.858349 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:02.898150 21831 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:02.859323 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:02.898963 25216 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:02.899386 25216 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.899693 25216 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:02.862968 21729 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:02.903255 21729 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:02.867043 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:02.862450 25148 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:02.905794 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:02.858111 24984 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:02.910377 22449 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:02.914988 24925 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:02.915179 25152 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:02.860037 25179 consensus_queue.cc:1048] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:09:02.918500 25084 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:02.938099 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:02.872349 25215 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:02.921317 21911 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:09:02.940080 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:02.940936 21912 raft_consensus.cc:1240] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:02.941983 21729 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:02.950201 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:02.950857 21760 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:02.922730 24925 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:02.953466 25231 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:09:02.954977 25228 log.cc:927] Time spent T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:09:02.944677 25226 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:02.930184 25148 raft_consensus.cc:697] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:02.873564 25219 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:02.958323 25214 log.cc:927] Time spent T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:09:02.958449 25084 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:02.946889 24937 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:02.959600 25026 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:02.964114 25202 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.966696 25194 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:02.938287 25190 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.943554 25215 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:02.969148 25014 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:02.969700 21908 raft_consensus.cc:2393] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 8: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:02.970924 25149 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:02.972414 24907 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:02.973647 24953 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:02.943354 25028 consensus_queue.cc:1059] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:09:02.863838 25210 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:02.977939 22479 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:02.978984 25213 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:02.979717 25136 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:02.981290 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:02.946524 25089 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:02.937976 25032 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:02.937685 25140 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:02.860301 25157 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:02.986339 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:02.986364 25076 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:02.986959 24925 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:02.942967 25086 consensus_queue.cc:1059] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:09:02.998466 25148 consensus_queue.cc:237] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:02.991804 25231 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:02.992090 25172 log.cc:927] Time spent T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.821s	user 0.002s	sys 0.000s
I20260709 13:09:03.189262 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:03.163527 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.077039 21760 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:09:03.003923 21757 raft_consensus.cc:1275] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:09:03.106146 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 126773us
I20260709 13:09:03.001857 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:03.519796 21763 raft_consensus.cc:2393] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 8: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:03.520815 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:03.522220 21757 raft_consensus.cc:1240] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:09:03.002709 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:03.211674 25233 log.cc:927] Time spent T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:09:03.527762 21756 raft_consensus.cc:1240] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:03.219954 25219 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:03.550993 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 311282us
I20260709 13:09:03.521729 21877 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:03.553932 21763 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:02.997678 25084 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.002023 25215 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:03.210644 25150 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:02.997500 24937 raft_consensus.cc:697] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:03.469669 25190 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:03.083608 24905 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.424592 25105 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.206846 25165 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.210299 25026 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:03.427191 25177 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:03.069592 25196 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:03.250141 25205 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:03.209448 25009 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:03.553742 25149 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.264544 25202 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:03.249691 24939 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:03.850955 21914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1582) took 1510 ms. Trace:
I20260709 13:09:03.767956 21834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:09:03.851564 21914 rpcz_store.cc:276] 0709 13:09:02.340061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.343581 (+  3520us) service_pool.cc:224] Handling call
0709 13:09:03.850712 (+1507131us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b5400112e54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:03.850889 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156757248}
I20260709 13:09:03.852294 21834 raft_consensus.cc:606] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:03.852584 21834 raft_consensus.cc:614] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:03.852408 25150 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:03.839687 25189 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:03.854152 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:03.854764 25150 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:03.854943 21762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59102 (request call id 2644) took 1463 ms. Trace:
I20260709 13:09:03.855108 25221 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:03.855412 21762 rpcz_store.cc:276] 0709 13:09:02.391972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.853839 (+1461867us) service_pool.cc:224] Handling call
0709 13:09:03.854889 (+  1050us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:03.508939 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:03.856415 21907 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:03.856642 21762 raft_consensus.cc:1240] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:03.863123 22450 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:03.863965 25032 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:03.864590 25032 raft_consensus.cc:697] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:03.865692 25165 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:03.865469 25032 consensus_queue.cc:237] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:03.867097 24924 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:03.867766 25165 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:03.867622 24924 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:03.752681 25193 raft_consensus.cc:3055] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:03.868587 25193 raft_consensus.cc:740] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:03.869298 24905 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:03.872045 24905 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:03.872718 25105 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:03.874641 24924 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:03.875247 25084 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:03.877295 25087 raft_consensus.cc:3055] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:03.877923 25087 raft_consensus.cc:740] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:03.878777 25087 consensus_queue.cc:260] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:03.880426 25087 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:03.881597 25239 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:03.882232 25239 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:03.884377 25239 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:03.885296 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:03.886168 21762 raft_consensus.cc:1275] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:03.886655 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:03.887269 21763 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:03.887488 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:03.887931 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:03.888720 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:03.889313 21762 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:03.890111 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:03.891084 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:03.891742 21762 raft_consensus.cc:2393] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 10: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:03.892416 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:03.892927 21762 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:03.894032 21879 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:03.894330 21763 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:03.899086 25196 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:03.901451 21837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1840) took 1704 ms. Trace:
I20260709 13:09:03.901623 25009 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:03.901868 21837 rpcz_store.cc:276] 0709 13:09:02.196964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.197076 (+   112us) service_pool.cc:224] Handling call
0709 13:09:02.197389 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.734424 (+537035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.901185 (+1166761us) spinlock_profiling.cc:243] Waited 533 ms on lock 0x7b54003f0f54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:03.901369 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1225063552}
I20260709 13:09:03.733976 25231 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:03.903301 25205 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:03.904328 21759 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:03.661983 25210 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:03.893306 21912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 563) took 1010 ms. Trace:
I20260709 13:09:03.736236 25066 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:03.551918 25209 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:03.905954 21912 rpcz_store.cc:276] 0709 13:09:02.883147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.886707 (+  3560us) service_pool.cc:224] Handling call
0709 13:09:02.940745 (+ 54038us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:02.943784 (+  3039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:03.893133 (+949349us) spinlock_profiling.cc:243] Waited 53.7 ms on lock 0x7b54001eb9d0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:03.893252 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123577216}
W20260709 13:09:03.907523 21905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1572) took 2500 ms (client timeout 3267 ms). Trace:
I20260709 13:09:03.907876 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:03.908164 21756 raft_consensus.cc:1275] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:09:03.907965 21905 rpcz_store.cc:269] 0709 13:09:01.407525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:01.736981 (+329456us) service_pool.cc:224] Handling call
0709 13:09:03.907319 (+2170338us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b5400196ed4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:03.907465 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":915184896}
I20260709 13:09:03.903861 25009 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:03.555697 25160 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:03.209761 25152 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.275565 25216 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:03.069510 25142 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:03.849788 25026 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:03.425364 24768 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:03.532447 25140 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:03.926949 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:03.845991 25149 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:03.839000 25014 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:03.835948 21806 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:03.531762 25136 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:03.462194 25083 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:03.428423 25197 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:03.912810 21908 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45202 (request call id 570) took 1028 ms. Trace:
I20260709 13:09:03.909088 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:03.953418 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 59462.5us
I20260709 13:09:03.920660 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:03.640781 25236 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:03.926441 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:03.850579 25177 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:03.966748 25210 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:09:03.968943 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 447253us
I20260709 13:09:03.931511 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:03.946913 25084 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:03.927254 25142 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:03.969928 25084 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:03.966871 25236 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:03.970330 25084 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:03.970866 25084 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:03.971347 25142 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:03.971935 25142 consensus_queue.cc:1059] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:09:03.972884 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 137069us
I20260709 13:09:03.973383 25150 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:03.973259 25220 consensus_queue.cc:1059] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:03.974203 25220 raft_consensus.cc:3055] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:03.974591 25220 raft_consensus.cc:740] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:03.975613 25220 consensus_queue.cc:260] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:03.976090 25242 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:03.976120 25221 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:03.976919 25220 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:03.976768 25242 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:03.966614 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:03.978219 22484 raft_consensus.cc:2393] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 8: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:09:03.937522 21907 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
W20260709 13:09:03.942131 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.596786 21839 raft_consensus.cc:1240] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:03.525179 25213 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:03.981927 21907 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:03.910707 25041 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:09:03.769025 25234 log.cc:927] Time spent T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.214s	user 0.000s	sys 0.000s
I20260709 13:09:03.947757 21911 raft_consensus.cc:2393] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 7: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:03.951865 21729 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:03.953465 21908 rpcz_store.cc:276] 0709 13:09:02.884838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.890136 (+  5298us) service_pool.cc:224] Handling call
0709 13:09:03.912612 (+1022476us) spinlock_profiling.cc:243] Waited 78.5 ms on lock 0x7b5400420ed4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:03.912740 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":180498688}
I20260709 13:09:03.992595 21729 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:03.994482 21729 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
W20260709 13:09:03.664592 25186 log.cc:927] Time spent T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 1.466s	user 0.002s	sys 0.010s
I20260709 13:09:03.926499 24937 consensus_queue.cc:237] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:03.943825 24768 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:03.966404 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:03.966531 25061 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:03.972054 25236 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:03.972735 25009 consensus_queue.cc:1059] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:03.974478 25165 consensus_queue.cc:1059] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:09:03.286326 25163 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10.
I20260709 13:09:03.562733 22483 raft_consensus.cc:2368] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6.
I20260709 13:09:03.562285 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:03.550722 25184 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.010s	sys 0.010s
I20260709 13:09:03.970224 21877 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:03.982240 21805 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:03.919396 24989 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:03.984042 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:03.984021 21907 raft_consensus.cc:1275] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:03.674968 25157 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:03.943931 25204 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:03.948426 25105 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:03.997879 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 80991.3us
I20260709 13:09:03.910588 24939 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:03.920171 25160 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:04.043987 25149 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:04.007790 21879 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:03.919962 25152 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:03.979183 25197 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:04.013809 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 1312) took 1012 ms. Trace:
I20260709 13:09:04.048729 21761 rpcz_store.cc:276] 0709 13:09:03.001202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.001304 (+   102us) service_pool.cc:224] Handling call
0709 13:09:03.562096 (+560792us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b5800000098. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232a22 00007fc6b414bc09 00007fc6b32a5ee0 00007fc6b336f0ab 00007fc6b336f131 00007fc6b331d0a0 00007fc6b331c984 00007fc6ac8976d4 00007fc6ac897662
0709 13:09:04.013721 (+451625us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9496960}
I20260709 13:09:03.974664 25216 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:03.949092 25239 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:09:04.017796 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:04.018599 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:03.988458 25041 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:04.057926 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 565) took 1174 ms. Trace:
I20260709 13:09:04.020215 21905 raft_consensus.cc:1275] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:04.058538 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:04.023149 21837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:09:04.059319 21837 raft_consensus.cc:606] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:03.997584 24924 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:04.026481 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 56321.9us
I20260709 13:09:04.065831 22485 raft_consensus.cc:1240] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:04.066931 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:04.068275 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:04.069074 21833 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:04.004225 25180 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:04.037339 25250 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.038187 25165 raft_consensus.cc:3055] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:03.988351 24979 consensus_queue.cc:1048] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:09:04.006601 25202 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:03.979547 25083 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:04.014940 25184 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.018s	sys 0.023s
I20260709 13:09:04.042723 25136 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:04.043787 24939 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:04.049767 25160 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:03.925625 25209 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:03.978403 25221 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:09:04.056272 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:04.058319 21909 rpcz_store.cc:276] 0709 13:09:02.883659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.952386 (+ 68727us) service_pool.cc:224] Handling call
0709 13:09:03.316353 (+363967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.982176 (+665823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.982207 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.982249 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:03.982280 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.057703 (+ 75423us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b5400416754. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:04.057747 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.057872 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1530861824}
I20260709 13:09:04.130916 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:04.132179 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:04.028687 25142 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:04.061822 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 54122.9us
I20260709 13:09:04.015358 25089 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:09:04.040123 25236 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:03.997318 25215 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:04.150657 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:04.031200 25177 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:04.087684 22481 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:04.020970 24989 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:04.032299 25205 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:04.033979 25208 consensus_queue.cc:1048] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:09:04.065105 25216 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:04.086864 25163 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.149926 25236 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.072165 25149 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:04.138684 25142 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:04.111213 22482 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36290 (request call id 902) took 2051 ms (client timeout 2383 ms). Trace:
I20260709 13:09:04.051568 25204 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:04.137780 24905 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:04.088577 25165 raft_consensus.cc:740] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:04.151497 22484 raft_consensus.cc:2393] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 8: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:09:04.164806 25163 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:04.187201 25196 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:04.109017 24925 consensus_meta.cc:287] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.557s	user 0.003s	sys 0.006s
I20260709 13:09:04.154992 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:04.109419 25202 raft_consensus.cc:697] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:04.093061 25250 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:04.138799 25195 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.135721 25242 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:04.082496 25219 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:04.176282 22482 rpcz_store.cc:269] 0709 13:09:02.060196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.060324 (+   128us) service_pool.cc:224] Handling call
0709 13:09:04.110976 (+2050652us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b540051fc54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:04.111136 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":939833600}
I20260709 13:09:04.137616 24768 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:04.178036 25076 consensus_meta.cc:287] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.660s	user 0.009s	sys 0.001s
I20260709 13:09:04.165506 25236 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:04.180958 25083 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:04.178674 25142 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:04.179189 25026 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:04.203545 25204 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:04.205744 25165 consensus_queue.cc:260] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:04.206899 25165 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:04.189489 25140 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:04.198295 25163 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:04.210403 25215 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:04.178638 25149 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:04.198660 25219 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:04.220629 25250 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:04.220661 25219 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:04.221112 25202 consensus_queue.cc:237] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:04.222306 25158 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:04.229538 25184 raft_consensus.cc:3055] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:04.230248 25184 raft_consensus.cc:740] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:04.230561 25210 raft_consensus.cc:3055] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:04.231019 25210 raft_consensus.cc:740] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:04.234691 25210 consensus_queue.cc:260] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:04.237257 25213 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:04.081285 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:04.275017 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:04.278142 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:04.280184 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:04.055743 21765 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:09:04.080163 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:04.282305 21757 raft_consensus.cc:1240] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:04.284029 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:04.285961 21762 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:04.285094 21761 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:04.290987 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:04.295117 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:04.095570 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:04.338127 21831 raft_consensus.cc:2376] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9. Re-sending same reply.
I20260709 13:09:04.084349 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:04.341915 21804 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:04.343575 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:04.089679 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:04.346539 21837 raft_consensus.cc:2393] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 9: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:04.347882 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:04.349164 21837 raft_consensus.cc:2393] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 9: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:04.105676 21838 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:04.307432 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44772 (request call id 436) took 1324 ms. Trace:
I20260709 13:09:04.349776 21765 rpcz_store.cc:276] 0709 13:09:02.982553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.986124 (+  3571us) service_pool.cc:224] Handling call
0709 13:09:04.306951 (+1320827us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b540028da54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:04.307193 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1150496640}
I20260709 13:09:04.352217 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:04.075328 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:04.308370 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.354704 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:04.354967 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:04.355728 21837 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:09:04.356974 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:04.309267 21757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1320) took 1160 ms. Trace:
I20260709 13:09:04.311527 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:04.104807 21833 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:04.359880 21763 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:09:04.359488 21757 rpcz_store.cc:276] 0709 13:09:03.149187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.535620 (+386433us) service_pool.cc:224] Handling call
0709 13:09:03.535872 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.283077 (+747205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.308931 (+ 25854us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b54000a41d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:04.309171 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1715120896}
I20260709 13:09:04.075591 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:04.319743 21839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2734) took 1422 ms. Trace:
I20260709 13:09:04.360991 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:04.361496 21836 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:04.361166 21839 rpcz_store.cc:276] 0709 13:09:02.896975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.901337 (+  4362us) service_pool.cc:224] Handling call
0709 13:09:02.901670 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.979940 (+1078270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.318948 (+339008us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b54003f0a54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:04.319383 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1515441536}
I20260709 13:09:04.362802 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:04.362934 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:04.340969 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:04.364169 21836 raft_consensus.cc:2410] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:09:04.153827 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:04.364434 21831 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:04.133239 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:04.367246 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:04.367290 21804 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:04.157238 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:04.368760 21908 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:04.370119 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:04.371963 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:04.374035 21837 raft_consensus.cc:2393] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:04.328683 21911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45202 (request call id 566) took 1444 ms. Trace:
I20260709 13:09:04.375384 21911 rpcz_store.cc:276] 0709 13:09:02.883916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.939845 (+ 55929us) service_pool.cc:224] Handling call
0709 13:09:04.328003 (+1388158us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400195fd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:04.328365 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2315770624}
I20260709 13:09:04.331117 21912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1595) took 1353 ms. Trace:
I20260709 13:09:04.334543 21910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 567) took 1450 ms. Trace:
I20260709 13:09:04.377837 21910 rpcz_store.cc:276] 0709 13:09:02.884143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.001509 (+117366us) service_pool.cc:224] Handling call
0709 13:09:03.001795 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.006358 (+1004563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:04.006391 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:04.006433 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:04.006462 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.333956 (+327494us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54001969d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:04.334015 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.334301 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2309877504}
I20260709 13:09:04.377743 21912 rpcz_store.cc:276] 0709 13:09:02.977408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.954142 (+976734us) service_pool.cc:224] Handling call
0709 13:09:03.954547 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:03.978813 (+ 24266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.978844 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:03.987583 (+  8739us) log.cc:844] Serialized 26 byte log entry
0709 13:09:04.330143 (+342560us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:04.330296 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.330478 (+   182us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:04.330571 (+    93us) raft_consensus.cc:1685] finished
0709 13:09:04.330592 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.330837 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43086,"raft.queue_time_us":24323,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":2952,"thread_start_us":308118,"threads_started":1,"wal-append.queue_time_us":161257}
I20260709 13:09:04.376976 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:04.357733 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:04.079496 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:04.383019 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:04.383337 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:04.383997 21834 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:04.384744 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:04.385517 21840 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:09:04.385540 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:04.388059 21837 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:09:04.358682 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:04.360446 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:04.139143 21879 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:04.324031 21758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1310) took 1933 ms. Trace:
I20260709 13:09:04.390304 21833 raft_consensus.cc:2393] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 5: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:04.390444 21840 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:04.390539 21758 rpcz_store.cc:276] 0709 13:09:02.390637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.322643 (+1932006us) service_pool.cc:224] Handling call
0709 13:09:04.323151 (+   508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.323526 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:04.323549 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:04.323617 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:04.323650 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.323709 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.323832 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:04.364066 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:04.391731 21833 raft_consensus.cc:1275] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:04.392076 21840 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:04.374161 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:04.327808 21764 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:04.394805 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:04.396660 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:04.380508 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:04.397894 21910 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:04.335783 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 569) took 1451 ms. Trace:
I20260709 13:09:04.401682 21906 rpcz_store.cc:276] 0709 13:09:02.884621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.244096 (+359475us) service_pool.cc:224] Handling call
0709 13:09:03.257103 (+ 13007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:03.985313 (+728210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.985357 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:03.985413 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:03.985477 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.335230 (+349753us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b5400112454. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:04.335297 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.335571 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1674205952}
I20260709 13:09:04.403757 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:04.406160 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:04.386529 21834 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:04.374821 21804 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:04.281414 21759 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:04.170208 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 160300us
W20260709 13:09:04.419278 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 44764.1us
I20260709 13:09:04.423123 21804 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:04.436002 21910 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
W20260709 13:09:04.439533 21663 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52326 (request call id 152) took 14218 ms (client timeout 15000 ms). Trace:
I20260709 13:09:04.201896 25076 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:04.453414 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:04.463670 22479 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:04.464512 25009 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.465490 25009 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:04.466027 24984 raft_consensus.cc:3055] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:04.466675 24984 raft_consensus.cc:740] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:04.191421 24905 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:04.195379 24925 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:04.468214 24984 consensus_queue.cc:260] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:04.235123 25193 consensus_queue.cc:260] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:04.197319 25195 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:04.231380 25197 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:04.480485 25150 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:04.597869 21831 raft_consensus.cc:2410] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:09:04.738003 21838 raft_consensus.cc:1275] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:04.461611 25089 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.773942 21756 raft_consensus.cc:1240] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:04.768208 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:04.775938 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:04.777208 25157 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:04.736436 25175 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:04.810590 25163 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.777597 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:04.811631 25163 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:04.812765 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:04.814525 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:04.660884 21832 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.036s	sys 0.016s
W20260709 13:09:04.755842 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.782579 21760 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:04.784574 24925 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:04.431859 21661 catalog_manager.cc:5697] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 5 to 8, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 8 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:04.674167 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:04.468901 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:04.627277 25209 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:04.712189 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 573027us
I20260709 13:09:04.759724 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:04.790930 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 370393us
I20260709 13:09:04.809746 25041 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:04.809957 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:04.778407 25184 consensus_queue.cc:260] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:04.479583 22483 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36270 (request call id 572) took 1574 ms (client timeout 1852 ms). Trace:
W20260709 13:09:04.826764 21832 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.041s	sys 0.030s
I20260709 13:09:04.454128 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:04.736354 25212 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:04.827848 25066 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:04.473018 25015 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:04.469384 24979 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:04.658883 25219 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:04.829829 22483 rpcz_store.cc:269] 0709 13:09:02.905309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.905493 (+   184us) service_pool.cc:224] Handling call
0709 13:09:04.479095 (+1573602us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b5400510c54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:04.479326 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1477158656}
I20260709 13:09:04.834443 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:04.834996 21762 raft_consensus.cc:1240] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:09:04.835155 25184 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:04.835907 25152 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:04.837371 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:04.835180 25226 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:04.838567 25142 consensus_meta.cc:287] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.627s	user 0.008s	sys 0.005s
I20260709 13:09:04.838514 25066 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.839325 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:04.839833 21758 raft_consensus.cc:1240] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:09:04.840898 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:04.842237 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.842691 21909 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:09:04.846498 25149 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:04.849879 25209 consensus_queue.cc:1059] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:09:04.850654 25084 consensus_meta.cc:287] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.879s	user 0.011s	sys 0.007s
I20260709 13:09:04.852094 25175 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:04.856375 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:04.858726 25163 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:04.858582 25026 consensus_queue.cc:1059] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:09:04.848094 25197 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:04.863693 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:04.864020 21913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1593) took 1934 ms. Trace:
I20260709 13:09:04.864778 25076 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.866671 21908 raft_consensus.cc:2393] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 10: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:09:04.867542 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:04.868788 21759 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
W20260709 13:09:04.871652 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 260709us
I20260709 13:09:04.871379 22450 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:04.889372 25066 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:04.841298 25165 consensus_meta.cc:287] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.634s	user 0.003s	sys 0.012s
I20260709 13:09:04.625408 25236 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:04.831773 25089 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:04.870730 21661 catalog_manager.cc:5697] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 4 to 5, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 5 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:04.624029 25215 consensus_queue.cc:1048] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.266s
I20260709 13:09:04.871801 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:04.904604 21759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44772 (request call id 442) took 1008 ms. Trace:
I20260709 13:09:04.910044 22485 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
W20260709 13:09:04.440136 21663 rpcz_store.cc:269] 0709 13:08:50.220629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:50.230326 (+  9697us) service_pool.cc:224] Handling call
0709 13:09:04.439226 (+14208900us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:02.724519 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:02.785660 (+ 61141us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:02.785698 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:09:02.785719 (+    21us) tablet.cc:662] Decoding operations
0709 13:09:02.786889 (+  1170us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:02.786957 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:02.786989 (+    32us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:09:02.788112 (+  1123us) tablet.cc:701] Row locks acquired
0709 13:09:02.788131 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:09:02.788278 (+   147us) write_op.cc:270] Start()
0709 13:09:02.788408 (+   130us) write_op.cc:276] Timestamp: P: 1783602542788225 usec, L: 0
0709 13:09:02.788431 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:09:02.789100 (+   669us) log.cc:844] Serialized 4301 byte log entry
0709 13:09:03.975602 (+1186502us) op_driver.cc:464] REPLICATION: finished
0709 13:09:04.181505 (+205903us) write_op.cc:301] APPLY: starting
0709 13:09:04.181600 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:04.181933 (+   333us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:04.182050 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:04.184785 (+  2735us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:04.185074 (+   289us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 13:09:04.185120 (+    46us) write_op.cc:312] APPLY: finished
0709 13:09:04.185465 (+   345us) log.cc:844] Serialized 83 byte log entry
0709 13:09:04.186312 (+   847us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:04.186459 (+   147us) write_op.cc:454] Released schema lock
0709 13:09:04.186513 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:04.186874 (+   361us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:04.186903 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13560,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":205580,"apply.run_cpu_time_us":3651,"apply.run_wall_time_us":5372,"num_ops":11,"prepare.queue_time_us":484885,"prepare.run_cpu_time_us":9008,"prepare.run_wall_time_us":120836,"raft.queue_time_us":798260,"raft.run_cpu_time_us":45931,"raft.run_wall_time_us":162940,"replication_time_us":1187018,"thread_start_us":825960,"threads_started":4,"wal-append.queue_time_us":46295}]]}
I20260709 13:09:04.910014 21759 rpcz_store.cc:276] 0709 13:09:03.892709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.279681 (+386972us) service_pool.cc:224] Handling call
0709 13:09:04.900816 (+621135us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:04.914458 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 120917us
I20260709 13:09:04.914359 25149 consensus_queue.cc:1059] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:04.928000 25149 raft_consensus.cc:3055] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:04.916136 25226 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:04.916850 25089 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:04.917833 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:04.914263 24989 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:04.918502 21906 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:09:04.920018 25009 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:04.922312 21877 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:04.893124 25142 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:04.899181 25084 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:04.915167 25076 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:04.868166 25015 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:04.932034 24905 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:04.900000 21913 rpcz_store.cc:276] 0709 13:09:02.929278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.560442 (+631164us) service_pool.cc:224] Handling call
0709 13:09:03.560744 (+   302us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:03.980508 (+419764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:03.980544 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:03.981086 (+   542us) log.cc:844] Serialized 52 byte log entry
0709 13:09:04.152555 (+171469us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:04.663451 (+510896us) log.cc:844] Serialized 14 byte log entry
0709 13:09:04.863455 (+200004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:04.863578 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:04.863621 (+    43us) raft_consensus.cc:1685] finished
0709 13:09:04.863635 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:04.863848 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124088,"prepare.queue_time_us":515536,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":6811,"raft.queue_time_us":327320,"raft.run_cpu_time_us":433,"raft.run_wall_time_us":9870,"thread_start_us":710112,"threads_started":3,"wal-append.queue_time_us":182977}
I20260709 13:09:04.898872 25210 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:04.938879 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 71226us
I20260709 13:09:04.901633 24979 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:04.929920 25149 raft_consensus.cc:740] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:04.955024 21835 raft_consensus.cc:2393] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 9: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:04.945827 21879 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:04.961078 21759 raft_consensus.cc:1275] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:09:04.960649 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 343910us
I20260709 13:09:04.966938 24905 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:04.967427 24905 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:04.967833 24905 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:04.967567 21879 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:04.969717 25140 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:04.969919 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:04.970268 25140 raft_consensus.cc:697] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:04.970835 21877 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:04.972215 25061 consensus_queue.cc:1059] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:04.972996 21757 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:04.973697 21907 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:04.974030 25053 raft_consensus.cc:3055] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:04.974519 25053 raft_consensus.cc:740] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:04.974160 25149 consensus_queue.cc:260] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:04.975662 25149 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:04.975540 25053 consensus_queue.cc:260] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:04.976969 25053 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:04.977674 25076 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:04.952461 21661 catalog_manager.cc:5697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 6 to 7, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 7 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:04.978150 24905 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:04.978947 21661 catalog_manager.cc:5697] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 4 to 5, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 5 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:04.976042 25010 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:04.980573 24905 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:04.980697 25010 raft_consensus.cc:697] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:04.981930 25010 consensus_queue.cc:237] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:04.984560 22450 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:04.985682 21908 raft_consensus.cc:1240] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:04.971395 25140 consensus_queue.cc:237] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:04.990558 25250 raft_consensus.cc:2804] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:09:04.996136 25264 log.cc:927] Time spent T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.770s	user 0.003s	sys 0.000s
I20260709 13:09:04.997670 21910 raft_consensus.cc:1240] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:04.998083 25009 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:04.999645 25015 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:05.000151 25142 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:05.001467 25226 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:05.002876 24979 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:05.005461 21756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1328) took 1093 ms. Trace:
I20260709 13:09:05.005568 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:04.969390 21879 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:04.980893 21661 catalog_manager.cc:5697] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:04.973204 21877 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:05.009660 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:04.962240 25152 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:05.010939 25084 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:05.012428 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:05.016163 25193 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:05.018108 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 52624.2us
I20260709 13:09:04.926259 25197 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:05.026392 21756 rpcz_store.cc:276] 0709 13:09:03.912254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.325925 (+413671us) service_pool.cc:224] Handling call
0709 13:09:04.326340 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.818618 (+492278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.005221 (+186603us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b540017be54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:05.005388 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1028282752}
W20260709 13:09:05.032979 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 201750us
I20260709 13:09:04.937176 25212 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:05.055019 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:05.051855 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:05.064042 25076 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:05.065876 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:05.066063 25197 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:05.069849 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 96766.9us
I20260709 13:09:05.026003 25061 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:05.054240 25250 raft_consensus.cc:697] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:05.076932 25250 consensus_queue.cc:237] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:05.077744 22482 raft_consensus.cc:1240] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:05.078994 25066 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:05.080045 21909 raft_consensus.cc:1240] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:05.081749 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 112454us
I20260709 13:09:05.082710 21879 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:05.085266 25053 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:05.085631 25028 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:05.086274 25028 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:05.086838 25028 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:05.091008 21661 catalog_manager.cc:5697] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 7 to 8, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 8 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:05.092243 25226 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:05.069058 25152 raft_consensus.cc:697] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:05.085671 25053 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.106237 21661 catalog_manager.cc:5697] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 6 to 8, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 8 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:05.110348 25226 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:05.113127 25226 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:05.114713 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.117250 21728 leader_election.cc:336] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.528s (SENT)
W20260709 13:09:05.118528 21728 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.763s (SENT) [suppressed 17 similar messages]
W20260709 13:09:05.119343 21728 leader_election.cc:336] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.608s (SENT)
I20260709 13:09:05.119735 21728 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:05.122500 25238 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:05.122959 25026 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:05.124012 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 575) took 1190 ms. Trace:
I20260709 13:09:05.124401 21907 rpcz_store.cc:276] 0709 13:09:03.933481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.023240 (+ 89759us) service_pool.cc:224] Handling call
0709 13:09:04.023616 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.974110 (+950494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.123703 (+149593us) spinlock_profiling.cc:243] Waited 929 ms on lock 0x7b5400100c54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:05.123947 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2137127168}
I20260709 13:09:05.068439 25009 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:05.131086 25212 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:05.131727 22449 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:05.132534 25026 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:05.134078 21804 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:05.134949 25148 consensus_queue.cc:1059] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:05.136536 21804 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:05.136762 25148 raft_consensus.cc:3055] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:05.137087 25158 consensus_meta.cc:287] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.914s	user 0.014s	sys 0.001s
I20260709 13:09:05.137627 25142 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:05.138489 25142 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:05.138221 25150 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:05.138810 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:05.139619 21907 raft_consensus.cc:2393] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 9: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:05.143891 21731 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:05.140224 25241 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.137168 25148 raft_consensus.cc:740] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:05.147377 25236 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:05.147303 25148 consensus_queue.cc:260] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:05.148610 25148 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:05.149000 25219 raft_consensus.cc:3055] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:05.149200 25009 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:05.149533 25219 raft_consensus.cc:740] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:05.126089 25053 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:05.153003 25219 consensus_queue.cc:260] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:05.154735 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:05.155925 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:09:05.156479 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.145787 25241 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:05.159824 21911 raft_consensus.cc:1275] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:09:05.160151 21911 pending_rounds.cc:85] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 4
I20260709 13:09:05.160369 21877 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:05.160370 21911 pending_rounds.cc:107] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:09:05.161235 21911 raft_consensus.cc:2889] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:05.161511 25184 consensus_queue.cc:1059] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:05.162302 25184 consensus_queue.cc:1243] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer 3843e9b794a245dd8608e04ec7915239 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:05.162758 21911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1344) took 1032 ms. Trace:
I20260709 13:09:05.162889 25184 raft_consensus.cc:3055] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:05.163368 25184 raft_consensus.cc:740] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:05.164008 25084 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:05.164426 25084 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:05.164322 25184 consensus_queue.cc:260] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:05.164985 25084 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:05.164983 25156 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:05.165970 25156 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:05.166386 25156 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:05.166885 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 47582.9us
I20260709 13:09:05.164613 21760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1319) took 2015 ms. Trace:
I20260709 13:09:05.168840 21760 rpcz_store.cc:276] 0709 13:09:03.148882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:03.533883 (+385001us) service_pool.cc:224] Handling call
0709 13:09:03.621203 (+ 87320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.820663 (+1199460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.164356 (+343693us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54001b99d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:05.164547 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2670024960}
I20260709 13:09:05.171545 21831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "915629d8ce0e4452b6308425161f143a"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:09:05.172402 21831 raft_consensus.cc:606] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:05.178057 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:05.179126 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1349) took 1047 ms. Trace:
I20260709 13:09:05.179488 21909 rpcz_store.cc:276] 0709 13:09:04.131748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.932259 (+800511us) service_pool.cc:224] Handling call
0709 13:09:04.936199 (+  3940us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.080400 (+144201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.178915 (+ 98515us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54001973d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:05.179047 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":330391424}
I20260709 13:09:05.183075 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:05.184029 24984 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:05.185325 25156 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:05.187626 25156 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:05.187741 21907 raft_consensus.cc:1275] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:05.130791 25152 consensus_queue.cc:237] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:05.202265 25026 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:05.200582 25028 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:05.211047 21907 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:05.163146 21911 rpcz_store.cc:276] 0709 13:09:04.130462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.899072 (+768610us) service_pool.cc:224] Handling call
0709 13:09:04.919267 (+ 20195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:05.161776 (+242509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.162527 (+   751us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54002d8554. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:05.162705 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":552449920}
W20260709 13:09:05.217693 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.218370 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.226505 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 90062.1us
I20260709 13:09:05.227735 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:05.228778 25028 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:05.224985 25009 consensus_queue.cc:1059] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:09:05.229915 25053 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:05.230417 25009 raft_consensus.cc:3055] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:05.230839 25009 raft_consensus.cc:740] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:05.231667 25009 consensus_queue.cc:260] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:05.232887 25009 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:05.224699 21661 catalog_manager.cc:5697] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:05.234035 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1332) took 1216 ms. Trace:
I20260709 13:09:05.114410 25195 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:05.241798 22478 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:05.245821 21731 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:05.298651 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:05.234609 21761 rpcz_store.cc:276] 0709 13:09:04.018036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.347446 (+329410us) service_pool.cc:224] Handling call
0709 13:09:04.747769 (+400323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:04.836503 (+ 88734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:04.836542 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:04.837176 (+   634us) log.cc:844] Serialized 26 byte log entry
0709 13:09:05.026709 (+189533us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:05.026749 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.026818 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:05.233756 (+206938us) raft_consensus.cc:1685] finished
0709 13:09:05.233782 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.233962 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40121,"raft.queue_time_us":48075,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":137,"thread_start_us":186599,"threads_started":1,"wal-append.queue_time_us":387303}
W20260709 13:09:05.321965 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 383607us
I20260709 13:09:05.322062 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:05.331465 21760 raft_consensus.cc:2393] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 6: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:09:05.334941 21835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:09:05.300768 25156 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:05.304414 25184 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:05.339100 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 254222us
I20260709 13:09:05.335747 21835 raft_consensus.cc:606] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:05.245573 25026 consensus_queue.cc:1059] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 13:09:05.325268 25238 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.330750 25197 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:05.355239 21838 raft_consensus.cc:1240] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:05.366469 25026 raft_consensus.cc:3055] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:05.367036 25026 raft_consensus.cc:740] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:05.367645 25053 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:05.368821 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.368196 25026 consensus_queue.cc:260] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:05.370558 21728 leader_election.cc:336] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.824s (SENT)
I20260709 13:09:05.372402 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1846) took 1298 ms. Trace:
I20260709 13:09:05.374074 25066 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:05.372852 21832 rpcz_store.cc:276] 0709 13:09:04.073989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.074135 (+   146us) service_pool.cc:224] Handling call
0709 13:09:04.074555 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:04.074795 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:04.878053 (+803258us) log.cc:844] Serialized 14 byte log entry
0709 13:09:05.338146 (+460093us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:05.343245 (+  5099us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:05.355271 (+ 12026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.372133 (+ 16862us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.372330 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":166936,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":5261,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":18889,"thread_start_us":1101677,"threads_started":2}
I20260709 13:09:05.375365 21804 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:05.376368 24979 raft_consensus.cc:993] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:09:05.376850 24979 raft_consensus.cc:1081] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:09:05.376755 25150 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:05.340163 25219 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:05.381394 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.382737 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.391604 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.383842 25238 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:05.401670 21661 catalog_manager.cc:5697] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:05.404386 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:05.404771 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:05.405224 21838 raft_consensus.cc:2393] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 6: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:05.405737 21831 raft_consensus.cc:2410] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:09:05.406261 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:05.406836 21840 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:05.407392 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:05.408924 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:05.410532 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:05.411293 21836 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:05.411530 25084 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:05.415398 21840 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:05.417652 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:05.418483 21907 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:09:05.417953 21832 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:05.420930 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 43608.5us
I20260709 13:09:05.423462 21804 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:05.427690 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:05.428481 21833 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:05.353895 25156 raft_consensus.cc:697] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 10 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:05.431758 22449 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:09:05.446189 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 52462.8us
I20260709 13:09:05.455874 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:05.459992 21879 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:05.457219 25009 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:05.465500 21836 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:05.447207 25084 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:05.473810 21804 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:05.471843 21806 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:05.468379 21661 catalog_manager.cc:5697] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:05.435680 25238 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:05.454981 25026 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:05.460279 21756 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "915629d8ce0e4452b6308425161f143a"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59108
I20260709 13:09:05.508231 21756 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:05.508749 21756 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:05.510942 25084 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:05.511598 25084 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:05.513577 25283 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:05.514209 25283 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.514403 25066 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:05.514686 25283 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:05.515094 25066 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:05.516825 21804 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:05.518186 21804 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:05.518355 25084 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:05.519460 21804 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:05.519596 25066 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:05.520869 25210 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:05.521615 25210 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:05.521947 25210 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.522282 25210 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:05.523983 24979 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:05.525761 25252 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:05.526207 25252 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.526531 25252 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:05.528923 21905 raft_consensus.cc:2410] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:09:05.530527 25273 log.cc:927] Time spent T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:09:05.530927 21905 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1351) took 1398 ms (client timeout 1801 ms). Trace:
I20260709 13:09:05.531530 21835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:44058
W20260709 13:09:05.531492 21905 rpcz_store.cc:269] 0709 13:09:04.132274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.151665 (+ 19391us) service_pool.cc:224] Handling call
0709 13:09:05.530629 (+1378964us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b5400195ad4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:05.530831 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2675425536}
I20260709 13:09:05.532254 21835 raft_consensus.cc:606] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:05.532656 21835 raft_consensus.cc:614] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:05.533741 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:05.542279 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 82383.4us
I20260709 13:09:05.522881 25150 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:05.553880 25009 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:05.566454 21804 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:09:05.567621 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 96224.1us
W20260709 13:09:05.573614 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 173473us
I20260709 13:09:05.577984 21806 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:05.588408 25150 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:05.590814 25276 log.cc:927] Time spent T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:09:05.592006 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1609) took 1267 ms. Trace:
I20260709 13:09:05.592572 21906 rpcz_store.cc:276] 0709 13:09:04.324323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.944538 (+620215us) service_pool.cc:224] Handling call
0709 13:09:04.954709 (+ 10171us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:04.997749 (+ 43040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:04.997794 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:04.998378 (+   584us) log.cc:844] Serialized 26 byte log entry
0709 13:09:05.248171 (+249793us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:05.248228 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.248327 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:05.591653 (+343326us) raft_consensus.cc:1685] finished
0709 13:09:05.591682 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.591891 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11887,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":249319,"threads_started":1,"wal-append.queue_time_us":437980}
I20260709 13:09:05.595091 21913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1613) took 1222 ms. Trace:
I20260709 13:09:05.603766 21806 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:05.584364 25241 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:05.587096 25015 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:05.608760 21836 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:05.567051 25156 consensus_queue.cc:237] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:05.614166 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:09:05.615341 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 243542us
I20260709 13:09:05.616853 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:05.617051 25219 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:05.621625 21729 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:05.623283 25041 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:05.627764 25009 raft_consensus.cc:993] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:09:05.628310 25009 raft_consensus.cc:1081] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:09:05.632718 21833 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:05.620889 25210 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:05.633484 21729 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:05.641455 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 82145.7us
I20260709 13:09:05.644842 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:05.645742 22482 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:05.647444 21661 catalog_manager.cc:5697] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 1 to 6, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 6 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:05.647419 21756 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:05.647157 25252 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:05.650820 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:05.651150 21806 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:05.651871 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:05.652055 25015 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:05.652441 22483 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:05.652558 25252 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:05.651476 22478 raft_consensus.cc:2368] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 9. Current term is 10.
I20260709 13:09:05.658320 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:05.659032 22480 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:05.659722 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:05.663672 21756 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:05.663242 21729 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:05.662564 25015 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:09:05.665915 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:05.668469 25283 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:05.652156 25041 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:05.671403 21661 catalog_manager.cc:5697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 3 to 4, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 4 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:05.672981 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:05.646929 25241 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.674365 25241 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:05.676396 25241 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:05.677842 22481 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:05.681344 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:05.682222 22478 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:05.683199 22482 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:05.595630 21913 rpcz_store.cc:276] 0709 13:09:04.373142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:04.986738 (+613596us) service_pool.cc:224] Handling call
0709 13:09:04.987304 (+   566us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:09:04.988016 (+   712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:04.988059 (+    43us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:09:04.988944 (+   885us) log.cc:844] Serialized 78 byte log entry
0709 13:09:05.313537 (+324593us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:05.486004 (+172467us) log.cc:844] Serialized 14 byte log entry
0709 13:09:05.495568 (+  9564us) log.cc:844] Serialized 14 byte log entry
0709 13:09:05.509595 (+ 14027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:05.509676 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:05.594788 (+ 85112us) raft_consensus.cc:1685] finished
0709 13:09:05.594820 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:05.595012 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26909,"prepare.queue_time_us":263671,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":28396,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":4832,"thread_start_us":409060,"threads_started":2,"wal-append.queue_time_us":353828}
I20260709 13:09:05.684172 21729 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:05.641480 25215 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.685174 24937 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:05.685874 24937 raft_consensus.cc:697] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:05.686082 25163 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:05.686913 24937 consensus_queue.cc:237] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:05.685673 25215 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:05.689356 25283 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:05.690748 25215 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:05.691635 22483 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:05.692916 21729 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:05.693692 25215 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:05.673314 21661 catalog_manager.cc:5697] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:05.695024 21804 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:05.695561 25015 consensus_queue.cc:1059] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:05.697103 25184 consensus_queue.cc:1059] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:05.734781 25215 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:05.735337 25215 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:05.735749 25215 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:05.700299 22485 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:05.700613 25219 consensus_queue.cc:1048] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:05.704640 22480 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:05.708485 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:05.708578 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:05.709641 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:05.756079 21907 raft_consensus.cc:2410] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:09:05.710093 25061 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.710687 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:05.711503 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:05.712455 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:05.718150 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:05.718654 22484 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:05.766681 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:05.771448 21877 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:05.771639 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:05.772455 21833 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:05.761492 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:05.773403 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:05.774216 21906 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:05.776427 21760 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:09:05.778319 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:05.768517 21763 raft_consensus.cc:1217] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[4.3-6.5]   Dedup: 5.4->[6.5-6.5]
I20260709 13:09:05.782886 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:05.782948 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:05.784109 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:05.783123 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:05.785172 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:05.784299 21763 raft_consensus.cc:1240] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: [4.3-6.5]
I20260709 13:09:05.784129 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:05.785961 21877 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:05.790957 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:05.791813 21910 raft_consensus.cc:2393] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 9: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:05.766212 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:05.795231 21836 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:09:05.735680 25210 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:05.797857 21910 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:05.807173 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:05.807964 21836 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:05.808259 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 183541us
I20260709 13:09:05.794615 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:05.819641 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:05.820819 21911 raft_consensus.cc:2410] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:05.816771 21838 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:05.822638 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:05.825135 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:05.775308 25061 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:05.828151 21877 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:05.829238 25061 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:05.829387 25053 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:05.829576 25204 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.829876 25061 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:05.830090 25053 raft_consensus.cc:697] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:05.830125 25204 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:05.831291 25053 consensus_queue.cc:237] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:05.832602 25204 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:05.833191 21909 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:05.833563 21835 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:05.821310 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:05.840814 21760 raft_consensus.cc:2410] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:09:05.844099 21906 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:09:05.813150 21910 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:05.853535 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:05.854938 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:05.775054 25283 consensus_queue.cc:1059] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:09:05.865242 21834 raft_consensus.cc:1275] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:05.868222 21833 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:05.868607 21836 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:05.872411 21831 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:05.873895 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:05.845286 25140 raft_consensus.cc:2764] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:09:05.883252 21880 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:05.884702 25015 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.891588 21907 raft_consensus.cc:1240] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:05.893978 25219 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.896394 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:05.904902 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:05.857596 24979 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:05.947849 25264 log.cc:927] Time spent T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:09:05.948354 24979 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:05.950099 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 67022.5us
I20260709 13:09:05.951421 21880 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:05.869120 25142 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:05.953092 25142 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:05.872138 25210 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:05.933776 21910 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:05.917135 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:05.923636 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:05.961596 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:05.966106 21911 raft_consensus.cc:2393] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 8: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:09:05.966894 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 293275us
W20260709 13:09:05.976872 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 152978us
I20260709 13:09:05.957247 25142 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:05.910751 25193 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:05.917660 25084 raft_consensus.cc:3055] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:05.977130 25066 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:06.011319 25084 raft_consensus.cc:740] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:06.020833 25084 consensus_queue.cc:260] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:05.977186 25219 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.022159 25084 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:06.024056 25219 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:06.012231 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.012816 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:06.029279 21906 raft_consensus.cc:2368] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 10. Current term is 11.
W20260709 13:09:06.029709 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 201628us
I20260709 13:09:06.016956 24979 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:06.017212 25150 raft_consensus.cc:3055] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:06.017580 25193 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.018307 25213 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:06.029626 22449 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:09:06.044984 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 93630.2us
I20260709 13:09:06.030567 21877 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:06.013933 21909 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
W20260709 13:09:06.066365 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 371432us
I20260709 13:09:06.068578 21806 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:05.978469 25015 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:06.067524 21758 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59108
I20260709 13:09:06.073755 21758 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:06.074285 21758 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:06.072077 21877 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:06.034186 25150 raft_consensus.cc:740] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:06.069224 25195 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.077988 21806 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:06.065472 25148 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:06.083318 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:06.074090 25241 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:06.079378 24979 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.093822 25053 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.094461 25053 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.096642 25053 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:06.098009 25150 consensus_queue.cc:260] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.098258 25140 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.099382 25241 raft_consensus.cc:697] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:06.079540 25213 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:06.078438 25061 raft_consensus.cc:697] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 9 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:06.100605 25213 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:06.100510 25241 consensus_queue.cc:237] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:06.099504 25140 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.101629 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:06.101768 21880 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:06.102285 21761 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:09:06.103166 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.093333 24979 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.103331 25061 consensus_queue.cc:237] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:06.101157 25213 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:06.107724 25140 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:06.109561 25319 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:06.110070 25319 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:06.085963 25009 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:06.110311 25140 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:06.112769 24979 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:06.099877 25150 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:06.098532 25193 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:06.118005 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.122200 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:06.123371 25015 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:06.091550 25148 raft_consensus.cc:697] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:06.124210 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.124845 21834 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:06.127856 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.128327 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.103994 21832 raft_consensus.cc:2393] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 8: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:06.111732 21906 consensus_queue.cc:237] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:06.135586 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.136703 21840 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:06.137828 21877 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:06.110446 25319 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:06.143195 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:06.155200 21833 raft_consensus.cc:1240] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:06.162648 25009 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:06.166066 21835 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:09:06.173837 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:06.174350 21877 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:09:06.179428 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 45992.1us
I20260709 13:09:06.183748 21877 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:06.080953 25195 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:06.201290 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.212479 21833 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:06.211679 21877 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:06.214221 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:06.214848 21765 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:06.185521 25193 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:06.254016 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 62005.9us
I20260709 13:09:06.225841 25053 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:06.216449 25320 raft_consensus.cc:2804] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:06.266315 21760 raft_consensus.cc:1240] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:06.241153 25193 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.268337 21880 leader_election.cc:400] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 9. Current term is 10.
I20260709 13:09:06.194764 25148 consensus_queue.cc:237] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:06.272284 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:06.273053 21761 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:06.268790 25320 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:06.279676 25320 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:06.280078 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:06.278264 21880 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:06.296080 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.270706 25193 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:06.298310 21805 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:06.268344 25317 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:06.303898 21877 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:06.272120 25066 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:09:06.301666 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.307196 21833 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:06.293471 25215 consensus_meta.cc:287] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.548s	user 0.012s	sys 0.000s
I20260709 13:09:06.287493 25140 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:06.310534 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:06.318368 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.282239 25053 raft_consensus.cc:697] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:06.319085 21763 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:06.269294 25061 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:09:06.319554 21805 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:06.327750 21879 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:06.305730 25310 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:06.322770 21836 raft_consensus.cc:2393] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 8: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:06.324265 21765 raft_consensus.cc:1275] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:06.331254 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:06.313733 25066 consensus_queue.cc:1243] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer 6fadfd81c5a645f1806a284ddbb6bf0d log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:06.335235 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.337668 21805 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:06.317459 25317 raft_consensus.cc:697] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:06.318321 25313 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:06.344413 21840 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:06.345455 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.346428 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:06.342190 21763 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:06.320205 25213 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.350355 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:06.353394 21765 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:06.356336 25015 consensus_queue.cc:1059] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:06.354650 21805 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:06.358055 25009 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:06.358476 25009 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.358815 25009 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:06.360186 25324 log.cc:927] Time spent T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:09:06.368580 25140 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:06.368405 25009 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.349753 25314 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:06.371061 25318 log.cc:927] Time spent T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:09:06.371834 25009 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:06.339533 25241 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:09:06.377297 25195 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:06.348678 25210 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:06.378269 25210 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.378674 25210 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:06.353971 21833 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:09:06.321691 25215 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.383222 21758 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.347618 25327 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:06.351747 25313 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.332787 25319 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:06.352623 25310 raft_consensus.cc:697] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:06.408257 21758 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:06.412344 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.413312 21832 raft_consensus.cc:2410] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:09:06.413519 21831 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:06.415124 25317 consensus_queue.cc:237] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.407305 25313 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:06.419188 21762 raft_consensus.cc:2368] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7.
I20260709 13:09:06.348987 25053 consensus_queue.cc:237] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.437214 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.437783 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.438020 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.440605 21840 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:09:06.442674 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.461351 21833 raft_consensus.cc:2393] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 9: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:06.444397 25310 consensus_queue.cc:237] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:06.446736 25325 log.cc:927] Time spent T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:09:06.407521 25327 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.448015 25213 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:06.448134 21835 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:09:06.455574 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:06.443486 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.461817 21837 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:06.462502 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.461393 21832 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
W20260709 13:09:06.463863 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 136235us
I20260709 13:09:06.466573 21879 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:06.469640 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.475484 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.476243 21836 raft_consensus.cc:1240] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:06.475517 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:09:06.483526 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.483711 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.484285 21833 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:06.479326 21838 raft_consensus.cc:2376] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10. Re-sending same reply.
I20260709 13:09:06.485306 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.485705 21877 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:06.486039 21835 raft_consensus.cc:2393] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 8: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:06.487082 21806 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:06.491312 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:06.492053 21910 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:06.500778 21877 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:06.504523 21835 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:06.504673 22485 raft_consensus.cc:1240] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:06.507719 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:06.508496 21907 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:06.512507 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:06.513043 21840 raft_consensus.cc:1275] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:09:06.463894 25327 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:06.460040 25150 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.515724 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.516055 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.516736 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:06.515666 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:06.517735 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.518114 21761 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:06.518644 21836 raft_consensus.cc:2393] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 8: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:06.525616 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:06.526561 21835 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:06.528697 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:06.516642 21832 raft_consensus.cc:2376] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6. Re-sending same reply.
I20260709 13:09:06.504192 25315 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:06.583937 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 74268.1us
I20260709 13:09:06.588174 21765 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:06.551155 21729 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:06.506184 25084 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:06.589438 21833 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
W20260709 13:09:06.592738 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 51005.7us
I20260709 13:09:06.509955 25329 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:06.592031 21879 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:06.603250 21877 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:06.550647 25314 raft_consensus.cc:3055] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:06.592279 25204 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.531013 25150 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.612865 21914 raft_consensus.cc:1240] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:06.604619 25329 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.618219 21838 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:06.619812 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:06.620690 21914 raft_consensus.cc:2410] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:09:06.597803 25163 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:09:06.622795 25083 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:09:06.624413 25193 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.618145 25331 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:06.629101 21840 pending_rounds.cc:85] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 4
I20260709 13:09:06.629400 21840 pending_rounds.cc:107] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:09:06.629633 21840 raft_consensus.cc:2889] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:06.630394 21837 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:09:06.632526 21761 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:06.609467 25314 raft_consensus.cc:740] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:09:06.636731 21728 leader_election.cc:336] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.568s (SENT)
I20260709 13:09:06.618647 25319 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:06.642180 25210 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.620209 25140 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:06.644236 25140 raft_consensus.cc:697] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:06.644423 25210 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:06.638279 21879 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:06.626924 25215 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:06.650617 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.620381 25329 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:06.668608 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 52936.4us
I20260709 13:09:06.676529 21837 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:06.659437 21907 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:09:06.616473 25204 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:06.635481 25041 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:06.685721 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:06.677620 25331 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.645184 25140 consensus_queue.cc:237] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.645682 25320 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.685683 25213 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:06.679232 25250 consensus_queue.cc:1048] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:09:06.675539 25309 consensus_queue.cc:1048] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
W20260709 13:09:06.714174 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 76100.4us
I20260709 13:09:06.716089 21879 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:06.717587 21879 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:06.712554 25334 log.cc:927] Time spent T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:09:06.693714 25066 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:09:06.729568 21879 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:06.720144 25332 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:06.700420 25331 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.746421 25204 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:06.747151 25333 log.cc:927] Time spent T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:09:06.730870 25150 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:06.730870 25213 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:06.711899 25314 consensus_queue.cc:260] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.761804 25320 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:06.777935 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 48496.4us
I20260709 13:09:06.791953 21879 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:06.795082 21879 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:06.780015 25066 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:06.799500 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 248412us
I20260709 13:09:06.795730 25195 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:06.800282 25320 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:06.800752 21729 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:06.792932 25314 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:06.795908 25332 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:06.814319 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:06.820325 25331 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:06.814154 25328 log.cc:927] Time spent T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:09:06.784415 25204 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:09:06.830101 25327 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.831439 25156 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:06.831912 25331 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.855760 25331 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.856770 21913 raft_consensus.cc:1240] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:06.857879 25331 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:06.832424 25241 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:06.858614 25327 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:06.858579 25241 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:06.821379 25329 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.860761 25241 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:06.862624 25313 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.864812 25313 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:06.824756 21880 consensus_peers.cc:597] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d76fbf464db84dbeb90facb1538a9ca1. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:06.867473 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 56938.4us
I20260709 13:09:06.833068 25320 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:06.868763 25320 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.869108 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.869906 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.870199 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.869910 21834 raft_consensus.cc:2393] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 9: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:06.870908 25320 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:06.872119 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.873114 21833 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 10: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:06.874874 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.875730 21831 raft_consensus.cc:2410] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:09:06.861250 25329 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:06.876147 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.876645 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.876987 21837 raft_consensus.cc:2410] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:09:06.877197 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.846253 25163 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:06.875754 21834 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:09:06.878026 21834 pending_rounds.cc:85] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 5
I20260709 13:09:06.877782 21833 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:06.878284 21834 pending_rounds.cc:107] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:09:06.846421 25309 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:06.879614 25314 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:06.847174 21728 leader_election.cc:336] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.587s (SENT)
I20260709 13:09:06.847102 25215 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:06.880112 25314 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.847826 25041 consensus_queue.cc:1048] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:06.848487 25226 consensus_queue.cc:1048] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:06.884380 25351 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:06.884831 25226 consensus_queue.cc:1059] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:06.837914 25343 consensus_queue.cc:1059] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:06.886011 25343 raft_consensus.cc:3055] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:06.886340 25343 raft_consensus.cc:740] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:06.887115 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:06.887177 25343 consensus_queue.cc:260] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:06.888057 22483 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:06.888623 25343 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:06.890256 22482 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:06.891745 21880 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:06.892849 25283 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:06.893222 25283 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.893612 25283 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:06.894627 21914 raft_consensus.cc:1240] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:06.895249 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:06.895920 21907 raft_consensus.cc:1240] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:06.896164 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:06.896492 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:06.896848 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:06.897508 22482 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:06.897620 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:06.878551 21834 raft_consensus.cc:2889] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:06.895954 21905 raft_consensus.cc:2393] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 10: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:06.896167 25195 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:06.900465 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:06.900588 25213 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:06.900583 25195 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:06.902060 22448 leader_election.cc:336] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.875s (SENT)
I20260709 13:09:06.902133 25330 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:06.903155 21728 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:06.903895 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.905404 25041 raft_consensus.cc:3055] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:06.905925 25041 raft_consensus.cc:740] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:06.906064 25193 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:06.906803 25041 consensus_queue.cc:260] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:06.908329 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.909026 21835 raft_consensus.cc:2368] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10.
I20260709 13:09:06.902664 22448 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:06.909444 21905 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:09:06.909757 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:06.910234 25299 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:06.910862 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.911196 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:06.911721 21906 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:06.913915 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:06.914423 21906 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:06.915246 25061 consensus_queue.cc:1059] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:06.917264 25320 raft_consensus.cc:3055] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:06.917672 25320 raft_consensus.cc:740] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:06.917840 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:06.918519 25320 consensus_queue.cc:260] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:06.919097 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:06.919653 21905 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:06.922722 25215 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:09:06.924435 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 77286.5us
I20260709 13:09:06.925488 25320 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:06.924445 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:06.926602 21832 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:06.927630 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.928273 21835 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:06.929687 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.930220 21840 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:06.931298 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.931846 21833 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:06.934617 21914 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:06.941588 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.942394 21837 raft_consensus.cc:2368] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6.
I20260709 13:09:06.908440 25041 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:06.936509 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.945256 21833 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 10: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:06.937170 21836 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:09:06.941073 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:06.952567 21838 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:06.953626 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.957414 21838 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:06.905130 21729 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:06.944490 21840 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:06.963310 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.963616 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.967345 21877 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:06.968268 21837 raft_consensus.cc:2410] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:09:06.973070 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.974188 21909 raft_consensus.cc:1240] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 10. Current term is 12. Ops: []
I20260709 13:09:06.975947 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.970266 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:06.984192 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 79148.2us
I20260709 13:09:06.985173 21729 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:06.986271 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.986889 21838 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:06.988297 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:06.989912 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.990438 21836 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:06.991783 21837 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:06.991878 21729 leader_election.cc:400] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 10. Current term is 11.
I20260709 13:09:06.993772 21835 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:06.993958 21729 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:06.995174 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.997995 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:06.987905 25084 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:07.000505 21908 raft_consensus.cc:1240] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:06.998082 21835 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:07.016568 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:06.999210 25084 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.012012 21877 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:09:06.995247 25355 log.cc:927] Time spent T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:09:06.999689 25309 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:07.021764 25084 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:07.029379 25309 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:06.989255 24937 consensus_queue.cc:1059] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:09:07.029886 25309 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:07.029930 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:07.030285 24937 raft_consensus.cc:3055] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:07.030661 24937 raft_consensus.cc:740] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:07.030818 21831 raft_consensus.cc:2393] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 11: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:07.031457 24937 consensus_queue.cc:260] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:07.027868 25156 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:07.032730 24937 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:07.033207 25156 raft_consensus.cc:697] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 8 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:07.034232 25156 consensus_queue.cc:237] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:07.034677 25314 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:07.040125 25084 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:07.041601 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.044020 21905 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:07.020921 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:07.046245 21914 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:09:07.047873 21728 leader_election.cc:336] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.763s (SENT)
I20260709 13:09:07.054152 21729 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:07.055316 21836 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:07.055845 21729 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
W20260709 13:09:07.058320 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 46394.4us
I20260709 13:09:06.996635 25351 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:07.059309 21877 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:07.078591 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:07.079250 21835 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:09:07.080570 25156 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:07.081321 25156 raft_consensus.cc:697] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 8 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:07.082495 25156 consensus_queue.cc:237] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:07.083464 21840 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:09:07.086457 21910 raft_consensus.cc:1240] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:06.982885 25061 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:09:07.011745 25317 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.089634 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:07.092125 21836 raft_consensus.cc:2410] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:09:06.999596 25193 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:09:07.093405 22482 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:07.094671 21838 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
W20260709 13:09:07.095389 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 47572.2us
I20260709 13:09:07.092607 21877 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:07.096787 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:07.097131 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:07.097813 21838 raft_consensus.cc:2368] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12.
I20260709 13:09:07.098201 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:07.098793 21833 raft_consensus.cc:3055] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:07.099104 21833 raft_consensus.cc:740] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:07.068542 25163 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:07.101377 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:07.076594 25326 raft_consensus.cc:2804] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:07.076457 25140 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:07.099602 21877 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:07.105085 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:07.105501 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:07.105868 21838 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:07.106222 21836 raft_consensus.cc:2393] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 9: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:07.109886 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:07.107322 21833 consensus_queue.cc:260] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:07.091188 25148 consensus_queue.cc:1059] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:09:07.110731 21835 raft_consensus.cc:2393] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 9: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:07.098171 25317 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:07.198555 25195 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:07.200712 25195 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:07.200748 25317 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:07.201490 25317 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:07.169744 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:07.206873 21833 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:07.209851 21836 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
W20260709 13:09:07.207983 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 121018us
I20260709 13:09:07.226505 21879 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:07.170194 21840 raft_consensus.cc:1240] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:09:07.102970 25163 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:07.241228 25163 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:07.241698 21728 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:07.107234 25053 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:07.108367 25140 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:07.243753 25140 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:07.094790 24984 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.150s
I20260709 13:09:07.120203 21831 raft_consensus.cc:1240] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:07.246040 21838 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
W20260709 13:09:07.251188 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.253674 21838 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:09:07.255010 21838 raft_consensus.cc:1240] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:09:07.262933 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:07.264509 21763 raft_consensus.cc:1240] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 8 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:07.266028 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:07.266666 21763 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
W20260709 13:09:07.267189 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.271926 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:07.272636 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 173109us
I20260709 13:09:07.273383 21877 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:07.257934 25298 raft_consensus.cc:3055] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:07.269268 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:07.294565 21760 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:07.275763 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:07.304111 21836 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:07.170993 25327 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.143s
I20260709 13:09:07.305804 21756 raft_consensus.cc:1240] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:07.246515 25314 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.273182 21833 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:09:07.311110 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:07.315433 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:07.319536 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 215754us
I20260709 13:09:07.201378 25195 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:09:07.344322 21833 raft_consensus.cc:1240] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:07.344689 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:07.258934 25084 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:07.349255 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:07.352859 21840 raft_consensus.cc:1275] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:07.357975 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:07.383080 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 306199us
I20260709 13:09:07.264760 25283 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:07.394619 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.378927 21764 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
W20260709 13:09:07.359937 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.161960 25326 raft_consensus.cc:697] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:07.373093 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:07.397727 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:07.397693 25326 consensus_queue.cc:237] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:07.373510 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:07.399192 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:07.399601 21836 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:07.400673 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:07.374126 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:07.307227 25215 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:07.294329 25298 raft_consensus.cc:740] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
W20260709 13:09:07.377677 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 467539us
I20260709 13:09:07.409565 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:09:07.380054 25360 log.cc:927] Time spent T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:09:07.377110 25084 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:07.410360 21756 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:07.411051 21759 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:07.358898 21833 raft_consensus.cc:1240] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:07.428586 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:07.429524 21765 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 10: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:07.358424 25314 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:07.411499 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.435055 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.475289 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 44913.2us
I20260709 13:09:07.425240 25241 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:07.487020 21759 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:07.503250 21836 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
W20260709 13:09:07.505404 25365 log.cc:927] Time spent T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:09:07.509696 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:07.510146 25066 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:07.511406 25374 ts_tablet_manager.cc:933] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:07.512744 25361 log.cc:927] Time spent T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
W20260709 13:09:07.513983 25356 log.cc:927] Time spent T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:09:07.472102 25204 consensus_queue.cc:1059] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 13:09:07.516479 25041 consensus_meta.cc:287] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.001s
W20260709 13:09:07.517127 25370 log.cc:927] Time spent T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:09:07.518389 25359 log.cc:927] Time spent T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 13:09:07.473497 25084 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:07.523087 25084 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:07.502218 25241 raft_consensus.cc:697] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 9 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:07.524561 25241 consensus_queue.cc:237] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:07.502477 25309 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:07.526708 21757 raft_consensus.cc:2393] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:07.527009 25283 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:07.531164 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:07.525231 25314 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:07.533989 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.535967 21839 consensus_meta.cc:287] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.001s
I20260709 13:09:07.537384 21839 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:07.543467 21760 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:07.544661 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:07.547369 21756 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:07.515275 25204 raft_consensus.cc:3055] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:07.580451 25163 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:07.583174 25163 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:07.557096 21756 raft_consensus.cc:1275] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:07.585355 21763 raft_consensus.cc:2393] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:07.563750 21760 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:07.592187 21760 raft_consensus.cc:1275] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:09:07.596020 21728 leader_election.cc:336] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.565s (SENT)
W20260709 13:09:07.597815 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.598206 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.598464 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:07.590848 25320 consensus_meta.cc:287] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.665s	user 0.006s	sys 0.004s
W20260709 13:09:07.603268 21728 leader_election.cc:336] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.600s (SENT)
I20260709 13:09:07.604333 21728 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:07.572824 25204 raft_consensus.cc:740] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:07.599195 21804 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:09:07.619726 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.584980 25140 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:07.699903 24937 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:07.718036 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 114809us
I20260709 13:09:07.719893 21728 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:07.704988 25313 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:07.724303 21728 leader_election.cc:400] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6.
I20260709 13:09:07.727762 21728 leader_election.cc:403] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:09:07.729260 21728 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:07.732045 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 132942us
I20260709 13:09:07.734340 21804 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:09:07.737874 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 511434us
I20260709 13:09:07.730382 25299 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:07.723112 25373 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:07.724598 25226 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 13:09:07.814149 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 68406.3us
W20260709 13:09:07.812892 21877 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.009s	sys 0.026s
I20260709 13:09:07.743655 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:07.824982 21912 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:09:07.744223 21905 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:07.733533 25317 raft_consensus.cc:697] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:09:07.820602 21877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.009s	sys 0.027s
I20260709 13:09:07.821115 21879 leader_election.cc:400] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7.
W20260709 13:09:07.818825 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 341798us
W20260709 13:09:07.855208 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.736191 25314 consensus_queue.cc:1059] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.101s
W20260709 13:09:07.947067 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:07.723398 25204 consensus_queue.cc:260] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:07.940330 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 211167us
I20260709 13:09:07.742713 24937 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:07.852218 22448 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:07.959014 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:07.732028 25053 raft_consensus.cc:697] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:07.949273 21879 leader_election.cc:403] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:07.949358 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:07.813895 25313 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:09:07.990654 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 138511us
W20260709 13:09:07.993613 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 173360us
W20260709 13:09:07.995523 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 261242us
I20260709 13:09:07.996479 21879 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:07.996621 21804 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:08.000013 21908 raft_consensus.cc:1240] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:09:08.003384 21879 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:08.004762 21907 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:08.013355 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:09:07.972715 25351 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.007s	sys 0.045s
I20260709 13:09:08.014178 21905 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:07.773051 25299 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.032755 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:08.017280 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:08.034564 21837 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:08.018146 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 69239.7us
I20260709 13:09:08.022045 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:07.851817 25381 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:08.035909 21907 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:07.956863 25311 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:09:08.057700 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 56132.9us
W20260709 13:09:08.058024 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 54738.2us
I20260709 13:09:08.059973 21728 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:08.062302 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:08.072055 21877 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:07.945086 25374 tablet_copy_client.cc:323] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
W20260709 13:09:08.030224 25351 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.007s	sys 0.046s
I20260709 13:09:07.941851 25152 consensus_queue.cc:1059] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:09:08.028507 25204 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:08.101075 21905 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:08.045214 25283 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:08.097635 21730 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.009s	sys 0.004s
W20260709 13:09:08.113371 21730 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.979s	user 0.010s	sys 0.004s
W20260709 13:09:08.113956 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.064244 25368 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:08.014816 25313 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.063977 25163 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 5. Current term is 6.
W20260709 13:09:08.130357 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 94465.5us
I20260709 13:09:08.098531 25083 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.099321 25250 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:08.100358 25327 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:08.056461 25331 consensus_queue.cc:1048] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:09:08.106003 25373 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:08.146175 21728 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:08.150290 21837 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:08.098762 25332 consensus_queue.cc:1059] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:09:08.126119 25326 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.131304 25314 consensus_queue.cc:1243] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer 6d698a5544b946939790e7a3972db9fb log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:09:08.166556 25380 log.cc:927] Time spent T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.422s	user 0.000s	sys 0.001s
W20260709 13:09:08.168439 25378 log.cc:927] Time spent T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 13:09:08.169658 25193 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:08.170365 25330 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:08.170926 25283 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:08.172986 25332 raft_consensus.cc:3055] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:08.091909 25311 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.160113 25367 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.337201 25332 raft_consensus.cc:740] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:08.302042 25314 raft_consensus.cc:3055] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:08.112246 25317 consensus_queue.cc:237] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:08.399686 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.409785 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.417354 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 271292us
I20260709 13:09:08.352823 25193 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:08.435948 25193 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:08.436800 25332 consensus_queue.cc:260] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:08.437690 25413 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:08.438154 25332 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:08.295138 25226 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:08.157737 25152 consensus_queue.cc:1048] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.183s
I20260709 13:09:08.345975 21757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 1370) took 1083 ms. Trace:
I20260709 13:09:08.489006 21757 rpcz_store.cc:276] 0709 13:09:07.262542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.262656 (+   114us) service_pool.cc:224] Handling call
0709 13:09:08.345701 (+1083045us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54003ef8d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:08.345898 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604438912}
I20260709 13:09:08.149103 25368 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:08.500950 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 464062us
I20260709 13:09:08.151188 25053 consensus_queue.cc:237] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:08.366451 25314 raft_consensus.cc:740] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:08.158182 25083 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.515148 22448 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:08.285794 25326 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.426023 25330 raft_consensus.cc:697] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:08.542881 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1907) took 1339 ms. Trace:
I20260709 13:09:08.543370 21831 rpcz_store.cc:276] 0709 13:09:07.203814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.260320 (+ 56506us) service_pool.cc:224] Handling call
0709 13:09:07.260647 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.266593 (+  5946us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.266627 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:07.298628 (+ 32001us) log.cc:844] Serialized 26 byte log entry
0709 13:09:07.537407 (+238779us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:07.537667 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.537747 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:08.539055 (+1001308us) raft_consensus.cc:1685] finished
0709 13:09:08.539078 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.542804 (+  3726us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45279,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":21432,"thread_start_us":161864,"threads_started":1,"wal-append.queue_time_us":370817}
I20260709 13:09:08.374781 25367 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:08.550304 21804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.011s	sys 0.049s
W20260709 13:09:08.561280 21804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.012s	sys 0.049s
W20260709 13:09:08.559563 21803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.002s	sys 0.041s
I20260709 13:09:08.531687 25391 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:09:08.567389 21803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.003s	sys 0.042s
W20260709 13:09:08.575393 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.575870 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.576579 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.572413 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 575890us
I20260709 13:09:08.438236 25413 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.550599 25384 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:08.603224 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1902) took 1419 ms. Trace:
W20260709 13:09:08.604513 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 95611.1us
I20260709 13:09:08.603672 21804 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:08.603667 21832 rpcz_store.cc:276] 0709 13:09:07.184063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.184333 (+   270us) service_pool.cc:224] Handling call
0709 13:09:07.184751 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.210368 (+ 25617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.210396 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:07.238535 (+ 28139us) log.cc:844] Serialized 26 byte log entry
0709 13:09:07.605653 (+367118us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:07.701874 (+ 96221us) log.cc:844] Serialized 14 byte log entry
0709 13:09:07.703045 (+  1171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.703142 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:08.586969 (+883827us) raft_consensus.cc:1685] finished
0709 13:09:08.586988 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.603167 (+ 16179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":775,"prepare.queue_time_us":96058,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":25933,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":21299,"thread_start_us":266437,"threads_started":1,"wal-append.queue_time_us":452695}
I20260709 13:09:08.605563 21728 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:08.607506 21728 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:08.609529 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 107243us
W20260709 13:09:08.611653 21912 consensus_meta.cc:287] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.759s	user 0.011s	sys 0.000s
I20260709 13:09:08.602684 25391 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.612344 21912 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
W20260709 13:09:08.613893 25405 log.cc:927] Time spent T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
W20260709 13:09:08.615310 25406 log.cc:927] Time spent T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:09:08.616088 21835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1903) took 1413 ms. Trace:
I20260709 13:09:08.616474 21758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 485) took 1357 ms. Trace:
I20260709 13:09:08.616951 21758 rpcz_store.cc:276] 0709 13:09:07.258905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.259896 (+   991us) service_pool.cc:224] Handling call
0709 13:09:07.260182 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.607301 (+347119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.607346 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:07.621765 (+ 14419us) log.cc:844] Serialized 26 byte log entry
0709 13:09:08.057948 (+436183us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:08.057992 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.058069 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:08.616283 (+558214us) raft_consensus.cc:1685] finished
0709 13:09:08.616300 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.616421 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6547,"raft.queue_time_us":141392,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":7907,"thread_start_us":685059,"threads_started":2,"wal-append.queue_time_us":454436}
I20260709 13:09:08.619606 25412 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:08.612960 25401 log.cc:927] Time spent T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:09:08.623631 21838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1906) took 1420 ms. Trace:
I20260709 13:09:08.624068 21838 rpcz_store.cc:276] 0709 13:09:07.203490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.255655 (+ 52165us) service_pool.cc:224] Handling call
0709 13:09:07.255904 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.297371 (+ 41467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.297415 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:07.318661 (+ 21246us) log.cc:844] Serialized 26 byte log entry
0709 13:09:07.741589 (+422928us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:07.836198 (+ 94609us) log.cc:844] Serialized 14 byte log entry
0709 13:09:07.836427 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.836517 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:08.623382 (+786865us) raft_consensus.cc:1685] finished
0709 13:09:08.623409 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.623564 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6559,"prepare.queue_time_us":94397,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":51,"raft.queue_time_us":54803,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":18660,"thread_start_us":355954,"threads_started":1,"wal-append.queue_time_us":737002}
I20260709 13:09:08.625694 25371 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7.
W20260709 13:09:08.626585 25408 log.cc:927] Time spent T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:09:08.616547 21835 rpcz_store.cc:276] 0709 13:09:07.202414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.211547 (+  9133us) service_pool.cc:224] Handling call
0709 13:09:07.255601 (+ 44054us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.256014 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:07.607025 (+351011us) log.cc:844] Serialized 14 byte log entry
0709 13:09:08.315854 (+708829us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:08.366221 (+ 50367us) log.cc:844] Serialized 26 byte log entry
0709 13:09:08.366372 (+   151us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:08.366605 (+   233us) log.cc:844] Serialized 14 byte log entry
0709 13:09:08.420776 (+ 54171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:08.420884 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:08.615837 (+194953us) raft_consensus.cc:1685] finished
0709 13:09:08.615863 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.616018 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12153,"prepare.queue_time_us":240865,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":83,"raft.queue_time_us":2528,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":2222,"thread_start_us":875267,"threads_started":3,"wal-append.queue_time_us":668130}
W20260709 13:09:08.637096 21839 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.017s	sys 0.061s
W20260709 13:09:08.637645 21839 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.017s	sys 0.061s
I20260709 13:09:08.416865 25283 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.647709 21728 leader_election.cc:400] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12.
I20260709 13:09:08.659042 21879 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:08.611131 25313 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:08.628594 25226 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:08.663352 21728 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:08.677634 21905 raft_consensus.cc:1240] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:08.677760 21728 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:08.657637 25407 log.cc:927] Time spent T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.361s	user 0.001s	sys 0.000s
I20260709 13:09:08.681514 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:08.683398 21758 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:08.687911 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:08.691061 21757 raft_consensus.cc:1240] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:08.692003 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:08.686865 24984 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:09:08.679474 25394 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:08.696606 25394 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.658567 25412 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:08.697887 25412 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:08.699463 25394 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:08.687469 25226 raft_consensus.cc:697] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 8 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:08.706781 25320 consensus_queue.cc:1048] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:08.706669 25226 consensus_queue.cc:237] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:08.709076 25367 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:08.709868 25311 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:08.710237 21877 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:08.710587 25311 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:08.711737 25311 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:08.712311 25393 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:08.713017 25393 raft_consensus.cc:697] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 9 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:08.713383 25415 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:08.714118 25415 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:08.714064 25393 consensus_queue.cc:237] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.716367 25330 consensus_queue.cc:237] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:08.669981 25241 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:08.689924 24937 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:09:08.725212 25417 log.cc:927] Time spent T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:09:08.725590 25399 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:08.726621 25392 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.727293 25392 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:08.729619 25377 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:09:08.732266 25396 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:09:08.736629 25283 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:08.741108 25373 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:08.645632 25409 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 13:09:08.662521 25397 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:08.747925 25397 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.750646 25397 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:08.752310 25413 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:08.754617 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 76942.3us
I20260709 13:09:08.691159 25152 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.758030 25152 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.760797 25152 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:08.762318 21840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2810) took 1470 ms. Trace:
I20260709 13:09:08.762823 21840 rpcz_store.cc:276] 0709 13:09:07.291480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.408516 (+117036us) service_pool.cc:224] Handling call
0709 13:09:07.427094 (+ 18578us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.430977 (+  3883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.431010 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:07.431496 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:09:07.853955 (+422459us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:07.854013 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.854107 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:08.762035 (+907928us) raft_consensus.cc:1685] finished
0709 13:09:08.762060 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:08.762244 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38796,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":6011,"thread_start_us":360511,"threads_started":1,"wal-append.queue_time_us":1040157}
W20260709 13:09:08.786396 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 182785us
I20260709 13:09:08.790387 21804 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:08.788445 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:08.772869 24937 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:08.773046 25399 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:08.774842 25346 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:08.775156 25367 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.812310 21833 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:08.712357 25311 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.800870 25413 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:08.775617 25397 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:08.849840 25413 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:08.846521 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 56241.7us
I20260709 13:09:08.850536 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:08.851390 21835 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:09:08.851579 21804 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:08.852035 25413 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:08.852541 25413 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:08.849911 25397 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.816576 25419 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:08.854074 25419 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.854600 25397 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:08.852762 21804 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:08.855350 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:08.855918 25413 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:08.855997 21838 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:08.858831 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:08.814920 25313 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:08.859692 21837 raft_consensus.cc:2393] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 10: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:09:08.832023 25351 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.003s	sys 0.015s
I20260709 13:09:08.861013 21804 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:08.814167 25420 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.873769 25420 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.812040 24937 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.876283 25420 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:08.813690 25399 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.876672 24937 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:08.878521 25399 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:08.880541 25283 raft_consensus.cc:2955] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:09:08.882797 25311 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:08.866415 21804 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:08.870157 25392 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:08.864537 25204 consensus_meta.cc:287] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.742s	user 0.013s	sys 0.000s
W20260709 13:09:08.865237 25351 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.003s	sys 0.016s
I20260709 13:09:08.888602 21805 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:08.816967 25367 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.862164 25152 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:08.897063 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 158464us
I20260709 13:09:08.896217 21805 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:08.888319 25413 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:08.909555 21911 raft_consensus.cc:1240] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:09:08.815042 25346 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:08.858433 25375 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:09:08.877314 24937 consensus_queue.cc:1059] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:09:08.913661 25429 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:08.913923 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 47611.9us
I20260709 13:09:08.914319 25429 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:08.914767 21804 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:08.914973 25429 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:08.916524 21805 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:08.916934 25412 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:08.917303 25311 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:08.919126 25420 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:08.937834 25311 raft_consensus.cc:697] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:08.912443 25313 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:08.910264 25152 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.939067 25311 consensus_queue.cc:237] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:08.940809 25152 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:08.898545 25426 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:08.941965 25426 raft_consensus.cc:697] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:08.942987 25426 consensus_queue.cc:237] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:08.932829 25430 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.951073 25373 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:08.951093 25430 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:08.956573 25430 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:08.960876 25346 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:08.935251 25367 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:08.990840 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:08.995428 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 76574.7us
I20260709 13:09:08.998008 21804 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:08.999879 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 210756us
I20260709 13:09:09.004936 25313 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:09:09.006338 21765 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59102 (request call id 2704) took 1735 ms (client timeout 1839 ms). Trace:
W20260709 13:09:09.006778 21765 rpcz_store.cc:269] 0709 13:09:07.271361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.373834 (+102473us) service_pool.cc:224] Handling call
0709 13:09:09.006161 (+1632327us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b54000ddc54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:09.006281 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46379904}
I20260709 13:09:09.007354 25313 raft_consensus.cc:697] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:09.008419 25313 consensus_queue.cc:237] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:09.013936 25368 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:09.015869 25083 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:09.020318 25332 consensus_meta.cc:287] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.582s	user 0.012s	sys 0.000s
I20260709 13:09:09.018355 25429 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:09.018754 21906 raft_consensus.cc:1240] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:09.035933 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1644) took 1287 ms. Trace:
I20260709 13:09:09.027266 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:09.027137 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:09.027649 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:09.028766 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:09.040019 21765 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:09:09.032723 21804 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:09.029400 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:09.023849 21879 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:09.046425 21804 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:09.036419 21906 rpcz_store.cc:276] 0709 13:09:07.748044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.809781 (+ 61737us) service_pool.cc:224] Handling call
0709 13:09:07.812816 (+  3035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.018540 (+1205724us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x7b54002a38a0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae2cedc0 00007fc6ae3591c0 00007fc6ae35a231 00007fc6ae356d8f 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c
0709 13:09:09.035578 (+ 17038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.035859 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15004928}
I20260709 13:09:09.051254 25313 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:09.051868 25313 raft_consensus.cc:697] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:09.055109 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:09.056092 21906 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:09.058409 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:09.059083 21756 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
W20260709 13:09:09.059312 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 139249us
I20260709 13:09:09.058068 21805 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:09.061128 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:09.061622 21728 leader_election.cc:336] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.816s (SENT)
I20260709 13:09:09.062259 21728 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:09.061239 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:09.061868 21906 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:09:09.064921 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:09.056219 25412 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:09.067718 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:09.067584 21805 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:09.071414 21909 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:09.098177 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:09.071540 25428 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.099498 25428 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:09.072212 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:09.072501 21907 raft_consensus.cc:1275] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:09.072818 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:09.100869 21914 raft_consensus.cc:2393] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 11: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:09.100939 21908 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:09.073127 25437 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.073662 21912 raft_consensus.cc:1240] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:09.105475 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:09.074800 21905 raft_consensus.cc:1240] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:09.070683 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.065784 25371 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:09.076349 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:09.078048 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.079458 21729 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:09.085939 25429 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:09.088901 25404 log.cc:927] Time spent T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.930s	user 0.003s	sys 0.009s
I20260709 13:09:09.064781 25368 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:09.058692 25332 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:09.094003 25412 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:09.112803 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 45930.3us
I20260709 13:09:09.070505 21728 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:09.113790 21833 raft_consensus.cc:1240] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:09.101680 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:09.114991 21907 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:09:09.103510 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:09.068483 25311 raft_consensus.cc:2804] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:09.111107 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:09.116888 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:09.068778 25420 raft_consensus.cc:697] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:09.121174 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:09.122689 21839 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
W20260709 13:09:09.123152 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 52751.3us
I20260709 13:09:09.112713 24937 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.125000 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:09.117813 25426 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.115262 25371 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:09.126452 25430 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.118160 25163 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:09.128616 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:09.114996 25412 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:09.132889 21833 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:09:09.117954 25311 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:09.135980 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:09.129973 25215 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:09.141054 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:09.142025 21909 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:09:09.143405 21833 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:09:09.126392 25283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:45192 (request call id 23) took 3028 ms. Trace:
I20260709 13:09:09.142714 25215 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:09.124084 25373 consensus_queue.cc:1059] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:09:09.111424 25437 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:09.131953 24937 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:09.135532 25156 consensus_queue.cc:1059] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:09:09.150254 25346 consensus_queue.cc:1059] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:09:09.146291 25441 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:09.139652 25368 consensus_queue.cc:1059] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:09:09.128791 25426 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:09.148306 25163 raft_consensus.cc:697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:09.126579 25399 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:09:09.135090 25313 consensus_queue.cc:237] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:09.151749 25215 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:09.147094 25298 consensus_queue.cc:260] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:09.138839 25311 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:09.126530 25367 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:09:09.162521 21839 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:09:09.182747 21839 pending_rounds.cc:85] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 3
I20260709 13:09:09.183041 21839 pending_rounds.cc:107] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:09:09.183359 21839 raft_consensus.cc:2889] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:09.158655 24937 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:09.165362 25298 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:09.181054 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:09:09.192816 25364 log.cc:927] Time spent T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 1.780s	user 0.000s	sys 0.012s
I20260709 13:09:09.149727 25283 rpcz_store.cc:276] 0709 13:09:06.091778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.109640 (+ 17862us) service_pool.cc:224] Handling call
0709 13:09:06.250116 (+140476us) log.cc:844] Serialized 492 byte log entry
0709 13:09:06.762915 (+512799us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b180017e120. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab26a3f3 00007fc6ab26c7c1 00007fc6ab26c779 00007fc6ab26c709 00007fc6ab26c6d1 00007fc6ab26b9cd 000000000038f354 000000000038f199 00007fc6ab24d83a
0709 13:09:06.885408 (+122493us) spinlock_profiling.cc:243] Waited 892 us on lock 0x7b54002a79a0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae2d7b26 00007fc6ae2d149a 00007fc6ae2d0714 00007fc6ae2b0eaa 00007fc6ae2b7d53 00007fc6ae2b7cd9 00007fc6ae2b7c69 00007fc6ae2b7c31 00007fc6ae2b6dfd 000000000038f354
0709 13:09:06.901237 (+ 15829us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b54002a79a0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae2d0142 00007fc6ae2b0eaa 00007fc6ae2b7d53 00007fc6ae2b7cd9 00007fc6ae2b7c69 00007fc6ae2b7c31 00007fc6ae2b6dfd 000000000038f354 000000000038f199 00007fc6ab26a475
0709 13:09:09.115519 (+2214282us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69392,"raft.queue_time_us":110471,"raft.run_cpu_time_us":8213,"raft.run_wall_time_us":631864,"spinlock_wait_cycles":16802688,"thread_start_us":256710,"threads_started":2,"wal-append.queue_time_us":106239,"wal-append.run_cpu_time_us":2841,"wal-append.run_wall_time_us":1073250}
I20260709 13:09:09.194072 25346 consensus_queue.cc:1243] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer 6d698a5544b946939790e7a3972db9fb log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:09:09.197960 25410 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:09.201551 25420 consensus_queue.cc:237] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:09.203962 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:09.204519 25390 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:09.154700 25373 consensus_queue.cc:1243] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer 6d698a5544b946939790e7a3972db9fb log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:09:09.161137 25426 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:09.205768 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:09.158878 25441 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.156736 25437 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:09.207278 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:09.260007 22477 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:09.204555 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:09.181242 21908 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:09.239944 21833 raft_consensus.cc:2376] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7. Re-sending same reply.
I20260709 13:09:09.135922 25430 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:09.162961 25399 raft_consensus.cc:3055] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:09:09.254722 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 129979us
I20260709 13:09:09.163833 25371 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:09.248889 24937 raft_consensus.cc:3055] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:09.160941 25428 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:09.247756 25367 raft_consensus.cc:3055] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:09.154377 25446 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:09.272436 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:09.276947 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:09.259502 25441 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:09.160952 25163 consensus_queue.cc:237] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:09.289978 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:09.266525 25399 raft_consensus.cc:740] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:09.252825 25410 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:09.269832 25437 consensus_queue.cc:1059] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:09:09.272605 25367 raft_consensus.cc:740] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:09.271071 24937 raft_consensus.cc:740] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:09.295158 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2792) took 2364 ms. Trace:
I20260709 13:09:09.271984 25373 consensus_queue.cc:1059] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:09:09.259883 25390 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:09.295640 21834 rpcz_store.cc:276] 0709 13:09:06.928460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.937501 (+  9041us) service_pool.cc:224] Handling call
0709 13:09:06.937777 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:06.938147 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:06.938180 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:06.938639 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:09:07.111879 (+173240us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:07.111934 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.112002 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:09.192053 (+2080051us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:09:09.284988 (+ 92935us) raft_consensus.cc:1685] finished
0709 13:09:09.285010 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.292698 (+  7688us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":6459136,"thread_start_us":172877,"threads_started":1,"wal-append.queue_time_us":406560}
I20260709 13:09:09.304147 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:09.306815 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:09.307771 21833 raft_consensus.cc:2410] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:09:09.308171 22485 raft_consensus.cc:1275] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:09.308621 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:09.309031 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:09.309830 25369 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.310380 25369 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:09.312549 25369 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:09.303938 25412 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:09.317312 25412 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:09.318434 25430 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:09.319357 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:09.321751 21832 raft_consensus.cc:2393] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 11: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:09.323035 25390 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:09.321743 25369 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:09:09.320981 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:09.324594 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:09.334007 22448 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:09.336383 21804 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:09.339430 21832 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:09.282240 25446 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:09.342664 25152 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.344122 25410 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:09.358255 21804 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:09.342195 22448 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:09.360646 21804 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:09:09.364622 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 85792.5us
I20260709 13:09:09.361456 25412 raft_consensus.cc:2804] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:09.371476 22477 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
W20260709 13:09:09.373726 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 245329us
I20260709 13:09:09.392457 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:09.394230 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:09.365571 25410 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:09.414053 25215 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:09.416508 25215 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:09.373353 25430 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:09.372965 25412 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.334453 25399 consensus_queue.cc:260] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:09.418295 25459 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:09.362186 24937 consensus_queue.cc:260] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:09.419759 25430 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:09.338601 25367 consensus_queue.cc:260] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:09.427832 24937 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:09.424405 25412 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:09.362964 25152 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:09.428375 25430 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:09.396726 25311 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:09.429236 25413 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:09.464438 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:09.465850 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:09.466467 21757 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:09.468137 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:09.469251 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:09.470016 21759 raft_consensus.cc:2393] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
W20260709 13:09:09.471235 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 110681us
I20260709 13:09:09.473111 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:09.430743 25140 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:09.482156 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:09.483310 21764 raft_consensus.cc:2410] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:09:09.483954 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:09.484558 21756 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:09:09.506366 21833 raft_consensus.cc:1240] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:09.451315 25450 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:09.431749 25459 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:09.545441 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.623376 21914 raft_consensus.cc:1240] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:09.731245 22448 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:09.660356 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:09.732628 22480 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:09.659260 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:09.463001 25367 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:09.616888 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:09.734231 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:09.688928 21806 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:09.660753 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:09.738363 22483 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:09:09.659701 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:09.740309 22482 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
W20260709 13:09:09.635306 21711 auto_rebalancer.cc:629] Failed to schedule move for tablet c2c5cb2b121749798f01933921c01ed6: Illegal state: Replica 6d698a5544b946939790e7a3972db9fb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:09.746942 21758 raft_consensus.cc:2410] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:09:09.749127 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:09.641919 25454 log.cc:927] Time spent T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
W20260709 13:09:09.649725 25411 log.cc:927] Time spent T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 1.071s	user 0.005s	sys 0.007s
W20260709 13:09:09.627662 25453 log.cc:927] Time spent T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 13:09:09.474915 25351 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:09.759563 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:09.506259 25390 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:09.760728 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:09.761596 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 72755.7us
I20260709 13:09:09.643929 25156 raft_consensus.cc:3055] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:09.768221 21728 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:09.627727 25299 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:09.681123 25463 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.532502 25371 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:09.636451 25415 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:09.772110 21757 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:09.754977 25343 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:09.780499 21728 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:09.771704 25311 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:09.789760 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:09.790091 21728 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:09.788892 21757 raft_consensus.cc:1275] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:09.791194 21728 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:09.775887 25156 raft_consensus.cc:740] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:09.745050 25450 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:09.647500 25314 consensus_queue.cc:260] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:09.784575 25346 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:09.805003 21911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1638) took 2062 ms. Trace:
I20260709 13:09:09.810314 21911 rpcz_store.cc:276] 0709 13:09:07.742960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.743083 (+   123us) service_pool.cc:224] Handling call
0709 13:09:07.817939 (+ 74856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:08.911710 (+1093771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.804674 (+892964us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400033754. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:09.804929 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2506130176}
I20260709 13:09:09.806519 21764 raft_consensus.cc:1240] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: [7.4-10.6]
I20260709 13:09:09.787459 25381 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:09.777513 25455 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:09:09.775796 25351 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:09.802904 25226 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:09.829244 25446 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:09.829728 25226 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:09.830188 25226 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:09.801530 25465 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:09.832726 25430 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:09.813144 25309 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:09.828501 25459 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:09.795135 25456 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:09.855626 25351 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:09.833009 25465 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:09.857970 21836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2818) took 1049 ms. Trace:
I20260709 13:09:09.858470 21836 rpcz_store.cc:276] 0709 13:09:08.808721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.809052 (+   331us) service_pool.cc:224] Handling call
0709 13:09:08.815348 (+  6296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:08.853391 (+ 38043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:08.853420 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:08.853482 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:08.853512 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:09.857738 (+1004226us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b54002e6154. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:09.857802 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:09.857918 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87038848}
I20260709 13:09:09.859284 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:09.859854 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:09.860029 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:09.860476 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:09.860951 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:09.809973 25346 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:09.861610 25346 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:09.861847 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:09.862218 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:09.863206 25455 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:09.863716 25455 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:09.866016 21923 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet d76fbf464db84dbeb90facb1538a9ca1 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:09:09.866578 21923 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet d76fbf464db84dbeb90facb1538a9ca1 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-d76fbf464db84dbeb90facb1538a9ca1
I20260709 13:09:09.839938 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:09.842372 25458 log.cc:927] Time spent T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:09:09.825943 25156 consensus_queue.cc:260] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:09.848788 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:09.786006 25371 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:09.851470 21806 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:09.861522 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:09.835050 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:09.881947 25156 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:09.882154 25367 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.785813 25463 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:09.792789 25441 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:09.814522 25437 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 13:09:09.869081 25412 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:10.145958 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:10.146190 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 294795us
I20260709 13:09:10.146898 21832 raft_consensus.cc:2393] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 11: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:09.975245 25450 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:10.147207 21806 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:09.977384 25215 raft_consensus.cc:3055] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:10.148176 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:10.166769 25413 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:10.179569 21729 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:09.912401 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:10.198374 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:10.150494 25367 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:10.148257 21832 raft_consensus.cc:2955] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:09:10.150355 25381 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:09:10.023185 25388 log.cc:927] Time spent T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 1.462s	user 0.004s	sys 0.000s
I20260709 13:09:09.944128 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:09.972312 25410 consensus_queue.cc:1059] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.223s
I20260709 13:09:10.150315 25391 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:10.153952 21834 raft_consensus.cc:2393] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 9: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:10.155818 25415 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.180683 25193 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:09.933751 25479 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.966213 21833 raft_consensus.cc:1240] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:10.065106 21913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 621) took 1404 ms. Trace:
I20260709 13:09:10.160612 25311 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.161545 21910 raft_consensus.cc:1275] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:10.161722 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:10.161963 25428 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.163482 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:10.163796 21805 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:10.165588 22477 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:09.895752 21836 raft_consensus.cc:2376] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8. Re-sending same reply.
W20260709 13:09:10.223328 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 59607.9us
W20260709 13:09:10.223686 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 44227.8us
I20260709 13:09:10.224298 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:10.167227 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:10.225226 21729 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:10.169325 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.226502 21728 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:10.169955 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:10.170029 21877 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:10.172240 21912 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:10.172241 21804 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:10.174391 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:10.172263 25394 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.177337 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:10.086829 25419 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:10.180627 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:10.181075 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.148507 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:10.232985 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 60831.4us
I20260709 13:09:09.980978 25371 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:10.181844 25368 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:10.149564 21806 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:10.204778 25366 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.196568 21879 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:10.199662 21759 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 10: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:10.195012 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:10.203822 25381 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:10.194398 25413 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:09.982050 25465 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:10.177008 25310 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:10.226194 25455 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:10.190687 25215 raft_consensus.cc:740] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:10.220760 21913 rpcz_store.cc:276] 0709 13:09:08.660240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:08.660352 (+   112us) service_pool.cc:224] Handling call
0709 13:09:08.678897 (+ 18545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:08.722270 (+ 43373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:08.722309 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:08.722370 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:08.722413 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.064799 (+1342386us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b5400416754. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:10.064855 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.065025 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99179264}
I20260709 13:09:10.200788 25480 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.234472 21729 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:10.236924 21838 raft_consensus.cc:1275] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:10.199837 25383 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:10.243222 25430 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:09.967183 21923 tablet_copy_source_session.cc:215] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:10.197264 25447 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:10.212201 25441 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:10.252079 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 55679.3us
I20260709 13:09:10.222373 25391 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.250670 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:10.288856 21759 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:10.290007 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:10.290632 21759 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.233665 25428 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:10.229913 24937 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:10.234683 25437 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:09:10.233965 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 64011.2us
I20260709 13:09:10.308322 21877 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:10.239784 25313 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:10.245666 25393 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:10.241835 25456 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:10.244535 25426 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:10.243539 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 94122.2us
I20260709 13:09:10.246292 25481 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:10.247447 25326 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:10.278582 25309 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:10.280217 25473 consensus_queue.cc:1059] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:10.281651 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:10.258298 25310 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:10.335371 22479 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:10.252954 25381 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.253600 25371 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:10.254571 25413 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:10.234011 25311 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:10.283859 21880 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:10.317196 25313 raft_consensus.cc:697] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:10.200980 25450 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:10.229055 25193 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:10.229118 25479 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:10.268181 25446 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:10.305913 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:10.381714 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 97658.4us
I20260709 13:09:10.382085 21760 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:10.243768 25394 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:10.253362 25368 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:10.271130 25383 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:10.253199 25366 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:10.319586 22481 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:10.320276 21836 raft_consensus.cc:1275] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:10.302987 25152 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:10.326786 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:10.327046 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:09:10.329154 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 149887us
I20260709 13:09:10.272959 25351 consensus_queue.cc:1059] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:09:10.307297 25463 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:10.331100 21759 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:09:10.246733 25464 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:10.230928 25415 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:10.414254 22478 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:10.298895 25140 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:09:10.305039 25396 consensus_queue.cc:1059] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:09:10.343982 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:10.314636 25369 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:10.302748 25375 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:09:10.397655 25367 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:10.305874 25391 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:10.382256 25450 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:10.425385 25391 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:10.319952 25419 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:09:10.425761 25477 log.cc:927] Time spent T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:09:10.426095 25419 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:10.427950 25490 raft_consensus.cc:3055] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:10.428295 25419 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:10.428352 25490 raft_consensus.cc:740] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:10.285645 21879 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:10.429386 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 143812us
I20260709 13:09:10.430171 21879 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:10.431232 21879 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:10.430928 25450 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:10.432842 25204 raft_consensus.cc:3055] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:10.353461 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:10.433267 25204 raft_consensus.cc:740] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:09:10.433732 25483 log.cc:927] Time spent T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:09:10.434262 25204 consensus_queue.cc:260] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:10.435556 25204 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:10.435657 25415 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:10.421366 25430 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:10.360610 25226 consensus_meta.cc:287] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.530s	user 0.004s	sys 0.006s
I20260709 13:09:10.376379 21914 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:09:10.301106 25447 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:10.379112 25332 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:10.379299 25482 log.cc:927] Time spent T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:09:10.379951 25313 consensus_queue.cc:237] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:10.380447 25193 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:10.332719 25481 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:10.376837 25437 raft_consensus.cc:697] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:10.267752 25480 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:10.310093 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 484) took 3047 ms. Trace:
W20260709 13:09:10.388273 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 76984.8us
I20260709 13:09:10.493566 21761 rpcz_store.cc:276] 0709 13:09:07.258606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.259642 (+  1036us) service_pool.cc:224] Handling call
0709 13:09:07.306762 (+ 47120us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:07.375089 (+ 68327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:07.375124 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:07.393218 (+ 18094us) log.cc:844] Serialized 26 byte log entry
0709 13:09:07.709067 (+315849us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:07.709111 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:07.709175 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.022371 (+2313196us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:09:10.286236 (+263865us) raft_consensus.cc:1685] finished
0709 13:09:10.286258 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.305524 (+ 19266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20182,"raft.queue_time_us":128507,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":59459840,"thread_start_us":244476,"threads_started":1,"wal-append.queue_time_us":998025}
I20260709 13:09:10.389199 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:10.495679 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:10.451586 25412 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:10.496119 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:10.409067 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 125297us
I20260709 13:09:10.398028 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:10.410808 22449 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:10.381646 25446 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:10.498333 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:10.414798 22450 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:10.499099 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 88373.3us
I20260709 13:09:10.499451 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:10.499843 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:10.416746 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:10.495126 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:10.351482 25426 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:10.413180 25351 consensus_queue.cc:1243] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer 6d698a5544b946939790e7a3972db9fb log is divergent from this leader: its last log entry 10.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:09:10.423790 25486 log.cc:927] Time spent T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:09:10.432327 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56424 (request call id 436) took 1121 ms. Trace:
I20260709 13:09:10.523300 21834 rpcz_store.cc:276] 0709 13:09:09.310774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.320675 (+  9901us) service_pool.cc:224] Handling call
0709 13:09:10.432101 (+1111426us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b540005fad4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:10.432240 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1906188160}
I20260709 13:09:10.456151 22478 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:10.487174 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:10.526803 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:10.527107 22476 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:10.528465 21912 raft_consensus.cc:1275] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:10.490571 21839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56424 (request call id 434) took 1180 ms. Trace:
I20260709 13:09:10.492245 22481 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:10.435670 25366 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:10.496294 21761 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:10.407958 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:10.533799 21840 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:10.536665 21834 raft_consensus.cc:1275] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:10.500016 22449 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:10.315131 25393 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:10.501030 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:10.451524 25391 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:10.501677 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:10.547458 21806 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:10.581646 21908 raft_consensus.cc:2393] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:10.502020 21760 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:09:10.503435 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:10.506016 21763 raft_consensus.cc:2410] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:10.506136 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:10.457273 25500 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:10.588135 25500 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:10.592234 25381 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:10.420931 25369 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:10.594115 25369 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:10.598412 25346 consensus_meta.cc:287] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.736s	user 0.010s	sys 0.000s
I20260709 13:09:10.598935 25346 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:10.599195 25215 consensus_queue.cc:260] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:10.506017 25488 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:10.533704 25410 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:10.508060 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:10.534121 25351 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:10.602051 25351 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:10.602635 21831 raft_consensus.cc:1240] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:10.509943 25479 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:10.604671 22476 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:10.606382 25464 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:10.606237 25369 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:10.607124 25464 raft_consensus.cc:697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:10.614207 21758 raft_consensus.cc:1240] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:10.514433 25314 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:10.514995 25310 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:10.437414 25430 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:10.518293 25311 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:10.518658 25375 raft_consensus.cc:3055] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:10.519168 25428 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:10.519661 25309 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:09:10.520282 25491 log.cc:927] Time spent T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:09:10.520817 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:10.503088 25446 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.486716 25226 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:10.460486 25084 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:10.730559 25084 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.730994 25084 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:10.733299 25428 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:10.734215 25428 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:10.452478 25140 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:10.529278 21839 rpcz_store.cc:276] 0709 13:09:09.310170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.365421 (+ 55251us) service_pool.cc:224] Handling call
0709 13:09:09.368625 (+  3204us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:09.473332 (+104707us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.473362 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:09.513559 (+ 40197us) log.cc:844] Serialized 26 byte log entry
0709 13:09:09.796210 (+282651us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:10.238010 (+441800us) log.cc:844] Serialized 14 byte log entry
0709 13:09:10.490194 (+252184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:10.490288 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:10.490353 (+    65us) raft_consensus.cc:1685] finished
0709 13:09:10.490370 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:10.490511 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7900,"prepare.queue_time_us":452122,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":54,"raft.queue_time_us":74097,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":10570,"spinlock_wait_cycles":48768,"thread_start_us":946671,"threads_started":4,"wal-append.queue_time_us":433540}
I20260709 13:09:10.737141 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:10.541733 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:10.583366 21760 pending_rounds.cc:85] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 7
I20260709 13:09:10.585915 21911 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:10.516896 25413 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:10.630754 21764 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:09:10.520901 25383 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:10.530642 25412 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.429325 25490 consensus_queue.cc:260] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:10.682863 21761 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:10.531234 25489 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.531411 25367 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.581336 25393 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:10.686228 25503 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:10.694552 21905 raft_consensus.cc:1275] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:09:10.608479 25464 consensus_queue.cc:237] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:10.696480 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:09:10.699241 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:10.686358 25487 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:10.666194 25368 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:10.527396 25426 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:10.712414 25309 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:10.729954 25226 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:10.737334 25499 log.cc:927] Time spent T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:09:10.547032 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:10.684793 25366 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.121460 21905 pending_rounds.cc:85] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 3
I20260709 13:09:11.116020 25415 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:11.122110 21759 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:11.122445 25489 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:11.063781 21831 raft_consensus.cc:1240] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:11.122727 25313 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:10.915730 25396 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:11.123487 25311 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.122547 25366 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:11.108963 21840 consensus_meta.cc:287] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.575s	user 0.035s	sys 0.026s
I20260709 13:09:11.152575 21840 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
W20260709 13:09:11.050945 22450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.009s	sys 0.029s
W20260709 13:09:11.124629 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.124212 25503 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:11.153035 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:11.041705 25430 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:11.125422 21758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2730) took 1196 ms. Trace:
I20260709 13:09:11.220818 21758 rpcz_store.cc:276] 0709 13:09:09.929218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.929415 (+   197us) service_pool.cc:224] Handling call
0709 13:09:09.929864 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.648788 (+718924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.125196 (+476408us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b54003dac54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:11.125363 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1573315968}
W20260709 13:09:10.996862 21879 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.536s (SENT) [suppressed 28 similar messages]
I20260709 13:09:10.931731 25193 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:09:11.115756 21832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.003s	sys 0.007s
I20260709 13:09:11.128500 21760 pending_rounds.cc:107] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:09:11.122583 25415 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:11.236384 21758 raft_consensus.cc:1275] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:11.238590 21758 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:10.783898 25480 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:11.232925 25332 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:11.240767 25346 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:11.230921 25061 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.241511 25193 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:11.242157 21838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1921) took 1492 ms. Trace:
I20260709 13:09:11.242594 21838 rpcz_store.cc:276] 0709 13:09:09.750007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.139591 (+389584us) service_pool.cc:224] Handling call
0709 13:09:10.231716 (+ 92125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.258432 (+ 26716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.241961 (+983529us) spinlock_profiling.cc:243] Waited 84.9 ms on lock 0x7b54000717d0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:11.242100 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195225344}
I20260709 13:09:11.243975 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:11.244246 25193 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:11.108922 21837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.005s	sys 0.024s
W20260709 13:09:11.245040 21837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.006s	sys 0.025s
I20260709 13:09:11.121901 21905 pending_rounds.cc:107] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:09:11.245869 21905 raft_consensus.cc:2889] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:11.247200 21914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 1667) took 1086 ms. Trace:
I20260709 13:09:11.247628 21914 rpcz_store.cc:276] 0709 13:09:10.160389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.169678 (+  9289us) service_pool.cc:224] Handling call
0709 13:09:11.246978 (+1077300us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54001969d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:11.247112 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341903232}
I20260709 13:09:11.231129 25140 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.250276 25500 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:11.250674 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:11.251437 22479 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:11.252440 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:11.253268 21839 raft_consensus.cc:2393] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 10: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:09:11.102641 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 602678us
I20260709 13:09:11.259756 22449 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:11.112519 25481 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:11.110358 25428 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:11.122771 25215 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:11.269454 21914 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:11.145021 21761 raft_consensus.cc:1240] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:11.153456 22450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.011s	sys 0.035s
W20260709 13:09:11.272957 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 858161us
I20260709 13:09:11.273883 22450 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:11.154398 21834 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:11.159057 25396 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:11.159587 25426 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:11.163127 25503 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:11.168175 25393 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:11.170001 25487 consensus_queue.cc:1059] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:09:11.279645 25314 consensus_meta.cc:287] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.002s
I20260709 13:09:11.147612 25456 consensus_queue.cc:1059] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:09:11.172044 25311 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:11.147866 25381 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:11.174510 25509 log.cc:927] Time spent T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:09:11.176574 21763 raft_consensus.cc:1275] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:09:11.340376 21763 pending_rounds.cc:85] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 9
I20260709 13:09:11.340730 21763 pending_rounds.cc:107] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:09:11.341041 21763 raft_consensus.cc:2889] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:11.178576 25366 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:11.127544 25367 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:11.180058 24937 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.148134 25412 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:11.146867 25394 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:11.147475 25204 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:09:11.182194 25447 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:11.183192 25369 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:11.184695 21764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2739) took 1215 ms. Trace:
I20260709 13:09:11.359025 25429 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.187394 25351 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:11.193651 25419 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:11.197413 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2830) took 1413 ms. Trace:
I20260709 13:09:11.177356 25446 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:11.203091 25309 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:10.762763 25437 consensus_queue.cc:237] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:11.387089 25381 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:11.395406 21762 raft_consensus.cc:2393] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 7: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:11.395716 25381 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:11.397305 25412 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:11.398280 25381 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:11.220175 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:09:11.230417 21832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.003s	sys 0.007s
I20260709 13:09:11.230599 21760 raft_consensus.cc:2889] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:11.400036 21760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2737) took 1431 ms. Trace:
I20260709 13:09:11.400103 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2827) took 1619 ms. Trace:
I20260709 13:09:11.241709 25415 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:11.241786 25061 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:11.400466 21760 rpcz_store.cc:276] 0709 13:09:09.968282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.501278 (+532996us) service_pool.cc:224] Handling call
0709 13:09:10.501540 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.399783 (+898243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.399979 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:11.387349 21833 rpcz_store.cc:276] 0709 13:09:09.783848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.227834 (+443986us) service_pool.cc:224] Handling call
0709 13:09:10.246929 (+ 19095us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:10.438294 (+191365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:10.438326 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:10.438723 (+   397us) log.cc:844] Serialized 26 byte log entry
0709 13:09:10.612326 (+173603us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:10.612372 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.196906 (+584534us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54003c0ad4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:11.196970 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:11.197039 (+    69us) raft_consensus.cc:1685] finished
0709 13:09:11.197057 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.197340 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19223,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":5857,"spinlock_wait_cycles":439319296,"thread_start_us":173311,"threads_started":1,"wal-append.queue_time_us":689397}
I20260709 13:09:11.146991 21759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2741) took 1177 ms. Trace:
I20260709 13:09:11.249233 25140 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:11.254336 25373 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.255646 25413 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:10.686748 25375 raft_consensus.cc:740] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:09:11.258535 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.409868 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.245203 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:11.264747 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 156540us
I20260709 13:09:11.275395 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 502) took 1005 ms. Trace:
I20260709 13:09:11.279316 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:11.281076 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 47387.9us
I20260709 13:09:11.295260 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:11.416468 21839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2833) took 1082 ms. Trace:
I20260709 13:09:11.417851 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:11.296743 25390 raft_consensus.cc:2764] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:09:11.419660 25390 consensus_queue.cc:1059] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:11.297222 25368 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:11.297572 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:11.311017 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:11.427605 21911 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:09:11.312463 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:11.312747 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:11.171001 22484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 942) took 1906 ms. Trace:
I20260709 13:09:11.416923 21839 rpcz_store.cc:276] 0709 13:09:10.334321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.415481 (+1081160us) service_pool.cc:224] Handling call
0709 13:09:11.415852 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.416065 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.416103 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:11.416160 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:11.416203 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.416284 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.416403 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:11.332798 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:11.334393 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:11.429906 21761 rpcz_store.cc:276] 0709 13:09:10.270250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.144421 (+874171us) service_pool.cc:224] Handling call
0709 13:09:11.144784 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.275054 (+130270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.275324 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:11.270140 25480 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:11.264106 25299 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:11.355476 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:11.358155 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2743) took 1087 ms. Trace:
I20260709 13:09:11.432910 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:11.240801 25332 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:11.186162 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 498) took 1722 ms. Trace:
W20260709 13:09:11.433468 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 436672us
I20260709 13:09:11.390350 21756 raft_consensus.cc:1275] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:11.210011 21906 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:11.435427 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:11.385593 25506 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:11.400683 21832 rpcz_store.cc:276] 0709 13:09:09.780885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.147523 (+366638us) service_pool.cc:224] Handling call
0709 13:09:10.147887 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.148124 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:10.437026 (+288902us) log.cc:844] Serialized 14 byte log entry
0709 13:09:11.399708 (+962682us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:11.399774 (+    66us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:11.399832 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.399914 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.400039 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":962214,"threads_started":1,"wal-append.queue_time_us":677411}
I20260709 13:09:11.402630 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:11.444051 21760 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:11.402431 21759 rpcz_store.cc:276] 0709 13:09:09.969388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.604438 (+635050us) service_pool.cc:224] Handling call
0709 13:09:11.121770 (+517332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.146708 (+ 24938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.146931 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:11.115741 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:11.431797 21729 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:11.382571 21764 rpcz_store.cc:276] 0709 13:09:09.968815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.516823 (+548008us) service_pool.cc:224] Handling call
0709 13:09:10.517090 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.146734 (+629644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.184429 (+ 37695us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b54001c70d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:11.184632 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260156800}
I20260709 13:09:11.448839 22476 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:11.124979 25399 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:11.432997 21763 rpcz_store.cc:276] 0709 13:09:10.271193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.175932 (+904739us) service_pool.cc:224] Handling call
0709 13:09:11.176239 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.341635 (+165396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.358081 (+ 16446us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:11.441838 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:11.451099 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:11.451915 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:11.452208 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:11.452903 21760 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:11.453773 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:11.454442 21879 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:11.454432 21760 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:11.456139 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:11.442566 21839 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:11.457412 21833 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:11.428781 22484 rpcz_store.cc:276] 0709 13:09:09.264198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.264351 (+   153us) service_pool.cc:224] Handling call
0709 13:09:09.275421 (+ 11070us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.322042 (+ 46621us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:09.446092 (+124050us) log.cc:844] Serialized 14 byte log entry
0709 13:09:09.798163 (+352071us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:09.798209 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:09.798259 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.170682 (+1372423us) spinlock_profiling.cc:243] Waited 46.3 ms on lock 0x7b54005eae54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:11.170746 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.170911 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":838834,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":3460,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":7717,"spinlock_wait_cycles":106500352,"thread_start_us":474951,"threads_started":2,"wal-append.queue_time_us":436258,"wal-append.run_cpu_time_us":1146,"wal-append.run_wall_time_us":1015371}
I20260709 13:09:11.445014 21832 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:09:11.367835 24937 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:11.410748 21838 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:09:11.463137 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:11.463394 21838 raft_consensus.cc:1275] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:11.459793 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2836) took 1116 ms. Trace:
I20260709 13:09:11.464211 21838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2840) took 1080 ms. Trace:
I20260709 13:09:11.433713 21765 rpcz_store.cc:276] 0709 13:09:09.463515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.463638 (+   123us) service_pool.cc:224] Handling call
0709 13:09:09.463954 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:09.845153 (+381199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:09.845183 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:09.845223 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:09.845254 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.185870 (+1340616us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b540028df54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:11.185932 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.186086 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":876272896}
I20260709 13:09:11.464104 21833 rpcz_store.cc:276] 0709 13:09:10.343332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.436475 (+1093143us) service_pool.cc:224] Handling call
0709 13:09:11.457066 (+ 20591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.459498 (+  2432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.459732 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:11.442296 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:11.460361 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:11.460598 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2839) took 1082 ms. Trace:
I20260709 13:09:11.461301 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:11.465863 21905 raft_consensus.cc:2393] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 8: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:11.465549 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:11.465651 21832 rpcz_store.cc:276] 0709 13:09:10.377924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.443733 (+1065809us) service_pool.cc:224] Handling call
0709 13:09:11.444059 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.460368 (+ 16309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.460552 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:11.466851 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:11.467168 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:11.457191 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:11.459677 21839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2835) took 1117 ms. Trace:
I20260709 13:09:11.469396 21839 rpcz_store.cc:276] 0709 13:09:10.342678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.429782 (+1087104us) service_pool.cc:224] Handling call
0709 13:09:11.434529 (+  4747us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.459363 (+ 24834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.459623 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:11.440724 25412 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:11.399976 25429 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:11.470774 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 359454us
I20260709 13:09:11.473382 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:11.480433 21763 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:09:11.480741 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:11.481824 21838 rpcz_store.cc:276] 0709 13:09:10.384248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.462612 (+1078364us) service_pool.cc:224] Handling call
0709 13:09:11.462966 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.463916 (+   950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.464146 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:11.490207 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 338750us
W20260709 13:09:11.462733 25084 consensus_meta.cc:287] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.731s	user 0.010s	sys 0.003s
I20260709 13:09:11.399165 25419 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:11.494323 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:11.454725 25413 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:11.495973 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:11.496188 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2841) took 1108 ms. Trace:
I20260709 13:09:11.500316 21833 rpcz_store.cc:276] 0709 13:09:10.387385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.465213 (+1077828us) service_pool.cc:224] Handling call
0709 13:09:11.495722 (+ 30509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.495900 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.495925 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:11.495964 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:11.495993 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.496045 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.496139 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:11.423599 25368 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:11.471316 25204 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:11.498345 21832 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:11.441205 25480 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:11.496474 21836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.008s	sys 0.005s
I20260709 13:09:11.502265 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:11.422566 25373 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:11.497745 21880 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:09:11.510630 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 236866us
I20260709 13:09:11.527202 21835 raft_consensus.cc:2410] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:11.497272 22476 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:11.527511 21731 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:11.497898 25466 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.166s	user 0.009s	sys 0.014s
W20260709 13:09:11.540191 21836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.017s	user 0.009s	sys 0.006s
I20260709 13:09:11.533526 21760 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:11.551126 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:11.551942 21763 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:11.508117 25369 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:11.450956 25513 consensus_queue.cc:1048] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:09:11.542836 22450 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:11.451188 25506 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:11.540735 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 227668us
I20260709 13:09:11.508419 25381 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:11.596230 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:11.574483 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:11.575814 21761 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:09:11.598053 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:11.599404 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:11.614051 21804 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:11.532732 25309 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:09:11.528352 25413 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:11.549958 25466 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.216s	user 0.010s	sys 0.014s
I20260709 13:09:11.535357 25204 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:11.592602 21836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1927) took 1437 ms. Trace:
I20260709 13:09:11.542790 25456 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:11.505203 25412 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:11.578858 22476 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:11.509164 25084 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:11.561141 21806 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:11.615315 25366 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:11.624720 25480 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:11.629099 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:11.629470 21805 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:11.635660 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 167615us
I20260709 13:09:11.637864 21836 rpcz_store.cc:276] 0709 13:09:10.155254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.521809 (+366555us) service_pool.cc:224] Handling call
0709 13:09:10.522096 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:10.522321 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:10.522623 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 13:09:11.592229 (+1069606us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:11.592301 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:11.592351 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:11.592424 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:11.592545 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47356,"prepare.queue_time_us":3197,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":29226,"raft.queue_time_us":48343,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":156,"thread_start_us":1021885,"threads_started":1}
I20260709 13:09:11.668856 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:11.640975 21804 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:09:11.649238 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:11.662041 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 100966us
I20260709 13:09:11.626307 25393 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:11.657713 25204 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:11.620071 25396 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:11.615868 25381 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:11.493403 25375 consensus_queue.cc:260] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:11.660046 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 121926us
I20260709 13:09:11.673465 21806 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:09:11.672835 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 43479.6us
I20260709 13:09:11.625756 25311 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:11.615994 25446 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:11.662029 25367 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:11.661296 25487 raft_consensus.cc:3055] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:11.665367 21763 raft_consensus.cc:1275] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:11.637441 25515 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:11.684176 21910 raft_consensus.cc:1240] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:11.891069 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 348308us
W20260709 13:09:12.035097 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 394236us
W20260709 13:09:11.734521 21762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59102 (request call id 2735) took 1766 ms (client timeout 2081 ms). Trace:
W20260709 13:09:12.037599 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:11.859256 21758 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:12.039587 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1399) took 1763 ms. Trace:
I20260709 13:09:12.040242 21763 rpcz_store.cc:276] 0709 13:09:10.276495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.629868 (+1353373us) service_pool.cc:224] Handling call
0709 13:09:11.665050 (+ 35182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.039316 (+374266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.039525 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:11.935076 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 72812.2us
I20260709 13:09:11.682533 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:12.043244 21836 raft_consensus.cc:2393] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 10: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:12.045691 21804 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:09:12.036855 21762 rpcz_store.cc:269] 0709 13:09:09.967724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.316738 (+349014us) service_pool.cc:224] Handling call
0709 13:09:11.734224 (+1417486us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b540028d054. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:11.734436 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2242172800}
I20260709 13:09:11.663194 25366 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:12.035262 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 361873us
I20260709 13:09:11.681290 25374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d76fbf464db84dbeb90facb1538a9ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:12.062870 21833 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:09:11.958494 25528 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:11.682643 25314 raft_consensus.cc:2804] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:09:12.142189 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 100012us
I20260709 13:09:11.996829 24937 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:11.681346 25525 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:12.023191 25413 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:11.689723 25140 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:12.022161 25084 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:12.024230 25506 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:11.690439 25419 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:12.182188 21879 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:12.182798 22449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.010s	sys 0.035s
W20260709 13:09:12.221028 22449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.010s	sys 0.035s
I20260709 13:09:12.189170 21762 raft_consensus.cc:1240] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: [7.4-10.6]
W20260709 13:09:12.193343 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.183073 25193 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.012s	sys 0.026s
W20260709 13:09:12.222829 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 626743us
W20260709 13:09:12.194342 21914 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.896s	user 0.005s	sys 0.008s
I20260709 13:09:12.056010 25522 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:11.683111 25503 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:12.061542 25375 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:11.968310 25371 consensus_queue.cc:1059] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.172s
I20260709 13:09:12.196826 25332 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:12.047336 25487 raft_consensus.cc:740] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
W20260709 13:09:12.209400 21835 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38352 (request call id 2826) took 2420 ms (client timeout 1536 ms). Trace:
I20260709 13:09:12.208304 25314 raft_consensus.cc:697] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:09:12.224335 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.224493 21914 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.005s	sys 0.008s
I20260709 13:09:12.056949 25311 consensus_queue.cc:1048] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.158s
I20260709 13:09:12.181912 25492 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:12.063231 25366 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:12.214346 25413 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:09:12.224133 25193 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.012s	sys 0.026s
W20260709 13:09:12.247437 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 65379.9us
I20260709 13:09:12.211161 21760 raft_consensus.cc:1275] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:12.267649 21760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1402) took 1008 ms. Trace:
I20260709 13:09:12.268088 21760 rpcz_store.cc:276] 0709 13:09:11.259583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.194233 (+934650us) service_pool.cc:224] Handling call
0709 13:09:12.200101 (+  5868us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.267309 (+ 67208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.267576 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:12.270503 21760 raft_consensus.cc:1240] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:12.248463 21838 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.008s	sys 0.028s
W20260709 13:09:12.247342 21835 rpcz_store.cc:269] 0709 13:09:09.776563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:09.834653 (+ 58090us) service_pool.cc:224] Handling call
0709 13:09:12.189416 (+2354763us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b5400187254. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:12.196890 (+  7474us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3771944832}
W20260709 13:09:12.253930 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.255738 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.274335 21838 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.009s	sys 0.029s
I20260709 13:09:12.245158 25522 raft_consensus.cc:697] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:09:12.263958 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 213144us
I20260709 13:09:12.252144 25415 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:12.213119 25525 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:12.257543 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 222712us
I20260709 13:09:12.278215 21910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1401) took 1715 ms. Trace:
I20260709 13:09:12.299882 21910 rpcz_store.cc:276] 0709 13:09:10.562711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.562937 (+   226us) service_pool.cc:224] Handling call
0709 13:09:10.563410 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.034527 (+1471117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.277927 (+243400us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54004092d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:12.278144 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2577052928}
I20260709 13:09:12.279337 21758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1397) took 2003 ms. Trace:
I20260709 13:09:12.301446 21758 rpcz_store.cc:276] 0709 13:09:10.275858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.245584 (+969726us) service_pool.cc:224] Handling call
0709 13:09:11.734949 (+489365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.045750 (+310801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.279119 (+233369us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b540028d050. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:12.279270 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124735232}
I20260709 13:09:12.254890 25539 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:12.229077 25412 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:12.291496 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:12.275719 21879 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:12.293727 21805 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:12.194200 25515 consensus_queue.cc:1048] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 13:09:12.310065 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:12.310775 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:12.322741 21805 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:12.323022 22476 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:12.246411 25534 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:09:12.275331 25446 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.334358 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:12.343568 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:12.341970 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:12.344815 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:12.345094 21907 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:12.350350 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2832) took 2028 ms. Trace:
I20260709 13:09:12.351370 21839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2848) took 1248 ms. Trace:
I20260709 13:09:12.352511 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:12.355211 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:12.355918 21833 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:12.350847 21831 rpcz_store.cc:276] 0709 13:09:10.322248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.603480 (+281232us) service_pool.cc:224] Handling call
0709 13:09:10.603749 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.149181 (+545432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.350041 (+1200860us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b540025e4d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:12.350277 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1057467776}
I20260709 13:09:12.358834 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:12.359562 21835 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:09:12.363090 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:12.366310 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 90719.9us
I20260709 13:09:12.373499 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:12.266141 25492 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:12.303567 24937 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:12.351876 21839 rpcz_store.cc:276] 0709 13:09:11.103282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.475397 (+372115us) service_pool.cc:224] Handling call
0709 13:09:11.478381 (+  2984us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.478634 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:11.641834 (+163200us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.350747 (+708913us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.350980 (+   233us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.351037 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:12.351094 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.351176 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.351306 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8392,"prepare.queue_time_us":583409,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":168679,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":16843,"thread_start_us":836754,"threads_started":3,"wal-append.queue_time_us":670178}
I20260709 13:09:12.427381 21907 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:12.313299 25539 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:12.400503 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:12.304420 25415 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:12.392774 25193 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:12.334873 25419 raft_consensus.cc:2764] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:09:12.345856 25503 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:12.409551 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:12.411989 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:12.436677 21835 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:12.436518 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:12.304181 25371 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 13:09:12.324508 25501 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:09:12.432895 25381 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:12.407120 25314 consensus_queue.cc:237] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:12.365420 25446 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:12.420233 25369 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:12.303603 25513 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:09:12.422681 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:12.358131 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:12.499702 21831 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:12.401090 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:12.437237 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:12.438177 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:12.439850 25412 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:12.442273 25490 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:12.498090 25369 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:12.468199 25530 log.cc:927] Time spent T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:09:12.502480 25369 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:12.443802 21837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56424 (request call id 443) took 2289 ms. Trace:
I20260709 13:09:12.414357 25489 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:12.466370 25500 raft_consensus.cc:3055] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:12.503870 25500 raft_consensus.cc:740] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:09:12.430473 25529 log.cc:927] Time spent T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.360s	user 0.000s	sys 0.001s
I20260709 13:09:12.308823 25413 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:09:12.504808 25500 consensus_queue.cc:260] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:12.505769 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:12.506202 25500 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:12.506584 21911 raft_consensus.cc:2393] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 7: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:12.452270 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 1404) took 1192 ms. Trace:
I20260709 13:09:12.507517 21761 rpcz_store.cc:276] 0709 13:09:11.260125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.466637 (+206512us) service_pool.cc:224] Handling call
0709 13:09:12.452082 (+985445us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54001c70d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:12.452208 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249122688}
I20260709 13:09:12.451498 21836 raft_consensus.cc:1240] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:12.502056 21839 raft_consensus.cc:2410] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:09:12.510504 21913 raft_consensus.cc:2393] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 10: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:09:12.510653 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.515678 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:12.516528 21835 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:12.519143 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:12.520231 21909 raft_consensus.cc:2410] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:09:12.503212 21837 rpcz_store.cc:276] 0709 13:09:10.154527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.270805 (+116278us) service_pool.cc:224] Handling call
0709 13:09:10.302224 (+ 31419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:10.487007 (+184783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:10.487072 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:10.487719 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 13:09:11.245509 (+757790us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:11.245563 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.443394 (+1197831us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b540025dad4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:12.443449 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:12.443494 (+    45us) raft_consensus.cc:1685] finished
0709 13:09:12.443505 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.443729 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45008,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":4974,"spinlock_wait_cycles":314743552,"thread_start_us":702139,"threads_started":1,"wal-append.queue_time_us":603330,"wal-append.run_cpu_time_us":1953,"wal-append.run_wall_time_us":1031946}
I20260709 13:09:12.530545 21839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38348 (request call id 1939) took 1015 ms. Trace:
I20260709 13:09:12.433930 25539 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:12.531055 21839 rpcz_store.cc:276] 0709 13:09:11.514848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.430665 (+915817us) service_pool.cc:224] Handling call
0709 13:09:12.530461 (+ 99796us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:12.320086 25487 consensus_queue.cc:260] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:12.543283 21831 raft_consensus.cc:1240] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:09:12.449373 25061 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:12.535104 21914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 636) took 1258 ms. Trace:
I20260709 13:09:12.430951 24937 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:12.545157 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:12.546103 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1933) took 1033 ms. Trace:
I20260709 13:09:12.554925 21839 raft_consensus.cc:2410] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:12.555137 21831 rpcz_store.cc:276] 0709 13:09:11.512665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.529282 (+1016617us) service_pool.cc:224] Handling call
0709 13:09:12.529762 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:12.545750 (+ 15988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.546031 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:12.534264 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 488646us
I20260709 13:09:12.462646 25525 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:12.466971 25492 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:12.544745 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:12.553272 21838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2849) took 1448 ms. Trace:
I20260709 13:09:12.557117 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:12.558151 21837 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:12.559569 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:12.560384 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:12.560520 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 336700us
I20260709 13:09:12.558125 21838 rpcz_store.cc:276] 0709 13:09:11.104443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.482851 (+378408us) service_pool.cc:224] Handling call
0709 13:09:11.483189 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.483443 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:12.274828 (+791385us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.552920 (+278092us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.552969 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:12.553011 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.553093 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.553217 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36358,"prepare.queue_time_us":737483,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":12905,"thread_start_us":1000876,"threads_started":2}
I20260709 13:09:12.556820 21804 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:12.565124 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:12.566073 21909 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:09:12.568732 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:12.581223 21831 raft_consensus.cc:2393] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 7: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:12.474310 25193 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:12.583194 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:12.586330 21837 raft_consensus.cc:2410] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:12.554639 25487 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:12.557473 25464 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:12.584697 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.593114 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.591334 21877 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:12.589910 21833 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:12.596045 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38348 (request call id 1940) took 1081 ms. Trace:
I20260709 13:09:12.597034 21877 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:12.596999 21833 rpcz_store.cc:276] 0709 13:09:11.515108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.319588 (+804480us) service_pool.cc:224] Handling call
0709 13:09:12.595980 (+276392us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:12.599126 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:12.599295 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:12.600330 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:12.463287 25522 consensus_queue.cc:237] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:12.604727 21877 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:12.608696 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:12.611266 21833 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:09:12.611377 21835 raft_consensus.cc:2410] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:09:12.612216 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1942) took 1096 ms. Trace:
I20260709 13:09:12.612742 21833 rpcz_store.cc:276] 0709 13:09:11.515651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.598937 (+1083286us) service_pool.cc:224] Handling call
0709 13:09:12.599222 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.611916 (+ 12694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.612144 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:12.614619 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:12.581481 25309 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:12.620189 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:12.629593 25309 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:12.632455 25309 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:12.633059 25309 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:12.633459 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:12.643536 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:12.644886 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 62624.5us
I20260709 13:09:12.645926 21804 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:12.591872 25555 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:12.608560 25492 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:12.652014 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 228626us
I20260709 13:09:12.654448 21877 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:12.615648 25396 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:12.660013 21804 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:12.642014 25215 consensus_meta.cc:287] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 1.353s	user 0.017s	sys 0.000s
I20260709 13:09:12.664806 21840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1932) took 1152 ms. Trace:
I20260709 13:09:12.664754 21804 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:12.665903 21877 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:09:12.653307 22477 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.006s	sys 0.006s
W20260709 13:09:12.653570 22484 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.042s	user 0.004s	sys 0.009s
W20260709 13:09:12.667094 22484 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.056s	user 0.004s	sys 0.009s
I20260709 13:09:12.665511 21840 rpcz_store.cc:276] 0709 13:09:11.512385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.461276 (+948891us) service_pool.cc:224] Handling call
0709 13:09:12.461727 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.461992 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:09:12.462381 (+   389us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.662657 (+200276us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.662705 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:12.662747 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.664525 (+  1778us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.664720 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1535,"prepare.queue_time_us":600,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":2559,"thread_start_us":198323,"threads_started":1}
W20260709 13:09:12.669227 22477 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.006s	sys 0.006s
I20260709 13:09:12.647365 25415 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:12.678154 22477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 967) took 1254 ms. Trace:
I20260709 13:09:12.622643 25513 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:12.656515 21763 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.000s	sys 0.012s
W20260709 13:09:12.652839 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 323841us
W20260709 13:09:12.644156 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 169219us
I20260709 13:09:12.679114 21804 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:12.679669 21757 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 13:09:12.681928 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:12.685026 21757 pending_rounds.cc:85] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 4
W20260709 13:09:12.684746 21763 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.000s	sys 0.012s
I20260709 13:09:12.685321 21757 pending_rounds.cc:107] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:09:12.685614 21757 raft_consensus.cc:2889] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:12.650635 25309 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:12.680922 25419 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:09:12.670043 25140 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:09:12.688953 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.689705 25437 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.690330 25437 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:12.690582 25215 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:12.691260 25215 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:12.694002 25560 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.694506 25560 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:12.704541 25204 consensus_meta.cc:287] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.002s
I20260709 13:09:12.708690 25429 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:12.663666 25311 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:12.717803 25492 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:12.671264 25412 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:12.671835 25396 raft_consensus.cc:697] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:12.678994 25555 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:12.678948 22477 rpcz_store.cc:276] 0709 13:09:11.424250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.426246 (+  1996us) service_pool.cc:224] Handling call
0709 13:09:11.426599 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.426825 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:09:11.682620 (+255795us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.669802 (+987182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.669872 (+    70us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:12.669932 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.677608 (+  7676us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.678077 (+   469us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":266216,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":620280,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":41739,"thread_start_us":1223911,"threads_started":2}
W20260709 13:09:12.723954 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 44915.3us
I20260709 13:09:12.705039 25204 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:12.730247 21804 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:12.732148 21804 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:12.683799 25381 consensus_queue.cc:1048] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
W20260709 13:09:12.791364 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:12.721446 25537 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:12.748351 21764 raft_consensus.cc:2393] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 7: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:12.770577 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1398) took 2247 ms. Trace:
I20260709 13:09:12.806070 21906 rpcz_store.cc:276] 0709 13:09:10.523444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.533462 (+ 10018us) service_pool.cc:224] Handling call
0709 13:09:10.533745 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.434664 (+900919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.770170 (+1335506us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b540032d054. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:12.770470 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1554244480}
I20260709 13:09:12.769032 21756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2719) took 3010 ms. Trace:
I20260709 13:09:12.807327 21756 rpcz_store.cc:276] 0709 13:09:09.758216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.605184 (+846968us) service_pool.cc:224] Handling call
0709 13:09:10.605613 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.434400 (+828787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.768728 (+1334328us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b54001c6bd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:12.768956 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1803774208}
I20260709 13:09:12.769809 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1929) took 2614 ms. Trace:
I20260709 13:09:12.761139 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56424 (request call id 446) took 1184 ms. Trace:
I20260709 13:09:12.738840 21804 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:12.785466 21912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1671) took 1371 ms. Trace:
I20260709 13:09:12.809859 21831 rpcz_store.cc:276] 0709 13:09:11.576489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.760151 (+1183662us) service_pool.cc:224] Handling call
0709 13:09:12.760534 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.760737 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.760769 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.760822 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:12.760874 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.760941 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.761068 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:12.808585 21834 rpcz_store.cc:276] 0709 13:09:10.155691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.537347 (+381656us) service_pool.cc:224] Handling call
0709 13:09:11.154158 (+616811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.281411 (+127253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.769581 (+1488170us) spinlock_profiling.cc:243] Waited 51.4 ms on lock 0x7b5400402c50. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:12.769740 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118214400}
I20260709 13:09:12.810043 21912 rpcz_store.cc:276] 0709 13:09:11.413962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.439854 (+ 25892us) service_pool.cc:224] Handling call
0709 13:09:11.440303 (+   449us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:11.677305 (+237002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:11.677354 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:11.678108 (+   754us) log.cc:844] Serialized 52 byte log entry
0709 13:09:12.227258 (+549150us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:12.264548 (+ 37290us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.285755 (+ 21207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.784870 (+499115us) spinlock_profiling.cc:243] Waited 9.61 ms on lock 0x7b54001973d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:12.784934 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:12.785018 (+    84us) raft_consensus.cc:1685] finished
0709 13:09:12.785139 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.785368 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51125,"prepare.queue_time_us":35960,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2918,"raft.queue_time_us":70906,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":16294,"spinlock_wait_cycles":22105856,"thread_start_us":517630,"threads_started":2,"wal-append.queue_time_us":504478}
W20260709 13:09:12.825378 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 155784us
I20260709 13:09:12.727229 25419 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:12.758145 25399 consensus_meta.cc:287] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 1.303s	user 0.011s	sys 0.002s
I20260709 13:09:12.846652 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:12.771585 25500 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.850801 25391 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:12.786082 25553 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:12.748018 25204 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:12.727957 25369 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:12.871060 25369 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:12.788688 25311 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:12.776109 25373 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:12.857777 21759 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:12.858040 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:56408 (request call id 6) took 2999 ms. Trace:
W20260709 13:09:12.816697 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 77943us
I20260709 13:09:12.727541 25343 consensus_queue.cc:1059] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
W20260709 13:09:12.871644 25559 log.cc:927] Time spent T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:09:12.878149 25343 raft_consensus.cc:3055] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:12.878574 25343 raft_consensus.cc:740] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:12.878628 25467 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.766285 25464 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:12.846654 25366 consensus_meta.cc:287] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.008s
W20260709 13:09:12.741642 25545 log.cc:927] Time spent T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 13:09:12.737128 25413 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:12.805797 25537 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.874876 21831 rpcz_store.cc:276] 0709 13:09:09.850448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.844935 (+2994487us) service_pool.cc:224] Handling call
0709 13:09:12.845638 (+   703us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:12.767623 25374 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36290 (request call id 937) took 5671 ms. Trace:
I20260709 13:09:12.877991 25310 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:12.857163 25500 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:12.857106 22480 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
W20260709 13:09:12.869104 25375 consensus_meta.cc:287] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.624s	user 0.012s	sys 0.002s
I20260709 13:09:12.748531 25193 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:12.837074 25555 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:12.747833 25446 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:12.886606 21840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56424 (request call id 444) took 1369 ms. Trace:
I20260709 13:09:12.749091 24937 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:12.892021 21877 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:12.899319 21806 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:12.889459 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:12.885375 25464 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:12.898898 21840 rpcz_store.cc:276] 0709 13:09:11.517004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.668016 (+1151012us) service_pool.cc:224] Handling call
0709 13:09:12.686573 (+ 18557us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.686811 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:09:12.687131 (+   320us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.886328 (+199197us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.886381 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:12.886420 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.886478 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.886564 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2578,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":1041,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":4303,"thread_start_us":198761,"threads_started":1}
I20260709 13:09:12.901405 21877 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:12.894711 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:12.885411 25419 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:12.902546 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:12.903191 21831 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:12.879655 25343 consensus_queue.cc:260] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:12.906759 25343 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:12.906702 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:12.891765 25537 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:12.910138 25368 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:12.912398 25539 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:12.913856 21711 auto_rebalancer.cc:629] Failed to schedule move for tablet 9d6d123916f54285a4a4b037399f46ec: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:09:12.914100 25412 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:12.914577 25412 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:12.914844 22480 raft_consensus.cc:1240] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:12.915009 25412 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:12.917685 25375 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:12.918169 25375 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:12.919884 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:12.905679 21877 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:12.921479 21877 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:12.923792 21757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2740) took 2954 ms. Trace:
I20260709 13:09:12.924245 21757 rpcz_store.cc:276] 0709 13:09:09.969124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:10.600295 (+631171us) service_pool.cc:224] Handling call
0709 13:09:10.600643 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.686108 (+2085465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.923577 (+237469us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b540028e454. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:12.923732 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4756763904}
I20260709 13:09:12.878446 25396 consensus_queue.cc:237] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:12.928210 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:12.890223 25366 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:12.934146 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:12.935542 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:12.936097 21906 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:12.936299 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:12.918589 25375 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:12.723673 25556 consensus_queue.cc:1059] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.215s
I20260709 13:09:12.894692 25369 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:09:12.879292 25467 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:12.947716 25556 raft_consensus.cc:3055] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:12.948287 25556 raft_consensus.cc:740] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:12.949210 25556 consensus_queue.cc:260] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:12.950644 25556 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:12.952160 25437 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:12.953169 21711 auto_rebalancer.cc:629] Failed to schedule move for tablet afc4a5871719461787d91a97d59582af: Illegal state: Replica 3843e9b794a245dd8608e04ec7915239 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:12.930171 25383 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:12.894670 25497 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:09:12.869597 25553 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:12.939335 25573 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.939985 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:12.955101 24937 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.942250 21909 raft_consensus.cc:2393] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 12: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:12.943135 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:12.943390 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:12.944154 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:13.014007 21761 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:09:13.013121 21840 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:12.942656 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:13.015983 21834 raft_consensus.cc:2410] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:09:12.945906 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:13.016646 21837 raft_consensus.cc:1240] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:13.017387 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:12.946358 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:12.924039 25193 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:12.968125 22484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36278 (request call id 488) took 1411 ms. Trace:
I20260709 13:09:12.968493 21905 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:12.967478 21728 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:09:13.021579 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 54189.2us
I20260709 13:09:12.934985 25368 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.001406 21906 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:09:12.972090 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:12.970252 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:12.941175 25500 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:12.941298 25332 raft_consensus.cc:3055] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:12.933089 25446 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.005575 21804 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:12.972275 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:12.970536 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:12.934304 25391 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:13.019855 21762 raft_consensus.cc:2955] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:09:13.002465 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:13.008116 21729 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:12.923563 25419 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:12.925130 25429 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:13.021200 22484 rpcz_store.cc:276] 0709 13:09:11.556786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.557352 (+   566us) service_pool.cc:224] Handling call
0709 13:09:11.610829 (+ 53477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:12.668746 (+1057917us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.668795 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:12.684450 (+ 15655us) log.cc:844] Serialized 26 byte log entry
0709 13:09:12.895535 (+211085us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:12.896537 (+  1002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.896637 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:12.957890 (+ 61253us) raft_consensus.cc:1685] finished
0709 13:09:12.957921 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.968065 (+ 10144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":612152,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":22778,"thread_start_us":1223768,"threads_started":2,"wal-append.queue_time_us":230988}
I20260709 13:09:13.022446 21728 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:13.042277 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:12.971030 25383 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:13.026597 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:13.028306 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:13.028841 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:13.029102 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:13.054284 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:13.027523 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:13.054921 21905 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:13.055639 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:13.057128 21906 raft_consensus.cc:1275] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:13.032757 21907 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:13.057375 21804 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:13.003978 25528 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:13.039016 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:13.059854 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:13.060105 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:13.060559 21756 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:13.019630 25193 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:12.892889 25374 rpcz_store.cc:276] 0709 13:09:07.102961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.106822 (+  3861us) service_pool.cc:224] Handling call
0709 13:09:07.511786 (+404964us) ts_tablet_manager.cc:934] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
0709 13:09:11.279024 (+3767238us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:12.694220 (+1415196us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:12.694345 (+   125us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:12.761553 (+ 67208us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:12.761946 (+   393us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:12.767466 (+  5520us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:12.767528 (+    62us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":197667,"tablet-copy.queue_time_us":301492,"thread_start_us":394161,"threads_started":2}
I20260709 13:09:13.042973 21765 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:12.551015 21914 rpcz_store.cc:276] 0709 13:09:11.276901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.277107 (+   206us) service_pool.cc:224] Handling call
0709 13:09:11.277503 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:11.277760 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:09:12.251541 (+973781us) log.cc:844] Serialized 14 byte log entry
0709 13:09:12.534698 (+283157us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:12.534778 (+    80us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:12.534838 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.534904 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:12.535036 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9157,"prepare.queue_time_us":275793,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2414,"raft.queue_time_us":10126,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":7913,"thread_start_us":1226481,"threads_started":2}
I20260709 13:09:13.052575 21728 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:13.026647 25437 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:13.032876 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:13.029155 25332 raft_consensus.cc:740] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:13.075423 21728 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:13.011860 25539 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:13.038751 25500 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:13.063236 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.066548 21914 raft_consensus.cc:1240] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:09:13.067553 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:13.069147 21804 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:13.055764 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:13.020886 24937 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:13.074681 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:13.077311 21907 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:09:13.058594 25383 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:13.039960 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:13.066082 25373 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:13.080813 25473 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:13.081540 25391 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:13.071735 25437 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:13.085314 25374 tablet_copy_client.cc:806] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:13.089653 25560 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:13.091003 21759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59102 (request call id 2747) took 1832 ms (client timeout 1819 ms). Trace:
I20260709 13:09:13.031038 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:13.125590 21759 rpcz_store.cc:269] 0709 13:09:11.258532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.450856 (+192324us) service_pool.cc:224] Handling call
0709 13:09:13.090837 (+1639981us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b540020bcd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:13.090936 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3233658624}
I20260709 13:09:13.126761 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:13.033378 25368 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:13.016103 25573 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:13.111227 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1945) took 1594 ms. Trace:
I20260709 13:09:13.143967 21833 rpcz_store.cc:276] 0709 13:09:11.516448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.613830 (+1097382us) service_pool.cc:224] Handling call
0709 13:09:12.643041 (+ 29211us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:12.657912 (+ 14871us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.657941 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:12.659138 (+  1197us) log.cc:844] Serialized 26 byte log entry
0709 13:09:12.887356 (+228218us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:12.887414 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.887490 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.110900 (+223410us) raft_consensus.cc:1685] finished
0709 13:09:13.110919 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.111045 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16302,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5694,"thread_start_us":227798,"threads_started":1,"wal-append.queue_time_us":347448}
I20260709 13:09:13.113312 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:13.070138 25193 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:13.070477 25413 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:13.034614 25446 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:13.046072 25314 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:09:13.084681 25464 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:13.120955 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 51919.5us
I20260709 13:09:13.063575 25522 raft_consensus.cc:2804] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:13.131731 21756 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:13.125216 25437 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:13.135268 25575 log.cc:927] Time spent T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:09:13.124020 25391 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:13.059404 25429 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:13.135541 21838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56424 (request call id 447) took 1522 ms. Trace:
I20260709 13:09:13.124096 25415 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:13.136196 25473 raft_consensus.cc:697] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:13.137738 25374 tablet_copy_client.cc:670] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
W20260709 13:09:13.133352 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 111101us
I20260709 13:09:13.141786 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:13.141958 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 63226.1us
I20260709 13:09:13.142586 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:13.146368 22477 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
I20260709 13:09:13.151384 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:13.072175 25528 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:13.212309 25528 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:13.213689 21836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1934) took 1700 ms. Trace:
I20260709 13:09:13.214110 21836 rpcz_store.cc:276] 0709 13:09:11.512988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.529892 (+1016904us) service_pool.cc:224] Handling call
0709 13:09:12.534748 (+  4856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:12.552854 (+ 18106us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.552887 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:12.553331 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:09:12.804903 (+251572us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:12.804952 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:12.805044 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.213417 (+408373us) raft_consensus.cc:1685] finished
0709 13:09:13.213477 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.213628 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22364,"raft.queue_time_us":17814,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":26871,"thread_start_us":213799,"threads_started":1,"wal-append.queue_time_us":342547}
I20260709 13:09:13.117496 25373 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:13.162581 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.216750 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:13.164562 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:13.175398 21757 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:13.176580 21905 raft_consensus.cc:2410] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:13.177255 22449 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:13.122049 25500 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:09:13.182828 21838 rpcz_store.cc:276] 0709 13:09:11.613611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.763770 (+1150159us) service_pool.cc:224] Handling call
0709 13:09:12.764127 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:12.764382 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:12.849481 (+ 85099us) log.cc:844] Serialized 14 byte log entry
0709 13:09:13.087097 (+237616us) spinlock_profiling.cc:243] Waited 8.83 ms on lock 0x7b180048f100. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab24ce07 00007fc6b40a7ab9 00007fc6ab26969b 00007fc6ab26793f 00007fc6ab269c02 00007fc6adef120b 00007fc6adef6d23 00007fc6adef723a 00007fc6ae361a2a
0709 13:09:13.135200 (+ 48103us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:13.135253 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:13.135309 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.135373 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.135483 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5656,"prepare.queue_time_us":84912,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":17718,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":45837,"spinlock_wait_cycles":20300032,"thread_start_us":42122,"threads_started":2,"wal-append.queue_time_us":283678}
I20260709 13:09:13.223500 21832 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:09:13.154407 25309 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:13.186283 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.191587 21840 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:13.226648 21728 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:13.175366 25413 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:09:13.206482 25368 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:13.206766 25391 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:13.134509 25419 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:13.223080 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 45953.2us
I20260709 13:09:13.260437 22449 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:13.185729 25415 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.228591 21728 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:13.209051 25383 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:13.261471 22449 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:13.222330 25373 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:13.273356 21731 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:13.277024 21914 raft_consensus.cc:1240] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:13.227133 25528 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:13.223026 25497 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:13.281329 21914 raft_consensus.cc:1240] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:13.284773 25497 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:13.267004 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 108103us
I20260709 13:09:13.253141 25309 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.288254 21911 raft_consensus.cc:1240] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:13.232338 25412 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:13.290650 25590 consensus_queue.cc:1059] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:13.291628 25524 raft_consensus.cc:3055] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:13.291961 25524 raft_consensus.cc:740] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:13.271293 25415 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:13.295677 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:13.277931 25582 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:13.292799 25524 consensus_queue.cc:260] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:13.284147 25540 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:13.265795 25522 raft_consensus.cc:697] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:13.293558 25014 raft_consensus.cc:2764] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:09:13.310132 25573 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:13.312245 25525 consensus_queue.cc:1059] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:13.312646 25524 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:13.312775 25490 consensus_queue.cc:1059] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:13.313412 25525 raft_consensus.cc:3055] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:13.313819 25525 raft_consensus.cc:740] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:13.314654 25525 consensus_queue.cc:260] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:13.305886 25204 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.315946 25525 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:13.316088 25204 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:13.312242 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:13.318356 25204 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:13.318863 25528 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.319317 25528 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:13.322106 25528 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:13.329571 25464 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:13.300397 25309 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:13.336127 25299 raft_consensus.cc:3055] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:13.336561 25299 raft_consensus.cc:740] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:13.337837 25309 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:13.307575 25540 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:13.337471 25299 consensus_queue.cc:260] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:13.328305 25595 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:13.363762 25299 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:13.366140 25583 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:13.369462 21836 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:13.354763 25540 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:13.355954 25446 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:13.377933 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 104690us
I20260709 13:09:13.379004 21731 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:13.353195 25193 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:13.384150 21731 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:13.404301 25497 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:13.328054 25473 consensus_queue.cc:237] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:13.405748 25383 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:13.382026 25367 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:13.405229 25375 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:13.412429 25582 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:13.412899 25582 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:13.413966 25375 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:13.405777 25522 consensus_queue.cc:237] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:13.418613 25415 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:13.420642 25415 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:13.385700 25429 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:13.401173 25437 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:13.422576 25366 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:13.423321 25437 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:13.425768 25373 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:13.427940 25373 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:13.434624 21758 raft_consensus.cc:2410] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:09:13.436612 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 52559.8us
I20260709 13:09:13.437866 21731 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:13.447960 21731 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:13.383289 25537 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:13.451618 21731 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:13.441218 25373 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:13.453828 21731 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:13.441161 25598 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:13.455945 21731 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:13.447057 25193 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:13.449059 25466 consensus_queue.cc:1059] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:09:13.453310 25446 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:13.458884 25537 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:13.452452 25367 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:13.457580 25595 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:13.466262 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 428876us
I20260709 13:09:13.469112 25467 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:13.472978 25582 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:13.476109 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:13.478313 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:09:13.483088 21764 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59102 (request call id 2748) took 2224 ms (client timeout 2213 ms). Trace:
W20260709 13:09:13.483520 21764 rpcz_store.cc:269] 0709 13:09:11.258810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:11.456980 (+198170us) service_pool.cc:224] Handling call
0709 13:09:13.482900 (+2025920us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b540028df54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:13.483020 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2942442880}
I20260709 13:09:13.487668 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:13.488350 21831 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:13.480684 21731 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:13.497596 21880 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:13.501039 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:13.483144 25466 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:13.502381 25598 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.502637 25466 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:13.503083 25466 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:13.502933 25598 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:13.525275 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 57960us
W20260709 13:09:13.531183 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 50597us
I20260709 13:09:13.532521 21831 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:13.495203 25373 raft_consensus.cc:3055] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:13.499745 25371 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:13.540017 21729 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:13.527781 25598 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:13.513059 25466 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:13.568607 25466 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:13.543462 25412 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:13.574347 21837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1935) took 2061 ms. Trace:
I20260709 13:09:13.574967 21837 rpcz_store.cc:276] 0709 13:09:11.513242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.590065 (+1076823us) service_pool.cc:224] Handling call
0709 13:09:12.592428 (+  2363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:13.017013 (+424585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.573898 (+556885us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b5400021554. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:13.574264 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":975216000}
I20260709 13:09:13.576740 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:13.536475 25373 raft_consensus.cc:740] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:13.582476 25373 consensus_queue.cc:260] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:13.584174 25373 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:13.584807 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.493234 25540 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:13.545209 25596 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:13.587524 25540 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:13.590996 25553 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:13.591562 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:13.592072 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 50372.8us
I20260709 13:09:13.593509 21729 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:13.594718 21837 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:13.597966 25467 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:13.634088 21837 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:13.635525 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:13.635594 21729 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:13.637641 25399 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:13.640537 25583 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:13.641032 25583 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:13.637033 21837 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
W20260709 13:09:13.645392 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.652136 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:13.652792 21911 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:13.648437 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:13.654743 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:13.655268 21839 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:13.649806 21910 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:09:13.648873 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45202 (request call id 641) took 1080 ms. Trace:
I20260709 13:09:13.656780 21909 rpcz_store.cc:276] 0709 13:09:12.568200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.568375 (+   175us) service_pool.cc:224] Handling call
0709 13:09:13.648682 (+1080307us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54004164d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:13.648817 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":856755584}
I20260709 13:09:13.655597 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:13.657665 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:13.658330 21907 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:13.658529 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:13.660051 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:13.661731 21729 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:13.662931 21729 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:13.666036 21907 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:13.667563 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:13.668651 21837 raft_consensus.cc:2368] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 8. Current term is 9.
I20260709 13:09:13.669298 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:13.671295 21804 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:13.661055 25501 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.671916 25446 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:13.672583 25595 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:13.680895 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:13.704615 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:13.660229 25596 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:13.663410 25560 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:09:13.635903 25582 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:13.682436 21728 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:13.688042 21839 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:09:13.688866 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:13.706395 21804 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:13.708108 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:13.708276 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:13.710393 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:13.711468 21837 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:13.713876 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:13.714418 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:13.714534 21837 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:13.715289 21840 raft_consensus.cc:2393] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 8: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:13.716822 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:13.705600 25501 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:13.719738 25501 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:13.721750 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:13.722489 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:13.723488 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:13.706722 25503 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:13.726733 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:13.725140 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:13.725808 21839 raft_consensus.cc:2410] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:09:13.733316 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:13.732524 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:13.734122 21831 raft_consensus.cc:2393] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 7: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:13.734812 25332 consensus_queue.cc:260] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:13.735253 21836 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:13.735970 25332 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:13.736824 21831 raft_consensus.cc:1240] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:09:13.737882 21836 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:09:13.738363 21836 pending_rounds.cc:85] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 6
I20260709 13:09:13.738607 21836 pending_rounds.cc:107] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:09:13.738855 21836 raft_consensus.cc:2889] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:13.721552 25554 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:13.740382 21835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 2860) took 1215 ms. Trace:
I20260709 13:09:13.740602 25554 raft_consensus.cc:697] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:13.741479 25554 consensus_queue.cc:237] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:13.740741 21835 rpcz_store.cc:276] 0709 13:09:12.524695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.788215 (+263520us) service_pool.cc:224] Handling call
0709 13:09:12.847754 (+ 59539us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:12.926011 (+ 78257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:12.926057 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:12.933085 (+  7028us) log.cc:844] Serialized 26 byte log entry
0709 13:09:13.028906 (+ 95821us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:13.028947 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.739999 (+711052us) spinlock_profiling.cc:243] Waited 54.1 ms on lock 0x7b54003c1254. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:13.740057 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.740107 (+    50us) raft_consensus.cc:1685] finished
0709 13:09:13.740120 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.740329 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23637,"raft.queue_time_us":27904,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":8812,"spinlock_wait_cycles":124449024,"thread_start_us":80367,"threads_started":1,"wal-append.queue_time_us":132600}
I20260709 13:09:13.729394 21840 raft_consensus.cc:2410] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:09:13.765195 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.771543 25600 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.772236 25600 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:13.775815 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2745) took 2517 ms. Trace:
I20260709 13:09:13.776280 21763 rpcz_store.cc:276] 0709 13:09:11.257972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:12.050700 (+792728us) service_pool.cc:224] Handling call
0709 13:09:12.051064 (+   364us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:12.051551 (+   487us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:12.685688 (+634137us) log.cc:844] Serialized 14 byte log entry
0709 13:09:13.485172 (+799484us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b180032e1e0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab24ce07 00007fc6b40a7ab9 00007fc6ab26969b 00007fc6ab26793f 00007fc6ab269c02 00007fc6adef120b 00007fc6adef6d23 00007fc6adef723a 00007fc6ae361a2a
0709 13:09:13.633211 (+148039us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:13.636966 (+  3755us) log.cc:844] Serialized 52 byte log entry
0709 13:09:13.637145 (+   179us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:13.637180 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:13.637247 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:13.775475 (+138228us) raft_consensus.cc:1685] finished
0709 13:09:13.775584 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:13.775753 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":142221,"prepare.queue_time_us":631343,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":2345,"raft.queue_time_us":46382,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":79804,"spinlock_wait_cycles":82024192,"thread_start_us":652165,"threads_started":2,"wal-append.queue_time_us":938187}
I20260709 13:09:13.728714 25503 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:13.785105 21835 raft_consensus.cc:1240] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:13.784200 25503 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:13.796607 25613 log.cc:927] Time spent T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.086s	user 0.002s	sys 0.000s
I20260709 13:09:13.801152 25503 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:13.802074 25600 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:13.815213 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:13.802755 21835 raft_consensus.cc:1240] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:13.803414 25215 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:13.809813 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:13.809850 21877 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:13.818635 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:13.820520 25539 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:13.821010 22480 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:13.821063 25539 raft_consensus.cc:697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:13.822355 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:13.822222 25539 consensus_queue.cc:237] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:13.810607 25396 consensus_queue.cc:1059] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:13.824829 25396 raft_consensus.cc:3055] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:13.825253 25396 raft_consensus.cc:740] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:13.826293 25396 consensus_queue.cc:260] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:13.827683 25396 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:13.828591 21805 connection.cc:256] RPC call timeout handler was delayed by -1.3525723000000198s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21660000000000001s for a response
I20260709 13:09:13.814400 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:13.812438 24937 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:13.830859 21805 connection.cc:256] RPC call timeout handler was delayed by -1.3036098649999985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2319s for a response
I20260709 13:09:13.832336 21806 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:13.837826 21833 raft_consensus.cc:1240] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:13.838961 21806 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:13.838843 21662 catalog_manager.cc:5697] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:13.840399 25516 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:13.833369 21877 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:13.841162 25588 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:13.841910 25501 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:13.842453 25501 raft_consensus.cc:697] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:13.836225 22485 raft_consensus.cc:1275] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:13.841440 25516 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:13.850256 21877 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:13.833391 21805 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
W20260709 13:09:13.866284 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:13.866977 22449 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:13.876667 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:13.880789 21805 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:13.886955 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:13.888922 22448 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:13.890487 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:13.891563 21907 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:13.861020 25390 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.894606 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:13.813060 25583 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:13.901994 25487 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:13.843346 25501 consensus_queue.cc:237] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:13.902972 25542 consensus_queue.cc:1059] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:13.903944 25542 raft_consensus.cc:3055] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:13.904323 25542 raft_consensus.cc:740] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:13.880088 25600 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:13.907063 21879 leader_election.cc:336] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.536s (SENT)
I20260709 13:09:13.907557 21879 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:13.908309 25573 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:13.909727 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:13.910395 21910 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:09:13.912676 21910 raft_consensus.cc:1240] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:13.919502 21910 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:13.920908 21907 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:09:13.920827 25366 consensus_queue.cc:1059] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:13.922767 25583 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:13.914074 25537 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:13.934520 22449 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:13.911906 25390 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:13.949242 22449 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:13.932582 25537 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:13.912127 25542 consensus_queue.cc:260] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:13.950789 25014 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:14.015363 25014 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.015825 25014 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:13.991478 25390 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:13.991592 25600 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:13.992285 25503 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:14.022940 25299 consensus_queue.cc:1175] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6d698a5544b946939790e7a3972db9fb" responder_term: 10 status { last_received { term: 10 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 10 index: 8 } }
I20260709 13:09:13.977017 25537 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:13.982892 25374 tablet_copy_client.cc:538] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:13.973471 25561 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:13.970468 25343 consensus_queue.cc:1059] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:09:14.048089 25343 raft_consensus.cc:3055] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:14.048629 25343 raft_consensus.cc:740] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:14.049393 25561 raft_consensus.cc:697] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:14.049757 25343 consensus_queue.cc:260] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:14.050487 25561 consensus_queue.cc:237] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:14.051450 25343 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:14.009109 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 346247us
I20260709 13:09:14.009618 25437 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:14.054056 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:14.054639 25522 consensus_queue.cc:1048] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:14.055655 21758 raft_consensus.cc:1275] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:14.056483 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:14.056725 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:14.057231 21756 raft_consensus.cc:2393] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:14.057279 21762 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:09:14.057761 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:14.058236 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:14.058458 21760 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:09:14.059022 21763 raft_consensus.cc:2410] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:09:14.059384 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:14.010342 25446 raft_consensus.cc:697] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:09:14.010442 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 328087us
I20260709 13:09:14.010977 25595 raft_consensus.cc:697] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:14.012812 21731 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:14.014642 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:14.063858 22480 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
W20260709 13:09:14.027257 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.011096 25473 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:13.992563 25542 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:14.061995 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 181294us
I20260709 13:09:14.083493 21805 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
W20260709 13:09:14.062678 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 171668us
I20260709 13:09:14.088795 25554 consensus_queue.cc:1059] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:14.088883 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:14.090328 25516 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:14.092396 25466 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:14.092654 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 79911.2us
I20260709 13:09:14.094477 21731 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:14.095887 25554 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:14.096329 25554 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:14.096671 25554 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:14.097855 25503 raft_consensus.cc:3055] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:14.098263 25503 raft_consensus.cc:740] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:14.099260 25503 consensus_queue.cc:260] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:14.100818 25503 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.068133 25473 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:14.068573 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:14.101691 25473 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:14.070749 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:14.070905 25595 consensus_queue.cc:237] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:14.072364 25014 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:14.068755 25437 consensus_queue.cc:1059] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
W20260709 13:09:14.073689 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 155079us
I20260709 13:09:14.068508 25588 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:14.106019 25588 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:14.106410 25588 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:14.107203 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.108351 21728 leader_election.cc:400] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 8. Current term is 9.
I20260709 13:09:14.108662 21728 leader_election.cc:403] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:09:14.074963 25556 consensus_queue.cc:1059] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:14.070818 25446 consensus_queue.cc:237] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:14.112098 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:14.114038 22477 raft_consensus.cc:1275] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:14.115797 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:14.108750 25014 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:14.118399 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:14.120402 22477 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:14.125468 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:14.130666 21728 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:14.132645 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:14.143175 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 201022us
I20260709 13:09:14.143447 21728 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
W20260709 13:09:14.144086 21879 leader_election.cc:336] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.599s (SENT)
I20260709 13:09:14.144680 21879 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:14.150890 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.167532 21728 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:14.168779 21728 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:14.175328 21728 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:14.181447 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:14.182085 21905 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:14.185827 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:14.197227 21760 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:14.203778 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:14.133060 25204 raft_consensus.cc:2804] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:14.142226 25596 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:14.210737 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:14.214970 21728 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:14.100625 25537 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:14.172857 25467 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:14.221993 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:14.174403 25309 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:14.231599 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:14.200899 25583 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:14.173717 25437 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:09:14.212797 25215 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:09:14.194322 25373 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:14.241371 21728 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:14.213241 25204 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.220351 25600 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:14.249946 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 119593us
I20260709 13:09:14.249892 25600 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:14.252717 25600 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:14.219539 25595 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:14.225467 21905 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:09:14.219310 25560 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:14.223248 25625 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:14.257830 22449 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:14.238871 25583 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.262133 21765 raft_consensus.cc:1240] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:14.247588 25373 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.254479 25204 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:14.230605 25522 consensus_queue.cc:1048] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:09:14.258347 25309 raft_consensus.cc:697] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:14.289085 21764 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:14.249075 25399 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:09:14.290000 21762 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:09:14.264245 24937 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:14.264796 25583 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:14.278403 25600 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:14.278832 25373 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:14.277137 25595 consensus_queue.cc:1059] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
W20260709 13:09:14.318743 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 134843us
W20260709 13:09:14.328474 25628 log.cc:927] Time spent T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:09:14.317008 25600 raft_consensus.cc:697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:14.330426 25600 consensus_queue.cc:237] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:14.301357 24937 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:14.341166 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 255649us
I20260709 13:09:14.321637 25467 raft_consensus.cc:3055] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:14.338106 24937 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:14.339753 25429 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.335930 25636 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:09:14.360172 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 100763us
I20260709 13:09:14.349270 25467 raft_consensus.cc:740] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:14.376941 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:14.381404 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:14.384474 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:14.377732 21837 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:09:14.386113 21839 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:14.368305 25516 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.362702 25429 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:14.363626 25636 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:14.410701 22448 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:14.388177 25061 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.385242 25399 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:14.406579 25638 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:09:14.435793 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.366315 25309 consensus_queue.cc:237] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:14.445358 25638 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:14.448516 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.450531 25638 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:14.451934 25429 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:14.441583 25399 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:14.427713 25561 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:14.461891 25561 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:14.462312 25561 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:14.461485 25373 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:14.412776 25516 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:14.424055 25374 tablet_bootstrap.cc:492] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:09:14.442382 25061 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:14.489759 25633 log.cc:927] Time spent T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 13:09:14.493064 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:14.494144 25641 log.cc:927] Time spent T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:14.495496 25061 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:14.499228 25399 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:14.501324 25588 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:14.502494 25625 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:14.506258 21833 raft_consensus.cc:1240] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:14.516222 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:14.486902 25646 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.519368 25646 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:14.533092 22484 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
W20260709 13:09:14.525203 21661 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45762 (request call id 243) took 19303 ms (client timeout 15000 ms). Trace:
I20260709 13:09:14.420610 25467 consensus_queue.cc:260] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:14.545650 24937 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:14.551893 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 137322us
I20260709 13:09:14.468796 25516 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:14.526403 21662 catalog_manager.cc:5697] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 8 to 10, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 10 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.565958 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:14.574577 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:14.575446 22477 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
W20260709 13:09:14.543141 21661 rpcz_store.cc:269] 0709 13:08:55.222185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:55.222458 (+   273us) service_pool.cc:224] Handling call
0709 13:09:14.525104 (+19302646us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:06.221978 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:06.222713 (+   735us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:06.222771 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:09:06.222787 (+    16us) tablet.cc:662] Decoding operations
0709 13:09:06.223986 (+  1199us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:06.224058 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:06.224090 (+    32us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:09:06.255174 (+ 31084us) tablet.cc:701] Row locks acquired
0709 13:09:06.271231 (+ 16057us) write_op.cc:260] PREPARE: finished
0709 13:09:06.300183 (+ 28952us) write_op.cc:270] Start()
0709 13:09:06.328633 (+ 28450us) write_op.cc:276] Timestamp: P: 1783602546286966 usec, L: 0
0709 13:09:06.330485 (+  1852us) op_driver.cc:348] REPLICATION: starting
0709 13:09:06.422321 (+ 91836us) log.cc:844] Serialized 5102 byte log entry
0709 13:09:06.542465 (+120144us) op_driver.cc:464] REPLICATION: finished
0709 13:09:06.794024 (+251559us) write_op.cc:301] APPLY: starting
0709 13:09:06.799529 (+  5505us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:06.808791 (+  9262us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:06.808942 (+   151us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:06.813974 (+  5032us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:06.818855 (+  4881us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:09:06.818904 (+    49us) write_op.cc:312] APPLY: finished
0709 13:09:06.819294 (+   390us) log.cc:844] Serialized 95 byte log entry
0709 13:09:06.819471 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:06.819608 (+   137us) write_op.cc:454] Released schema lock
0709 13:09:06.819673 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:06.820052 (+   379us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:06.820085 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":289122,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":236592,"apply.run_cpu_time_us":4085,"apply.run_wall_time_us":36308,"num_ops":13,"prepare.queue_time_us":283650,"prepare.run_cpu_time_us":15459,"prepare.run_wall_time_us":344923,"raft.queue_time_us":1513,"raft.run_cpu_time_us":10853,"raft.run_wall_time_us":145858,"replication_time_us":211778,"spinlock_wait_cycles":18176,"thread_start_us":289724,"threads_started":4,"wal-append.queue_time_us":92305,"wal-append.run_cpu_time_us":4128,"wal-append.run_wall_time_us":1298535}]]}
I20260709 13:09:14.579416 25373 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:14.511636 25473 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:14.582083 25473 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:14.584040 25204 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:14.584455 25583 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:14.586599 25583 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:14.586925 25639 log.cc:927] Time spent T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.163s	user 0.003s	sys 0.000s
I20260709 13:09:14.589120 21758 raft_consensus.cc:1240] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:14.593658 25651 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:14.594280 25651 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:14.596553 25651 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:14.598523 21806 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:14.598968 24937 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:14.599828 25429 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.600598 25314 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:14.600364 25429 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:14.600973 25314 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.601351 25314 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:14.546721 25588 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:14.602661 21662 catalog_manager.cc:5697] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 7 to 10, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 10 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:14.605309 22477 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:14.552516 25636 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:14.620968 21662 catalog_manager.cc:5697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 6 to 7, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 7 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:14.571628 25646 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:14.509820 25554 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:14.653823 21662 catalog_manager.cc:5697] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 6 to 8, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 8 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:09:14.762864 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 297100us
W20260709 13:09:14.768961 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.775837 21662 catalog_manager.cc:5697] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.780661 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:14.660490 25561 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:14.781351 22480 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:09:14.755383 25429 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:14.644304 25596 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 8. Current term is 9.
I20260709 13:09:14.649521 25588 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.711865 25516 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:14.785308 21806 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:14.784732 21662 catalog_manager.cc:5697] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 5 to 6, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 6 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:14.659090 25204 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:14.624325 25556 consensus_queue.cc:1059] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.160s
I20260709 13:09:14.802001 21759 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:14.799153 25636 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:14.823621 21662 catalog_manager.cc:5697] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 5 to 6, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 6 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.794081 25588 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:14.800386 25516 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:14.834288 25412 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:14.823773 25636 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.835956 25636 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:14.838372 25314 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:14.840673 25314 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:14.845288 25636 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:14.848330 25636 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:14.851532 25467 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:14.871897 25537 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:14.879880 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:14.880556 22477 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:14.890780 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:14.891618 21806 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:14.892817 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:14.899096 21832 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:14.901566 21912 raft_consensus.cc:1240] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:14.903126 22477 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:14.904953 25588 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:14.907292 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:14.908476 25313 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:14.909075 25313 raft_consensus.cc:697] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:14.909940 25313 consensus_queue.cc:237] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:14.914076 25554 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:14.915956 25466 raft_consensus.cc:3055] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:14.916383 25466 raft_consensus.cc:740] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:14.917224 25466 consensus_queue.cc:260] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:14.918371 25466 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:14.926383 25656 log.cc:927] Time spent T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.162s	user 0.003s	sys 0.000s
I20260709 13:09:14.930877 25516 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:14.936137 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:14.936818 22484 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:09:14.943929 21805 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:09:14.950929 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 54644.7us
I20260709 13:09:14.953790 21879 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:14.955158 21662 catalog_manager.cc:5697] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 3 to 5, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 5 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.957144 22484 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:14.961095 21760 raft_consensus.cc:1240] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:14.964401 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 63180.2us
I20260709 13:09:14.964905 21759 raft_consensus.cc:1240] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:14.966799 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:14.967309 21879 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:14.968958 21912 raft_consensus.cc:2393] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 10: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:14.969733 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:14.970767 21906 raft_consensus.cc:1240] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:14.971457 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:14.973510 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:14.975569 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:14.978945 21905 raft_consensus.cc:2393] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 9: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:14.962770 25588 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:14.980424 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:14.955291 25636 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:09:14.984066 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:14.981688 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:14.984896 21913 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:14.982486 21905 raft_consensus.cc:2368] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 8. Current term is 9.
I20260709 13:09:14.965670 25516 consensus_queue.cc:1059] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:09:14.983348 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:14.959335 25310 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:09:14.986816 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:14.958504 25554 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:09:14.958074 25573 consensus_queue.cc:1048] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:09:14.970479 25501 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:14.992499 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:14.996203 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:14.981536 25626 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:14.966198 25314 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:09:15.003118 21912 raft_consensus.cc:1240] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:09:15.004240 25535 raft_consensus.cc:3055] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:14.990021 25061 consensus_queue.cc:1059] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:09:15.000623 25390 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:15.010879 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:15.012977 21907 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:14.991009 25561 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:15.109990 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 106528us
I20260709 13:09:15.112685 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:15.120262 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:15.121253 21914 raft_consensus.cc:2368] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10.
I20260709 13:09:15.021257 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:15.114174 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:15.093482 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:15.118289 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:15.123908 21759 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:09:15.117470 21907 raft_consensus.cc:1240] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:15.123962 21908 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:15.109402 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 107464us
I20260709 13:09:15.130012 25061 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.131042 25061 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:15.132333 21877 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:15.134128 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:15.135226 25371 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:15.139211 25332 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:15.141611 25061 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:15.015888 25381 raft_consensus.cc:3055] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:15.028266 25390 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:15.085734 21662 catalog_manager.cc:5697] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 7 to 8, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 8 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.157405 25390 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:15.159544 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:15.041815 25626 raft_consensus.cc:3055] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:15.164258 25381 raft_consensus.cc:740] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:15.165947 25381 consensus_queue.cc:260] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:15.167546 25381 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:15.171448 25646 raft_consensus.cc:3055] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:15.171957 25646 raft_consensus.cc:740] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:15.173897 25299 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.174750 25299 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:15.176311 25626 raft_consensus.cc:740] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:09:15.179610 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 656591us
W20260709 13:09:15.182426 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.173357 25646 consensus_queue.cc:260] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:15.198170 25204 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:09:15.200194 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:15.200542 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:15.227991 21759 raft_consensus.cc:3055] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:15.228284 21912 raft_consensus.cc:1275] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:15.228477 21759 raft_consensus.cc:740] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:15.230240 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:15.203503 25299 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:15.235280 21909 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:09:15.018067 25535 raft_consensus.cc:740] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:15.242084 25646 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:15.253264 21908 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:15.251899 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:15.256012 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:15.262235 21759 consensus_queue.cc:260] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:15.263532 21759 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:15.264835 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:15.266101 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:15.267371 21913 raft_consensus.cc:2393] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 9: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:15.268244 21911 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:15.281859 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:15.283358 21910 raft_consensus.cc:2368] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9.
I20260709 13:09:15.285049 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:15.286077 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:15.286679 21765 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:15.286405 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:15.287456 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:15.287854 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:15.288174 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:15.288579 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:15.290714 25535 consensus_queue.cc:260] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:15.292479 25535 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:15.246371 24937 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.295768 24937 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:15.297607 21760 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:09:15.298197 21758 raft_consensus.cc:2393] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 8: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:15.286093 21906 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:15.300400 24937 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:15.301229 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:15.305684 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:15.306032 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.321813 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:15.322957 21836 raft_consensus.cc:2393] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 12: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:15.324149 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:15.325037 21840 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:15.326149 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:15.327231 21756 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:15.328255 21662 catalog_manager.cc:5697] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 4 to 6, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 6 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.332110 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:15.332931 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:15.333711 21762 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:09:15.334239 25412 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:15.334781 25412 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:15.337178 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1423) took 1142 ms. Trace:
I20260709 13:09:15.339852 25399 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.340869 25215 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:15.340583 25399 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:15.341841 25644 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:15.342799 25644 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:15.337731 21763 rpcz_store.cc:276] 0709 13:09:14.195025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.199624 (+  4599us) service_pool.cc:224] Handling call
0709 13:09:14.223553 (+ 23929us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:14.225746 (+  2193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.225791 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:14.236712 (+ 10921us) log.cc:844] Serialized 52 byte log entry
0709 13:09:14.367660 (+130948us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:14.409178 (+ 41518us) log.cc:844] Serialized 14 byte log entry
0709 13:09:14.411595 (+  2417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:14.411667 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:14.664134 (+252467us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b1800292d80. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab2382a6 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab26a3f3 00007fc6ab26c7c1
0709 13:09:15.178094 (+513960us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b1800292d80. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab1e4c0a 00007fc6b4924219 00007fc6b222b58f 00007fc6ab26a571 00007fc6ab26c7c1 00007fc6ab26c779 00007fc6ab26c709 00007fc6ab26c6d1 00007fc6ab26b9cd
0709 13:09:15.333768 (+155674us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b1800292d80. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab26a3f3 00007fc6ab26c7c1 00007fc6ab26c779 00007fc6ab26c709 00007fc6ab26c6d1 00007fc6ab26b9cd 000000000038f354 000000000038f199 00007fc6ab24d83a
0709 13:09:15.336572 (+  2804us) raft_consensus.cc:1685] finished
0709 13:09:15.336604 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.336927 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28767,"prepare.queue_time_us":38948,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":4935,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":17038,"spinlock_wait_cycles":57714304,"thread_start_us":101903,"threads_started":1,"wal-append.queue_time_us":185666}
I20260709 13:09:15.347891 25399 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:15.348152 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:15.370472 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:15.371292 21833 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:15.331526 21662 catalog_manager.cc:5697] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:15.374712 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:15.375106 21662 catalog_manager.cc:5697] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 5 to 6, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 6 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:15.376439 21912 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:15.393054 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:15.362591 25215 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:15.400143 21759 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:15.359361 25644 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:15.377077 21662 catalog_manager.cc:5697] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 4 to 6, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 6 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.418963 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:15.420711 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:15.721261 21835 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:15.721391 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.453594 22479 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:15.434859 22480 raft_consensus.cc:1240] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:15.724238 21911 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:15.454479 22478 raft_consensus.cc:1240] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:15.440255 21840 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:09:15.462919 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:09:15.434482 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:15.597364 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.448335 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1976) took 1068 ms. Trace:
W20260709 13:09:15.442085 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 49941.5us
I20260709 13:09:15.441005 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1431) took 1216 ms. Trace:
I20260709 13:09:15.458415 21837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 1981) took 1050 ms. Trace:
I20260709 13:09:15.448324 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:15.451553 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:15.740401 21838 raft_consensus.cc:1240] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:09:15.742230 21836 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:15.455116 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:15.437077 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:15.452419 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:15.744899 21833 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:15.438230 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:15.745326 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:15.746928 21911 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
I20260709 13:09:15.601118 25626 consensus_queue.cc:260] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:15.749884 25626 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:15.750032 21840 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:15.752225 21834 raft_consensus.cc:2410] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:15.438887 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:15.762732 22481 raft_consensus.cc:2393] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 8: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:09:15.740504 25672 log.cc:927] Time spent T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 13:09:15.762732 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.643522 25675 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:15.551769 25412 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:15.766571 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:15.767176 21839 raft_consensus.cc:1275] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:09:15.767310 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:15.767755 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.797639 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:15.766634 21662 catalog_manager.cc:5697] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 7 to 8, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 8 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.732597 21837 rpcz_store.cc:276] 0709 13:09:14.408421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.410060 (+  1639us) service_pool.cc:224] Handling call
0709 13:09:14.415016 (+  4956us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:14.762773 (+347757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.762818 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:14.763273 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:09:14.951381 (+188108us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:14.951417 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.457817 (+506400us) spinlock_profiling.cc:243] Waited 55.6 ms on lock 0x7b540033a9d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:15.457875 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:15.457952 (+    77us) raft_consensus.cc:1685] finished
0709 13:09:15.457965 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.458251 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11490,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":1975,"spinlock_wait_cycles":127876992,"thread_start_us":459424,"threads_started":2,"wal-append.queue_time_us":221261}
I20260709 13:09:15.773535 25646 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.774191 21832 raft_consensus.cc:2393] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 8: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:15.774747 25381 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:15.775218 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.775581 21806 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:15.776084 21913 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:15.730486 21761 rpcz_store.cc:276] 0709 13:09:14.224159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.224422 (+   263us) service_pool.cc:224] Handling call
0709 13:09:14.243596 (+ 19174us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:14.363460 (+119864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:14.363489 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:14.366488 (+  2999us) log.cc:844] Serialized 26 byte log entry
0709 13:09:14.470059 (+103571us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:14.539819 (+ 69760us) log.cc:844] Serialized 14 byte log entry
0709 13:09:15.440502 (+900683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.440608 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:15.440664 (+    56us) raft_consensus.cc:1685] finished
0709 13:09:15.440683 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.440840 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":658449,"prepare.queue_time_us":69462,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":663931,"raft.run_cpu_time_us":432,"raft.run_wall_time_us":6211,"thread_start_us":342984,"threads_started":3,"wal-append.queue_time_us":95462,"wal-append.run_cpu_time_us":2637,"wal-append.run_wall_time_us":1088617}
I20260709 13:09:15.782613 21908 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:15.784818 21911 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:15.789636 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:15.790442 25390 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.727653 21831 rpcz_store.cc:276] 0709 13:09:14.379549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:14.379683 (+   134us) service_pool.cc:224] Handling call
0709 13:09:14.379982 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:14.446903 (+ 66921us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:15.106510 (+659607us) log.cc:844] Serialized 14 byte log entry
0709 13:09:15.247998 (+141488us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:15.253464 (+  5466us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:15.305569 (+ 52105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:15.446772 (+141203us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b18003f4060. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab2382a6 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419
0709 13:09:15.447766 (+   994us) spinlock_profiling.cc:243] Waited 66.7 ms on lock 0x7b5400147654. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:15.447824 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:15.448099 (+   275us) inbound_call.cc:177] Queueing success response
0709 13:09:15.450552 (+  2453us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b18003f4060. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab26a522 00007fc6ab26c7c1 00007fc6ab26c779 00007fc6ab26c709 00007fc6ab26c6d1 00007fc6ab26b9cd 000000000038f354 000000000038f199 00007fc6ab24d83a
Metrics: {"mutex_wait_us":493520,"prepare.queue_time_us":510556,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":2302,"raft.queue_time_us":18887,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":20642,"spinlock_wait_cycles":250219904,"thread_start_us":287991,"threads_started":2,"wal-append.queue_time_us":148646}
W20260709 13:09:15.793735 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.796409 22478 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:15.801103 25576 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:15.807009 21840 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:15.815639 21835 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:09:15.818647 21833 raft_consensus.cc:2410] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:09:15.818092 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 359584us
W20260709 13:09:15.821485 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 67426.2us
I20260709 13:09:15.824205 22449 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:15.816485 25299 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.803825 25646 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:15.830848 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.830116 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:15.827764 21907 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:09:15.816661 25390 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:15.835029 25595 consensus_queue.cc:1059] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:09:15.819444 25215 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:15.847256 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.849092 25503 consensus_queue.cc:1048] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:09:15.849402 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:15.869833 25497 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.872246 21806 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:15.845032 25629 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:15.831117 25381 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:15.876317 25313 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:15.876626 25390 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:15.876701 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:15.877689 21914 raft_consensus.cc:2393] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 9: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:15.828326 25675 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:15.880648 25675 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:15.882895 21731 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:15.850473 25299 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:15.839885 25576 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:15.901494 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:15.902281 21909 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:15.873775 25629 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:15.902192 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 71715.5us
I20260709 13:09:15.887439 25644 raft_consensus.cc:3055] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:15.908717 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:15.887449 25215 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:15.915940 21906 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:09:15.920680 25412 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:15.920806 25553 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.921567 25553 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:15.922137 25412 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:15.922691 25412 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:15.923882 25553 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:15.924639 25553 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.924830 25412 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:15.906607 25503 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:15.909421 25644 raft_consensus.cc:740] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:15.925215 25553 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:15.925758 25503 raft_consensus.cc:697] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:15.926729 25644 consensus_queue.cc:260] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:15.926997 25503 consensus_queue.cc:237] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:15.927855 25644 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:15.917737 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:15.906761 25629 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:15.894121 25595 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:09:15.937817 25299 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:15.942113 21761 raft_consensus.cc:1240] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:15.944324 22482 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:15.901829 25497 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:15.965759 21760 raft_consensus.cc:2410] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:09:15.944437 25215 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:15.968492 25381 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:15.968205 25215 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:15.969915 25381 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.970435 25381 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:15.970960 25215 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:15.972726 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:15.973308 21761 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:15.973985 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:15.967399 21879 leader_election.cc:336] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.819s (SENT)
I20260709 13:09:15.984575 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:15.987998 21759 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:15.989107 25374 tablet_bootstrap.cc:492] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:16.001185 21760 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:16.005164 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:16.020577 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 72589.8us
I20260709 13:09:16.020772 25553 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:16.021474 21879 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.593s (SENT) [suppressed 42 similar messages]
I20260709 13:09:16.029407 21761 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:16.041128 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:16.043695 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:09:16.048588 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 199815us
W20260709 13:09:16.050630 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 226527us
I20260709 13:09:16.048723 25374 tablet_bootstrap.cc:492] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:09:16.045675 25576 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:16.051107 25381 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:16.062772 21759 raft_consensus.cc:2376] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10. Re-sending same reply.
I20260709 13:09:16.057538 25313 raft_consensus.cc:697] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:16.067770 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:16.068799 21804 leader_election.cc:400] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9.
I20260709 13:09:16.069149 21804 leader_election.cc:403] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:16.069149 25313 consensus_queue.cc:237] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:16.069936 25503 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9.
I20260709 13:09:16.070848 21804 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:16.071805 25684 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:16.072232 25684 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.072603 25684 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:16.072715 25381 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:16.073578 25381 consensus_queue.cc:1243] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer 6d698a5544b946939790e7a3972db9fb log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:09:16.074000 21805 leader_election.cc:336] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.577s (SENT)
I20260709 13:09:16.074093 21804 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:16.075012 25412 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:16.075428 25412 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.075814 25412 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:16.077634 25595 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.078168 25595 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:16.078323 25390 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:16.079883 21833 raft_consensus.cc:1240] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:16.082851 21761 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:09:16.083261 21761 pending_rounds.cc:85] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 4
I20260709 13:09:16.074620 21805 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:16.087201 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:16.084805 21761 pending_rounds.cc:107] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:09:16.090231 21761 raft_consensus.cc:2889] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:16.090760 25215 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.091495 25374 ts_tablet_manager.cc:1403] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 1.721s	user 0.057s	sys 0.024s
I20260709 13:09:16.093309 21759 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:16.095640 25646 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:16.098703 21647 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 291227c6f9914476b4363d40f7cfebb8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:09:16.099196 25688 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:16.099113 25683 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:09:16.104210 21763 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:16.097399 25497 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:16.105834 25215 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:16.111995 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:16.112622 21911 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:16.114665 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:16.115473 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:16.116932 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:16.115693 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:16.117700 21835 raft_consensus.cc:2393] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 10: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:16.119529 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:16.120698 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:16.121024 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:16.121308 21760 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:16.122720 21728 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:16.121870 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:09:16.125764 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 123328us
I20260709 13:09:16.124308 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:16.127655 21763 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:16.126308 21880 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:09:16.129827 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 55959.6us
I20260709 13:09:16.129477 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:16.127054 25686 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:16.131151 21832 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
I20260709 13:09:16.136770 21804 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:16.137116 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:16.137930 22482 raft_consensus.cc:2410] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:09:16.138939 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:16.139688 22478 raft_consensus.cc:2393] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 11: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:16.122509 25646 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.142005 21836 raft_consensus.cc:1240] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:16.127240 25595 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:16.144106 21913 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:09:16.144162 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:16.144613 25687 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:16.149890 25684 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:16.150897 25412 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:16.151006 25374 raft_consensus.cc:359] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:16.151988 25374 raft_consensus.cc:740] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
W20260709 13:09:16.155126 21805 leader_election.cc:336] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.650s (SENT)
I20260709 13:09:16.155634 21805 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:16.156456 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:16.157816 25684 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:16.161902 21837 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:09:16.152729 25374 consensus_queue.cc:260] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:16.167094 21804 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:09:16.168646 25681 log.cc:927] Time spent T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.333s	user 0.007s	sys 0.000s
I20260709 13:09:16.170440 21837 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:16.171694 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:16.172688 21837 raft_consensus.cc:2410] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:09:16.174388 25553 consensus_queue.cc:1059] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:16.175442 25553 consensus_queue.cc:1059] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:16.176739 25553 raft_consensus.cc:3055] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:09:16.176905 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.177708 25084 raft_consensus.cc:3055] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:16.178076 25084 raft_consensus.cc:740] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:09:16.178887 21879 leader_election.cc:336] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.081s (SENT)
I20260709 13:09:16.179052 25084 consensus_queue.cc:260] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:16.180372 25084 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.177085 25553 raft_consensus.cc:740] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:09:16.182231 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.182811 25553 consensus_queue.cc:260] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:16.183534 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:16.179392 21879 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:16.184613 25553 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.185390 25215 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:16.185495 25396 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:16.147341 25687 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:16.207727 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 61347.3us
I20260709 13:09:16.208600 21804 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:16.163578 25684 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:16.153273 25412 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:16.188174 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:16.226584 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.227653 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:16.155393 25595 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
W20260709 13:09:16.231607 21805 leader_election.cc:336] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.665s (SENT)
I20260709 13:09:16.232362 22476 raft_consensus.cc:1217] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEARNER]: Deduplicated request from leader. Original: 10.6->[10.7-10.7]   Dedup: 10.7->[]
I20260709 13:09:16.194689 25687 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:16.165413 25646 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:16.238397 21879 leader_election.cc:336] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.574s (SENT)
I20260709 13:09:16.227049 25381 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:09:16.246500 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 183095us
I20260709 13:09:16.260190 21756 raft_consensus.cc:1240] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:16.260551 21762 raft_consensus.cc:1240] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:16.269088 25381 raft_consensus.cc:697] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:16.233557 25688 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:16.278996 22449 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:16.281467 21836 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:16.238413 25497 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:09:16.291373 21764 raft_consensus.cc:1240] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:16.294426 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 60733.2us
W20260709 13:09:16.295591 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.295940 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.286623 21765 raft_consensus.cc:1240] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:16.294032 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 170420us
I20260709 13:09:16.279465 25688 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.302347 22479 raft_consensus.cc:1240] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:16.301405 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 112871us
I20260709 13:09:16.299963 22448 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:16.305190 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:16.238051 25412 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:09:16.308282 21877 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:16.309966 21806 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:16.315908 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:16.261070 25396 consensus_queue.cc:1059] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:09:16.284210 25685 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:09:16.319080 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 85273.4us
I20260709 13:09:16.307235 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:16.321779 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:16.298612 25683 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:16.323894 21757 raft_consensus.cc:2376] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8. Re-sending same reply.
I20260709 13:09:16.321003 21728 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:16.327913 21833 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
W20260709 13:09:16.329348 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 121011us
I20260709 13:09:16.327050 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:16.331151 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.348495 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.302954 25688 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.322078 25685 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.329107 25503 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:16.395998 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 89832.5us
W20260709 13:09:16.397174 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 118687us
I20260709 13:09:16.327050 25683 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:16.406323 21879 leader_election.cc:336] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.625s (SENT)
I20260709 13:09:16.406920 21879 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:16.401240 25683 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.408130 25576 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:16.411885 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:16.412084 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:16.406610 25691 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:16.417701 25698 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:16.418613 25374 ts_tablet_manager.cc:1434] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.307s	user 0.002s	sys 0.006s
I20260709 13:09:16.419348 25695 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:16.419550 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:16.420042 25695 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:16.422183 25693 log.cc:927] Time spent T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:09:16.396615 25626 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:16.396297 25685 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:16.432329 21728 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:16.442194 21879 leader_election.cc:336] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.213s (SENT)
I20260709 13:09:16.480718 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:09:16.489820 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 181623us
I20260709 13:09:16.492410 21877 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:16.491444 21908 pending_rounds.cc:85] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 3
I20260709 13:09:16.493153 21908 pending_rounds.cc:107] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:09:16.493511 21908 raft_consensus.cc:2889] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:16.502890 21913 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
W20260709 13:09:16.504268 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 72055.6us
I20260709 13:09:16.505725 21877 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:16.498633 21879 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:16.510776 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 117851us
I20260709 13:09:16.375862 25381 consensus_queue.cc:237] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:16.512275 21905 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:16.508584 25215 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.515699 21923 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-d76fbf464db84dbeb90facb1538a9ca1 received from {username='slave'} at 127.0.0.1:45202
I20260709 13:09:16.516376 21923 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-d76fbf464db84dbeb90facb1538a9ca1 on tablet d76fbf464db84dbeb90facb1538a9ca1 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:16.517138 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:16.427081 25695 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:16.522547 21762 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:16.529170 21756 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:16.540076 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:16.540850 21757 raft_consensus.cc:2376] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9. Re-sending same reply.
I20260709 13:09:16.539460 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:16.542665 21911 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
I20260709 13:09:16.543474 21905 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:09:16.546639 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:16.543009 21765 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
W20260709 13:09:16.549499 21805 leader_election.cc:336] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.748s (SENT)
I20260709 13:09:16.549952 21805 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:16.495031 25698 consensus_queue.cc:1048] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
W20260709 13:09:16.550833 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 342300us
W20260709 13:09:16.617743 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 76000.4us
I20260709 13:09:16.571465 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:16.563123 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:16.589385 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 86464us
W20260709 13:09:16.593956 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 164277us
I20260709 13:09:16.542896 25576 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:16.545993 25497 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:16.678562 21765 raft_consensus.cc:2468] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
W20260709 13:09:16.679566 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 135840us
I20260709 13:09:16.587523 25313 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:16.684470 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.549850 25691 raft_consensus.cc:697] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
W20260709 13:09:16.687595 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.687011 22450 leader_election.cc:336] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.736s (SENT)
I20260709 13:09:16.600685 25215 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:16.693907 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 293951us
I20260709 13:09:16.683066 25576 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.704516 25576 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:16.702580 22450 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:16.691396 22449 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:16.688789 25412 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:16.716352 22448 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:16.703855 25710 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:09:16.723867 21879 leader_election.cc:336] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.543s (SENT)
I20260709 13:09:16.757535 25299 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:16.758255 25712 log.cc:927] Time spent T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:16.749260 21879 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:16.791286 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 75006us
I20260709 13:09:16.758213 25299 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:16.761015 25709 log.cc:927] Time spent T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
W20260709 13:09:16.770009 25696 log.cc:927] Time spent T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.339s	user 0.001s	sys 0.000s
W20260709 13:09:16.813998 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 126469us
I20260709 13:09:16.748970 25708 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:16.825378 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.813230 25299 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:16.819229 21805 leader_election.cc:336] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.894s (SENT)
W20260709 13:09:16.821357 25629 consensus_meta.cc:287] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.880s	user 0.012s	sys 0.001s
I20260709 13:09:16.831988 21805 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:16.840195 21805 leader_election.cc:336] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.898s (SENT)
W20260709 13:09:16.841029 25687 consensus_meta.cc:287] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.000s
I20260709 13:09:16.841610 25687 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:16.842186 25503 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:16.844956 25724 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:16.845745 25707 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.132s
W20260709 13:09:16.851182 25084 consensus_meta.cc:287] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.670s	user 0.009s	sys 0.005s
I20260709 13:09:16.827023 25535 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:16.853555 21805 leader_election.cc:336] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.953s (SENT)
W20260709 13:09:16.856400 25702 log.cc:927] Time spent T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.172s	user 0.002s	sys 0.000s
I20260709 13:09:16.859810 25691 consensus_queue.cc:237] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:16.762444 25710 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:16.865834 25710 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:16.866643 21805 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:16.876632 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 157884us
W20260709 13:09:16.844297 25679 log.cc:927] Time spent T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.910s	user 0.009s	sys 0.005s
I20260709 13:09:16.813449 25412 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:16.882983 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.890297 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 208263us
I20260709 13:09:16.843940 25687 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:16.894896 25686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.002s	sys 0.012s
I20260709 13:09:16.891265 25700 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
W20260709 13:09:16.897552 25553 consensus_meta.cc:287] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.712s	user 0.012s	sys 0.001s
I20260709 13:09:16.897897 25630 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.902029 25522 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:16.902304 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 48868.6us
I20260709 13:09:16.902320 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:16.903720 25711 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:09:16.907333 25688 consensus_meta.cc:287] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.000s
I20260709 13:09:16.926798 25688 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:16.928184 25646 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:16.928930 25688 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:16.930081 25710 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:16.930624 25710 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:16.931234 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 426277us
I20260709 13:09:16.931967 21728 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:16.915004 25299 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:16.919718 25390 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:16.932062 25193 raft_consensus.cc:3055] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:16.918349 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.945080 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:16.916839 25686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.002s	sys 0.012s
I20260709 13:09:16.838929 25629 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:16.946178 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:16.966981 21914 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:16.946398 21805 leader_election.cc:336] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.975s (SENT)
I20260709 13:09:16.967705 21805 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:16.946509 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:16.968323 21905 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:16.947497 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.919869 25396 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:16.919518 25695 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:16.922813 25711 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.976387 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:16.949398 25390 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:16.990737 25390 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:16.992749 25396 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:16.993510 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:16.994053 25735 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:16.998471 21905 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:17.002051 21906 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:16.994608 25735 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:17.006925 25695 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:17.008352 25735 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:17.008908 25690 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.009126 25695 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:17.009496 25690 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:17.010640 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:17.027621 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:17.013258 25396 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:17.001108 22482 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:16.947099 25697 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:17.017511 25710 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:17.018575 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 77144.9us
I20260709 13:09:17.019258 25629 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:16.942498 25193 raft_consensus.cc:740] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:17.021049 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:17.011412 21907 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:17.028501 21906 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:16.976181 25698 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:16.967064 25686 raft_consensus.cc:697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:16.985651 25711 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:17.046303 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.083519 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:09:17.103900 21805 leader_election.cc:336] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.995s (SENT)
I20260709 13:09:17.104390 21911 raft_consensus.cc:2368] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 12. Current term is 13.
I20260709 13:09:17.104360 21805 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:17.048039 25688 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.082204 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:17.051805 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:16.922363 25630 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:17.046973 25735 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:09:17.083006 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 95813.3us
I20260709 13:09:17.087903 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:17.088285 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:17.093353 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.037660 25644 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:17.099200 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:17.069968 25683 consensus_meta.cc:287] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.662s	user 0.011s	sys 0.000s
I20260709 13:09:17.100180 21804 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:17.088661 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:17.101714 25686 consensus_queue.cc:237] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.105348 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:17.020133 25522 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:17.106639 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 59284us
I20260709 13:09:17.108616 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:17.056656 25215 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:17.049817 25695 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.112072 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:17.047859 25576 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.116153 21840 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:17.118767 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:17.126190 22480 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:17.084786 25390 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:17.126678 21831 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:17.151485 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:17.123616 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:17.154686 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:17.111481 25698 raft_consensus.cc:697] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:09:17.155385 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 223515us
I20260709 13:09:17.151788 21912 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:17.158231 21905 raft_consensus.cc:1240] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:17.126176 25646 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:17.122018 25313 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:17.160707 21729 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:17.160149 21877 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:17.112682 25688 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:17.166363 25736 log.cc:927] Time spent T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:09:17.156965 25390 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:17.178821 25630 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:17.180315 25576 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:17.149978 25215 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:17.182097 25497 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:17.117238 25644 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:17.185707 22481 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:17.176038 21877 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:17.122394 25735 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:17.206631 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.110141 25697 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:17.194273 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 90406.4us
I20260709 13:09:17.192539 21760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2799) took 1064 ms. Trace:
I20260709 13:09:17.158102 21837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:09:17.208544 21837 raft_consensus.cc:606] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:17.209597 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:17.206701 22484 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:17.157883 25695 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:17.121780 25683 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:17.164476 25412 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:17.204267 21914 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:17.200343 21906 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:17.189239 25739 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:17.208750 21877 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:17.210265 21908 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:17.230906 21840 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:17.209926 25299 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:17.274042 25728 log.cc:927] Time spent T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.301s	user 0.004s	sys 0.000s
I20260709 13:09:17.274159 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:17.274936 21907 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:09:17.238480 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:17.204115 25646 raft_consensus.cc:697] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:09:17.269372 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 60711.8us
I20260709 13:09:17.278700 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:17.279222 21840 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:17.203327 25685 consensus_meta.cc:287] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.672s	user 0.008s	sys 0.003s
I20260709 13:09:17.272395 25690 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:17.208897 25576 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:17.279160 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:17.282481 21839 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
W20260709 13:09:17.280853 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 132056us
I20260709 13:09:17.281327 22483 raft_consensus.cc:1240] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:17.285790 25738 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:17.285912 25743 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.286409 25738 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.286557 25743 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.286777 25646 consensus_queue.cc:237] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.288673 25738 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:17.290480 25744 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:09:17.290904 25697 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:17.292295 25737 log.cc:927] Time spent T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:09:17.233006 25503 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:09:17.208189 25711 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:17.275756 25698 consensus_queue.cc:237] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.296243 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:17.280802 25497 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:17.289151 25743 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:17.314213 21840 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:17.208082 21760 rpcz_store.cc:276] 0709 13:09:16.127712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.127849 (+   137us) service_pool.cc:224] Handling call
0709 13:09:16.138212 (+ 10363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:16.296881 (+158669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:16.304580 (+  7699us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:16.363445 (+ 58865us) log.cc:844] Serialized 26 byte log entry
0709 13:09:16.546864 (+183419us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:16.589657 (+ 42793us) log.cc:844] Serialized 14 byte log entry
0709 13:09:16.854349 (+264692us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b1800052fc0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab26a3f3 00007fc6ab26c7c1 00007fc6ab26c779 00007fc6ab26c709 00007fc6ab26c6d1 00007fc6ab26b9cd 000000000038f354 000000000038f199 00007fc6ab24d83a
0709 13:09:17.163747 (+309398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.163798 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:17.163826 (+    28us) raft_consensus.cc:1685] finished
0709 13:09:17.177733 (+ 13907us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:17.192457 (+ 14724us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":377673,"prepare.queue_time_us":70247,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":36,"raft.queue_time_us":417080,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":8166,"spinlock_wait_cycles":7947520,"thread_start_us":525637,"threads_started":3,"wal-append.queue_time_us":293684}
W20260709 13:09:17.315649 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 162758us
I20260709 13:09:17.283542 25576 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:17.326531 21729 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:17.278090 25691 consensus_queue.cc:1059] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:09:17.329227 22450 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:17.330309 21840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:09:17.331081 21840 raft_consensus.cc:606] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:17.333030 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:17.316118 25497 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:17.282755 25685 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:17.315167 25390 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:17.326349 25576 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:17.340431 25497 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:17.344290 25644 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:17.347184 25691 raft_consensus.cc:3055] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:17.347643 25691 raft_consensus.cc:740] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:17.347981 21834 raft_consensus.cc:2393] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 13: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:17.302423 25708 consensus_queue.cc:1059] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:09:17.347661 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:17.360301 22476 raft_consensus.cc:2368] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 10. Current term is 11.
I20260709 13:09:17.348657 25691 consensus_queue.cc:260] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:17.338022 25742 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:17.429986 21908 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
I20260709 13:09:17.433880 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:17.439980 21840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:09:17.445999 21840 raft_consensus.cc:606] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:17.446434 21840 raft_consensus.cc:614] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:17.450013 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 128859us
I20260709 13:09:17.347654 25685 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:17.467229 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:17.446725 25215 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:17.469321 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 140157us
W20260709 13:09:17.472316 25753 log.cc:927] Time spent T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:09:17.472507 25733 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:09:17.474100 25754 log.cc:927] Time spent T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:09:17.475692 25748 log.cc:927] Time spent T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:09:17.478991 25749 log.cc:927] Time spent T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:09:17.472720 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:17.491417 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:17.462308 25735 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:17.465399 25695 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:17.517804 21840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:09:17.518682 21840 raft_consensus.cc:606] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:17.519182 21840 raft_consensus.cc:614] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:17.473317 25733 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:17.523524 25733 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:17.526055 21729 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:17.530751 25730 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:09:17.548782 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 143225us
I20260709 13:09:17.558773 21840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
W20260709 13:09:17.559518 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.559656 21840 raft_consensus.cc:606] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
W20260709 13:09:17.563059 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.548800 25497 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.564083 25691 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:17.567283 25497 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:17.567903 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.569020 21729 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:17.570304 21729 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:17.571019 25695 consensus_queue.cc:1059] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:17.571102 25626 consensus_queue.cc:1059] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:17.571961 21879 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:17.572513 25686 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:17.572856 25626 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:17.572803 25553 raft_consensus.cc:3055] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:17.572116 25695 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:17.547325 25215 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:17.578166 25687 consensus_queue.cc:1059] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:17.578991 25553 raft_consensus.cc:740] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:17.579996 25553 consensus_queue.cc:260] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.581398 25690 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:17.582065 25690 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:17.582899 25553 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:17.583772 25687 raft_consensus.cc:3055] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:17.584200 25687 raft_consensus.cc:740] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:17.585112 25687 consensus_queue.cc:260] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.585604 21879 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:17.586441 25687 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:17.587706 25710 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:17.588177 25396 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:17.588898 25710 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:17.590049 21879 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:17.591740 21879 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:17.592487 25497 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:17.593166 25497 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:09:17.593704 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 316710us
I20260709 13:09:17.563045 25193 consensus_queue.cc:260] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.595328 25193 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:17.597949 25313 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:17.598615 25313 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.599241 21729 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:17.564213 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:17.601262 25688 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:17.557569 25711 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:17.598074 25690 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:17.573220 25686 raft_consensus.cc:3055] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:09:17.603018 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:17.601738 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:17.614266 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:17.608968 21877 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:17.614519 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:17.605634 25576 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.606954 21729 leader_election.cc:400] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 8. Current term is 9.
I20260709 13:09:17.607124 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:17.608182 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:17.615438 21877 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:09:17.617499 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 341191us
I20260709 13:09:17.602209 25215 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:17.631814 21837 raft_consensus.cc:1240] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:09:17.593534 25497 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:17.633215 21831 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:09:17.633831 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:17.637881 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:17.633405 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:17.641280 21832 raft_consensus.cc:2393] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 11: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:17.639807 21839 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:17.642792 22476 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:09:17.644454 25313 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:17.645548 25576 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:17.646190 25396 consensus_queue.cc:1059] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:17.647095 25396 raft_consensus.cc:3055] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:17.620800 25710 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:17.616003 25686 raft_consensus.cc:740] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:17.647449 25396 raft_consensus.cc:740] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:09:17.658771 22450 leader_election.cc:336] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.514s (SENT)
W20260709 13:09:17.663081 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 56311.1us
I20260709 13:09:17.663172 22450 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:17.610857 25412 consensus_queue.cc:1059] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:09:17.630363 25626 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:17.665020 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:17.640630 25497 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.620373 25734 consensus_queue.cc:1059] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:09:17.666324 25553 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.670310 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:17.657990 25710 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.673070 25553 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.677929 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:17.680481 21832 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:09:17.679644 21729 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:17.667754 25691 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:17.670329 25626 raft_consensus.cc:697] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:17.679930 25710 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:17.687456 25396 consensus_queue.cc:260] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:17.694811 25695 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:17.692162 25686 consensus_queue.cc:260] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.708282 25626 consensus_queue.cc:237] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.709012 25686 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.708945 22483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36270 (request call id 643) took 1414 ms. Trace:
I20260709 13:09:17.714322 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:17.712276 21879 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:17.715166 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:17.711957 22483 rpcz_store.cc:276] 0709 13:09:16.294888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.295010 (+   122us) service_pool.cc:224] Handling call
0709 13:09:16.319270 (+ 24260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:17.299999 (+980729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:17.708680 (+408681us) spinlock_profiling.cc:243] Waited 962 ms on lock 0x7b54004fd8d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:17.708864 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2212031360}
I20260709 13:09:17.715864 21832 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
W20260709 13:09:17.717607 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 47946us
I20260709 13:09:17.697276 25733 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:17.726516 22450 leader_election.cc:336] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.964s (SENT)
I20260709 13:09:17.727483 21729 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:17.729545 21911 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:17.725761 25084 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:17.732862 21729 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:17.734407 25553 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:17.734970 25735 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:17.741003 25695 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:17.747956 25497 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.749508 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:17.752000 22483 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:17.757171 25742 consensus_queue.cc:1059] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:17.758530 25742 raft_consensus.cc:3055] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:17.758896 25742 raft_consensus.cc:740] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:17.759886 25742 consensus_queue.cc:260] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.761142 25742 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:17.761392 25733 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:17.766000 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.766976 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 54762.3us
I20260709 13:09:17.769943 25727 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.729755 25215 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:17.782410 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 55926.8us
W20260709 13:09:17.785357 21834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38352 (request call id 2917) took 1625 ms (client timeout 1882 ms). Trace:
W20260709 13:09:17.787434 21834 rpcz_store.cc:269] 0709 13:09:16.151039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.153062 (+  2023us) service_pool.cc:224] Handling call
0709 13:09:17.772780 (+1619718us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b5400186854. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:17.776460 (+  3680us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2739478144}
I20260709 13:09:17.797899 25412 raft_consensus.cc:3055] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:09:17.798383 25412 raft_consensus.cc:740] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:17.799211 25412 consensus_queue.cc:260] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:17.800377 25720 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.800953 25720 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.803011 25720 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:17.803562 25497 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:17.804917 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 90944.3us
I20260709 13:09:17.805621 21804 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:17.806442 21804 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:17.807852 25729 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:17.809276 25714 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:17.810061 25714 raft_consensus.cc:697] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:17.810978 25714 consensus_queue.cc:237] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.807876 21804 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:09:17.814165 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 176638us
I20260709 13:09:17.815840 25744 raft_consensus.cc:993] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:09:17.816373 25744 raft_consensus.cc:1081] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
W20260709 13:09:17.816726 21805 connection.cc:256] RPC call timeout handler was delayed by -1.0066764239999202s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2451s for a response
I20260709 13:09:17.817930 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:17.820672 25576 raft_consensus.cc:3055] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:17.820832 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:17.821935 21840 raft_consensus.cc:2393] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 13: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:17.823829 25396 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:17.825876 22482 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36278 (request call id 530) took 1642 ms (client timeout 1588 ms). Trace:
W20260709 13:09:17.826264 22482 rpcz_store.cc:269] 0709 13:09:16.183140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:16.183257 (+   117us) service_pool.cc:224] Handling call
0709 13:09:17.825681 (+1642424us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54004f0bd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:17.825774 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878714752}
I20260709 13:09:17.830245 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:17.830710 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:17.789048 25727 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.832307 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:17.833026 21838 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:17.834203 25727 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:17.835016 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 48482.4us
I20260709 13:09:17.835776 21729 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:17.831499 21834 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:17.836534 25695 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:17.837114 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:17.837922 21729 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:17.838738 25683 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:17.840363 25766 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:17.840957 25766 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.842463 25412 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:17.821108 25576 raft_consensus.cc:740] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:17.841390 25766 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:17.845396 25576 consensus_queue.cc:260] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.808531 25684 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:17.849913 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:17.850191 25684 raft_consensus.cc:697] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:17.852074 25733 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:17.851640 25684 consensus_queue.cc:237] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:17.853420 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 44581.8us
I20260709 13:09:17.853847 25729 raft_consensus.cc:993] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d: : Instructing follower 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:09:17.853919 25695 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:17.854450 22449 leader_election.cc:400] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 12. Current term is 13.
I20260709 13:09:17.854533 25729 raft_consensus.cc:1081] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Signalling peer 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:09:17.854817 22449 leader_election.cc:403] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:09:17.854930 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:17.855806 21909 raft_consensus.cc:2393] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 8: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:17.785213 25710 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:17.860562 21806 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:17.852697 25733 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:17.862741 21911 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:17.865586 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:17.871423 21832 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:17.866529 21912 raft_consensus.cc:1240] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:17.867632 25688 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:17.868664 21806 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:17.869508 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:17.874439 21836 raft_consensus.cc:1275] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:17.874914 21906 raft_consensus.cc:2393] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 13: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:17.876032 21728 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:17.875878 25698 consensus_queue.cc:1059] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:17.883647 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:17.880721 21839 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:09:17.898042 21837 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:17.903008 21838 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:17.900274 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:17.865361 25691 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:17.885555 22449 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:17.878362 21728 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:17.865494 25576 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:17.912832 21804 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:17.914942 25685 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:17.916932 25767 consensus_queue.cc:1059] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:17.918131 25744 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:17.918439 25767 raft_consensus.cc:3055] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:17.918993 25767 raft_consensus.cc:740] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:17.920166 25767 consensus_queue.cc:260] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:17.922912 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:17.927937 21879 leader_election.cc:336] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.593s (SENT)
W20260709 13:09:17.903808 25700 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.008s	sys 0.023s
I20260709 13:09:17.928459 21879 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:17.928689 21729 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:17.929827 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 47541.1us
I20260709 13:09:17.930786 22449 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:17.931495 22480 raft_consensus.cc:1240] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:17.881767 25686 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:17.906230 25215 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:17.909475 25729 raft_consensus.cc:2804] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:17.940836 21879 leader_election.cc:336] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.603s (SENT)
I20260709 13:09:17.881453 25735 consensus_queue.cc:1059] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:09:17.925299 21911 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:49554
I20260709 13:09:17.943902 21911 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:17.944527 21911 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:17.932339 25700 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.008s	sys 0.024s
I20260709 13:09:17.943205 25729 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.932245 25299 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:17.955391 21877 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:17.940274 25767 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:17.942677 25711 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:17.943796 25215 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.943949 25576 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:17.961726 21877 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:17.962633 25313 consensus_queue.cc:1059] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
W20260709 13:09:17.966279 21879 leader_election.cc:336] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.795s (SENT)
I20260709 13:09:17.971968 21879 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:17.948990 25690 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:17.954071 25729 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:17.955423 25299 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:17.974566 25690 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:17.976759 25690 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:17.970278 21877 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:17.963995 25215 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:17.973209 25299 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:17.985038 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:17.968626 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 151271us
I20260709 13:09:17.959812 25686 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:17.963057 25727 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:17.960477 25734 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.999339 21838 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:09:17.995812 21911 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:17.971289 25626 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:18.000695 21805 leader_election.cc:336] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.092s (SENT)
I20260709 13:09:18.024554 21805 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:18.026419 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:17.993409 25576 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:09:18.027347 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 61085.8us
W20260709 13:09:18.028211 21879 leader_election.cc:336] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.829s (SENT)
I20260709 13:09:17.998581 25686 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:18.033239 21879 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:18.000222 25727 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.003079 25708 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:18.044483 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:18.045120 21831 raft_consensus.cc:3055] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:18.045392 21831 raft_consensus.cc:740] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:18.014551 25626 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.046095 21831 consensus_queue.cc:260] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:18.064654 21831 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:18.030153 25576 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:18.069598 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 138915us
W20260709 13:09:18.073640 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 196254us
I20260709 13:09:18.041785 25686 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:18.070755 22449 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:09:18.086107 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 57929.5us
I20260709 13:09:18.047103 25727 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.063102 25700 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:18.063771 25626 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:18.092968 21728 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:18.026469 25734 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:18.101514 21731 leader_election.cc:400] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 10. Current term is 11.
I20260709 13:09:18.073611 25576 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:18.103487 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 102826us
I20260709 13:09:18.072959 25630 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:18.104862 21731 leader_election.cc:403] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:18.104236 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:18.105556 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:18.107275 21912 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.107715 21909 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:18.108554 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:18.109674 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 228183us
W20260709 13:09:18.110140 21805 leader_election.cc:336] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.194s (SENT)
I20260709 13:09:18.110538 21729 leader_election.cc:400] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10.
I20260709 13:09:18.110611 21805 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:18.115172 25734 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:18.115715 25774 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:18.119587 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.126610 21911 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:18.127470 25576 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:18.140038 25576 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:18.096370 25629 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:09:18.170758 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 57834.1us
W20260709 13:09:18.171021 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 71588.8us
I20260709 13:09:18.159790 21909 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:09:18.100663 25710 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:18.172638 21731 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:18.113206 25766 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:18.176684 25742 raft_consensus.cc:3055] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:18.183602 25698 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:18.231611 25729 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:18.235440 21838 raft_consensus.cc:2393] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 12: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:09:18.238544 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 67000.4us
I20260709 13:09:18.187693 25735 raft_consensus.cc:2804] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:18.186100 25629 raft_consensus.cc:697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:18.239780 21729 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:18.243331 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 139445us
I20260709 13:09:18.214579 25742 raft_consensus.cc:740] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:18.249409 21729 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:18.242761 25782 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:09:18.243427 25735 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:18.247079 25691 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 12. Current term is 13.
I20260709 13:09:18.252099 25698 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:09:18.270556 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.277127 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:18.277853 22476 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:18.279896 25742 consensus_queue.cc:260] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:18.280790 25695 raft_consensus.cc:3055] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:18.281193 25695 raft_consensus.cc:740] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:18.281328 25742 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:18.281992 25791 consensus_queue.cc:1059] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:09:18.248540 25780 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:09:18.283902 25780 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:18.284260 25733 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:18.284495 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:18.258092 25711 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:18.286885 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:18.287781 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 100320us
W20260709 13:09:18.291659 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.297606 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:18.299963 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.262665 25735 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:18.305222 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.318284 22448 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:18.319798 25629 consensus_queue.cc:237] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:18.286891 25779 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:18.323173 25299 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:18.310693 25497 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:18.329493 25698 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.329378 25497 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:18.329994 25698 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:18.330714 25729 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:18.331318 25788 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:18.331630 25497 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:18.331866 25788 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:18.332715 25724 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:18.292407 25685 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.333417 25685 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:18.334121 25691 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:18.334770 25788 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:18.335604 25685 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:18.336158 21834 raft_consensus.cc:1275] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:09:18.290831 25780 raft_consensus.cc:3055] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:18.312783 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:18.341120 22480 raft_consensus.cc:1240] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:18.341679 22482 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:18.343247 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:18.343914 22483 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:18.332087 25698 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:18.347855 21831 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:18.348734 21912 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:09:18.346272 25691 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:18.354112 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:18.350342 21877 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:18.357046 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:18.340453 22476 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:18.361105 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:18.355551 22449 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:18.366003 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:18.325327 25299 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:18.371143 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:18.341794 25780 raft_consensus.cc:740] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:18.372644 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:18.355221 25708 consensus_queue.cc:1048] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:09:18.374168 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:18.375859 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 126583us
I20260709 13:09:18.376658 21729 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:18.333218 25724 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:18.377653 21805 leader_election.cc:336] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.628s (SENT)
I20260709 13:09:18.329155 25686 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:18.379477 21729 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:18.381244 21805 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:18.370481 25711 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:18.362605 25497 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:18.404449 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:18.369652 25691 raft_consensus.cc:697] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:18.404531 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:18.412647 21834 raft_consensus.cc:2393] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 9: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:18.388731 25788 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:09:18.384754 25750 raft_consensus.cc:3055] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:18.426339 25215 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:18.428695 25215 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:18.429459 25780 consensus_queue.cc:260] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:18.430718 25780 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.433503 25711 raft_consensus.cc:697] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:18.433677 25767 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:18.434626 25711 consensus_queue.cc:237] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:18.400923 25779 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:18.438138 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:18.438776 21837 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:09:18.441473 25686 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:18.442327 25794 consensus_queue.cc:1048] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:18.443444 25724 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:18.443756 25794 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:18.447537 21839 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:18.449860 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:18.454761 25695 consensus_queue.cc:260] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:18.454983 25691 consensus_queue.cc:237] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:18.456115 25695 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.408375 25766 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:18.460704 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:18.457540 21728 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:18.462182 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:18.466060 21839 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:18.466302 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:18.464277 22482 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:18.415256 21729 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:18.466952 22478 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:18.470229 22483 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:18.417459 25750 raft_consensus.cc:740] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:18.468287 22448 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:18.474205 22448 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:18.476038 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:18.477583 22481 raft_consensus.cc:1240] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:18.478699 21805 leader_election.cc:336] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.688s (SENT)
I20260709 13:09:18.479153 21805 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:18.489939 22449 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:18.491760 25684 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:18.491685 21728 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:18.493067 25795 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:18.493322 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 78157.8us
I20260709 13:09:18.494503 21729 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:18.496028 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.496778 21760 raft_consensus.cc:2393] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:18.496635 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:18.497339 21758 raft_consensus.cc:2376] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9. Re-sending same reply.
I20260709 13:09:18.497745 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.497816 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.498446 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.499266 21761 raft_consensus.cc:2368] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10.
I20260709 13:09:18.499945 25779 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:18.500408 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:18.501546 25733 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:18.493199 25786 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:18.517932 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:18.511858 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.523325 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:18.524365 21906 raft_consensus.cc:2393] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 12: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:18.525521 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.529101 22478 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:09:18.530457 21909 raft_consensus.cc:1275] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:18.531378 21731 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:18.531370 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.518460 25783 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:18.481699 25215 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:18.545617 25215 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:18.548463 25215 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:18.498337 25686 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:18.475183 25299 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:18.556672 21879 leader_election.cc:336] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.141s (SENT)
I20260709 13:09:18.557333 21879 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:18.556356 21806 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:18.558821 21838 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 13:09:18.562248 21880 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:18.565588 21763 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:18.567615 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.568171 21837 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:09:18.568353 21763 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:18.574177 25750 consensus_queue.cc:260] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:18.576216 25750 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:18.577837 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.578763 21760 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:18.580577 25727 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:18.500442 25779 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:18.582211 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.601850 21761 raft_consensus.cc:2368] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8.
I20260709 13:09:18.583097 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:18.584630 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 53359.6us
I20260709 13:09:18.585695 25798 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:18.573043 25782 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 10. Current term is 11.
I20260709 13:09:18.595321 21728 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:18.608875 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:18.611639 21758 raft_consensus.cc:2368] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12.
I20260709 13:09:18.611748 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.612437 21756 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:18.614022 21906 raft_consensus.cc:1275] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:09:18.614384 21759 raft_consensus.cc:2393] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:18.481945 25497 raft_consensus.cc:697] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:18.615963 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.626179 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.627113 21760 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:09:18.630170 21663 catalog_manager.cc:5697] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.631685 25497 consensus_queue.cc:237] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:18.638132 25313 consensus_queue.cc:1059] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:18.639179 25313 raft_consensus.cc:3055] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:18.639600 25313 raft_consensus.cc:740] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:18.640553 25313 consensus_queue.cc:260] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:18.505188 25626 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:18.597867 25687 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:18.599812 25744 raft_consensus.cc:2804] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:18.646658 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 90037.6us
I20260709 13:09:18.651114 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.651952 21759 raft_consensus.cc:2393] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 9: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:18.632591 21663 catalog_manager.cc:5697] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:18.610167 25779 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:18.623971 25215 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:09:18.653688 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 50151.7us
I20260709 13:09:18.613339 25734 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:18.544648 25735 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:18.660742 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.662102 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:18.665684 21761 raft_consensus.cc:3060] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:18.666684 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:18.671749 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.678146 21756 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:18.678645 25626 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:18.666960 25744 raft_consensus.cc:697] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:18.681524 25744 consensus_queue.cc:237] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:18.665508 25687 raft_consensus.cc:697] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:18.685451 25687 consensus_queue.cc:237] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:18.691591 21761 raft_consensus.cc:1275] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:09:18.652635 25727 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:18.615579 25742 consensus_queue.cc:1059] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:09:18.710705 21757 raft_consensus.cc:2393] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 7: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:18.713413 21663 catalog_manager.cc:5697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.668576 25313 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:18.716477 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.717067 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:09:18.717362 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.718222 21756 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:18.718014 21761 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:18.668843 25215 raft_consensus.cc:697] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:18.730901 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:18.731885 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.732578 21764 raft_consensus.cc:2393] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:18.733368 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:18.712831 25522 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:18.733896 21764 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:18.734228 25522 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:18.735153 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.735741 21765 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:18.736397 25522 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:18.736536 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.737134 21765 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:18.741106 21764 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:18.719218 25767 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:18.754802 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.755455 21764 raft_consensus.cc:2376] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11. Re-sending same reply.
I20260709 13:09:18.758159 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.753549 21906 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:09:18.722383 25695 raft_consensus.cc:3055] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:18.768416 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:18.769883 21764 raft_consensus.cc:2410] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:09:18.766146 21663 catalog_manager.cc:5697] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 4 to 6, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 6 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:18.769996 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:18.778632 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:18.779402 21914 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:18.779374 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:18.772164 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.781136 21764 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:18.782147 21757 raft_consensus.cc:2410] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 13:09:18.785352 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:18.788995 21804 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:18.791419 21663 catalog_manager.cc:5697] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:18.795802 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.758844 25795 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:18.799490 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:18.802383 21763 raft_consensus.cc:1240] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 9. Ops: [7.8-7.8]
I20260709 13:09:18.766813 25695 raft_consensus.cc:740] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:09:18.807245 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.780471 25735 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:18.812414 21663 catalog_manager.cc:5697] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.814513 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:18.815109 21839 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:18.816298 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.817175 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.766409 25522 consensus_queue.cc:1048] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:09:18.822662 21757 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:18.820034 21763 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:18.796895 25767 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:18.819555 21663 catalog_manager.cc:5697] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 6 to 7, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 7 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.826974 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:09:18.833024 25799 log.cc:927] Time spent T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 13:09:18.834467 21662 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45778 (request call id 284) took 15952 ms (client timeout 15000 ms). Trace:
I20260709 13:09:18.809000 21756 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:18.839179 21764 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
W20260709 13:09:18.842411 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:18.827977 21728 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:18.857949 21764 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59108
I20260709 13:09:18.858624 21764 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:09:18.834856 21662 rpcz_store.cc:269] 0709 13:09:02.882127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:02.891401 (+  9274us) service_pool.cc:224] Handling call
0709 13:09:18.834381 (+15942980us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:16.305327 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:16.550699 (+245372us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:16.563531 (+ 12832us) write_op.cc:435] Acquired schema lock
0709 13:09:16.584916 (+ 21385us) tablet.cc:662] Decoding operations
0709 13:09:17.015244 (+430328us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:17.015306 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:17.015340 (+    34us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:09:17.016693 (+  1353us) tablet.cc:701] Row locks acquired
0709 13:09:17.016744 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:09:17.016937 (+   193us) write_op.cc:270] Start()
0709 13:09:17.017141 (+   204us) write_op.cc:276] Timestamp: P: 1783602557016870 usec, L: 0
0709 13:09:17.017164 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:09:17.170259 (+153095us) log.cc:844] Serialized 5920 byte log entry
0709 13:09:17.607796 (+437537us) op_driver.cc:464] REPLICATION: finished
0709 13:09:17.741542 (+133746us) write_op.cc:301] APPLY: starting
0709 13:09:17.741678 (+   136us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:17.742050 (+   372us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:17.742210 (+   160us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:17.744266 (+  2056us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:17.744637 (+   371us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:09:17.744694 (+    57us) write_op.cc:312] APPLY: finished
0709 13:09:17.745146 (+   452us) log.cc:844] Serialized 107 byte log entry
0709 13:09:17.777762 (+ 32616us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:17.793744 (+ 15982us) write_op.cc:454] Released schema lock
0709 13:09:17.793823 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:17.850706 (+ 56883us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:17.850740 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4675582,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":119026,"apply.run_cpu_time_us":4735,"apply.run_wall_time_us":117058,"num_ops":15,"prepare.queue_time_us":236649,"prepare.run_cpu_time_us":23710,"prepare.run_wall_time_us":932611,"raft.queue_time_us":130189,"raft.run_cpu_time_us":29952,"raft.run_wall_time_us":85246,"replication_time_us":590463,"thread_start_us":352645,"threads_started":4,"wal-append.queue_time_us":137267,"wal-append.run_cpu_time_us":41608,"wal-append.run_wall_time_us":1423815}]]}
I20260709 13:09:18.859016 21764 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:18.869192 21839 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:18.866225 21663 catalog_manager.cc:5697] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 6 to 7, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 7 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:18.871726 21877 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:18.824222 25714 consensus_queue.cc:1048] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:09:18.854363 25735 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:18.895051 21764 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:18.913666 21756 raft_consensus.cc:1240] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:18.900556 21663 catalog_manager.cc:5697] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 5 to 8, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 8 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:18.907800 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:18.910283 21879 leader_election.cc:336] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.210s (SENT)
I20260709 13:09:18.915133 21879 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:18.918081 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:18.913254 21877 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:18.934625 21663 catalog_manager.cc:5697] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:18.958233 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 45044.4us
I20260709 13:09:18.960469 25727 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:18.961069 25727 raft_consensus.cc:697] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 9 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:18.844890 25215 consensus_queue.cc:237] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:18.962127 25802 log.cc:927] Time spent T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:09:18.962035 25727 consensus_queue.cc:237] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:18.967475 21764 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:18.984925 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.990633 21763 raft_consensus.cc:2393] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 9: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:18.991779 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:18.992496 21763 raft_consensus.cc:2376] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11. Re-sending same reply.
I20260709 13:09:18.995436 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:18.997334 21663 catalog_manager.cc:5697] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.951436 25710 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:19.035369 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 44582.9us
I20260709 13:09:19.036907 21760 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:19.054919 21906 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:19.053933 21763 raft_consensus.cc:2410] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 13:09:18.986545 25800 log.cc:927] Time spent T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:09:18.964898 25734 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:09:19.041531 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 131290us
I20260709 13:09:18.874364 25695 consensus_queue.cc:260] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:18.984395 25708 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:18.922248 25726 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:19.055953 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:19.079917 21760 raft_consensus.cc:2368] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 8. Current term is 9.
I20260709 13:09:19.038308 21663 catalog_manager.cc:5697] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:19.065040 21765 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:09:19.070319 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.084367 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:19.086247 21764 raft_consensus.cc:2393] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:19.088349 21906 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:19.093015 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:19.095728 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:19.081104 25710 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:19.105609 21763 raft_consensus.cc:2393] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:19.108110 25710 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:19.109117 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:19.107640 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:19.105500 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:19.121767 21764 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
I20260709 13:09:19.082367 25708 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:19.132746 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:19.133481 21764 raft_consensus.cc:2376] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10. Re-sending same reply.
I20260709 13:09:19.092412 25726 raft_consensus.cc:697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:19.135205 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:09:19.137125 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.146638 21760 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
W20260709 13:09:19.147403 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.148679 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:19.149803 21756 raft_consensus.cc:2410] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:09:19.151247 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:19.152566 21760 raft_consensus.cc:2376] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8. Re-sending same reply.
I20260709 13:09:19.152678 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:19.153345 21764 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:19.141074 25714 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:09:19.154532 25750 consensus_meta.cc:287] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.578s	user 0.014s	sys 0.000s
I20260709 13:09:19.154771 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:19.164753 21765 raft_consensus.cc:2393] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:19.165216 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:19.165866 21764 raft_consensus.cc:2376] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8. Re-sending same reply.
I20260709 13:09:19.173727 21764 raft_consensus.cc:1275] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:09:19.131031 25779 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:19.190074 25726 consensus_queue.cc:237] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:19.195749 25808 log.cc:927] Time spent T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:09:19.197463 21833 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:19.201927 25396 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:09:19.212033 25805 log.cc:927] Time spent T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.249s	user 0.000s	sys 0.005s
I20260709 13:09:19.218627 21839 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:09:19.220471 25809 log.cc:927] Time spent T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:09:19.234625 25708 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:19.176461 25299 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:09:19.240828 25695 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:19.243443 22478 raft_consensus.cc:1275] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:19.168936 25733 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:09:19.252687 25742 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:19.258751 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:19.259949 21758 raft_consensus.cc:2410] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:19.165815 25714 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:19.264447 25714 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:19.257926 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:19.275602 25779 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:19.178555 21756 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 13:09:19.179131 21765 raft_consensus.cc:1275] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:19.277319 21756 pending_rounds.cc:85] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 3
I20260709 13:09:19.277661 21756 pending_rounds.cc:107] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 13:09:19.277899 21756 raft_consensus.cc:2889] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:19.278172 25742 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:19.278363 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:19.278980 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:19.280289 21765 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:09:19.280447 25742 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:19.276646 21762 raft_consensus.cc:2393] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 10: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:19.281265 21756 raft_consensus.cc:1240] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:19.284991 22476 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:19.285323 25744 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:09:19.295902 25313 consensus_meta.cc:287] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.574s	user 0.013s	sys 0.000s
W20260709 13:09:19.302933 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.305265 21839 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:19.307744 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:19.261246 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:19.328508 25766 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:19.329478 25766 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:19.334101 25766 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:19.347398 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.349010 25750 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:19.349740 25750 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:19.352561 25750 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:19.358610 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:19.359668 21764 raft_consensus.cc:2393] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 6: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:19.362012 21756 raft_consensus.cc:1240] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:19.364152 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:19.364854 21758 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 6.
I20260709 13:09:19.375204 22479 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:19.177663 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:19.386391 21760 raft_consensus.cc:2410] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:09:19.388724 25708 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:19.388942 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.390690 25626 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:19.394037 25708 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:19.397068 25708 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:19.397336 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:19.407106 21832 raft_consensus.cc:3055] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:19.399523 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:19.408282 21838 raft_consensus.cc:2393] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 10: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:19.401830 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:19.401823 21805 leader_election.cc:336] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.585s (SENT)
I20260709 13:09:19.412762 21763 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:09:19.407528 21832 raft_consensus.cc:740] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:19.402858 21804 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:19.403522 25750 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:19.432698 25497 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:19.415163 21832 consensus_queue.cc:260] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:19.440210 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:19.441411 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 406875us
I20260709 13:09:19.438016 25744 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.447175 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:19.450318 21906 raft_consensus.cc:1240] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:19.444619 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:19.452299 21838 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:19.450438 21832 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:19.453825 21759 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
I20260709 13:09:19.462306 21911 raft_consensus.cc:1240] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:19.465245 21911 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:09:19.469923 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:19.472162 21914 raft_consensus.cc:1240] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:19.475049 21914 raft_consensus.cc:1240] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:19.480005 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:19.438660 25313 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:19.484413 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:19.487051 21877 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:19.493319 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:19.494359 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:19.495301 21909 raft_consensus.cc:2368] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 10. Current term is 11.
I20260709 13:09:19.490999 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:19.486192 25313 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:19.505959 25313 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:19.436642 25708 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:09:19.440574 25730 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
W20260709 13:09:19.537935 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:19.470759 25744 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:19.510233 25626 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:19.556902 25626 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:19.612208 22450 leader_election.cc:336] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.696s (SENT)
W20260709 13:09:19.624032 21663 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.001s	sys 0.030s
W20260709 13:09:19.624528 21663 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.001s	sys 0.030s
I20260709 13:09:19.619176 25626 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:19.665345 21832 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:09:19.667203 22450 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:19.651139 25795 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.015s	sys 0.009s
I20260709 13:09:19.671204 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:19.675172 22476 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 5.
I20260709 13:09:19.654444 25744 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:19.674292 25730 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:19.679852 25783 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
W20260709 13:09:19.673935 25795 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.016s	sys 0.009s
W20260709 13:09:19.705296 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 393641us
W20260709 13:09:19.708381 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 261013us
W20260709 13:09:19.704216 22449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.030s	sys 0.002s
W20260709 13:09:19.711809 22449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.030s	sys 0.002s
W20260709 13:09:19.712165 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 544166us
I20260709 13:09:19.689087 25299 consensus_queue.cc:1059] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:09:19.718334 21906 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:09:19.731686 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.732640 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.733284 21805 leader_election.cc:336] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.730s (SENT)
I20260709 13:09:19.720569 25193 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.725513 25727 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:19.761121 22450 leader_election.cc:336] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.231s (SENT)
I20260709 13:09:19.758014 25193 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:19.794004 25823 log.cc:927] Time spent T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:09:19.793159 25193 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:19.812826 25497 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.813495 25497 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:19.816349 25497 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:19.824600 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 338346us
I20260709 13:09:19.827999 25193 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.830308 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:19.830971 21839 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:19.828081 21833 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:19.831806 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:19.832397 21837 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:19.828686 25193 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:19.835330 25193 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:19.843729 25744 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.849555 25744 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:19.871402 25744 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:19.880188 25744 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:09:19.895491 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:19.916625 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 205184us
W20260709 13:09:19.923748 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 128415us
I20260709 13:09:19.785903 25701 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:19.810272 25819 log.cc:927] Time spent T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:09:19.764479 25724 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.161s
W20260709 13:09:19.929909 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 168811us
I20260709 13:09:19.772815 25727 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:19.928375 25833 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.938434 25695 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.941716 25766 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.938879 25750 consensus_queue.cc:1048] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
W20260709 13:09:19.952596 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 173444us
I20260709 13:09:19.936779 25701 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:19.972278 25701 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:19.972883 25843 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.973392 25843 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:19.975427 25843 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:19.958200 25833 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:19.959614 25779 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.977861 25833 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:19.978549 25822 log.cc:927] Time spent T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:19.961835 25766 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:19.982998 25816 log.cc:927] Time spent T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.293s	user 0.000s	sys 0.002s
I20260709 13:09:19.983316 25766 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:19.960548 25695 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:19.986687 25695 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:19.991768 21728 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:19.977876 25779 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:19.995535 25779 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:19.996119 25779 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:19.998179 25727 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:19.999838 25849 log.cc:927] Time spent T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:09:20.008733 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:20.009269 21879 leader_election.cc:336] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.865s (SENT)
I20260709 13:09:20.044109 21806 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:09:20.039527 25313 consensus_meta.cc:287] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.503s	user 0.012s	sys 0.000s
I20260709 13:09:20.012805 25626 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:20.057337 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:20.060504 22484 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:20.057171 25313 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:20.074698 25313 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:20.080199 21837 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:20.081382 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:20.085153 25766 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:20.085832 25766 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.086280 25766 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:20.091130 25735 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.091549 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.091746 25735 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:20.092461 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:20.093277 21760 raft_consensus.cc:2410] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:09:20.093163 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.095662 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:20.096127 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:20.097604 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:20.097833 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:20.098315 21910 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:20.099045 21838 raft_consensus.cc:2410] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:09:20.100818 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:20.106333 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 142486us
I20260709 13:09:20.109230 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:20.106952 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.113788 25779 raft_consensus.cc:697] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 12 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:20.113310 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:20.115124 21761 raft_consensus.cc:2368] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 9. Current term is 10.
I20260709 13:09:20.113721 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.120895 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.124217 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:20.134380 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:20.134783 21759 raft_consensus.cc:1240] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:20.109997 25695 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.140359 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:20.181145 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:20.176918 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.138298 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:20.182062 21757 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:20.181524 21912 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:20.184024 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:20.189344 25396 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:20.189996 25396 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:20.190615 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 62692.3us
I20260709 13:09:20.191366 21877 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:20.192201 25396 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:20.192803 25497 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:20.192891 21877 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:20.193331 25497 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.193835 25497 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:20.192214 25843 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:09:20.194512 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:20.186131 21880 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:20.195107 21907 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:20.196044 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:20.196585 21907 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:20.196677 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:20.197283 21757 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:20.197835 25708 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:20.192965 25841 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.192811 25396 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:09:20.198591 21731 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:20.198783 25841 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:20.198280 25708 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.199893 25396 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:20.200379 25396 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.200445 25843 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:20.200911 25396 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:20.200198 25708 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:20.201223 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:20.202230 22476 raft_consensus.cc:2393] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 9: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:09:20.207160 25497 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:20.118973 25830 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.180219 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:20.212499 21908 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:20.212392 25830 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:20.178465 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:20.213791 22479 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:20.182862 21909 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:20.208004 21912 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:20.210706 25708 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:20.190415 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.215253 21760 raft_consensus.cc:2410] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:09:20.216058 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:20.216236 25708 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:20.216545 25695 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:20.217118 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.218509 25727 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.218983 25727 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:20.218225 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.219907 21760 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:20.220712 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:20.220968 25727 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:20.221482 21760 raft_consensus.cc:2410] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:09:20.222208 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.222388 25735 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:20.222925 21760 raft_consensus.cc:2410] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:09:20.227174 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.227711 21760 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:20.222500 25497 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:20.228482 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.229211 25779 consensus_queue.cc:237] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:20.235975 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 48452.9us
I20260709 13:09:20.193092 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:20.244905 21905 raft_consensus.cc:2393] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 9: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:20.245692 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:20.246659 21832 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:20.250252 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:20.251125 21832 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:20.254477 21760 raft_consensus.cc:1275] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:09:20.254925 21760 pending_rounds.cc:85] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 3
I20260709 13:09:20.255182 21760 pending_rounds.cc:107] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:09:20.255447 21760 raft_consensus.cc:2889] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:20.146360 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.256501 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:20.140146 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.119941 25710 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:20.261492 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:20.317906 21837 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:09:20.257409 21839 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:20.316670 21764 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:20.321818 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:20.264498 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.326251 21761 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:20.259358 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.327989 21759 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:20.259557 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.329859 21758 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:20.339666 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.341274 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.342094 21764 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:20.345023 21764 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:09:20.345531 21764 pending_rounds.cc:85] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 5
I20260709 13:09:20.345813 21764 pending_rounds.cc:107] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:09:20.346100 21764 raft_consensus.cc:2889] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:20.351065 21838 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:09:20.353731 21804 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:20.354152 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:20.355048 21804 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:20.356474 21804 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:20.356789 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:20.358615 21804 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:20.257925 25842 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.355089 21838 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:20.298135 25795 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:20.366215 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.360723 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:20.363796 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.307586 25735 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:20.359319 21764 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:20.368525 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:20.381850 21837 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:20.369303 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:20.383361 21839 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
W20260709 13:09:20.370067 21879 leader_election.cc:336] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.138s (SENT)
I20260709 13:09:20.384621 21805 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:20.385059 21879 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:20.395012 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.405259 21877 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:20.367255 25834 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:20.410202 25834 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.410784 25834 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:20.412863 25830 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:20.367024 25840 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:20.414265 25837 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:20.414698 25837 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:20.414762 25840 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.415292 25837 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:20.415448 25840 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:20.380651 25742 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.418033 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:20.418603 21835 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:09:20.427443 21837 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:20.429186 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.429883 21761 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:20.430009 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:20.430883 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.431653 21758 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:20.364280 25850 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:20.441062 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 79296.9us
I20260709 13:09:20.440470 21759 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
W20260709 13:09:20.416669 25838 log.cc:927] Time spent T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.467s	user 0.000s	sys 0.002s
I20260709 13:09:20.443804 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:20.445739 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 249751us
I20260709 13:09:20.367316 25832 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:20.454687 21764 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:20.481057 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:20.482554 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.442257 21804 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:20.460810 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:20.484279 21761 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:20.407397 25687 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:20.352502 25710 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:20.492699 21764 raft_consensus.cc:2393] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:20.487306 21728 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:20.494750 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.497953 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.498490 21758 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:20.474670 21879 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:20.499045 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:20.501595 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.380306 25795 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:20.503535 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:20.505641 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.508690 21759 raft_consensus.cc:2393] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:20.400301 25735 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:20.441222 25850 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:20.376396 25842 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:20.488643 25832 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:20.522608 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:20.500900 25727 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:20.529630 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.529933 21729 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:20.428745 25742 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:20.524174 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 49598.6us
I20260709 13:09:20.518623 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:20.534169 21758 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:09:20.510243 25831 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:20.494062 25691 consensus_queue.cc:1059] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:09:20.542788 21879 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:20.549799 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 3002) took 1112 ms. Trace:
I20260709 13:09:20.518115 25215 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:20.519330 25850 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:20.547319 25780 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:20.529215 25727 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.526700 25832 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:20.568845 21758 raft_consensus.cc:1275] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:09:20.571503 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 113999us
I20260709 13:09:20.547995 25695 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:20.550065 25626 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:20.572085 25844 log.cc:927] Time spent T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:09:20.550782 25865 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:20.576220 21835 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:20.560675 21759 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:20.577559 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:20.550235 21834 rpcz_store.cc:276] 0709 13:09:19.437295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.439210 (+  1915us) service_pool.cc:224] Handling call
0709 13:09:19.439534 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:19.450260 (+ 10726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:19.450295 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:19.472181 (+ 21886us) log.cc:844] Serialized 26 byte log entry
0709 13:09:19.726859 (+254678us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:19.726896 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.726960 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:20.412970 (+686010us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:09:20.549305 (+136335us) raft_consensus.cc:1685] finished
0709 13:09:20.549334 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.549731 (+   397us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7418,"raft.queue_time_us":1621,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":37827,"spinlock_wait_cycles":10000768,"thread_start_us":205122,"threads_started":1,"wal-append.queue_time_us":454775}
I20260709 13:09:20.544253 25831 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.564296 25858 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:20.580087 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 195578us
W20260709 13:09:20.562400 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 141732us
I20260709 13:09:20.581532 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:20.581756 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:20.596916 21909 raft_consensus.cc:2393] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 12: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:20.597255 25795 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:20.593739 25831 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:20.605906 25855 log.cc:927] Time spent T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:09:20.606906 21877 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:20.607332 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:20.567451 25687 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:20.570571 25727 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:20.592662 21761 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:20.538859 25396 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:20.608162 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:20.608850 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:20.634939 21908 raft_consensus.cc:2393] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 10: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:20.610641 21729 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:20.619182 25839 log.cc:927] Time spent T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.669s	user 0.000s	sys 0.006s
W20260709 13:09:20.641141 25856 log.cc:927] Time spent T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:09:20.647877 25846 log.cc:927] Time spent T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.698s	user 0.006s	sys 0.014s
I20260709 13:09:20.593988 25695 consensus_queue.cc:1059] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:09:20.649819 25730 raft_consensus.cc:3055] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:20.650364 25730 raft_consensus.cc:740] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:20.650938 25735 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:20.568804 25215 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:20.653321 25215 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:20.655081 25766 consensus_meta.cc:287] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.003s
I20260709 13:09:20.655599 25742 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:20.655505 25766 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:20.633972 25865 raft_consensus.cc:697] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:09:20.619509 25845 log.cc:927] Time spent T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
W20260709 13:09:20.661026 25867 log.cc:927] Time spent T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:09:20.619206 25853 log.cc:927] Time spent T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:09:20.620487 25857 log.cc:927] Time spent T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:09:20.670336 21805 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:09:20.621891 25854 log.cc:927] Time spent T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:09:20.622606 21879 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:20.631795 21910 consensus_meta.cc:287] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.000s
I20260709 13:09:20.649927 25842 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:20.667508 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:20.620770 25858 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:20.619592 25834 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:20.674721 21910 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:09:20.692682 21805 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:20.693933 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:20.663255 25843 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:20.649942 25695 raft_consensus.cc:3055] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:20.685688 25858 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.698606 25750 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:20.698908 25858 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:20.700274 25834 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:20.701359 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:20.702241 22485 raft_consensus.cc:2393] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 10: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:09:20.703662 21805 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:20.705407 25834 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:20.706529 25396 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:20.671274 25836 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:20.709954 21757 consensus_meta.cc:287] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.002s
I20260709 13:09:20.706108 25850 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:20.710378 21757 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:20.708087 21805 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
W20260709 13:09:20.711954 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 72291us
I20260709 13:09:20.712997 21729 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:20.637400 25313 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:09:20.706897 25834 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:09:20.689014 25866 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:20.658438 25865 consensus_queue.cc:237] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:20.651266 25730 consensus_queue.cc:260] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:20.832693 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 119820us
I20260709 13:09:20.707947 25695 raft_consensus.cc:740] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:20.838984 21729 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:20.839982 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 131971us
W20260709 13:09:20.780659 25857 log.cc:927] Time spent T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:09:20.843430 21805 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:20.832664 25868 raft_consensus.cc:2764] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
W20260709 13:09:20.845000 25779 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.023s	sys 0.023s
I20260709 13:09:20.831859 25842 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.842133 25780 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:20.844830 25830 consensus_queue.cc:1059] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:09:20.884508 25830 raft_consensus.cc:3055] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:20.884925 25830 raft_consensus.cc:740] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:20.852366 25733 raft_consensus.cc:3055] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:20.885795 25830 consensus_queue.cc:260] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:20.885964 25695 consensus_queue.cc:260] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:20.887081 25695 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:20.888156 25829 log.cc:927] Time spent T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.939s	user 0.002s	sys 0.003s
I20260709 13:09:20.889779 22482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36278 (request call id 561) took 1518 ms. Trace:
I20260709 13:09:20.812258 25843 consensus_queue.cc:1059] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 13:09:20.890811 25860 log.cc:927] Time spent T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.314s	user 0.004s	sys 0.007s
I20260709 13:09:20.890122 22482 rpcz_store.cc:276] 0709 13:09:19.370938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.371246 (+   308us) service_pool.cc:224] Handling call
0709 13:09:19.371543 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:19.371908 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:19.371937 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:19.372418 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:09:19.706462 (+334044us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:19.706514 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.720905 (+ 14391us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:20.887441 (+1166536us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:09:20.889509 (+  2068us) raft_consensus.cc:1685] finished
0709 13:09:20.889529 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.889725 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1359,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"spinlock_wait_cycles":33002752,"thread_start_us":333502,"threads_started":1,"wal-append.queue_time_us":575750}
I20260709 13:09:20.688062 25832 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:20.703891 25727 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:20.879870 21805 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:20.854187 25795 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:20.878432 25779 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.023s	sys 0.023s
I20260709 13:09:20.867260 25766 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:20.813556 25837 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:20.718020 25836 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:20.855786 25872 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.885816 25733 raft_consensus.cc:740] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:20.887081 25830 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:20.921861 25733 consensus_queue.cc:260] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:20.893754 25876 raft_consensus.cc:2804] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:20.916350 25834 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:20.898813 25842 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:20.954193 25842 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:20.955106 25733 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:20.957571 25724 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:20.958089 25724 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:20.960107 25724 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:20.961759 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:20.962404 21832 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
W20260709 13:09:20.943032 25840 consensus_meta.cc:287] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.000s
I20260709 13:09:20.964224 22448 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:09:20.966646 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 54623.4us
I20260709 13:09:20.947129 25710 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:20.947388 25766 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:20.970477 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 131642us
I20260709 13:09:20.973603 25766 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:20.972796 21729 leader_election.cc:400] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 10. Current term is 11.
W20260709 13:09:20.982318 25835 log.cc:927] Time spent T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 1.031s	user 0.000s	sys 0.024s
I20260709 13:09:20.983127 21729 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:20.983965 25695 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:20.984685 21729 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:20.985731 25695 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:20.985942 21729 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:20.986825 25795 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:20.987929 21729 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:20.988668 25795 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:20.989071 21729 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:20.989135 25795 raft_consensus.cc:697] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 10 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:20.990064 25842 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:20.991456 21729 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:20.991707 25841 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:20.992669 25841 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:20.994026 21729 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:20.995993 25841 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:20.997392 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 540) took 1741 ms. Trace:
I20260709 13:09:20.998848 21762 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:20.999354 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:20.999652 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:21.000445 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:21.000595 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:21.001251 21762 raft_consensus.cc:2410] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:21.001368 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:21.001760 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:21.002457 21839 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
W20260709 13:09:21.003068 25862 log.cc:927] Time spent T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.405s	user 0.009s	sys 0.004s
I20260709 13:09:21.004493 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:20.997789 21765 rpcz_store.cc:276] 0709 13:09:19.255766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.281060 (+ 25294us) service_pool.cc:224] Handling call
0709 13:09:19.413304 (+132244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:19.422902 (+  9598us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:19.422938 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:19.423442 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:09:19.689547 (+266105us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b4800002958. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b3280aa1 00007fc6b3277b37 00007fc6b32779ca 00007fc6b336f26f 00007fc6b336ef37 00007fc6b338355c 00007fc6b3383508 00007fc6b3383488 00007fc6b3383443 00007fc6b33826ec 00007fc6b22aca96
0709 13:09:19.738039 (+ 48492us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:19.757021 (+ 18982us) log.cc:844] Serialized 14 byte log entry
0709 13:09:19.761632 (+  4611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:19.761706 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:20.618482 (+856776us) spinlock_profiling.cc:243] Waited 9.23 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:09:20.641364 (+ 22882us) raft_consensus.cc:1685] finished
0709 13:09:20.641395 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:20.997231 (+355836us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b5400039650. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:20.997338 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4298,"prepare.queue_time_us":19216,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":226694,"raft.run_cpu_time_us":3909,"raft.run_wall_time_us":273343,"spinlock_wait_cycles":327570560,"thread_start_us":241779,"threads_started":1,"wal-append.queue_time_us":499239}
I20260709 13:09:21.005126 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:21.007449 21840 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:21.005131 21832 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:20.962971 25876 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:21.014653 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 390010us
I20260709 13:09:21.015601 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:20.969249 25724 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:09:21.018738 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 397209us
I20260709 13:09:21.019461 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:21.020555 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:21.027583 21761 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:21.019867 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:21.020714 21757 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:09:21.028960 21757 pending_rounds.cc:85] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 7
I20260709 13:09:21.029253 21757 pending_rounds.cc:107] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:09:21.029579 21757 raft_consensus.cc:2889] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:20.990339 25795 consensus_queue.cc:237] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.030089 21728 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:21.031625 21765 raft_consensus.cc:2393] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 6: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:21.030905 21906 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 711) took 1064 ms. Trace:
I20260709 13:09:21.035861 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:21.036053 21728 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:21.036464 21765 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:21.038116 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:21.040427 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:21.041011 21756 raft_consensus.cc:2376] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11. Re-sending same reply.
I20260709 13:09:21.013048 25834 consensus_queue.cc:1048] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.006s
W20260709 13:09:21.050583 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.049269 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:21.053690 21805 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:21.055230 21728 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:20.941581 25872 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:21.034610 21906 rpcz_store.cc:276] 0709 13:09:19.954523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:19.954689 (+   166us) service_pool.cc:224] Handling call
0709 13:09:19.955143 (+   454us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:19.955618 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:19.955663 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:19.958882 (+  3219us) log.cc:844] Serialized 52 byte log entry
0709 13:09:20.337348 (+378466us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:20.663781 (+326433us) log.cc:844] Serialized 14 byte log entry
0709 13:09:21.018086 (+354305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.018160 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:21.018204 (+    44us) raft_consensus.cc:1685] finished
0709 13:09:21.018220 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.018351 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":353982,"prepare.queue_time_us":65551,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":355861,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":12118,"thread_start_us":593252,"threads_started":2,"wal-append.queue_time_us":405484}
I20260709 13:09:21.048983 25871 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:21.014580 25876 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:20.965991 25840 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:21.032572 25724 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:21.066169 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 50900.3us
I20260709 13:09:20.968086 25831 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.053018 25842 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:21.066972 21761 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:09:21.036916 25695 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:21.035156 25841 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:21.069664 21877 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:21.058228 25843 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.068725 25744 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:09:21.076967 25847 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:09:21.077615 25831 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:21.078379 25889 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:21.078675 21877 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:21.060144 25742 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.062536 25313 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:21.083302 21758 raft_consensus.cc:1240] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:21.089973 21764 raft_consensus.cc:2393] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 10: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:21.039626 25866 consensus_queue.cc:1048] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:09:21.067348 25850 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:21.072747 25724 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:21.100104 25880 raft_consensus.cc:2764] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:09:21.049628 25868 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:09:21.091821 25695 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.075577 25842 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.105268 21877 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:21.098618 25840 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:21.071789 25859 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:09:21.104614 25695 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.114475 25832 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:21.116266 25695 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:21.117218 25851 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:21.117738 25851 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.118230 25851 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:21.121127 25727 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:21.122538 25701 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:21.122642 21877 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:21.123075 25701 raft_consensus.cc:697] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:21.123597 25766 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:21.123965 25701 consensus_queue.cc:237] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.092929 25889 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:21.141170 21879 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:21.107573 25842 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:21.144433 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:21.142766 21765 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:21.096437 25742 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.155416 25742 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:21.155668 25872 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:21.085795 25843 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.144563 25871 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:21.159446 25871 raft_consensus.cc:697] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:21.159756 25843 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:21.160331 25871 consensus_queue.cc:237] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.153362 25396 consensus_queue.cc:1048] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:21.161649 25836 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:21.142145 25889 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:21.171927 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:21.173877 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:21.174739 21910 raft_consensus.cc:2368] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12.
I20260709 13:09:21.177076 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:21.177629 21912 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:21.177784 21879 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:21.180860 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:21.184924 21804 leader_election.cc:400] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12.
I20260709 13:09:21.185241 21804 leader_election.cc:403] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:09:21.185726 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 130577us
I20260709 13:09:21.188170 21728 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:21.189033 21912 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:21.186866 22450 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:21.193866 22450 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:21.198017 21879 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:21.199673 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:21.176793 25396 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:09:21.207974 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 152361us
I20260709 13:09:21.202550 21804 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:21.209828 21879 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:21.211491 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:21.213373 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:21.213995 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:21.214772 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:21.217092 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:21.177662 25836 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:21.184065 25859 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:21.225214 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:21.217943 21756 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:21.225344 25629 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:21.225677 25893 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:09:21.220418 25396 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.228129 25313 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:21.231689 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:21.251215 21762 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:21.204283 25726 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:21.220819 25840 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:21.207584 25783 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:09:21.205987 25892 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:21.239434 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:21.239956 21831 raft_consensus.cc:2393] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 10: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:21.216902 25710 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:21.235875 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:21.229111 25724 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:21.204568 25711 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:21.157369 25858 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.252750 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:21.203212 25872 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:09:21.254207 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 45027.1us
I20260709 13:09:21.195449 25843 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:09:21.259546 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 59312.1us
I20260709 13:09:21.258116 25840 raft_consensus.cc:697] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:21.279136 21908 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:21.244024 25836 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.269972 25872 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.270156 25726 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:21.275015 25843 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.294260 25840 consensus_queue.cc:237] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.281843 25859 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.274096 25710 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:21.303251 21762 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:21.320657 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:09:21.321171 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 78239.1us
I20260709 13:09:21.321564 21762 raft_consensus.cc:2393] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:21.324935 25858 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:21.314402 25872 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:21.326372 25396 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:21.326984 25843 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:21.328334 25724 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:21.336810 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:21.338689 21762 raft_consensus.cc:2368] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9.
I20260709 13:09:21.314334 25726 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:21.342047 25726 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:21.344696 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:21.345340 21831 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:21.322790 25859 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:21.349749 25780 raft_consensus.cc:3055] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:21.350308 25780 raft_consensus.cc:740] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:21.351312 25780 consensus_queue.cc:260] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.338006 25710 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:21.384913 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 175169us
I20260709 13:09:21.385700 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:21.385385 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:21.383805 25836 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:21.396112 25889 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:21.391274 21879 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:21.409888 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:21.412153 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 140938us
I20260709 13:09:21.376714 25780 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:21.415333 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 136979us
I20260709 13:09:21.418116 22450 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:21.421087 21911 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:21.400259 25711 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:09:21.431341 21729 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:21.433152 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:21.432961 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:21.435729 22485 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:21.447538 25842 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.448895 25836 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:21.422319 25851 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.451188 25876 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.436527 25847 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:21.454002 25847 raft_consensus.cc:697] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:21.455145 25847 consensus_queue.cc:237] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:21.456851 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:21.457571 21833 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:21.459425 25859 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:21.448043 25889 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:21.461488 25900 log.cc:927] Time spent T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:09:21.467059 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:21.468060 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:21.468688 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:21.469420 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:21.469830 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:21.470741 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:21.470999 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:21.471333 21910 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:21.472267 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:21.473373 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:21.474293 21912 raft_consensus.cc:2393] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 10: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:21.475634 21909 raft_consensus.cc:1240] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:09:21.472381 21905 raft_consensus.cc:1275] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:09:21.481500 21759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59102 (request call id 2870) took 1060 ms. Trace:
I20260709 13:09:21.453383 25851 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:21.482067 25892 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12.
I20260709 13:09:21.482882 21914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1512) took 1339 ms. Trace:
W20260709 13:09:21.480527 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 89340.9us
I20260709 13:09:21.483326 21914 rpcz_store.cc:276] 0709 13:09:20.143852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.143988 (+   136us) service_pool.cc:224] Handling call
0709 13:09:20.144514 (+   526us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.519808 (+375294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.519856 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:20.519914 (+    58us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:20.519946 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:21.482641 (+962695us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b5400033c54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:21.482689 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.482822 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":862464768}
I20260709 13:09:21.485512 21879 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:21.481909 21759 rpcz_store.cc:276] 0709 13:09:20.420855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.513283 (+ 92428us) service_pool.cc:224] Handling call
0709 13:09:21.481319 (+968036us) spinlock_profiling.cc:243] Waited 30.2 ms on lock 0x7b54001b99d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:21.481417 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69556992}
I20260709 13:09:21.490962 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:21.491601 21759 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:09:21.494885 21763 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59102 (request call id 2822) took 1403 ms (client timeout 1643 ms). Trace:
W20260709 13:09:21.495501 21763 rpcz_store.cc:269] 0709 13:09:20.091192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.091314 (+   122us) service_pool.cc:224] Handling call
0709 13:09:21.494570 (+1403256us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b54003ef8d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:21.494764 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1918947200}
I20260709 13:09:21.498670 21760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2849) took 1319 ms. Trace:
I20260709 13:09:21.499163 21760 rpcz_store.cc:276] 0709 13:09:20.179308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.313919 (+134611us) service_pool.cc:224] Handling call
0709 13:09:20.710890 (+396971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:20.712072 (+  1182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.712102 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:20.712142 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:20.712171 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.712228 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:21.498460 (+786232us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b54001c70d0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:21.498601 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":838,"raft.queue_time_us":68804,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":23853,"spinlock_wait_cycles":912127744}
I20260709 13:09:21.511741 21879 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:21.514344 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:21.513957 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:21.515946 21836 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:21.517889 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:21.526573 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:21.530496 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:21.531118 22479 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:21.502534 25889 raft_consensus.cc:2764] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:09:21.538062 21831 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:09:21.533844 21833 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:21.534512 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:21.539448 21837 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:21.539839 21838 raft_consensus.cc:1240] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:21.541018 21728 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:21.535336 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:21.542295 21834 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:21.537200 25869 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:21.546042 25869 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:21.546461 25869 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:21.548714 25863 log.cc:927] Time spent T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.932s	user 0.002s	sys 0.003s
I20260709 13:09:21.534381 21879 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:21.550114 21911 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:21.553730 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:21.554141 21836 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:09:21.554417 22478 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:21.542229 22448 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:09:21.555586 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 132882us
I20260709 13:09:21.557801 21729 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:21.558138 22476 raft_consensus.cc:1240] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:21.522012 25851 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:21.566022 21839 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:21.567022 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:21.568449 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.568642 21729 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:21.570209 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:21.572712 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:21.572901 21759 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:09:21.571249 25836 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:21.581233 25780 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:21.581832 25780 raft_consensus.cc:697] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 10 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:21.583964 21729 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:21.585733 21729 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:21.591203 21837 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:21.592267 21914 raft_consensus.cc:1240] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:21.592971 21836 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:21.593974 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:21.594208 22485 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:09:21.594830 21837 raft_consensus.cc:2368] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 9. Current term is 10.
W20260709 13:09:21.596391 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:21.598145 25735 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:21.598433 21729 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:21.599474 21729 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:21.592435 25783 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:21.600679 21729 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:21.603315 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 69016.5us
I20260709 13:09:21.604507 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:21.602046 21731 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:21.513882 25872 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:21.566869 25876 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:21.610281 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:21.622081 21834 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:21.611342 21729 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:21.606240 25497 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:21.674561 21764 raft_consensus.cc:2368] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12.
I20260709 13:09:21.606215 25843 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:21.571033 25842 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:21.592336 25836 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:21.601058 25833 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:21.585503 25215 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:21.635211 25910 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:21.619029 25913 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:21.686185 25869 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.686751 25870 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:09:21.687199 25887 log.cc:927] Time spent T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:09:21.674659 25831 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:21.639219 25695 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:21.693579 22478 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:09:21.613795 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:21.708416 21837 raft_consensus.cc:2393] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 10: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:21.635422 25866 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:09:21.689643 25912 log.cc:927] Time spent T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:09:21.640172 25710 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:21.635625 25783 raft_consensus.cc:697] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:21.632277 25735 consensus_queue.cc:1048] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:09:21.632721 25396 consensus_queue.cc:1059] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:09:21.690703 25833 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.700124 21839 raft_consensus.cc:1240] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:21.763305 25833 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:21.676594 25780 consensus_queue.cc:237] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.766103 25783 consensus_queue.cc:237] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:21.683872 25497 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:21.768648 25497 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:21.755431 21806 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:21.751497 25843 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:21.769905 21804 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:21.698155 25913 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:21.771956 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:21.762781 25396 raft_consensus.cc:3055] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:21.710959 25870 raft_consensus.cc:697] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 9 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:21.754598 25893 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:21.711165 25831 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.698439 25910 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:21.756986 25836 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:21.801836 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:21.783946 25396 raft_consensus.cc:740] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:21.769953 25843 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:21.753250 25866 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:21.843463 22479 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
W20260709 13:09:21.853237 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 83413.1us
I20260709 13:09:21.855911 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:21.815925 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 211518us
I20260709 13:09:21.858366 21880 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:21.867673 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:21.872210 21729 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:21.805227 25895 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:21.881065 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:21.882401 25795 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:21.882623 25911 log.cc:927] Time spent T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:09:21.883050 25795 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.853314 25869 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:21.885262 25795 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:21.841952 25836 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:21.876142 25726 consensus_meta.cc:287] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.000s
I20260709 13:09:21.888914 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:21.885088 25842 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:21.807387 25893 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:21.882736 25918 log.cc:927] Time spent T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:09:21.877338 25710 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:21.885607 25913 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:21.904325 25726 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.914530 21912 raft_consensus.cc:1240] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:21.914441 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:21.915195 22479 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:09:21.916538 25866 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:21.917074 25910 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:21.917192 25866 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:21.908836 25710 raft_consensus.cc:697] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:09:21.918339 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 163029us
I20260709 13:09:21.920849 21731 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:21.921610 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:21.917739 25866 raft_consensus.cc:697] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:21.923187 21877 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:21.904762 25832 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:21.915050 25893 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:21.911715 25919 log.cc:927] Time spent T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:09:21.934016 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:21.915488 25726 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:21.913327 25836 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:21.925401 25842 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:21.926812 25905 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:21.944278 25843 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:21.945605 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:21.911005 25833 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.968629 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:21.900341 25870 consensus_queue.cc:237] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:21.903074 25396 consensus_queue.cc:260] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:21.940261 25832 raft_consensus.cc:697] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:21.972013 22479 raft_consensus.cc:1240] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:21.948179 25842 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:21.981117 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:21.982930 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:21.984165 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:21.985649 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:21.986459 21806 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:21.998313 21877 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:22.000893 21832 raft_consensus.cc:1275] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:22.002638 21877 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:22.010069 21877 leader_election.cc:400] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 9. Current term is 10.
I20260709 13:09:22.010478 21877 leader_election.cc:403] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:09:22.008400 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:22.012573 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:22.002912 25891 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:21.991829 25842 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:22.008424 25869 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:22.002323 25396 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:22.042317 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:21.991664 25710 consensus_queue.cc:237] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:22.051970 25879 log.cc:927] Time spent T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.959s	user 0.000s	sys 0.003s
I20260709 13:09:22.053081 21913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1511) took 1912 ms. Trace:
I20260709 13:09:22.053925 25832 consensus_queue.cc:237] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:22.055140 25833 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:22.053473 21913 rpcz_store.cc:276] 0709 13:09:20.140700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.143486 (+  2786us) service_pool.cc:224] Handling call
0709 13:09:20.193582 (+ 50096us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:20.193912 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:20.193938 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:20.705859 (+511921us) spinlock_profiling.cc:243] Waited 41.6 ms on lock 0x7b2c00021ff8. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6acc50a11 00007fc6acc60372 00007fc6ae392a01 00007fc6ae35743a 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2
0709 13:09:20.706230 (+   371us) log.cc:844] Serialized 26 byte log entry
0709 13:09:20.948555 (+242325us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:20.948630 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:20.950784 (+  2154us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:22.051406 (+1100622us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:09:22.052862 (+  1456us) raft_consensus.cc:1685] finished
0709 13:09:22.052885 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.053014 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5827,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":105240832,"thread_start_us":241884,"threads_started":1,"wal-append.queue_time_us":353445}
W20260709 13:09:22.072026 25924 log.cc:927] Time spent T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:09:22.074577 25895 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:22.075139 25895 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:22.077280 25895 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:22.078431 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:22.079020 21759 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:22.034148 25923 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:22.034080 25687 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 9. Current term is 10.
I20260709 13:09:22.081328 25923 raft_consensus.cc:697] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:22.082113 25859 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:22.082332 25923 consensus_queue.cc:237] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:22.037990 25831 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:22.066793 21763 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:22.085119 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:22.087105 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:22.087380 21761 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:22.088445 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:22.089187 21761 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:22.090183 21759 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:22.091564 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:09:22.069226 25935 log.cc:927] Time spent T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:09:22.086175 25744 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:22.096174 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:22.102800 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:09:22.109632 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 116988us
I20260709 13:09:22.007588 25866 consensus_queue.cc:237] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:09:22.131040 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 75713.2us
I20260709 13:09:22.120205 25744 raft_consensus.cc:697] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:22.134804 21763 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:22.133940 21877 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:22.139213 25913 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:22.139986 25837 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:22.155494 22448 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:22.159931 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:22.164541 22448 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:22.164891 21833 raft_consensus.cc:1275] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:22.159955 21805 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:22.157271 21760 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:22.167784 21832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:09:22.167413 25913 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:22.177556 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.166354 25869 raft_consensus.cc:697] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:22.158371 25938 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:22.168406 25726 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
W20260709 13:09:22.255302 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:22.137781 25396 consensus_queue.cc:1059] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:09:22.179148 25744 consensus_queue.cc:237] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:22.162635 25925 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:22.303584 21913 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:22.305117 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:09:22.260833 25936 log.cc:927] Time spent T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.127s	user 0.000s	sys 0.004s
I20260709 13:09:22.341856 21906 raft_consensus.cc:1275] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:09:22.467370 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 162862us
I20260709 13:09:22.769942 21832 raft_consensus.cc:606] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:22.769942 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:09:22.771230 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 606766us
I20260709 13:09:22.771670 21763 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:22.254197 25837 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:22.253947 25824 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:22.254349 25832 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:09:22.768610 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 608724us
I20260709 13:09:22.844005 21840 raft_consensus.cc:1275] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:22.851179 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:22.852198 21762 raft_consensus.cc:2393] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 7: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
W20260709 13:09:22.511281 25951 log.cc:927] Time spent T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 13:09:22.854264 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:22.829348 21763 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
W20260709 13:09:22.510378 25931 log.cc:927] Time spent T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.257s	user 0.000s	sys 0.000s
I20260709 13:09:22.863566 21756 raft_consensus.cc:2368] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12.
I20260709 13:09:22.665091 25626 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:22.509282 25953 log.cc:927] Time spent T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:09:22.843940 25783 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:22.701349 25727 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:22.881143 21763 raft_consensus.cc:1275] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:09:22.896162 21913 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:22.897645 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:22.885218 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:22.898825 21905 raft_consensus.cc:2393] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 10: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:22.886937 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:22.887907 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:22.340961 25869 consensus_queue.cc:237] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:22.892165 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:22.903245 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:22.904322 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:22.904803 21908 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:22.294958 25938 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:22.851346 25734 consensus_queue.cc:1048] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:09:22.928279 22450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.000s	sys 0.028s
W20260709 13:09:22.901015 25949 log.cc:927] Time spent T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:09:22.854246 25832 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:22.930207 21756 raft_consensus.cc:1240] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:22.901990 25842 consensus_meta.cc:287] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.836s	user 0.012s	sys 0.000s
W20260709 13:09:22.930598 22450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.000s	sys 0.028s
W20260709 13:09:22.932709 25915 log.cc:927] Time spent T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 1.468s	user 0.019s	sys 0.026s
I20260709 13:09:22.950380 21756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2888) took 1007 ms. Trace:
I20260709 13:09:22.933100 21908 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
W20260709 13:09:22.916054 25942 log.cc:927] Time spent T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.469s	user 0.000s	sys 0.001s
I20260709 13:09:22.933518 21835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 3035) took 1413 ms. Trace:
I20260709 13:09:22.895054 25727 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:22.950966 21756 rpcz_store.cc:276] 0709 13:09:21.942867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.908650 (+965783us) service_pool.cc:224] Handling call
0709 13:09:22.930022 (+ 21372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.949979 (+ 19957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.950297 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:22.952766 21835 rpcz_store.cc:276] 0709 13:09:21.519561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.519686 (+   125us) service_pool.cc:224] Handling call
0709 13:09:21.519989 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:21.520307 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:21.520336 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:22.074909 (+554573us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b2c0000e678. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6acc50a11 00007fc6acc60372 00007fc6ae392a01 00007fc6ae35743a 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2
0709 13:09:22.075353 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:09:22.134155 (+ 58802us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:22.134190 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.134260 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:22.933207 (+798947us) raft_consensus.cc:1685] finished
0709 13:09:22.933230 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.933419 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":7700,"spinlock_wait_cycles":6902656,"thread_start_us":58181,"threads_started":1,"wal-append.queue_time_us":329552}
W20260709 13:09:22.957451 21803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.036s	sys 0.051s
I20260709 13:09:22.953922 25842 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:22.957948 21803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.036s	sys 0.051s
I20260709 13:09:22.959517 25842 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:22.962495 25866 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:22.963023 25866 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:22.964931 25866 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:22.957952 25945 log.cc:927] Time spent T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 13:09:22.966827 25938 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:22.895680 25626 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:22.968860 25626 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:22.969784 25832 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:22.972705 25859 raft_consensus.cc:3055] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:22.973217 25859 raft_consensus.cc:740] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:22.974222 25859 consensus_queue.cc:260] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:22.975004 25727 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:22.978041 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:22.978753 22485 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:22.981302 21756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2889) took 1033 ms. Trace:
I20260709 13:09:22.981868 21756 rpcz_store.cc:276] 0709 13:09:21.948000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.980363 (+1032363us) service_pool.cc:224] Handling call
0709 13:09:22.980725 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.980920 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.980956 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.981008 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:22.981051 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.981118 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.981236 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:22.984170 21756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 568) took 1035 ms. Trace:
I20260709 13:09:22.984683 21756 rpcz_store.cc:276] 0709 13:09:21.948341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.983082 (+1034741us) service_pool.cc:224] Handling call
0709 13:09:22.983394 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.983626 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.983661 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.983714 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:22.983920 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.983984 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:22.984110 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:22.986565 21756 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:22.987330 21756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 569) took 1016 ms. Trace:
I20260709 13:09:22.987778 21756 rpcz_store.cc:276] 0709 13:09:21.971377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.985867 (+1014490us) service_pool.cc:224] Handling call
0709 13:09:22.986168 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.987057 (+   889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:22.987272 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.033854 21756 raft_consensus.cc:1275] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:09:23.036648 21805 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.656s (SENT) [suppressed 40 similar messages]
I20260709 13:09:23.040745 22485 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:09:23.052505 21731 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:22.957422 25913 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:23.061795 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:23.054226 25744 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.004s	sys 0.018s
W20260709 13:09:23.068701 25744 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.005s	sys 0.018s
W20260709 13:09:23.072367 22451 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.015s	sys 0.015s
W20260709 13:09:23.072826 22451 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.016s	sys 0.015s
I20260709 13:09:23.034168 25865 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:23.076262 25960 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:09:23.084966 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 48344.2us
W20260709 13:09:23.075805 25954 log.cc:927] Time spent T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:09:23.087198 21835 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:09:23.091636 25902 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:09:23.092587 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 226065us
W20260709 13:09:23.097259 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.098891 21908 raft_consensus.cc:1240] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:23.099457 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:23.102272 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:23.086313 25865 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:23.124578 21760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59102 (request call id 2878) took 1482 ms. Trace:
I20260709 13:09:23.109138 25959 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:23.102065 25934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.000s	sys 0.016s
I20260709 13:09:23.126351 25959 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:23.119359 25958 consensus_queue.cc:1048] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:09:23.128435 21906 raft_consensus.cc:2393] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 8: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:23.125078 21760 rpcz_store.cc:276] 0709 13:09:21.641658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.086856 (+445198us) service_pool.cc:224] Handling call
0709 13:09:23.124367 (+1037511us) spinlock_profiling.cc:243] Waited 69.5 ms on lock 0x7b5400039154. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:23.124504 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159758208}
I20260709 13:09:23.124619 21805 leader_election.cc:400] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9.
I20260709 13:09:23.132462 21805 leader_election.cc:403] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:09:23.138561 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:23.129248 25959 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:23.141549 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:23.142167 21910 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:23.153820 21835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "915629d8ce0e4452b6308425161f143a"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:09:23.153648 25876 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.155133 25701 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:23.119267 25963 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:23.153355 25934 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:23.171571 25701 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:23.109580 25896 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:23.170145 25959 consensus_queue.cc:1059] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:09:23.173053 25896 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.173942 25959 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9.
I20260709 13:09:23.174355 25701 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:23.175088 25876 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:23.175539 25959 raft_consensus.cc:3055] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:23.176443 25959 raft_consensus.cc:740] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:23.177515 25876 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:23.126420 25865 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:23.171751 25963 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:23.155169 21804 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:23.097918 25744 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:09:23.202526 21907 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:23.175624 25896 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:23.171937 25934 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.177479 25959 consensus_queue.cc:260] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:23.170511 21835 raft_consensus.cc:606] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:23.207449 21835 raft_consensus.cc:614] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:23.184998 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 108680us
W20260709 13:09:23.200266 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 45259.2us
I20260709 13:09:23.209173 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:23.185209 25824 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.216264 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:23.092500 25902 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.222190 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:23.236212 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 137025us
I20260709 13:09:23.212631 25865 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:23.095475 25960 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.213582 25932 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:23.217279 25959 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:23.246485 25968 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:23.247077 25968 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:23.247443 21805 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:23.251528 21805 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:23.255208 25934 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:23.255802 25934 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:23.213634 25977 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:09:23.259025 25744 raft_consensus.cc:2804] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:23.259526 25744 raft_consensus.cc:697] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:23.244395 25932 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.261875 25963 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:23.262609 25932 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:23.253612 25902 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:23.260375 25744 consensus_queue.cc:237] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:23.217108 25824 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.278118 25944 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:23.307832 25944 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:23.249365 25968 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:23.309357 25968 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:23.309940 25968 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.311879 25968 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:23.312947 25968 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.281939 25960 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:23.305584 25876 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:23.313388 25968 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.314018 25876 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.314843 25824 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:23.306767 25932 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:23.319608 25932 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:23.320164 21758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 556) took 2295 ms. Trace:
I20260709 13:09:23.320555 21758 rpcz_store.cc:276] 0709 13:09:21.020508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.020630 (+   122us) service_pool.cc:224] Handling call
0709 13:09:21.051962 (+ 31332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.097769 (+ 45807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.315572 (+2217803us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b5400038754. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:23.315740 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71600512}
I20260709 13:09:23.321744 25932 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:23.323850 25876 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:23.333858 25730 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:23.432909 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:23.433674 21835 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:09:23.434764 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:23.435508 21835 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
I20260709 13:09:23.436658 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:23.437881 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:23.441713 21832 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:09:23.444164 25984 log.cc:927] Time spent T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:09:23.444635 22478 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:09:23.445288 25956 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.322981 25968 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:23.469139 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:23.470752 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:23.479231 21835 raft_consensus.cc:2410] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:09:23.493325 22448 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:23.495739 22448 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:23.427420 25932 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:23.433157 25733 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:23.501639 25824 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:23.504420 25964 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:23.504822 25968 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:23.505195 25957 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:23.495158 25730 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:23.435038 25980 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 13:09:23.502173 25934 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:23.506928 21833 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:23.532207 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:23.514339 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:23.551827 22482 raft_consensus.cc:1275] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:23.550493 21835 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 14.
I20260709 13:09:23.554227 22448 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:23.556191 21834 raft_consensus.cc:1240] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:23.520045 25824 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.572352 25824 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:23.531217 25733 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.571205 25985 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:23.580502 25985 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.580606 21833 raft_consensus.cc:1240] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:23.580994 25985 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:23.535732 25983 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:23.582201 25983 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.520107 25986 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:23.584185 25733 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:23.539371 25964 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:23.535475 25968 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.586982 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:23.587520 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.608131 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:23.487967 25956 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.520171 25960 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:09:23.529971 25932 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:23.535427 25730 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.613019 22482 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:23.584344 25986 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:23.614470 25913 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:23.549446 25957 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:23.621258 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:23.624492 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:23.624153 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.624918 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:23.627349 22484 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:23.629356 21836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 2063) took 2046 ms. Trace:
I20260709 13:09:23.629927 21836 rpcz_store.cc:276] 0709 13:09:21.582733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.582895 (+   162us) service_pool.cc:224] Handling call
0709 13:09:21.592778 (+  9883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.593487 (+   709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.629172 (+2035685us) spinlock_profiling.cc:243] Waited 8.04 ms on lock 0x7b5400147150. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:23.629293 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18480512}
I20260709 13:09:23.634677 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:23.635281 21836 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
I20260709 13:09:23.637040 22480 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44346
I20260709 13:09:23.637634 22480 raft_consensus.cc:606] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:23.637841 25730 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:23.626283 25913 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.640547 25913 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:23.643934 25985 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.647125 25985 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:23.647888 21914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1761) took 2178 ms. Trace:
I20260709 13:09:23.648460 21806 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:23.648629 25934 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:23.649226 25973 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:23.650323 25934 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:23.650707 25934 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:23.651067 25934 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:23.648260 21914 rpcz_store.cc:276] 0709 13:09:21.500517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.506580 (+  6063us) service_pool.cc:224] Handling call
0709 13:09:21.524624 (+ 18044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.600611 (+ 75987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.647616 (+2047005us) spinlock_profiling.cc:243] Waited 67.4 ms on lock 0x7b5400112e54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:23.647788 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155065216}
I20260709 13:09:23.653672 25872 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:23.654714 25964 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:23.656862 25932 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:23.664906 21911 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1526) took 2494 ms (client timeout 1529 ms). Trace:
W20260709 13:09:23.665343 21911 rpcz_store.cc:269] 0709 13:09:21.170144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.171654 (+  1510us) service_pool.cc:224] Handling call
0709 13:09:23.664635 (+2492981us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54002d8f54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:23.664794 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571180416}
I20260709 13:09:23.666453 22479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 1060) took 1743 ms. Trace:
I20260709 13:09:23.666579 25983 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:23.666848 22479 rpcz_store.cc:276] 0709 13:09:21.923525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.924079 (+   554us) service_pool.cc:224] Handling call
0709 13:09:21.934180 (+ 10101us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.978193 (+ 44013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.666216 (+1688023us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b5400602cd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:23.666384 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86545664}
I20260709 13:09:23.665639 25934 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.669050 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:23.671583 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.672055 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:23.672434 22481 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:23.673461 25708 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:23.673534 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:23.674233 22481 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:23.674062 25708 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.624527 25986 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:23.678840 22477 raft_consensus.cc:1240] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:23.645210 25824 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.674950 25869 consensus_queue.cc:1059] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:09:23.683064 22485 raft_consensus.cc:2368] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10.
I20260709 13:09:23.677652 25934 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:23.692942 25708 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:23.694830 25824 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:23.694986 25968 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:23.695410 25957 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:23.698678 22481 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:09:23.701705 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:23.700582 21806 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:23.703624 25869 consensus_queue.cc:1059] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:09:23.749765 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:23.715163 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:23.711752 21757 raft_consensus.cc:1240] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:09:23.793045 21757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1500) took 2600 ms. Trace:
I20260709 13:09:23.710084 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:23.793553 21757 rpcz_store.cc:276] 0709 13:09:21.192859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.192992 (+   133us) service_pool.cc:224] Handling call
0709 13:09:23.711197 (+2518205us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b5800000098. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232a22 00007fc6b414bc09 00007fc6b32a5ee0 00007fc6b336f0ab 00007fc6b336f131 00007fc6b3330fc0 00007fc6b331b929 00007fc6b331b3d2 00007fc6ac892bd4
0709 13:09:23.711437 (+   240us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.792656 (+ 81219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.792960 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8867072}
I20260709 13:09:23.808502 22449 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:23.775727 25869 raft_consensus.cc:3055] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:23.812922 25901 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:23.784134 25902 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:23.818679 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:23.825982 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:23.705721 25934 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:23.814760 25869 raft_consensus.cc:740] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:23.832554 21838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 3030) took 2308 ms. Trace:
W20260709 13:09:23.832805 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.814491 25851 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:23.819691 25902 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.837639 21838 rpcz_store.cc:276] 0709 13:09:21.516626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.517520 (+   894us) service_pool.cc:224] Handling call
0709 13:09:21.538573 (+ 21053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.549803 (+ 11230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.821926 (+2272123us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b540025dad0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:23.822150 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47682816}
I20260709 13:09:23.829674 25986 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.858181 25869 consensus_queue.cc:260] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:23.859299 25987 log.cc:927] Time spent T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.178s	user 0.001s	sys 0.001s
I20260709 13:09:23.859658 25869 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:23.849498 25934 raft_consensus.cc:697] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:23.845145 25851 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:23.868953 25934 consensus_queue.cc:237] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:23.871160 25865 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:23.871330 22482 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEARNER]: Advancing to term 11
I20260709 13:09:23.878273 22476 raft_consensus.cc:2393] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 13: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:09:23.882347 25986 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:23.883520 25902 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:23.883462 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:23.886493 22448 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:23.888875 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:23.889513 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:23.890305 21831 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:23.889703 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 562) took 2700 ms. Trace:
I20260709 13:09:23.892421 21765 rpcz_store.cc:276] 0709 13:09:21.189579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.189746 (+   167us) service_pool.cc:224] Handling call
0709 13:09:21.197263 (+  7517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:21.198020 (+   757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:21.198065 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:21.238795 (+ 40730us) log.cc:844] Serialized 26 byte log entry
0709 13:09:21.512178 (+273383us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:21.845880 (+333702us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.889185 (+2043305us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b540030eba0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae2d2733 00007fc6ae357dbf 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c
0709 13:09:23.889240 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.889358 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:23.889412 (+    54us) raft_consensus.cc:1685] finished
0709 13:09:23.889513 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.889643 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11078,"prepare.queue_time_us":193715,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":65,"raft.queue_time_us":204,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":10526,"spinlock_wait_cycles":58730752,"thread_start_us":507068,"threads_started":2,"wal-append.queue_time_us":319415,"wal-append.run_cpu_time_us":4572,"wal-append.run_wall_time_us":1367750}
I20260709 13:09:23.895993 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:23.896728 21832 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:09:23.896998 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:23.896984 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1516) took 1743 ms. Trace:
I20260709 13:09:23.887518 25865 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:23.897056 25986 raft_consensus.cc:2764] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:09:23.916592 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:23.923867 25944 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:23.925179 21912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1531) took 2316 ms. Trace:
I20260709 13:09:23.903172 21831 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 15.
I20260709 13:09:23.906420 25909 raft_consensus.cc:3055] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:23.901742 21765 rpcz_store.cc:276] 0709 13:09:22.153737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.896026 (+1742289us) service_pool.cc:224] Handling call
0709 13:09:23.896331 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:23.896544 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.896606 (+    62us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:23.896670 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:23.896725 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.896786 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:23.896918 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:23.927671 22448 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:23.911338 22482 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEARNER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:23.911432 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:23.913306 21832 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:09:23.885353 25851 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:23.911612 25859 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:23.925693 21912 rpcz_store.cc:276] 0709 13:09:21.608355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.608535 (+   180us) service_pool.cc:224] Handling call
0709 13:09:21.608864 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:21.915011 (+306147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.924935 (+2009924us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b540021aa54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:23.925110 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702516608}
I20260709 13:09:23.926990 22484 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:23.929503 21833 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:24.473110 25831 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.315482 25943 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:24.515132 25831 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:24.315088 25832 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:24.516566 25832 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:24.061280 21763 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:24.517380 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:24.473881 25891 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:24.059268 25956 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:24.368571 25958 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:24.518214 21840 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
W20260709 13:09:24.475169 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:24.474084 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 1.42164e+06us
I20260709 13:09:24.515307 25943 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:24.520027 21731 connection.cc:256] RPC call timeout handler was delayed by -1.4416097319999608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
I20260709 13:09:24.518124 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1519) took 2363 ms. Trace:
W20260709 13:09:24.468163 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 2.31174e+06us
I20260709 13:09:24.521064 25872 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:24.522755 25872 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:24.523326 25832 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:24.518694 25958 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:24.525161 25872 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:24.521898 25695 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:24.521600 21763 rpcz_store.cc:276] 0709 13:09:22.154533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:24.060604 (+1906071us) service_pool.cc:224] Handling call
0709 13:09:24.061022 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.517851 (+456829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.518062 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:09:24.525883 25695 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:24.527196 25943 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:24.525349 25958 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:24.077840 25950 log.cc:927] Time spent T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 1.556s	user 0.003s	sys 0.016s
I20260709 13:09:24.313778 25957 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:24.367918 25869 consensus_meta.cc:287] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.000s
I20260709 13:09:24.472885 25895 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.473664 25842 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:24.322889 25865 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:24.529457 25842 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:24.531380 25865 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:24.529382 25895 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:24.472188 25735 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:24.532775 25735 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:24.307844 25992 log.cc:927] Time spent T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.406s	user 0.001s	sys 0.000s
I20260709 13:09:24.474232 25836 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:24.472422 25795 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.460508 22448 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:24.531770 25842 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:24.063005 21839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 3063) took 1251 ms. Trace:
I20260709 13:09:23.970256 25899 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:23.927664 25909 raft_consensus.cc:740] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:24.536423 25872 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.528185 25695 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:24.537633 25895 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:24.066211 22478 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36270 (request call id 669) took 2288 ms (client timeout 2128 ms). Trace:
W20260709 13:09:24.187219 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.163138 25938 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.064906 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44772 (request call id 564) took 2630 ms. Trace:
W20260709 13:09:24.155510 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:23.936411 21765 raft_consensus.cc:1275] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:09:24.558698 22478 rpcz_store.cc:269] 0709 13:09:21.777849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:21.778104 (+   255us) service_pool.cc:224] Handling call
0709 13:09:24.065968 (+2287864us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b5400510c54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:24.066098 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3764929920}
I20260709 13:09:24.547251 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:24.466320 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:24.561391 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.528374 21806 leader_election.cc:400] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10.
I20260709 13:09:24.564064 21806 leader_election.cc:403] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:24.565785 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:24.122900 25993 log.cc:927] Time spent T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.232s	user 0.000s	sys 0.000s
W20260709 13:09:24.554505 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 94130.6us
I20260709 13:09:24.555590 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:24.551672 21839 rpcz_store.cc:276] 0709 13:09:22.811467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.812377 (+   910us) service_pool.cc:224] Handling call
0709 13:09:22.812692 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.867728 (+ 55036us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.867758 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:22.867810 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:22.867851 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.062768 (+1194917us) spinlock_profiling.cc:243] Waited 54.8 ms on lock 0x7b54000bdbd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:24.062812 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.062935 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":126147840}
I20260709 13:09:24.526903 21652 maintenance_manager.cc:419] P ff36b0eb624c458eb7f542eb2e635aa2: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033352
I20260709 13:09:24.561969 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1518) took 2407 ms. Trace:
W20260709 13:09:24.563449 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:24.584441 21663 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52326 (request call id 153) took 18430 ms (client timeout 15000 ms). Trace:
I20260709 13:09:24.528317 25957 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:24.476815 25843 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:24.580081 21833 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:09:24.475507 25780 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:24.635246 22448 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:24.634984 21765 rpcz_store.cc:276] 0709 13:09:22.154275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.927958 (+1773683us) service_pool.cc:224] Handling call
0709 13:09:23.928226 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.561688 (+633462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.561913 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:09:24.610826 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.560608 21761 rpcz_store.cc:276] 0709 13:09:21.434099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.105560 (+671461us) service_pool.cc:224] Handling call
0709 13:09:22.106261 (+   701us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:22.106626 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:22.106675 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:22.107230 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:09:22.117028 (+  9798us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:22.118037 (+  1009us) log.cc:844] Serialized 14 byte log entry
0709 13:09:24.064286 (+1946249us) spinlock_profiling.cc:243] Waited 6.48 ms on lock 0x7b18002d7120. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab1e4c0a 00007fc6b4924219 00007fc6ab26ca40 00007fc6ab2674e4 00007fc6ab267455 00007fc6ae34f060 00007fc6ae361716 00007fc6ae372287 00007fc6ae372208
0709 13:09:24.064512 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.064608 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.064647 (+    39us) raft_consensus.cc:1685] finished
0709 13:09:24.064742 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.064851 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1934448,"prepare.queue_time_us":457,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":1959872,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":9729,"spinlock_wait_cycles":14915328,"thread_start_us":9206,"threads_started":1,"wal-append.queue_time_us":66553,"wal-append.run_cpu_time_us":26031,"wal-append.run_wall_time_us":1697633}
I20260709 13:09:24.550630 25215 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:24.560367 25969 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:23.935989 25944 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.648s
I20260709 13:09:24.560149 25842 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:24.665485 25724 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:24.666803 25735 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:24.667153 25724 raft_consensus.cc:697] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:24.667423 25735 consensus_queue.cc:1059] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:24.654075 25831 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:24.668165 25724 consensus_queue.cc:237] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:24.669000 25396 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:24.669595 25396 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:24.670030 25969 raft_consensus.cc:697] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:24.671077 25969 consensus_queue.cc:237] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:24.671591 25396 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:24.663028 25843 raft_consensus.cc:697] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:24.672140 25215 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:24.634754 21663 rpcz_store.cc:269] 0709 13:09:06.123832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:06.124024 (+   192us) service_pool.cc:224] Handling call
0709 13:09:24.554366 (+18430342us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:19.924266 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:19.990584 (+ 66318us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:19.990655 (+    71us) write_op.cc:435] Acquired schema lock
0709 13:09:19.990678 (+    23us) tablet.cc:662] Decoding operations
0709 13:09:19.992261 (+  1583us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:19.992363 (+   102us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:19.992417 (+    54us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:09:19.994158 (+  1741us) tablet.cc:701] Row locks acquired
0709 13:09:19.994193 (+    35us) write_op.cc:260] PREPARE: finished
0709 13:09:19.994340 (+   147us) write_op.cc:270] Start()
0709 13:09:19.994465 (+   125us) write_op.cc:276] Timestamp: P: 1783602559994294 usec, L: 0
0709 13:09:19.994490 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:09:19.995327 (+   837us) log.cc:844] Serialized 4678 byte log entry
0709 13:09:21.085383 (+1090056us) op_driver.cc:464] REPLICATION: finished
0709 13:09:21.319727 (+234344us) write_op.cc:301] APPLY: starting
0709 13:09:21.321606 (+  1879us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:21.329147 (+  7541us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:21.329265 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:21.341106 (+ 11841us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:21.341349 (+   243us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:09:21.341398 (+    49us) write_op.cc:312] APPLY: finished
0709 13:09:21.341727 (+   329us) log.cc:844] Serialized 89 byte log entry
0709 13:09:21.341911 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:21.342081 (+   170us) write_op.cc:454] Released schema lock
0709 13:09:21.342140 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:21.390287 (+ 48147us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:21.393644 (+  3357us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":129718,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":188058,"apply.run_cpu_time_us":3892,"apply.run_wall_time_us":83965,"num_ops":12,"prepare.queue_time_us":650380,"prepare.run_cpu_time_us":48638,"prepare.run_wall_time_us":616585,"raft.queue_time_us":198754,"raft.run_cpu_time_us":27766,"raft.run_wall_time_us":209346,"replication_time_us":1068278,"spinlock_wait_cycles":2432,"thread_start_us":1139999,"threads_started":4,"wal-append.queue_time_us":445084,"wal-append.run_cpu_time_us":48681,"wal-append.run_wall_time_us":1922452}]]}
I20260709 13:09:24.634428 25876 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10.
I20260709 13:09:24.673171 25843 consensus_queue.cc:237] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:24.674309 25909 consensus_queue.cc:260] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:24.675616 25909 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:24.565834 25947 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:24.646863 25708 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:24.582326 25895 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:24.582659 25869 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.643723 25892 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:24.646879 25943 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.567286 25695 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:09:24.654315 25992 log.cc:927] Time spent T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:09:24.646632 25933 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:24.558254 25795 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:24.558799 25836 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:24.668394 25735 raft_consensus.cc:3055] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:24.560938 25872 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:24.557988 25891 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:24.583397 25938 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:24.803437 25859 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.663271 25780 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:24.806041 25396 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:24.900599 22484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36290 (request call id 1064) took 1230 ms. Trace:
I20260709 13:09:24.905591 22484 rpcz_store.cc:276] 0709 13:09:23.670277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.672716 (+  2439us) service_pool.cc:224] Handling call
0709 13:09:23.926815 (+254099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:24.527596 (+600781us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.900372 (+372776us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54005eae50. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:24.900528 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":583698304}
I20260709 13:09:24.666811 25842 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:24.925494 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 188913us
I20260709 13:09:24.879112 25869 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:24.932219 22480 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36278 (request call id 588) took 1264 ms. Trace:
I20260709 13:09:24.903041 25215 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:24.886341 25735 raft_consensus.cc:740] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:24.860508 25708 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:24.857156 25895 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:24.837327 25947 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:24.884981 25943 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:24.882123 25892 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:24.884801 25695 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:24.932809 22480 rpcz_store.cc:276] 0709 13:09:23.667810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.668155 (+   345us) service_pool.cc:224] Handling call
0709 13:09:23.668472 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.678164 (+  9692us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:23.743181 (+ 65017us) log.cc:844] Serialized 14 byte log entry
0709 13:09:23.849778 (+106597us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:23.850413 (+   635us) log.cc:844] Serialized 26 byte log entry
0709 13:09:23.850578 (+   165us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:23.850610 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:23.850743 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:24.931917 (+1081174us) raft_consensus.cc:1685] finished
0709 13:09:24.931950 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:24.932135 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3264,"prepare.queue_time_us":141690,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":4387,"raft.queue_time_us":10906,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":4301,"thread_start_us":120391,"threads_started":2,"wal-append.queue_time_us":124606}
I20260709 13:09:24.886631 25933 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:24.970429 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:24.924461 25859 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:24.927062 25396 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:24.985064 21758 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.009s	sys 0.022s
W20260709 13:09:24.985630 21758 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.009s	sys 0.022s
W20260709 13:09:25.003032 21729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.013s	sys 0.056s
W20260709 13:09:25.003592 21729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.013s	sys 0.056s
W20260709 13:09:25.003924 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 2.1082e+06us
I20260709 13:09:25.006605 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:25.019227 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:25.020390 21912 raft_consensus.cc:2393] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 12: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:25.028469 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:25.033988 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:25.038018 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:25.038952 21906 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:25.042536 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:25.045668 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:25.056177 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:24.972437 25708 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:25.058779 21762 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.014s	sys 0.030s
W20260709 13:09:25.063421 21762 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.014s	sys 0.030s
I20260709 13:09:25.064554 21762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2883) took 3142 ms. Trace:
W20260709 13:09:25.011679 21730 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.025s	sys 0.045s
W20260709 13:09:25.065994 21730 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.025s	sys 0.046s
I20260709 13:09:25.061267 21914 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:09:25.080487 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.083285 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:25.084236 22480 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:25.090324 21731 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:25.092080 21911 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:09:24.985052 25629 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:25.099658 22480 raft_consensus.cc:1240] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:25.065089 21762 rpcz_store.cc:276] 0709 13:09:21.922232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.862206 (+939974us) service_pool.cc:224] Handling call
0709 13:09:22.862578 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:22.862772 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:09:23.102425 (+239653us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.063895 (+1961470us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:25.063968 (+    73us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:25.064053 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.064327 (+   274us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.064480 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1297174,"prepare.queue_time_us":343095,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":977,"raft.queue_time_us":1298813,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"thread_start_us":884309,"threads_started":3,"wal-append.queue_time_us":75204,"wal-append.run_cpu_time_us":1282,"wal-append.run_wall_time_us":1001296}
I20260709 13:09:25.071189 25831 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:25.116740 25795 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:25.112736 25629 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:25.126003 25795 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:25.126236 25695 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:25.126878 25695 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:25.126588 25795 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:25.127367 25695 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:25.128304 25629 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:25.128934 25795 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:25.129323 25695 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:25.129536 25795 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:25.134987 25695 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.135164 25795 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:25.135456 25695 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:25.137929 25795 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:24.985620 25735 consensus_queue.cc:260] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:25.476137 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.455415 22451 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.008s	sys 0.010s
W20260709 13:09:25.447208 22450 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.026s	sys 0.029s
W20260709 13:09:25.350447 21757 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.007s	sys 0.015s
W20260709 13:09:25.561007 21879 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.000s	sys 0.021s
W20260709 13:09:25.607811 21757 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.121s	user 0.010s	sys 0.020s
W20260709 13:09:25.607869 21879 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.000s	sys 0.021s
W20260709 13:09:25.606180 22450 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.028s	sys 0.046s
W20260709 13:09:25.531461 21804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.022s	sys 0.043s
W20260709 13:09:25.609611 21804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.022s	sys 0.043s
I20260709 13:09:25.614375 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:25.442296 21756 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.004s	sys 0.013s
I20260709 13:09:25.613819 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:25.362103 21759 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.002s	sys 0.020s
W20260709 13:09:25.350703 21760 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.009s	sys 0.009s
I20260709 13:09:25.613358 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:25.615118 21831 raft_consensus.cc:1240] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:25.612752 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:09:25.609001 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 962024us
I20260709 13:09:25.138238 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:25.637807 21832 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 5.
W20260709 13:09:25.650998 21805 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.998s	user 0.023s	sys 0.052s
W20260709 13:09:25.651615 21805 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.023s	sys 0.053s
W20260709 13:09:25.652020 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 1.00794e+06us
W20260709 13:09:25.653235 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.638303 21756 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.004s	sys 0.019s
I20260709 13:09:25.114231 25957 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:25.638867 21759 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.078s	user 0.006s	sys 0.024s
W20260709 13:09:25.606716 21877 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.019s	sys 0.055s
W20260709 13:09:25.663483 21877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.020s	sys 0.055s
W20260709 13:09:25.639286 21760 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.156s	user 0.009s	sys 0.017s
W20260709 13:09:25.605350 22451 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.008s	sys 0.014s
I20260709 13:09:25.638685 21840 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
W20260709 13:09:25.409528 25724 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.012s	sys 0.005s
W20260709 13:09:25.132128 25996 log.cc:927] Time spent T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:09:25.661280 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:25.195767 25998 log.cc:927] Time spent T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:09:25.422199 25313 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.012s	sys 0.004s
W20260709 13:09:25.132524 25997 log.cc:927] Time spent T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.230s	user 0.000s	sys 0.000s
W20260709 13:09:25.555053 25783 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.008s	sys 0.012s
W20260709 13:09:25.482205 25843 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.008s	sys 0.052s
W20260709 13:09:25.129891 25999 log.cc:927] Time spent T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:09:25.347028 25842 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:25.672094 25944 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:25.693785 25843 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.017s	user 0.008s	sys 0.056s
I20260709 13:09:25.694099 21837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56424 (request call id 530) took 1799 ms. Trace:
W20260709 13:09:25.694465 25783 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.009s	sys 0.014s
I20260709 13:09:25.672860 25833 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:09:25.616568 25865 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.000s	sys 0.020s
I20260709 13:09:25.671789 25965 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:25.695379 25865 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.001s	sys 0.020s
I20260709 13:09:25.363564 25836 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:25.694582 21837 rpcz_store.cc:276] 0709 13:09:23.894327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.894475 (+   148us) service_pool.cc:224] Handling call
0709 13:09:23.894860 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.904913 (+ 10053us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:23.904951 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:23.905402 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:09:24.542151 (+636749us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:24.542198 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.542265 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:25.693848 (+1151583us) raft_consensus.cc:1685] finished
0709 13:09:25.693871 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.694029 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9624,"raft.queue_time_us":9804,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"thread_start_us":147939,"threads_started":1,"wal-append.queue_time_us":1075093}
I20260709 13:09:25.334939 25938 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:25.456225 25943 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:25.618377 25909 consensus_meta.cc:287] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.942s	user 0.009s	sys 0.004s
I20260709 13:09:25.318856 25872 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:25.477949 25939 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.001s	sys 0.017s
I20260709 13:09:25.347424 25859 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:25.684111 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:25.177752 25832 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.183024 25695 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:25.672616 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:25.131393 25396 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:25.561098 26003 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:25.423091 25892 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:25.346024 25895 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:25.421900 26001 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:25.671970 25724 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.000s	user 0.018s	sys 0.007s
I20260709 13:09:25.682811 26002 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.695936 25965 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:25.683060 21832 raft_consensus.cc:2410] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 13:09:25.875147 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.876374 21758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.009s	sys 0.003s
W20260709 13:09:25.883551 21758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.010s	sys 0.004s
I20260709 13:09:25.883737 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:25.884812 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:25.882984 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:25.885807 21840 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:09:25.876241 21764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2876) took 4234 ms. Trace:
I20260709 13:09:25.886188 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:25.886430 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:25.887432 21832 raft_consensus.cc:2410] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:09:25.878315 21731 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.007s	sys 0.015s
W20260709 13:09:25.888319 21731 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.008s	sys 0.016s
I20260709 13:09:25.886694 21764 rpcz_store.cc:276] 0709 13:09:21.641096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.140858 (+499762us) service_pool.cc:224] Handling call
0709 13:09:22.141252 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:24.468532 (+2327280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.468578 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:24.484404 (+ 15826us) log.cc:844] Serialized 26 byte log entry
0709 13:09:24.948227 (+463823us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:24.948286 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.948360 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:25.875336 (+926976us) raft_consensus.cc:1685] finished
0709 13:09:25.875417 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.875884 (+   467us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2311789,"raft.queue_time_us":2313489,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":98,"thread_start_us":462326,"threads_started":1,"wal-append.queue_time_us":1213053}
I20260709 13:09:25.888780 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:25.888935 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 798711us
I20260709 13:09:25.878700 21759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2875) took 4237 ms. Trace:
I20260709 13:09:25.889804 21835 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:09:25.890156 21759 rpcz_store.cc:276] 0709 13:09:21.640846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:22.125044 (+484198us) service_pool.cc:224] Handling call
0709 13:09:22.125281 (+   237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:24.064574 (+1939293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.064606 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:24.065077 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:09:24.386389 (+321312us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:25.877060 (+1490671us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.877934 (+   874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.878120 (+   186us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:25.878225 (+   105us) raft_consensus.cc:1685] finished
0709 13:09:25.878236 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.878497 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1938689,"prepare.queue_time_us":1375684,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":1939977,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":1422451,"threads_started":2,"wal-append.queue_time_us":900834}
I20260709 13:09:25.879912 21760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1512) took 3727 ms. Trace:
I20260709 13:09:25.887375 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:25.894629 21837 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:25.893180 21760 rpcz_store.cc:276] 0709 13:09:22.152584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.131002 (+978418us) service_pool.cc:224] Handling call
0709 13:09:23.131442 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:24.478337 (+1346895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.478382 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:24.483209 (+  4827us) log.cc:844] Serialized 26 byte log entry
0709 13:09:25.664913 (+1181704us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:09:25.664977 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.665081 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:25.879345 (+214264us) raft_consensus.cc:1685] finished
0709 13:09:25.879399 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.879709 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1346413,"raft.queue_time_us":1346618,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":1181210,"threads_started":1,"wal-append.queue_time_us":1284645}
I20260709 13:09:25.880087 21838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56424 (request call id 526) took 1992 ms. Trace:
I20260709 13:09:25.886431 21758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1513) took 3733 ms. Trace:
I20260709 13:09:25.896095 21838 rpcz_store.cc:276] 0709 13:09:23.887670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.887861 (+   191us) service_pool.cc:224] Handling call
0709 13:09:23.888264 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:23.890627 (+  2363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:23.890668 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:24.055823 (+165155us) spinlock_profiling.cc:243] Waited 887 us on lock 0x7b2c0000e678. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6acc50a11 00007fc6acc60372 00007fc6ae392a01 00007fc6ae35743a 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2
0709 13:09:24.056372 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 13:09:24.464020 (+407648us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:24.464085 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:24.464189 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:25.879283 (+1415094us) raft_consensus.cc:1685] finished
0709 13:09:25.879343 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.879799 (+   456us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4148,"raft.queue_time_us":111,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":3148,"spinlock_wait_cycles":2263552,"thread_start_us":349959,"threads_started":1,"wal-append.queue_time_us":1007465}
I20260709 13:09:25.887233 21831 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
W20260709 13:09:25.877753 21730 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.004s	sys 0.018s
W20260709 13:09:25.899334 21730 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.822s	user 0.005s	sys 0.018s
I20260709 13:09:25.898037 21758 rpcz_store.cc:276] 0709 13:09:22.152864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.321502 (+1168638us) service_pool.cc:224] Handling call
0709 13:09:23.321873 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:24.986210 (+1664337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.986312 (+   102us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:25.062416 (+ 76104us) log.cc:844] Serialized 52 byte log entry
0709 13:09:25.884359 (+821943us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:25.885154 (+   795us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.885755 (+   601us) log.cc:844] Serialized 14 byte log entry
0709 13:09:25.885950 (+   195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:25.886078 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:25.886154 (+    76us) raft_consensus.cc:1685] finished
0709 13:09:25.886172 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:25.886380 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1154096,"raft.queue_time_us":1155644,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"thread_start_us":1273682,"threads_started":2,"wal-append.queue_time_us":735396}
W20260709 13:09:25.900161 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:25.748281 21911 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.020s	sys 0.023s
I20260709 13:09:25.905139 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:25.905807 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:25.905932 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:25.904148 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:25.912560 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:25.916611 21837 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:25.906924 21832 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
W20260709 13:09:25.914922 21911 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.020s	sys 0.023s
I20260709 13:09:25.917495 21839 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:09:25.911259 21660 catalog_manager.cc:5697] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 6 to 9, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 9 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:25.876410 21729 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.009s	sys 0.007s
W20260709 13:09:25.925916 21729 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.010s	sys 0.007s
W20260709 13:09:25.930402 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 274994us
W20260709 13:09:25.795409 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.705376 25396 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:25.718962 25724 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:09:25.692260 25313 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.226s	user 0.013s	sys 0.010s
I20260709 13:09:25.708781 25711 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:25.647092 25780 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:25.179229 25831 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.093575 25711 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.096563 25711 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:26.096803 25831 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:25.702066 25832 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:26.097987 25724 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.098917 25843 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:26.100018 25832 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:26.099759 25843 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:25.695284 25833 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:25.206982 25869 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:25.702736 25859 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:26.101671 21834 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
W20260709 13:09:25.700206 25939 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.023s	user 0.002s	sys 0.018s
W20260709 13:09:26.102111 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:25.655798 25947 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:25.693897 25944 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:26.104151 26025 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.104041 25396 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.104984 26025 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.105711 25944 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:25.708249 25969 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.037s	sys 0.012s
W20260709 13:09:26.106582 25969 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.149s	user 0.038s	sys 0.013s
I20260709 13:09:25.706504 26003 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:26.107574 26003 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:26.108049 26025 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:25.722036 26002 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:25.728857 26001 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:25.935923 21660 catalog_manager.cc:5697] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
W20260709 13:09:26.114939 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.116353 26012 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.116990 26001 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:25.952891 25895 consensus_queue.cc:1059] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:26.079030 26043 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.117472 25695 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:26.117986 26043 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.118369 25695 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:26.120684 26043 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:26.080485 25872 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:25.929307 21805 connection.cc:256] RPC call timeout handler was delayed by -1.2362767739998617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18230000000000002s for a response
I20260709 13:09:26.079360 21911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:09:26.115468 21660 catalog_manager.cc:5697] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.089421 26004 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:26.117197 26012 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:26.106829 25396 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:26.121666 21805 connection.cc:256] RPC call timeout handler was delayed by -1.2275464459999057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260709 13:09:26.121721 21879 connection.cc:256] RPC call timeout handler was delayed by -1.3825679029999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28130000000000005s for a response
I20260709 13:09:26.122644 26004 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.121932 21911 raft_consensus.cc:606] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:26.135802 21911 raft_consensus.cc:614] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:26.137777 21879 connection.cc:256] RPC call timeout handler was delayed by -1.1795691519999991s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
W20260709 13:09:26.138290 21879 connection.cc:256] RPC call timeout handler was delayed by -1.1624691520000852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15400000000000003s for a response
I20260709 13:09:26.139365 26032 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:26.141580 26038 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:09:26.142149 21805 connection.cc:256] RPC call timeout handler was delayed by -1.165446445999919s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
W20260709 13:09:26.142567 21805 connection.cc:256] RPC call timeout handler was delayed by -1.1546464459999015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
W20260709 13:09:26.142963 21805 connection.cc:256] RPC call timeout handler was delayed by -1.0961464459999206s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1733s for a response
I20260709 13:09:26.142411 26038 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:26.143229 21805 connection.cc:256] RPC call timeout handler was delayed by -1.0472767739998972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2033s for a response
I20260709 13:09:26.121348 25695 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:26.127213 25843 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:26.121536 26037 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.145404 25947 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.140597 26032 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.172616 25724 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:26.145364 26038 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:26.102119 25859 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:26.178155 26002 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:26.179188 25843 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:26.179860 25843 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:26.180213 25859 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:26.180986 26012 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:26.181901 26042 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:26.181531 25947 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.145828 26004 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:26.124289 25965 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:26.173456 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 92723.9us
I20260709 13:09:26.121584 25872 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:26.199582 26037 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:26.203831 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.204588 22484 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:26.206029 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.206143 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.207329 22476 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:26.207599 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.208549 22484 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:09:26.212412 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.214570 22481 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:26.215687 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.214455 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.224637 25872 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:26.227591 26037 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:26.230479 26012 consensus_queue.cc:1059] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:26.160861 21660 catalog_manager.cc:5697] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 8 to 9, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 9 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.231556 26012 raft_consensus.cc:3055] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:26.231989 26012 raft_consensus.cc:740] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:26.228397 25859 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:26.231319 25892 consensus_queue.cc:1048] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:26.168042 25831 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.232405 21660 catalog_manager.cc:5697] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.274395 25843 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:26.182721 26042 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.218503 21879 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:26.166232 25944 consensus_queue.cc:1059] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.086s
I20260709 13:09:26.286381 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.287392 22483 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:26.312314 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.283792 26042 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:26.300836 26032 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:26.233338 26012 consensus_queue.cc:260] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:26.282402 25831 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:26.337275 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.341331 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.342399 26053 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.343216 26053 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:26.347039 26012 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:26.347388 21806 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:26.348722 25947 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:26.349536 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.350256 21660 catalog_manager.cc:5697] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 8 to 10, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 10 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.352397 26037 consensus_queue.cc:1059] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:26.354070 26037 raft_consensus.cc:3055] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:26.354501 26037 raft_consensus.cc:740] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:26.355873 26037 consensus_queue.cc:260] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.327705 26049 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:09:26.358114 26037 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:26.325982 26026 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:26.359444 26003 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.359881 26026 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.364537 26026 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:26.332970 25396 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:26.365351 25396 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:26.365782 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.367374 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:26.368269 25831 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:26.327744 21805 leader_election.cc:336] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.656s (SENT)
I20260709 13:09:26.368772 21756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1511) took 4216 ms. Trace:
W20260709 13:09:26.350698 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 147930us
I20260709 13:09:26.352466 21660 catalog_manager.cc:5697] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 10 to 11, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 11 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.337327 26024 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:26.365815 25396 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:26.380163 21911 pending_rounds.cc:85] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 10
I20260709 13:09:26.385730 21911 pending_rounds.cc:107] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:09:26.386071 21911 raft_consensus.cc:2889] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:26.388492 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.389829 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.391306 26024 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:26.392091 25833 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:26.394393 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 47275.7us
I20260709 13:09:26.377820 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:26.398209 21879 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:26.398463 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.399899 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.400189 25891 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:26.400904 26050 consensus_queue.cc:1059] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:26.401719 26050 consensus_queue.cc:1243] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer 6fadfd81c5a645f1806a284ddbb6bf0d log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:09:26.402086 25947 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:26.402336 21909 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:09:26.402638 25947 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:26.403223 25947 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:26.403525 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:26.393903 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 74121.2us
I20260709 13:09:26.408265 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.409304 22479 raft_consensus.cc:2410] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:09:26.409616 21728 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:26.410357 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.411913 26043 raft_consensus.cc:3055] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:26.412014 21728 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:26.412535 26043 raft_consensus.cc:740] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:26.414916 25891 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:09:26.415405 25891 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:26.415483 21877 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:26.415798 25891 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:26.417037 25859 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:26.417496 25859 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:26.417929 25859 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:26.420828 25943 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:26.421267 25943 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:26.421693 25943 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:26.424353 25735 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:26.425823 25215 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:26.426369 25215 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:26.426882 26024 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:26.429275 25892 raft_consensus.cc:3055] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:26.429800 25892 raft_consensus.cc:740] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:26.430742 25892 consensus_queue.cc:260] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:26.432216 25892 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:26.432042 25859 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.433692 26053 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:26.434229 25859 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:26.434898 25859 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:26.435508 25933 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:26.435557 25859 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.399775 21731 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:26.439716 25859 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:26.438593 21660 catalog_manager.cc:5697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 7 to 9, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 9 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.426883 25215 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:26.441383 26053 raft_consensus.cc:2804] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:26.441840 26053 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.399807 21879 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:26.441613 21660 catalog_manager.cc:5697] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 6 to 7, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 7 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.443919 25629 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.443635 26043 consensus_queue.cc:260] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.444727 26049 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.444295 21660 catalog_manager.cc:5697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 4 to 5, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 5 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:26.445386 26043 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:26.445290 26049 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.446089 26037 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:26.446730 26037 raft_consensus.cc:697] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:26.447957 26049 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:26.447829 26037 consensus_queue.cc:237] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:26.444442 25629 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.369223 21756 rpcz_store.cc:276] 0709 13:09:22.152300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.057490 (+905190us) service_pool.cc:224] Handling call
0709 13:09:23.133268 (+ 75778us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:24.475769 (+1342501us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:09:25.655197 (+1179428us) log.cc:844] Serialized 14 byte log entry
0709 13:09:26.274524 (+619327us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:26.275287 (+   763us) log.cc:844] Serialized 26 byte log entry
0709 13:09:26.275439 (+   152us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:26.275690 (+   251us) log.cc:844] Serialized 14 byte log entry
0709 13:09:26.275851 (+   161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.275963 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.282651 (+  6688us) raft_consensus.cc:1685] finished
0709 13:09:26.282678 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.368505 (+ 85827us) spinlock_profiling.cc:243] Waited 75.3 ms on lock 0x7b5400039150. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:26.368619 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1523393,"prepare.queue_time_us":1305904,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":1393225,"raft.run_cpu_time_us":504,"raft.run_wall_time_us":42819,"spinlock_wait_cycles":173237120,"thread_start_us":1289565,"threads_started":3,"wal-append.queue_time_us":257235}
I20260709 13:09:26.450577 25629 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:26.451490 25933 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:26.452677 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:26.454427 21806 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:26.455351 25832 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:26.455827 25832 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:26.456281 25832 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:26.457858 25969 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:26.458460 25969 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.460577 25969 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:26.442250 26053 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:26.465734 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 66116.5us
W20260709 13:09:26.470919 21804 connection.cc:256] RPC call timeout handler was delayed by -1.3836263489998828s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260709 13:09:26.471345 21804 connection.cc:256] RPC call timeout handler was delayed by -1.3694692489999625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
W20260709 13:09:26.471657 21804 connection.cc:256] RPC call timeout handler was delayed by -1.3550515590000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 13:09:26.472077 21804 connection.cc:256] RPC call timeout handler was delayed by -1.0530514099999664s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
I20260709 13:09:26.473860 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:26.474632 21836 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
W20260709 13:09:26.484566 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.486650 25396 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.488103 21906 raft_consensus.cc:1240] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:26.473999 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 60950us
I20260709 13:09:26.494166 26003 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:26.494478 21728 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:26.502151 21728 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:26.503067 21728 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:26.503101 25842 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:26.503804 25842 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.504908 25842 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:26.509922 26003 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:26.511148 26003 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:26.512225 26003 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:26.514919 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:26.515166 21757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1514) took 4175 ms. Trace:
I20260709 13:09:26.515929 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:26.501113 21879 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:26.516741 21759 raft_consensus.cc:2468] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:09:26.522238 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:26.522984 21762 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:26.523138 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:09:26.523922 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.504437 25830 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:26.522508 21764 raft_consensus.cc:1240] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:26.524302 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.524668 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:26.524416 25830 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.525508 21906 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:09:26.504329 21728 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:26.530851 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:26.525545 25830 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:26.539876 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.539582 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:26.515620 21757 rpcz_store.cc:276] 0709 13:09:22.153135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:23.804686 (+1651551us) service_pool.cc:224] Handling call
0709 13:09:23.805040 (+   354us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:24.477303 (+672263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:24.477346 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:24.483317 (+  5971us) log.cc:844] Serialized 52 byte log entry
0709 13:09:25.608289 (+1124972us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:26.080182 (+471893us) log.cc:844] Serialized 14 byte log entry
0709 13:09:26.310396 (+230214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:26.318655 (+  8259us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:26.318727 (+    72us) raft_consensus.cc:1685] finished
0709 13:09:26.318775 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:26.328763 (+  9988us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":719160,"prepare.queue_time_us":172847,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":703229,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":9435,"spinlock_wait_cycles":78720,"thread_start_us":1745662,"threads_started":3,"wal-append.queue_time_us":1319828}
I20260709 13:09:26.542821 21909 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:09:26.539634 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:26.539614 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:26.541499 22449 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:26.550833 21764 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
W20260709 13:09:26.551311 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 46999.2us
I20260709 13:09:26.534192 25711 consensus_queue.cc:1059] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:09:26.552888 21728 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:26.552001 26051 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:26.554198 22479 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:09:26.563488 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 112750us
I20260709 13:09:26.566427 22449 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:26.534965 25891 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:26.578529 25711 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:26.606302 25711 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:26.606724 25711 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:26.566618 25947 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:26.580547 26032 raft_consensus.cc:3055] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:26.626060 25795 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:09:26.628543 21909 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:09:26.629356 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:26.623795 26051 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:26.630880 26051 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:26.631318 26051 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:26.635574 25891 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:26.638109 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:26.639365 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:26.639977 21761 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:26.582559 21660 catalog_manager.cc:5697] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
W20260709 13:09:26.663869 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 111062us
I20260709 13:09:26.667711 22448 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:26.613476 26037 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:26.671316 25947 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:26.671638 26052 log.cc:927] Time spent T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:09:26.673384 26061 log.cc:927] Time spent T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:09:26.658671 21660 catalog_manager.cc:5697] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:26.623766 26032 raft_consensus.cc:740] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:26.706225 25215 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:26.707646 21764 raft_consensus.cc:1240] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:26.706506 21660 catalog_manager.cc:5697] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.727370 21909 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:26.731689 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 143414us
I20260709 13:09:26.733834 21728 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:26.786748 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 57957.8us
W20260709 13:09:26.858474 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 91952.1us
I20260709 13:09:26.790206 21912 raft_consensus.cc:1240] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:26.742182 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:26.864655 21909 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:26.835664 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:09:26.724598 26062 log.cc:927] Time spent T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:09:26.790680 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:26.741154 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:26.950537 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:26.961881 21761 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:09:26.951128 21759 raft_consensus.cc:1275] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:09:26.765291 21660 catalog_manager.cc:5697] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
W20260709 13:09:26.786749 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 162120us
I20260709 13:09:26.793798 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:26.978085 21914 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:09:26.730955 25396 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:26.813529 25629 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:27.015673 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.016323 21761 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:27.017843 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:09:26.983174 25735 consensus_meta.cc:287] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.008s
I20260709 13:09:27.017125 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:26.727507 25832 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.815578 25711 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.813342 26003 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:26.836676 25943 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:26.869292 26032 consensus_queue.cc:260] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:27.074471 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 55618.9us
I20260709 13:09:27.189662 25215 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:27.043628 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.213914 25832 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:27.124059 21759 raft_consensus.cc:2368] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12.
I20260709 13:09:27.215377 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:27.216008 25943 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:27.074213 21758 raft_consensus.cc:1275] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
W20260709 13:09:27.038185 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.217044 21758 pending_rounds.cc:85] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 7
I20260709 13:09:27.217510 21758 pending_rounds.cc:107] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:09:27.010538 25842 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:27.220336 21758 raft_consensus.cc:2889] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:27.221037 21760 raft_consensus.cc:2393] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 9: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:27.221771 25842 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:27.019166 25629 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:27.222496 25629 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:27.224535 26003 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:27.224653 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:09:27.209182 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 484141us
I20260709 13:09:27.215358 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:27.139853 26057 log.cc:927] Time spent T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 13:09:27.140239 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:27.205478 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 704688us
W20260709 13:09:27.075160 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 48197.5us
I20260709 13:09:27.196203 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.143821 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.178463 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:27.209970 26053 consensus_meta.cc:287] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.741s	user 0.007s	sys 0.005s
W20260709 13:09:27.234637 25830 consensus_meta.cc:287] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.682s	user 0.006s	sys 0.006s
I20260709 13:09:27.245630 22479 raft_consensus.cc:1240] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:09:27.035558 25891 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:27.245661 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.252724 21910 raft_consensus.cc:2410] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:09:26.999053 26042 consensus_queue.cc:1059] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.242s
I20260709 13:09:27.255834 21765 raft_consensus.cc:1240] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:27.255004 21906 raft_consensus.cc:2393] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 12: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:27.258016 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:27.259464 26043 consensus_meta.cc:287] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.813s	user 0.012s	sys 0.000s
I20260709 13:09:27.259858 25711 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:27.249905 25830 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:27.261005 21761 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:09:27.262866 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.263473 21761 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:27.264309 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.267006 21728 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:27.270068 25842 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:27.270457 25842 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.270782 25842 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:27.273554 25780 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.274109 25780 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:27.274809 26063 log.cc:927] Time spent T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.477s	user 0.000s	sys 0.003s
I20260709 13:09:27.276325 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.277330 21761 raft_consensus.cc:2393] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:27.279644 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:27.280228 21908 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:27.280206 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.236388 26045 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:27.295763 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.288920 21759 raft_consensus.cc:2368] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13.
I20260709 13:09:27.303974 21908 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
W20260709 13:09:27.294026 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.305146 22449 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:27.324926 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.310405 21879 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:27.244786 26053 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:27.327343 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:27.305035 25830 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:27.257977 26003 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
I20260709 13:09:27.334477 21908 raft_consensus.cc:1275] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:27.334992 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.365906 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.354750 21763 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:27.376994 21908 raft_consensus.cc:1240] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:27.378034 21756 raft_consensus.cc:2368] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9.
I20260709 13:09:27.339092 26012 raft_consensus.cc:1064] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:09:27.350605 26049 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:27.334959 26065 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:27.389570 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:27.375217 26051 consensus_meta.cc:287] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.743s	user 0.006s	sys 0.007s
W20260709 13:09:27.392302 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.352128 25780 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:27.394388 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 146814us
W20260709 13:09:27.384407 25909 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.010s	sys 0.034s
I20260709 13:09:27.409051 21759 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:27.409773 21757 raft_consensus.cc:1240] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:27.409973 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.406526 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:27.392226 26012 raft_consensus.cc:1068] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Unable to promote non-voter 8c6c2207af3d47b3acf352d81959f4dd: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:09:27.409024 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.413525 21762 raft_consensus.cc:2393] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 9: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:27.414676 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.396557 26049 raft_consensus.cc:697] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
W20260709 13:09:27.409101 25909 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.010s	sys 0.034s
I20260709 13:09:27.425611 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.421326 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.427392 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.427629 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.430545 21763 raft_consensus.cc:2393] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 6: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
W20260709 13:09:27.431649 26071 log.cc:927] Time spent T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:09:27.431758 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.432477 21838 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:09:27.433594 21833 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:09:27.436583 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.436878 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.437175 21837 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:09:27.438024 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.438133 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.438997 21839 raft_consensus.cc:2410] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:09:27.439163 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.439924 21834 raft_consensus.cc:2393] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 10: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:27.394773 26051 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:27.442384 21832 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:09:27.429955 21879 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:27.443959 21765 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:09:27.447440 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.448403 21765 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:27.449163 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.454653 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.412328 25780 consensus_queue.cc:1059] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:09:27.455313 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.456065 21758 raft_consensus.cc:2393] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:27.457679 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:27.457834 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.456506 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:27.459301 26072 log.cc:927] Time spent T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:09:27.460067 25780 raft_consensus.cc:3055] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:27.460480 25780 raft_consensus.cc:740] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:27.459628 26049 consensus_queue.cc:237] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:27.453413 26065 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:27.481015 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:27.481689 21765 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:27.484011 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:27.484879 21840 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:27.484899 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.483909 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:27.486508 22482 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:27.486683 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:27.487254 21838 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:09:27.487782 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:27.488427 21833 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:09:27.489398 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 67732.4us
I20260709 13:09:27.491416 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:27.491955 21834 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:27.470412 25780 consensus_queue.cc:260] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:27.496997 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.497476 25780 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:27.506438 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.509780 21763 raft_consensus.cc:1275] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:27.509687 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:27.511523 21832 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:09:27.484089 26053 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:27.517760 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.519385 21840 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:27.522742 26051 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:27.523491 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.523826 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.524569 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.523501 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.525985 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:27.526644 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.544051 21762 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:27.527577 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.528889 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.540845 21832 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:09:27.541723 21833 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:09:27.552757 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:27.553681 21832 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:27.559641 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:27.560415 21760 raft_consensus.cc:2368] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12.
I20260709 13:09:27.560568 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.561225 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.565758 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.566385 21763 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:09:27.561635 21836 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:27.570803 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.571837 21832 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:09:27.558192 21914 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:27.561657 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.562037 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.577139 21834 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:27.574170 21762 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:27.579327 21765 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:27.561789 21760 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:27.584833 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.585462 21764 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:27.586154 21838 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:27.587499 21757 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:27.592664 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:27.596194 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:27.597846 21756 raft_consensus.cc:2393] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 9: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:27.621824 21910 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:27.624575 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 195944us
I20260709 13:09:27.625327 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.626569 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.627209 21832 raft_consensus.cc:2393] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 10: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:27.628489 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.629801 21914 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:27.633204 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.629333 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.636432 21756 raft_consensus.cc:2368] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13.
I20260709 13:09:27.641335 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.648514 21832 raft_consensus.cc:1240] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:27.650388 21879 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:27.650614 21832 raft_consensus.cc:1275] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:27.651124 26066 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:27.652803 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:27.653366 21757 raft_consensus.cc:2376] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13. Re-sending same reply.
I20260709 13:09:27.659657 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.660477 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.664155 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.665117 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.668553 21758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 1532) took 1028 ms. Trace:
I20260709 13:09:27.668967 21758 rpcz_store.cc:276] 0709 13:09:26.640156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:27.265602 (+625446us) service_pool.cc:224] Handling call
0709 13:09:27.408891 (+143289us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b5800000098. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232a22 00007fc6b414bc09 00007fc6b32a5ee0 00007fc6b336f0ab 00007fc6b336f131 00007fc6b331d0a0 00007fc6b331c984 00007fc6ac8976d4 00007fc6ac897662
0709 13:09:27.668350 (+259459us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b5400268c54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:27.668486 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130374912}
I20260709 13:09:27.665840 21756 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:09:27.620872 25629 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:27.710722 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:27.711597 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.711588 21757 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:27.720211 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.729238 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.732689 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.733031 21910 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:27.707926 25909 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:27.735308 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.739148 21758 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:27.734828 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:27.658051 25396 consensus_queue.cc:1048] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:09:27.744345 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.744671 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:27.748533 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.746711 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.756472 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.746429 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.759042 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.762995 21758 raft_consensus.cc:2368] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9.
I20260709 13:09:27.763622 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.764245 21910 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:09:27.766171 21906 raft_consensus.cc:2393] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 12: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:27.766381 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.769238 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.774238 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.775012 21756 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:27.737746 25909 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:27.834137 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.834255 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.804112 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.839529 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.776018 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.777312 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.841766 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.794829 21831 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:09:27.843901 21756 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:27.850327 21838 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
W20260709 13:09:27.821004 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.855502 22448 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:27.798520 21728 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:27.857167 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 58771.6us
I20260709 13:09:27.858058 21728 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:27.859174 21728 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:27.849771 21836 raft_consensus.cc:2393] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 13: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:27.861370 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.862072 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:27.865649 26041 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:27.868775 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.852483 21838 raft_consensus.cc:606] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:27.869666 21759 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:27.870123 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.870687 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.870829 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.869731 21838 raft_consensus.cc:614] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:27.871165 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.871905 21764 raft_consensus.cc:2393] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:27.871999 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.872668 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.873175 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.873360 21765 raft_consensus.cc:2393] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:27.870853 21757 raft_consensus.cc:2393] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 9: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:27.876504 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.874831 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.877995 21763 raft_consensus.cc:2376] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10. Re-sending same reply.
I20260709 13:09:27.880100 21762 raft_consensus.cc:2393] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 6: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:27.881551 22482 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
W20260709 13:09:27.882526 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:27.884531 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.885396 21757 raft_consensus.cc:2393] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 13: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:27.884430 21763 raft_consensus.cc:1240] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:27.886430 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.886441 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.887897 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.888789 21728 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:27.890118 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:27.890651 21731 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:09:27.890923 26094 log.cc:927] Time spent T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:09:27.891513 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 241191us
I20260709 13:09:27.893149 21756 raft_consensus.cc:2393] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 10: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:27.894147 21728 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:27.895295 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:27.895388 25891 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:27.895982 25891 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:27.896371 25891 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:27.897614 26003 raft_consensus.cc:2804] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:27.897795 26083 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.898309 26083 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:27.900854 26083 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:27.903757 25899 raft_consensus.cc:3055] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:27.904244 25899 raft_consensus.cc:740] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:27.862985 26053 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:27.884354 26032 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:27.873742 26051 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:27.906214 26051 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:27.906610 26051 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:27.907946 21759 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:09:27.910378 26053 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:27.910523 25629 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:27.911564 25780 raft_consensus.cc:2804] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:27.911989 25780 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:27.912189 21728 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:27.912583 25780 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:27.913728 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:27.914664 26066 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:27.915081 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.915169 26066 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:27.916282 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.916688 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:27.917136 21839 raft_consensus.cc:2410] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:09:27.917408 26066 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:27.917972 21879 connection.cc:256] RPC call timeout handler was delayed by -2.3605357999999796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
I20260709 13:09:27.918097 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:27.918329 21879 connection.cc:256] RPC call timeout handler was delayed by -2.2444357999999056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
W20260709 13:09:27.918651 21879 connection.cc:256] RPC call timeout handler was delayed by -1.7566357999999127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2203s for a response
W20260709 13:09:27.919000 21879 connection.cc:256] RPC call timeout handler was delayed by -1.2697357999999213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27440000000000003s for a response
I20260709 13:09:27.921499 21728 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:27.845152 25909 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:27.924247 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:27.851428 26045 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:27.927567 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:27.927650 26045 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:27.928272 21835 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:27.934924 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:27.951259 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.951447 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:27.951164 22450 leader_election.cc:336] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.548s (SENT)
I20260709 13:09:27.952418 21762 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:09:27.919163 26041 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:27.926477 26053 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:27.953122 21832 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:27.964972 26003 raft_consensus.cc:697] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 8 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:27.966046 26003 consensus_queue.cc:237] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:27.974437 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 50265.7us
W20260709 13:09:27.975270 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 48231.2us
W20260709 13:09:27.976183 21805 leader_election.cc:336] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.574s (SENT)
I20260709 13:09:27.978581 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:27.979806 21728 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:27.977614 21831 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: []
W20260709 13:09:27.989517 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 43831.1us
I20260709 13:09:27.990243 21833 raft_consensus.cc:1240] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:27.997440 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.000017 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.006387 21911 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:27.987864 25933 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:28.008340 25933 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:28.026731 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:28.037894 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:28.040557 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 70994.6us
W20260709 13:09:28.041275 21805 leader_election.cc:336] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.965s (SENT)
I20260709 13:09:28.038969 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:28.018251 26053 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:28.043069 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:28.042699 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:28.045269 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:28.045917 21756 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:09:28.039695 21758 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
W20260709 13:09:28.046308 21879 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.532s (SENT) [suppressed 52 similar messages]
I20260709 13:09:28.030066 26041 consensus_queue.cc:1059] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:09:28.059013 22483 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:28.037457 25933 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:28.061924 21835 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:28.067477 26098 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:28.067628 26102 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:28.051100 25909 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:28.082500 21835 raft_consensus.cc:1240] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:28.084054 21840 raft_consensus.cc:1240] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:28.084277 25909 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:28.084923 21831 raft_consensus.cc:1275] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:28.085659 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:28.086222 25842 consensus_meta.cc:287] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.815s	user 0.013s	sys 0.000s
I20260709 13:09:28.086848 21756 raft_consensus.cc:2410] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:28.086815 25842 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:28.088351 21835 raft_consensus.cc:1240] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:28.090128 21761 raft_consensus.cc:2393] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 10: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:28.070202 26098 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:28.094131 26098 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:28.095975 21763 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:28.096249 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:28.096596 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:28.097186 21756 raft_consensus.cc:2410] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:09:28.097913 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:28.098449 25891 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:28.099118 21757 raft_consensus.cc:2393] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 13: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:28.100459 25891 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:28.101572 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:28.103364 21763 raft_consensus.cc:1275] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:09:28.114364 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 52262us
W20260709 13:09:28.116632 21805 leader_election.cc:336] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.500s (SENT)
W20260709 13:09:28.117530 21805 leader_election.cc:336] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.506s (SENT)
I20260709 13:09:28.127805 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:28.127677 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:28.131352 21805 leader_election.cc:336] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.587s (SENT)
W20260709 13:09:28.132320 21805 leader_election.cc:336] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.592s (SENT)
I20260709 13:09:28.133744 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:28.134356 25943 raft_consensus.cc:1064] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
W20260709 13:09:28.134878 25943 raft_consensus.cc:1068] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Unable to promote non-voter 8c6c2207af3d47b3acf352d81959f4dd: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:09:28.136286 26084 consensus_queue.cc:1059] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:28.137611 25944 raft_consensus.cc:3055] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:28.137985 25944 raft_consensus.cc:740] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:28.138865 25944 consensus_queue.cc:260] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:28.140122 25944 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:28.140146 26084 consensus_queue.cc:1048] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:28.140684 26065 consensus_queue.cc:1059] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:28.141341 25892 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:28.141888 26065 consensus_queue.cc:1048] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:28.141956 25892 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:28.144411 26065 raft_consensus.cc:3055] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:28.144860 26065 raft_consensus.cc:740] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:28.146674 25892 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:28.147969 25892 consensus_queue.cc:1059] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:28.134449 21759 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:09:28.148607 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:28.149005 25892 raft_consensus.cc:3055] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:28.149474 25892 raft_consensus.cc:740] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:28.140307 21877 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:28.156334 21757 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:09:28.162681 25892 consensus_queue.cc:260] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:28.164484 25892 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:28.165486 21877 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:28.165764 26065 consensus_queue.cc:260] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:28.166476 26066 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:28.170468 26065 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:28.172339 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.176990 26038 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:28.126689 25842 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:28.164507 25899 consensus_queue.cc:260] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:28.182493 21804 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:28.183437 26084 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:28.183849 26084 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:28.184228 26084 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:28.185227 21804 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:28.167330 21877 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:28.123328 26083 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:09:28.186306 26045 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:28.186162 25943 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:28.187469 25943 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:28.187816 22484 raft_consensus.cc:1240] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:28.187951 26070 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:28.188462 26070 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:28.188736 26045 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:28.188916 26070 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:28.191726 26083 consensus_queue.cc:1059] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:28.192481 25933 raft_consensus.cc:3055] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:28.187827 25943 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:28.193010 25933 raft_consensus.cc:740] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:28.193886 25933 consensus_queue.cc:260] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:28.194797 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:28.195472 21908 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:28.198297 26051 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:28.194955 25933 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:28.200577 26051 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:28.202219 22483 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36290 (request call id 1081) took 1373 ms. Trace:
I20260709 13:09:28.202697 22483 rpcz_store.cc:276] 0709 13:09:26.828446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:26.828758 (+   312us) service_pool.cc:224] Handling call
0709 13:09:28.201992 (+1373234us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54004fd8d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:28.202097 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2512363904}
I20260709 13:09:28.204707 21763 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:09:28.207386 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:28.203759 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:28.210734 21757 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:09:28.203261 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:28.210842 21759 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
I20260709 13:09:28.211923 21761 raft_consensus.cc:2393] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 10: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:28.212630 21804 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:28.210506 21763 pending_rounds.cc:85] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 7
I20260709 13:09:28.214226 21763 pending_rounds.cc:107] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:09:28.214494 21763 raft_consensus.cc:2889] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:28.215866 21880 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:28.218645 21877 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:28.219784 21805 leader_election.cc:336] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.668s (SENT)
I20260709 13:09:28.130510 25780 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:28.220259 21805 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:28.222697 25396 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:28.216699 26066 consensus_queue.cc:1059] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:09:28.224169 25780 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:28.224632 26068 raft_consensus.cc:3055] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:28.229640 25396 raft_consensus.cc:697] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 9 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:28.231277 25396 consensus_queue.cc:237] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:28.232285 26098 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:28.225167 26068 raft_consensus.cc:740] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:28.238266 26068 consensus_queue.cc:260] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:28.240362 26066 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:28.241004 26066 raft_consensus.cc:697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:28.242316 26083 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:28.246495 26066 consensus_queue.cc:237] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:28.182516 25899 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:28.256585 21804 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:28.258049 21804 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:28.201414 25943 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:28.257514 21805 leader_election.cc:336] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.733s (SENT)
I20260709 13:09:28.258936 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:28.261170 21805 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:28.239881 25944 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:28.263249 21804 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:28.255856 26068 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:28.268756 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 170379us
I20260709 13:09:28.289299 26112 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:28.290390 26112 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:09:28.298142 21805 leader_election.cc:336] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.823s (SENT)
I20260709 13:09:28.298681 21805 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:28.265048 26083 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:28.324709 21908 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
W20260709 13:09:28.325834 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 107317us
I20260709 13:09:28.266304 26111 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:28.331327 22449 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:28.332435 21729 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:28.339355 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 359480us
I20260709 13:09:28.320817 25944 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:28.346791 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 83629.5us
I20260709 13:09:28.347558 21804 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:28.347896 21728 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:28.344365 25724 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:28.353298 21804 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:28.346087 26083 raft_consensus.cc:697] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:09:28.361542 21805 leader_election.cc:336] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.884s (SENT)
I20260709 13:09:28.340235 26065 consensus_queue.cc:1059] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:09:28.361678 25869 consensus_queue.cc:1059] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:09:28.421721 26116 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:28.429540 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.353997 26105 log.cc:927] Time spent T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:09:28.429677 21663 catalog_manager.cc:5697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 7 to 9, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 9 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:09:28.431632 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 78431.7us
I20260709 13:09:28.431321 21663 catalog_manager.cc:5697] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 2 to 8, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 8 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:28.432396 21804 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:28.433197 25933 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:28.432696 21663 catalog_manager.cc:5697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:28.433624 21804 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:28.434372 25933 raft_consensus.cc:2764] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:09:28.434813 21804 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:28.435591 25933 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:28.347018 26038 consensus_queue.cc:1059] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:09:28.434386 21663 catalog_manager.cc:5697] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:28.355445 26098 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:28.351176 25944 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:28.437511 21663 catalog_manager.cc:5697] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:28.439066 26065 raft_consensus.cc:3055] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:28.438994 21663 catalog_manager.cc:5697] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 6 to 9, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 9 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:28.371644 25724 raft_consensus.cc:697] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:28.440647 25724 consensus_queue.cc:237] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:28.352399 25780 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:28.356144 25943 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:28.374053 21908 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:28.410030 26084 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:28.400578 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 60592.7us
I20260709 13:09:28.446357 21728 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:28.447094 26084 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:28.447227 21728 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:28.411314 26083 consensus_queue.cc:237] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:28.448040 25780 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:28.448086 21728 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:28.447846 26070 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:28.449417 26003 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:09:28.450024 26003 raft_consensus.cc:697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:28.450691 25724 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:28.450878 26003 consensus_queue.cc:237] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:28.451480 26070 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:28.419085 26113 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:28.439587 26065 raft_consensus.cc:740] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:28.448763 25780 raft_consensus.cc:697] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:28.571885 25780 consensus_queue.cc:237] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:28.573340 22484 raft_consensus.cc:1240] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:28.374053 26091 consensus_queue.cc:1048] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:09:28.448917 26116 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:09:28.417680 21805 leader_election.cc:336] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.905s (SENT)
I20260709 13:09:28.576916 21805 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:28.577988 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 160344us
I20260709 13:09:28.577801 26065 consensus_queue.cc:260] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:28.578998 26065 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:28.579339 21805 leader_election.cc:336] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.033s (SENT)
I20260709 13:09:28.579734 21805 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:28.579849 26070 consensus_queue.cc:1059] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:28.455533 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:28.580858 26070 raft_consensus.cc:3055] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:28.577811 21663 catalog_manager.cc:5697] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 10 to 11, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 11 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:28.582008 26113 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:28.583009 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.457639 21804 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:28.364960 21729 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:28.456558 21728 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:09:29.111380 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 654882us
I20260709 13:09:29.111495 26003 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:29.112061 26003 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.112459 26003 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:29.112721 21728 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:09:29.115068 21879 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.018s	sys 0.084s
W20260709 13:09:29.115614 21879 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.018s	sys 0.084s
W20260709 13:09:28.506458 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:28.525210 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.582698 26113 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:28.511099 21908 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:28.581259 26070 raft_consensus.cc:740] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:28.576938 26116 raft_consensus.cc:697] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:29.124527 26070 consensus_queue.cc:260] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:28.758849 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 322898us
I20260709 13:09:28.760174 26084 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:28.759528 21663 catalog_manager.cc:5697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.131781 21804 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:29.132678 22483 raft_consensus.cc:1275] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:29.133248 26084 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:29.133028 21663 catalog_manager.cc:5697] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 10 to 13, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 13 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:28.842079 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:28.974501 25780 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:09:29.014883 21907 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.023s	sys 0.015s
W20260709 13:09:29.137039 21907 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.024s	sys 0.016s
W20260709 13:09:29.049705 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 684783us
I20260709 13:09:29.078511 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:29.099537 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.107242 21877 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.024s	sys 0.058s
W20260709 13:09:29.138763 21877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.025s	sys 0.059s
W20260709 13:09:29.139099 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 782535us
I20260709 13:09:29.120581 26003 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:29.137171 21663 catalog_manager.cc:5697] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 6 to 8, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 8 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:29.124675 26116 consensus_queue.cc:237] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:28.755780 21660 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45746 (request call id 228) took 21271 ms (client timeout 15000 ms). Trace:
I20260709 13:09:29.133052 21804 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:29.121268 25724 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.148893 21833 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:29.145131 25724 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:29.151412 21663 catalog_manager.cc:5697] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 8 to 10, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 10 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:29.166484 25724 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:29.146461 26113 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:29.172039 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:29.172767 21840 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:29.175671 21663 catalog_manager.cc:5697] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 7 to 8, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 8 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.183190 21840 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:09:29.184579 21663 catalog_manager.cc:5697] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 8 to 10, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 10 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.193504 21663 catalog_manager.cc:5697] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:09:29.197840 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 85193.5us
I20260709 13:09:29.199259 21728 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:29.198189 21663 catalog_manager.cc:5697] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:29.140506 21660 rpcz_store.cc:269] 0709 13:09:07.490940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:07.505257 (+ 14317us) service_pool.cc:224] Handling call
0709 13:09:28.755644 (+21250387us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:27.508938 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:27.569001 (+ 60063us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:27.569055 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:09:27.569084 (+    29us) tablet.cc:662] Decoding operations
0709 13:09:27.570349 (+  1265us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:27.570446 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:27.570471 (+    25us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:09:27.726330 (+155859us) tablet.cc:701] Row locks acquired
0709 13:09:27.726376 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:09:27.726555 (+   179us) write_op.cc:270] Start()
0709 13:09:27.726689 (+   134us) write_op.cc:276] Timestamp: P: 1783602567726492 usec, L: 0
0709 13:09:27.726707 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:09:27.727396 (+   689us) log.cc:844] Serialized 5497 byte log entry
0709 13:09:28.043990 (+316594us) op_driver.cc:464] REPLICATION: finished
0709 13:09:28.253769 (+209779us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b18002f2300. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab26a3f3 00007fc6ab26c7c1 00007fc6ab26c779 00007fc6ab26c709 00007fc6ab26c6d1 00007fc6ab26b9cd 000000000038f354 000000000038f199 00007fc6ab24d83a
0709 13:09:28.256480 (+  2711us) write_op.cc:301] APPLY: starting
0709 13:09:28.256593 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:28.266237 (+  9644us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:28.285768 (+ 19531us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:28.300103 (+ 14335us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:28.300429 (+   326us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0709 13:09:28.300480 (+    51us) write_op.cc:312] APPLY: finished
0709 13:09:28.300915 (+   435us) log.cc:844] Serialized 101 byte log entry
0709 13:09:28.301112 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:28.301270 (+   158us) write_op.cc:454] Released schema lock
0709 13:09:28.301324 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:28.302882 (+  1558us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:28.302927 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6168636,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":172274,"apply.run_cpu_time_us":5269,"apply.run_wall_time_us":46316,"num_ops":14,"prepare.queue_time_us":125782,"prepare.run_cpu_time_us":9067,"prepare.run_wall_time_us":308959,"raft.queue_time_us":147853,"raft.run_cpu_time_us":68923,"raft.run_wall_time_us":176289,"replication_time_us":316025,"spinlock_wait_cycles":10460928,"thread_start_us":342073,"threads_started":4,"wal-append.queue_time_us":65659}]]}
I20260709 13:09:29.209726 21663 catalog_manager.cc:5697] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 6 to 9, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 9 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:29.216696 21663 catalog_manager.cc:5697] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 6 to 10, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 10 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:29.225775 21663 catalog_manager.cc:5697] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 8 to 13, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 13 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.227519 21663 catalog_manager.cc:5697] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index -1 to 7, term changed from 10 to 11, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to <none>, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 11 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:09:29.237545 26127 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:29.237821 26130 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:29.238472 26130 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:29.239288 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 88356.8us
I20260709 13:09:29.240607 21729 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:29.253326 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:29.262454 26128 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:29.263082 26128 raft_consensus.cc:697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:29.264025 26128 consensus_queue.cc:237] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:29.274231 21835 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:29.275508 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:29.280234 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:29.280911 21831 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:09:29.283130 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:29.284916 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:29.286614 21836 raft_consensus.cc:2393] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 8: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:29.257727 26127 raft_consensus.cc:697] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:29.288638 21840 raft_consensus.cc:2376] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13. Re-sending same reply.
I20260709 13:09:29.290325 22448 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:29.293622 22448 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:29.300588 26133 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:29.301180 26133 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:29.305877 26133 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:29.305797 26129 consensus_queue.cc:1048] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:29.308250 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:29.310009 21836 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:29.312057 26127 consensus_queue.cc:237] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:29.314967 22448 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:29.286435 26126 consensus_queue.cc:1059] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:09:29.539194 26133 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:29.544750 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.589442 26145 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:29.589888 26126 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:29.590610 26145 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:29.590692 26126 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:29.591337 26145 raft_consensus.cc:697] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:29.591560 26126 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:29.610916 21835 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
I20260709 13:09:29.612303 21836 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:29.636013 26147 raft_consensus.cc:3055] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:09:29.636166 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 324742us
I20260709 13:09:29.636731 26147 raft_consensus.cc:740] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:29.660802 26145 consensus_queue.cc:237] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:29.668453 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.673023 26147 consensus_queue.cc:260] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:29.674276 26137 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.675032 26137 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:29.677405 26147 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:29.678249 26137 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:29.686618 26135 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:29.687206 26135 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:29.690973 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:29.694265 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 495066us
I20260709 13:09:29.690550 26135 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:29.703979 26070 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:29.704772 21728 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:29.709015 26135 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:29.712364 26091 raft_consensus.cc:3055] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:29.712975 26091 raft_consensus.cc:740] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:09:29.722010 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.713876 21728 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:29.740866 25629 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:29.741469 25629 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:29.743548 25629 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:29.728652 26003 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:29.755113 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 514566us
I20260709 13:09:29.744269 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:29.753955 26126 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:29.756366 21833 raft_consensus.cc:2393] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 9: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:09:29.758402 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.761826 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 48037.5us
I20260709 13:09:29.764235 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:29.767501 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:29.768932 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:29.769562 21834 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:29.770601 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:29.775453 21832 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:29.775882 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:29.777035 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:29.782825 21835 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:29.778839 21833 raft_consensus.cc:2368] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 12. Current term is 13.
I20260709 13:09:29.783855 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:29.786047 21833 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:29.786289 21834 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:09:29.794977 21729 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:29.778151 26142 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:29.807160 21729 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:29.813951 21729 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:29.805192 26129 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:29.827291 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:29.828032 21840 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:29.831120 26130 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:29.818326 26116 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:29.836338 21840 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
I20260709 13:09:29.820545 26133 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:29.826506 26126 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:29.809504 26140 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:29.805119 26142 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:29.838577 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:29.838707 26142 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:29.838852 21837 raft_consensus.cc:1240] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: []
W20260709 13:09:29.844512 25780 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.003s	sys 0.021s
W20260709 13:09:29.844923 25780 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.003s	sys 0.021s
I20260709 13:09:29.845170 25780 raft_consensus.cc:697] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 12 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:29.849843 25780 consensus_queue.cc:237] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:29.853825 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:09:29.856609 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 54232.4us
I20260709 13:09:29.819103 21729 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:29.865731 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:29.877698 26068 raft_consensus.cc:3055] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:09:29.870658 22450 leader_election.cc:336] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.944s (SENT)
I20260709 13:09:29.878212 26068 raft_consensus.cc:740] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:29.893399 26068 consensus_queue.cc:260] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:29.894786 26068 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:09:29.880178 26116 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:29.910187 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 91241.9us
W20260709 13:09:29.919708 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 723567us
I20260709 13:09:29.919939 25869 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:29.920763 21877 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:29.922376 21729 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:29.925774 26070 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.926082 26121 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.926337 26119 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:29.926578 26121 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:29.926955 26119 raft_consensus.cc:697] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:29.928624 25869 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:29.929178 25869 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:29.929539 26119 consensus_queue.cc:237] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:29.930450 26091 consensus_queue.cc:260] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:29.931393 25869 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:29.932116 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 61509.8us
W20260709 13:09:29.932650 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.931495 26091 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:29.926373 26070 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:29.950721 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:29.944250 21910 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:29.951139 21833 raft_consensus.cc:1240] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:29.951388 21838 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:29.946931 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:29.952083 21913 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
W20260709 13:09:29.960726 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.965112 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:09:29.965492 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.966005 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:29.968405 22450 leader_election.cc:336] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.651s (SENT)
I20260709 13:09:29.968870 22450 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:29.961808 26127 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:29.967278 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:29.972584 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:29.945953 26142 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:29.977021 26126 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:29.981475 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 60328.7us
I20260709 13:09:29.977154 26142 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:29.962082 26120 consensus_queue.cc:1059] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:09:29.973217 25780 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:29.989804 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:29.990362 21834 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:29.991032 26070 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:29.989153 26120 raft_consensus.cc:3055] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:09:29.992309 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:29.992461 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:29.996680 21834 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:29.997251 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:29.998296 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:30.001361 21805 leader_election.cc:336] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.126s (SENT)
I20260709 13:09:29.999898 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.001211 21909 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:29.988899 25780 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:30.009301 21804 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:30.011900 21909 raft_consensus.cc:1240] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:30.009618 21906 raft_consensus.cc:1240] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:09:29.979736 26121 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:30.016212 22482 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:30.005976 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.019479 25629 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.020098 25629 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:30.022116 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:30.023015 22483 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:30.028383 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:30.028554 25629 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:30.029125 21834 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:09:30.030141 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:30.030741 21907 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:30.031404 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:30.031985 21912 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:30.033069 21805 connection.cc:256] RPC call timeout handler was delayed by -1.1759020530000726s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32180000000000003s for a response
W20260709 13:09:30.033524 21805 connection.cc:256] RPC call timeout handler was delayed by -1.1361235210000586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2907s for a response
I20260709 13:09:30.033885 22484 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:30.034463 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 72485.8us
I20260709 13:09:30.036089 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:30.037019 21839 raft_consensus.cc:2410] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:09:30.033864 21805 connection.cc:256] RPC call timeout handler was delayed by -1.0443235210001376s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3009s for a response
I20260709 13:09:30.000687 26120 raft_consensus.cc:740] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:30.038614 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:30.005971 26065 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.011319 26142 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:30.029479 25944 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:09:30.060009 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 91631.9us
I20260709 13:09:30.072098 21834 raft_consensus.cc:1240] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:30.005849 26116 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:09:30.043671 25892 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:30.075582 22450 leader_election.cc:336] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.833s (SENT)
I20260709 13:09:30.065600 25944 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.086480 21908 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 6.
I20260709 13:09:30.069485 26142 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:30.077242 22450 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:30.087839 26120 consensus_queue.cc:260] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:30.067113 26158 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.082557 25892 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:30.089843 25780 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:30.047148 26065 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:30.114480 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:30.116729 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:30.130712 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:30.131371 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.092533 25944 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:30.092094 26083 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:30.144896 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 69344.1us
W20260709 13:09:30.145784 22450 leader_election.cc:336] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.965s (SENT)
I20260709 13:09:30.146245 22450 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:30.147190 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 71301.8us
W20260709 13:09:30.147804 21879 leader_election.cc:336] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.532s (SENT)
I20260709 13:09:30.151273 26126 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:30.153223 26083 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:30.153651 21879 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:30.155767 26083 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:30.157069 21912 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:09:30.162308 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.143381 26068 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:09:30.196484 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 48707.5us
I20260709 13:09:30.165736 26166 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:30.197811 21835 raft_consensus.cc:1275] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:09:30.196758 26138 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:30.185732 21935 debug-util.cc:398] Leaking SignalData structure 0x7b0800081200 after lost signal to thread 20643
W20260709 13:09:30.201026 21935 debug-util.cc:398] Leaking SignalData structure 0x7b08001ca8a0 after lost signal to thread 21697
W20260709 13:09:30.202126 21935 debug-util.cc:398] Leaking SignalData structure 0x7b08000f6620 after lost signal to thread 21789
W20260709 13:09:30.202382 21935 debug-util.cc:398] Leaking SignalData structure 0x7b08000f6640 after lost signal to thread 21790
W20260709 13:09:30.203286 21935 debug-util.cc:398] Leaking SignalData structure 0x7b08002cb260 after lost signal to thread 21864
W20260709 13:09:30.203526 21935 debug-util.cc:398] Leaking SignalData structure 0x7b08002e7c40 after lost signal to thread 21865
W20260709 13:09:30.204425 21935 debug-util.cc:398] Leaking SignalData structure 0x7b08002c4ee0 after lost signal to thread 21938
W20260709 13:09:30.204663 21935 debug-util.cc:398] Leaking SignalData structure 0x7b0800331fe0 after lost signal to thread 21939
I20260709 13:09:30.163093 26120 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:30.211481 26175 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.211987 26175 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:30.213788 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:30.214371 21835 raft_consensus.cc:2376] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11. Re-sending same reply.
W20260709 13:09:30.217792 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.223268 21835 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:30.225993 25944 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:30.226516 26065 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:30.226922 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 81177.8us
I20260709 13:09:30.214327 26175 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:30.229686 22450 leader_election.cc:336] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.972s (SENT)
W20260709 13:09:30.231216 22450 leader_election.cc:336] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.061s (SENT)
I20260709 13:09:30.231647 25892 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:30.231709 21907 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:30.116242 26158 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:30.234122 26121 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:30.234493 26142 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:30.234932 26158 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:30.232952 21880 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:30.235549 21912 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:09:30.236117 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:30.199074 26138 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:30.237109 26121 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:30.237560 26121 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.237944 26121 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:30.238770 26138 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:30.238689 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:30.239850 22483 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:30.240767 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:30.241760 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:30.243197 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.243978 21908 raft_consensus.cc:2410] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:09:30.244747 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.246037 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.246968 21907 raft_consensus.cc:2393] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 11: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:30.250267 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.250768 26121 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:30.246268 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.254799 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:30.255453 21839 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:30.256556 21804 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:30.274655 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.260553 21804 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:30.276439 21804 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:30.237329 26119 consensus_queue.cc:1059] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:09:30.277446 26175 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:30.278328 21911 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:09:30.279454 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.280845 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.273952 26065 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:30.199432 26068 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:30.282217 26065 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:30.283908 26068 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:30.286677 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:30.275532 21908 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:09:30.289309 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:30.296154 21834 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:30.296339 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.297343 21908 raft_consensus.cc:2393] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 10: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:30.209684 26145 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.298312 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.298503 26145 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:30.299063 21911 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:09:30.300297 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.289189 26158 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.301491 26158 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:30.305301 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:30.306059 21834 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:30.300846 26145 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:30.293570 25892 consensus_queue.cc:1059] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:09:30.307286 26158 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:30.275475 26138 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:30.293746 26142 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:30.309491 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.310247 21908 raft_consensus.cc:2368] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 12. Current term is 13.
I20260709 13:09:30.309867 26142 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:30.311029 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.311583 21908 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:30.312354 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.313369 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.313534 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.315420 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.320398 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.320489 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.320406 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.321002 21909 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:30.321590 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.322293 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:30.322547 22449 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:30.322862 22485 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:30.233006 25944 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:30.318246 26176 log.cc:927] Time spent T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.107s	user 0.002s	sys 0.000s
I20260709 13:09:30.318120 21906 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:09:30.323616 26145 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:30.325034 26145 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:30.325254 25629 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:30.328995 26119 raft_consensus.cc:3055] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:30.329102 26145 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:30.329519 26119 raft_consensus.cc:740] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:30.330354 26119 consensus_queue.cc:260] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:30.332149 21835 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:30.332343 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 132073us
W20260709 13:09:30.333679 21805 leader_election.cc:336] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.667s (SENT)
I20260709 13:09:30.334036 21805 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:09:30.337798 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 61420.1us
I20260709 13:09:30.338783 21804 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:30.345357 22449 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:09:30.351982 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 120780us
W20260709 13:09:30.354303 22450 leader_election.cc:336] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.192s (SENT)
I20260709 13:09:30.354727 22450 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:30.356709 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.357944 21911 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:30.367116 21912 raft_consensus.cc:1240] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:30.312417 26142 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:30.289978 26065 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:30.348126 26175 raft_consensus.cc:697] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:09:30.374677 21935 debug-util.cc:398] Leaking SignalData structure 0x7b0800387420 after lost signal to thread 22509
W20260709 13:09:30.375039 21935 debug-util.cc:398] Leaking SignalData structure 0x7b0800387940 after lost signal to thread 22510
I20260709 13:09:30.347632 26163 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:30.375152 21805 leader_election.cc:336] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.961s (SENT)
I20260709 13:09:30.368281 26119 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:30.375538 21935 debug-util.cc:398] Leaking SignalData structure 0x7b08003fd460 after lost signal to thread 26071
I20260709 13:09:30.360775 26173 raft_consensus.cc:2764] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:09:30.360314 26147 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:30.371376 26113 raft_consensus.cc:3055] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:30.385664 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.390937 21758 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
W20260709 13:09:30.384958 21805 leader_election.cc:336] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.006s (SENT)
I20260709 13:09:30.387391 21756 raft_consensus.cc:1240] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:30.392947 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.393155 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.393791 21762 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:30.394459 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.394939 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.395048 21765 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:30.395848 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.396384 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.396632 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.396416 21757 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:30.398479 21728 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:30.393759 21763 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:30.400077 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.381246 26083 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:30.405301 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:30.404357 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:30.399768 21805 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:30.410157 21765 raft_consensus.cc:1240] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 5. Current term is 6. Ops: []
I20260709 13:09:30.383685 25892 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:30.411046 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.417352 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:30.427512 21758 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:30.427701 21763 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:30.411355 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:30.413183 21764 raft_consensus.cc:1240] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:30.428737 21765 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:30.388433 25629 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:30.429244 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.430186 21758 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:30.419061 21728 leader_election.cc:400] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 12. Current term is 13.
I20260709 13:09:30.443600 21728 leader_election.cc:403] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:09:30.444905 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.389397 26147 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.446274 21762 raft_consensus.cc:2393] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 12: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:30.448674 21758 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:30.453930 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.460592 21761 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:30.455478 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:30.461957 21757 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:30.390677 26113 raft_consensus.cc:740] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:30.478385 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.417196 25892 raft_consensus.cc:697] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:30.488646 21763 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
W20260709 13:09:30.475088 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 68835.8us
I20260709 13:09:30.475355 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.489848 21764 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:30.476111 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.490823 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.483026 21838 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:30.417623 26128 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:30.492264 21840 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:30.472355 21757 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:30.493338 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.493999 21757 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:30.494755 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.495538 21757 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:30.503168 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:30.504810 21763 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:09:30.505954 21877 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:30.508388 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:30.503239 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 118301us
W20260709 13:09:30.509284 21805 leader_election.cc:336] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.118s (SENT)
I20260709 13:09:30.509472 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:30.509727 21805 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:30.509892 21765 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:30.510842 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.511373 21765 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:09:30.515801 21880 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:30.523489 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:09:30.524943 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 128837us
I20260709 13:09:30.462462 26147 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:30.527657 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:30.527981 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.530462 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.427325 26142 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:09:30.532018 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.532209 21757 raft_consensus.cc:2393] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 7: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:30.418955 25780 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:09:30.534772 22448 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:30.538091 21880 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:30.539590 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.536031 21758 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:30.550253 21761 raft_consensus.cc:2393] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 12: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:30.551455 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:30.539214 21651 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.628s	user 0.000s	sys 0.000s
W20260709 13:09:30.538890 21805 leader_election.cc:336] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.162s (SENT)
I20260709 13:09:30.556115 21805 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:30.556461 21758 raft_consensus.cc:1240] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:30.561110 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.561955 21763 raft_consensus.cc:2468] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:09:30.563122 21729 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:30.462275 26161 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:09:30.524253 26138 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:30.568193 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.526901 26065 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:30.582386 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.570215 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.583529 21758 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:30.584679 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.585368 21758 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:30.586197 21877 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:30.586328 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.587083 21758 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:30.587332 21877 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:30.588004 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.588634 21758 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:30.588222 21729 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:30.580183 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:30.594148 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.594561 21764 raft_consensus.cc:2376] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10. Re-sending same reply.
I20260709 13:09:30.594774 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.535131 26128 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:30.595221 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:30.595427 21761 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:30.595748 21763 raft_consensus.cc:2376] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12. Re-sending same reply.
W20260709 13:09:30.575675 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 216642us
I20260709 13:09:30.596580 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:30.597201 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 58357.5us
I20260709 13:09:30.589406 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.589637 21910 raft_consensus.cc:1275] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:09:30.598029 21805 leader_election.cc:336] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.173s (SENT)
I20260709 13:09:30.557075 25909 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:30.550544 26070 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:30.592664 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:30.593223 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.605849 21912 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:30.596298 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.595458 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:30.607302 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.608105 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:30.608542 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.590010 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.591325 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:30.609210 26187 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:30.609227 21913 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:30.612181 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.612815 21911 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:30.614079 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.614099 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.614655 21907 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:30.614954 21758 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:30.597237 21763 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
W20260709 13:09:30.594147 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 63625.7us
I20260709 13:09:30.600270 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.560793 25629 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:09:30.601476 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 247208us
I20260709 13:09:30.535220 26157 consensus_queue.cc:1059] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 13:09:30.609576 21906 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:30.550872 25943 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:30.616154 21757 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:30.662650 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.598469 21805 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:30.607126 26188 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:30.617805 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:09:30.654716 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 57730.7us
I20260709 13:09:30.655838 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:30.664476 21758 raft_consensus.cc:2376] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9. Re-sending same reply.
I20260709 13:09:30.665701 21757 raft_consensus.cc:1240] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:30.665992 21758 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:30.590602 26121 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:30.656992 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 111547us
I20260709 13:09:30.667063 21757 raft_consensus.cc:1275] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:30.667972 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:30.603415 26083 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:30.659915 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 71770.8us
I20260709 13:09:30.587324 26193 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:09:30.661530 22450 leader_election.cc:336] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.237s (SENT)
I20260709 13:09:30.670357 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:30.672021 21729 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:30.672688 22450 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:30.672914 21909 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:30.668612 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.674153 21763 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:30.669654 21840 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:30.678221 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:30.533195 26175 consensus_queue.cc:237] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:30.617129 26070 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:30.658921 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 61002us
I20260709 13:09:30.684114 21840 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:30.698014 21762 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:09:30.615875 26118 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:30.697992 21906 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:09:30.616994 26116 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:30.652582 26127 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:30.706380 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:30.706646 21764 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:30.695153 21910 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 6.
I20260709 13:09:30.707350 25780 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.707711 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:30.707876 25780 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:30.708036 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:30.709481 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:30.709988 25780 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:30.700956 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:30.710783 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:30.712201 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:30.717020 21906 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:30.718824 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:30.719835 21906 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:30.722831 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:30.693111 26193 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.733551 21910 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 7.
I20260709 13:09:30.734771 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:30.735936 21910 raft_consensus.cc:2368] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 12. Current term is 13.
I20260709 13:09:30.592541 26113 consensus_queue.cc:260] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:30.731256 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 67462.7us
I20260709 13:09:30.737388 21906 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:09:30.740028 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:30.751035 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:30.755112 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:30.755249 21731 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:30.755118 21906 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:30.757974 21906 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 10. Current term is 11. Ops: [10.5-10.5]
I20260709 13:09:30.759485 21906 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:30.724476 26070 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:30.721822 26118 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:30.724709 26142 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:30.768603 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:30.770104 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 98196.4us
I20260709 13:09:30.773156 21906 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:30.668620 26192 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 13:09:30.660789 25892 consensus_queue.cc:237] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:30.738101 26193 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:30.754243 25629 raft_consensus.cc:697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:30.797962 26118 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:30.801726 21729 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:30.797446 26194 raft_consensus.cc:2804] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:30.824519 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:09:30.824558 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 170659us
W20260709 13:09:30.827559 22450 leader_election.cc:336] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.797s (SENT)
I20260709 13:09:30.828014 22450 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:30.820043 26204 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:30.875334 21729 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:30.825491 26194 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:09:30.887523 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 59972.8us
W20260709 13:09:30.888501 22450 leader_election.cc:336] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.815s (SENT)
I20260709 13:09:30.888978 22450 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:30.855660 26198 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:30.919026 26191 log.cc:927] Time spent T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:09:30.922642 26065 raft_consensus.cc:3055] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:30.923256 26065 raft_consensus.cc:740] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:30.928018 25724 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:30.929319 25724 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:09:30.940078 26186 log.cc:927] Time spent T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
I20260709 13:09:30.942751 26202 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:30.946560 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 71352us
I20260709 13:09:30.947369 21729 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:30.948555 21729 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:30.886888 26194 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:30.911302 25629 consensus_queue.cc:237] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:30.951877 21728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.002s	sys 0.011s
W20260709 13:09:30.963514 21728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.003s	sys 0.012s
I20260709 13:09:30.963773 21729 leader_election.cc:400] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 12. Current term is 13.
W20260709 13:09:30.961323 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:30.963780 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 544959us
W20260709 13:09:30.959695 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 361683us
W20260709 13:09:30.968488 21805 leader_election.cc:336] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.838s (SENT)
I20260709 13:09:30.971692 21729 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:30.975472 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:30.970242 21728 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:30.977031 21909 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:30.985416 21729 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:30.987277 21912 raft_consensus.cc:1275] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:09:30.987264 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:30.987986 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 99542.4us
W20260709 13:09:30.989979 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 170643us
I20260709 13:09:30.949608 26142 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:30.949384 26145 consensus_meta.cc:287] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.620s	user 0.006s	sys 0.001s
W20260709 13:09:30.960682 26171 log.cc:927] Time spent T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.734s	user 0.004s	sys 0.000s
I20260709 13:09:30.994449 21728 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:30.950304 26198 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:30.961632 25943 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:30.965740 26084 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:31.003779 21729 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:30.992131 26120 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:30.989513 25944 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:31.017437 26120 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:31.015666 21805 leader_election.cc:336] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.135s (SENT)
I20260709 13:09:31.018471 21805 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:30.991611 26137 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.017493 25944 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:30.992002 26202 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:30.996595 26135 raft_consensus.cc:2804] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:09:30.997371 26142 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:31.009656 26127 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:31.042398 26221 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:31.043354 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 48998.8us
I20260709 13:09:31.044275 21728 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:31.045440 21728 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:31.001796 25780 consensus_queue.cc:1059] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:09:31.015323 26128 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 12. Current term is 13.
W20260709 13:09:31.050392 21805 leader_election.cc:336] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.995s (SENT)
I20260709 13:09:31.051013 21805 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:31.052083 22484 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:31.004616 26145 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:31.037196 26198 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:31.039268 26142 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:31.018829 26084 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:31.048264 26135 raft_consensus.cc:697] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:31.077226 21765 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:09:31.077857 21804 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:09:31.077873 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 81325.6us
I20260709 13:09:31.053877 26189 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:31.085044 21804 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:31.058400 26127 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:31.053557 26173 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:31.086634 22485 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:31.037127 26137 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:31.059216 25943 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:31.088528 21877 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:31.070926 26202 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:31.092195 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.096063 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 49398.8us
I20260709 13:09:31.048154 26147 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:31.092857 21804 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:31.096814 21728 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:31.089278 26119 consensus_meta.cc:287] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.000s
W20260709 13:09:31.102237 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 98581.4us
I20260709 13:09:31.074924 26128 consensus_queue.cc:1048] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:09:31.097270 26179 log.cc:927] Time spent T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:09:31.108844 21729 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:31.117262 21729 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:31.095556 26127 raft_consensus.cc:697] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:31.097900 26121 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:31.104086 26198 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:31.094718 26195 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:09:31.132259 26213 log.cc:927] Time spent T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:09:31.133555 26145 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:31.100963 26206 consensus_queue.cc:1059] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:09:31.135918 22450 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:31.137641 26181 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:31.138198 26160 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:31.126379 26135 consensus_queue.cc:237] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:31.184561 26137 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:31.185638 26206 raft_consensus.cc:3055] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:31.186072 26206 raft_consensus.cc:740] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:31.141096 26084 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:31.191279 26193 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:31.193570 26220 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:31.194059 26220 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.194401 26220 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:31.195225 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 59401.5us
I20260709 13:09:31.140772 26127 consensus_queue.cc:237] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:31.120399 26202 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:09:31.198241 26147 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:31.198839 26147 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:09:31.142277 26211 log.cc:927] Time spent T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:09:31.142592 25944 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:31.143990 26224 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:31.145888 26198 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:31.097812 26173 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:31.199175 26147 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:31.131349 26189 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:31.148854 26070 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:31.208564 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 219749us
I20260709 13:09:31.126965 26121 raft_consensus.cc:697] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:09:31.218312 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 115925us
W20260709 13:09:31.229641 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 136849us
I20260709 13:09:31.105512 26228 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
I20260709 13:09:31.201565 26227 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:31.218634 26147 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:31.217959 26189 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.244089 26189 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:31.244299 26222 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:31.242254 21804 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:31.247871 21804 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:31.247583 26121 consensus_queue.cc:237] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:31.244089 26157 consensus_queue.cc:1059] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:09:31.250438 26157 raft_consensus.cc:3055] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:31.250782 26157 raft_consensus.cc:740] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:31.251451 26070 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:31.251633 26157 consensus_queue.cc:260] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:31.242769 21879 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:31.239771 26227 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.252569 26193 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:31.200723 21651 maintenance_manager.cc:643] P ff36b0eb624c458eb7f542eb2e635aa2: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 6.535s	user 0.178s	sys 0.051s Metrics: {"bytes_written":29761,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":337188,"dirs.run_cpu_time_us":477,"dirs.run_wall_time_us":21168,"drs_written":1,"lbm_read_time_us":372,"lbm_reads_lt_1ms":4,"lbm_write_time_us":53862,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":3,"lbm_writes_lt_1ms":29,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":337709,"threads_started":1,"update_count":14}
I20260709 13:09:31.276489 21805 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:31.308499 25892 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:31.278203 26137 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:31.283321 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:31.284089 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:31.285322 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:31.312358 21840 raft_consensus.cc:2368] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 9. Current term is 10.
I20260709 13:09:31.270825 26227 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:31.315747 26189 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:31.288715 26229 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:31.333089 26185 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.333683 26185 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:31.335768 26142 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:31.337530 26185 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:31.291353 26120 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:31.292735 26065 consensus_queue.cc:260] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:31.294458 26177 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:31.338658 26177 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.338766 26065 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:31.339078 26177 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:31.340075 26180 log.cc:927] Time spent T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:09:31.341643 26203 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:31.342011 26142 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:31.294899 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 52194.5us
I20260709 13:09:31.343858 21879 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:31.344014 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:31.345587 26188 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.295586 26091 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:31.346102 26188 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:31.346663 22448 leader_election.cc:400] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 9. Current term is 10.
I20260709 13:09:31.346839 26091 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:31.347182 22448 leader_election.cc:403] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:09:31.347409 26091 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:31.295902 26084 consensus_queue.cc:1059] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:09:31.296536 26173 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:31.349494 26119 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:31.350014 26119 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.350370 26119 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:31.350649 26188 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:31.297745 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:31.298934 26116 raft_consensus.cc:3055] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:31.299292 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:31.299402 26118 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:31.300197 26235 log.cc:927] Time spent T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:09:31.242489 26113 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:31.303874 21914 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:31.354938 21908 raft_consensus.cc:2368] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10.
I20260709 13:09:31.237715 26038 consensus_queue.cc:1059] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:09:31.316159 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:31.253806 26206 consensus_queue.cc:260] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:31.317948 26220 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:31.320753 21652 maintenance_manager.cc:419] P ff36b0eb624c458eb7f542eb2e635aa2: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10045 bytes on disk
I20260709 13:09:31.242933 26194 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:31.366267 26118 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:31.367796 26194 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:31.370555 26177 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:31.325280 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:31.375104 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:31.375792 22483 raft_consensus.cc:2393] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 11: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:09:31.325510 26195 consensus_queue.cc:1048] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:31.376262 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:31.377022 21833 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 14.
I20260709 13:09:31.377851 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:31.265762 26157 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:31.352516 26116 raft_consensus.cc:740] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:31.355495 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:31.355890 21913 raft_consensus.cc:2393] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 11: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:31.356974 21910 raft_consensus.cc:1240] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:31.363533 26038 raft_consensus.cc:3055] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:31.373904 21651 maintenance_manager.cc:643] P ff36b0eb624c458eb7f542eb2e635aa2: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.005s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":317,"lbm_reads_lt_1ms":4}
I20260709 13:09:31.323624 26147 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:31.385949 21831 raft_consensus.cc:1240] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:31.381772 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:31.382710 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:31.388290 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:31.389117 22483 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:31.286186 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:31.391621 21838 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:31.387065 21912 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:31.395262 21804 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:31.396042 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:09:31.403239 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 323353us
I20260709 13:09:31.390499 21880 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:31.394026 22448 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:31.407213 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:31.414667 22485 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:31.416823 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:31.420611 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:31.420904 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:31.423374 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:31.384138 26206 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:31.382599 26038 raft_consensus.cc:740] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:09:31.443537 21879 leader_election.cc:336] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.203s (SENT)
I20260709 13:09:31.451638 21879 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:31.452108 22479 raft_consensus.cc:1240] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:31.445201 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:31.402205 26194 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:31.452967 22483 raft_consensus.cc:2393] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 10: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
W20260709 13:09:31.453645 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 59731us
I20260709 13:09:31.391356 26229 raft_consensus.cc:697] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:09:31.456873 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 61718.6us
I20260709 13:09:31.424250 26203 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:31.457176 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:31.373337 26227 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:31.466140 26220 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:31.467358 26227 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:31.463682 26226 log.cc:927] Time spent T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:31.459007 26120 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:31.463636 26212 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 9. Current term is 10.
I20260709 13:09:31.470009 26229 consensus_queue.cc:237] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:31.443975 26204 consensus_queue.cc:1059] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:09:31.464404 26038 consensus_queue.cc:260] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:31.476253 26038 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:31.478049 26189 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:31.466244 21835 raft_consensus.cc:1240] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:31.482533 26119 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:09:31.484975 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.487087 21912 raft_consensus.cc:2393] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 13: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:31.383106 26091 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:31.450912 26084 raft_consensus.cc:3055] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:09:31.461213 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.498086 26177 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:31.500696 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.504493 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:31.461483 26142 consensus_queue.cc:1059] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:09:31.462069 26203 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.505862 21728 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:31.519531 21806 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:31.461311 26137 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:31.508472 21910 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:31.382893 26116 consensus_queue.cc:260] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:31.504341 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:31.522990 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:31.533607 21908 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:31.534600 21838 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
I20260709 13:09:31.533228 21913 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:31.536506 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.501634 26084 raft_consensus.cc:740] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:31.508558 25944 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:31.518733 26126 raft_consensus.cc:3055] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:31.543984 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:31.528951 26203 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:31.557163 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:31.557611 26119 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:31.557986 21835 raft_consensus.cc:2393] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 11: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:09:31.523594 26137 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:31.565629 22448 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:31.562697 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:31.552978 21910 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:31.566794 21877 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:31.541850 26127 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:09:31.596866 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.597503 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:31.598294 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.599036 21834 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:31.598892 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:31.547739 25629 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:31.563042 26126 raft_consensus.cc:740] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:31.563378 26116 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:31.613097 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 46375.3us
W20260709 13:09:31.622759 21805 leader_election.cc:336] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 3.151s (SENT)
W20260709 13:09:31.598415 22450 leader_election.cc:336] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.636s (SENT)
W20260709 13:09:31.601056 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.623409 21877 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:31.566522 26227 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:31.568078 26137 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:31.621608 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 504412us
I20260709 13:09:31.618969 21908 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:09:31.595533 26163 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:31.628510 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:31.628599 21804 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:31.635198 21838 raft_consensus.cc:2393] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 13: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:31.563248 25944 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:31.639925 21910 raft_consensus.cc:1240] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:31.596294 26142 consensus_queue.cc:1059] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:09:31.640128 21912 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:31.644562 21804 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:31.629554 26038 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:31.652230 21729 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:31.626997 26084 consensus_queue.cc:260] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:31.646587 26083 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:31.670785 21913 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:09:31.672103 21804 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:09:31.682073 26247 log.cc:927] Time spent T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:09:31.652397 26147 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:31.683970 26242 log.cc:927] Time spent T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:09:31.656356 26220 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:31.631968 26227 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:31.682864 26190 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:31.680745 26218 consensus_queue.cc:1059] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 13:09:31.689284 21729 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:31.692803 22479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:44346
I20260709 13:09:31.738509 22479 raft_consensus.cc:606] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:31.693545 21913 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:31.697979 26084 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:31.658229 26189 consensus_queue.cc:1059] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:09:31.669061 26236 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:09:31.689900 26127 raft_consensus.cc:3055] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:31.658736 26163 raft_consensus.cc:697] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:31.643060 26234 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:09:31.741333 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 52129.1us
I20260709 13:09:31.756587 21729 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:31.758107 21729 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:31.720623 26142 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:31.722008 25943 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:31.779556 26250 log.cc:927] Time spent T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:09:31.729518 26138 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:31.743476 26239 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:09:31.673259 26126 consensus_queue.cc:260] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:31.754634 26091 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:31.745476 26127 raft_consensus.cc:740] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:31.731398 26083 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:31.839314 26243 log.cc:927] Time spent T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:09:31.840469 26083 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:31.812669 26230 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:31.745532 26220 raft_consensus.cc:697] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:31.825623 21831 raft_consensus.cc:1240] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:31.828737 25944 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:31.829617 26239 consensus_queue.cc:1059] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:09:31.830282 26251 log.cc:927] Time spent T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 13:09:31.830721 26245 log.cc:927] Time spent T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 13:09:31.834146 26246 log.cc:927] Time spent T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 13:09:31.836086 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:31.805846 26163 consensus_queue.cc:237] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:31.796275 26173 raft_consensus.cc:3055] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:31.799388 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:31.843881 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:31.849534 22482 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:31.850524 25892 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.851363 21836 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:31.808565 26142 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:31.852504 22479 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:44346
W20260709 13:09:31.852599 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 182489us
W20260709 13:09:31.861696 21879 leader_election.cc:336] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 2.744s (SENT)
I20260709 13:09:31.863241 22479 raft_consensus.cc:606] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:31.863776 22479 raft_consensus.cc:614] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:31.863288 21879 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:31.863435 21838 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:09:31.863381 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.872723 21910 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:09:31.873199 21910 pending_rounds.cc:85] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 9
I20260709 13:09:31.874475 21910 pending_rounds.cc:107] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:09:31.874787 21910 raft_consensus.cc:2889] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:31.890026 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:31.848899 26126 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:31.897975 21914 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 13:09:31.905645 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 43986.1us
I20260709 13:09:31.906565 26190 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:31.907800 26190 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.908391 26190 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:31.911332 26190 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:31.914047 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:31.852162 26175 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:09:31.896709 26239 consensus_queue.cc:1243] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer 6fadfd81c5a645f1806a284ddbb6bf0d log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:09:31.862905 26173 raft_consensus.cc:740] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:31.906597 26137 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:31.946128 21833 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:31.866547 26038 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:09:31.974007 22482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:44346
I20260709 13:09:31.974756 22482 raft_consensus.cc:606] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:31.904623 26187 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:09:31.895779 25892 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:31.978879 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 220842us
I20260709 13:09:31.945176 26137 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:31.981561 21729 leader_election.cc:400] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 12. Current term is 13.
I20260709 13:09:31.965976 26234 raft_consensus.cc:697] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:31.964617 25724 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:32.013964 25724 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:31.912850 26127 consensus_queue.cc:260] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.017064 26127 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.018862 26194 raft_consensus.cc:3055] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:32.019392 26194 raft_consensus.cc:740] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:32.020339 26194 consensus_queue.cc:260] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.021235 25892 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:32.023082 26203 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:32.025368 26203 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:32.027822 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.027982 26234 consensus_queue.cc:237] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:32.031848 26244 log.cc:927] Time spent T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.309s	user 0.000s	sys 0.003s
I20260709 13:09:31.998962 26227 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:32.034829 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:32.035434 21839 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
W20260709 13:09:32.036176 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.037364 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:31.935279 26220 consensus_queue.cc:237] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.040400 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:32.047183 22483 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:32.041953 26173 consensus_queue.cc:260] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:32.045886 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:32.056438 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:09:32.049042 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 67679.8us
I20260709 13:09:32.050515 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:32.051891 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:32.053660 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:32.059648 21879 leader_election.cc:336] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.527s (SENT)
I20260709 13:09:32.060292 21879 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:32.060392 21909 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:32.005388 26138 raft_consensus.cc:697] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:32.064419 21914 raft_consensus.cc:2368] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 10. Current term is 11.
I20260709 13:09:32.072413 21729 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:32.076629 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.077550 21879 leader_election.cc:336] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.549s (SENT)
I20260709 13:09:32.078070 21879 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:32.038034 26194 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:32.097682 22483 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:32.101050 21880 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:32.065244 26193 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:32.075310 26173 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:32.088996 26221 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:32.075433 25724 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:32.119799 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.121958 21879 leader_election.cc:336] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.581s (SENT)
I20260709 13:09:32.122424 21879 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:32.123766 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.124524 26091 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:32.130183 26138 consensus_queue.cc:237] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.082185 26185 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:09:32.106819 26157 consensus_meta.cc:287] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.728s	user 0.008s	sys 0.003s
I20260709 13:09:32.074883 26239 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:09:32.100540 26128 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
W20260709 13:09:32.115887 26206 consensus_meta.cc:287] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.661s	user 0.012s	sys 0.000s
W20260709 13:09:32.136612 21805 leader_election.cc:336] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.599s (SENT)
I20260709 13:09:32.143020 21805 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:32.115378 26203 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:32.117596 26190 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:32.157297 22484 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:32.158869 26234 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:32.161574 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:32.138780 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 64035.9us
I20260709 13:09:32.137282 26185 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:32.192859 21729 leader_election.cc:400] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10.
I20260709 13:09:32.161687 26190 raft_consensus.cc:697] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:09:32.203187 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 56511.5us
W20260709 13:09:32.205250 21879 leader_election.cc:336] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.633s (SENT)
I20260709 13:09:32.206425 21879 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:32.206553 21805 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:32.207927 26190 consensus_queue.cc:237] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:32.213589 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.218502 21906 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:09:32.226626 21837 raft_consensus.cc:1240] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:09:32.228103 26138 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:32.228706 26157 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:32.231081 21912 raft_consensus.cc:1275] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:32.231384 21909 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:09:32.224541 26220 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:32.237931 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:32.200624 26274 consensus_queue.cc:1059] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:09:32.238622 21908 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:32.229951 26116 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:09:32.241735 21879 leader_election.cc:336] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.678s (SENT)
I20260709 13:09:32.242185 26116 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:32.242520 21879 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:32.244130 21879 leader_election.cc:336] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.685s (SENT)
I20260709 13:09:32.244478 26116 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:32.244818 21879 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:32.246587 26185 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:32.246608 21908 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:32.247692 26038 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:32.248080 26157 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:32.250771 21879 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:32.251559 26157 raft_consensus.cc:2764] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:09:32.252033 21879 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:32.252807 26157 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:32.253237 21879 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:32.253994 26157 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:32.254348 26157 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:32.254379 21879 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:32.254856 26157 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:32.255206 26203 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:32.205699 26128 consensus_queue.cc:1059] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:09:32.257376 26203 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:32.257963 26128 raft_consensus.cc:3055] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:32.258359 26128 raft_consensus.cc:740] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:32.241848 26212 raft_consensus.cc:993] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd: : Instructing follower 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:09:32.259449 26212 raft_consensus.cc:1081] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Signalling peer 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:09:32.259246 26128 consensus_queue.cc:260] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.260488 26128 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.260471 21879 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:32.268735 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:32.270002 21908 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:45202
I20260709 13:09:32.270592 21908 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:32.270957 21908 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.267664 26203 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:32.272545 26203 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:32.272397 26157 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:32.273015 26203 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.276948 26185 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:32.277580 26127 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:32.281085 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:32.281865 26185 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.282423 26127 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.284303 26185 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:32.284595 26127 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:32.286363 26135 raft_consensus.cc:3055] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:32.286765 26135 raft_consensus.cc:740] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:32.287511 26135 consensus_queue.cc:260] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:32.291193 26238 log.cc:927] Time spent T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.671s	user 0.003s	sys 0.000s
I20260709 13:09:32.292447 26220 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:32.294150 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56424 (request call id 567) took 1334 ms. Trace:
W20260709 13:09:32.294811 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.278167 21908 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:32.305905 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:32.306644 21765 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:09:32.278857 26157 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:32.279021 26116 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.279448 26257 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:32.309500 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:32.310566 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:32.294525 21832 rpcz_store.cc:276] 0709 13:09:30.960218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.983264 (+ 23046us) service_pool.cc:224] Handling call
0709 13:09:30.983705 (+   441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:30.999990 (+ 16285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:31.000019 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:31.244663 (+244644us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b2c0000e678. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6acc50a11 00007fc6acc60372 00007fc6ae392a01 00007fc6ae35743a 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2
0709 13:09:31.245101 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:09:31.408886 (+163785us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:31.408937 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:31.409027 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:32.290608 (+881581us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:09:32.293949 (+  3341us) raft_consensus.cc:1685] finished
0709 13:09:32.293969 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:32.294094 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7275,"raft.queue_time_us":20679,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":23642,"spinlock_wait_cycles":13276160,"thread_start_us":163396,"threads_started":1,"wal-append.queue_time_us":294135}
I20260709 13:09:32.314829 21758 raft_consensus.cc:2393] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 10: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:32.313282 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:32.315306 21765 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:32.316143 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:32.311535 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:32.317936 21765 raft_consensus.cc:2410] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:09:32.319762 21757 raft_consensus.cc:2393] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 10: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:32.321475 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:32.323375 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:32.325827 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:32.326359 21763 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:32.332021 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:32.329460 22450 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:32.323962 21757 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:32.329913 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:32.333854 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:32.334465 21765 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:32.330327 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:32.335405 21908 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:32.336958 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:32.337559 21761 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:32.309391 26256 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:32.319375 26127 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.343766 21805 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:32.347401 21805 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:32.346709 21729 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:32.337846 26038 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.350978 21729 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:32.355047 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:32.355633 21759 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:32.322280 26257 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:32.322149 26116 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:32.362723 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:32.363497 26116 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:32.364795 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:32.356489 26230 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:32.348133 26256 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.365998 26230 raft_consensus.cc:697] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:32.366859 26230 consensus_queue.cc:237] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.367700 26256 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:32.351922 26208 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:32.368654 26208 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:32.369079 26208 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.369972 26135 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:32.372002 25629 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:32.372443 25629 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:32.353586 26232 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.361367 26257 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:32.358340 26272 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:32.350385 26239 consensus_queue.cc:1048] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:09:32.378166 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:32.359211 26038 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.381525 21805 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:32.390627 21805 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:32.391719 21805 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:32.353420 26220 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:32.383983 21763 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 14.
I20260709 13:09:32.384694 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:32.385298 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:32.351003 26185 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:09:32.394405 22450 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:32.351224 26274 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:09:32.407529 21729 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:32.373157 26203 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.352329 26127 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.410631 26188 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:32.410867 26116 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:32.395334 26195 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:32.395321 26113 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:32.390326 26187 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:32.423595 21759 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:32.401173 26233 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:32.396143 26220 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:32.405110 26190 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.434754 21879 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:32.436223 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:32.438547 21763 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:32.438969 21756 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:32.436625 26220 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:32.441638 26119 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:32.442230 26119 raft_consensus.cc:697] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:32.443163 26203 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:32.443094 26119 consensus_queue.cc:237] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.451512 26208 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:32.436719 26233 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:32.452770 26233 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:32.446542 26190 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.455904 26190 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:32.456214 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:32.456908 21757 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.458704 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:32.459498 21765 raft_consensus.cc:2393] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 8: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:32.462231 21912 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:32.439915 26187 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:32.463750 26147 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:32.466651 26187 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:32.430119 26195 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:32.431803 26113 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.432717 26188 raft_consensus.cc:697] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:32.493953 21763 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:32.489293 26188 consensus_queue.cc:237] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:32.495462 21804 leader_election.cc:400] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 10. Current term is 11.
I20260709 13:09:32.495818 21804 leader_election.cc:403] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:09:32.483206 21757 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:32.483964 21805 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:32.497701 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:32.498281 21763 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:32.499346 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:32.500365 21757 raft_consensus.cc:2376] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11. Re-sending same reply.
I20260709 13:09:32.501562 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:32.484826 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:32.487519 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:32.502910 21761 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:09:32.504112 21759 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:32.502285 21757 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.513087 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:32.516106 21759 raft_consensus.cc:2376] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13. Re-sending same reply.
I20260709 13:09:32.520685 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:32.520741 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:32.523820 21763 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:09:32.528563 26127 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:32.538189 22484 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36270 (request call id 705) took 1195 ms. Trace:
I20260709 13:09:32.538341 26208 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:32.539881 26038 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:32.514459 26229 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.564445 26233 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.478469 26138 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:32.566761 26218 raft_consensus.cc:3055] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:32.566638 26138 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:32.567210 26218 raft_consensus.cc:740] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:32.568583 26232 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:32.542809 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:32.569634 22485 raft_consensus.cc:2368] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 10. Current term is 11.
I20260709 13:09:32.569104 26138 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:32.495936 26113 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:32.578138 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:32.578850 22485 raft_consensus.cc:3055] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:32.579165 22485 raft_consensus.cc:740] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:32.579995 21806 leader_election.cc:400] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 10. Current term is 11.
I20260709 13:09:32.579922 22485 consensus_queue.cc:260] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:32.580631 25629 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:32.550395 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:09:32.610401 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 198356us
W20260709 13:09:32.553264 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.522037 25944 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:32.557355 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:32.557682 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:32.559789 21757 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:32.558689 22484 rpcz_store.cc:276] 0709 13:09:31.342695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:31.343748 (+  1053us) service_pool.cc:224] Handling call
0709 13:09:32.537998 (+1194250us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b540018bd54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:32.538120 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1868788992}
I20260709 13:09:32.622939 21759 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:32.560153 22483 raft_consensus.cc:1240] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:32.623273 21877 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:32.568127 26218 consensus_queue.cc:260] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.485152 26195 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:32.543794 21758 raft_consensus.cc:2410] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:09:32.580382 26233 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:32.544963 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:32.626214 21731 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:32.626329 21761 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:32.561024 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:32.585846 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:32.588982 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:32.581250 22485 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:32.546814 21764 raft_consensus.cc:2393] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 13: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:32.600116 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:32.629231 21765 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:32.615314 21832 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:32.616143 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:32.630721 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.612696 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:32.631138 21762 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:32.643849 21759 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:09:32.644974 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:32.645068 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:32.649024 21757 raft_consensus.cc:2393] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 13: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:32.649684 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:32.650604 21765 raft_consensus.cc:2410] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:09:32.639163 26193 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:32.651592 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:32.645696 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:32.610260 26203 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:32.658259 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:32.662582 21759 raft_consensus.cc:2376] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11. Re-sending same reply.
I20260709 13:09:32.663664 21838 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 14.
I20260709 13:09:32.664247 21757 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:32.665613 21757 raft_consensus.cc:1240] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:09:32.668327 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:32.669216 21764 raft_consensus.cc:2410] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:09:32.661175 21765 raft_consensus.cc:1240] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:32.765642 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.685328 26157 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.766263 26157 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.776952 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:32.779168 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:32.781111 21838 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:09:32.784376 21762 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:32.682912 26220 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:32.670080 26203 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.803375 26220 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:32.804463 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:32.642081 26239 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:32.804988 21763 raft_consensus.cc:1240] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:32.815912 21728 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:32.631865 26190 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:09:32.817824 21835 raft_consensus.cc:1240] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:32.728080 22485 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:32.652009 26218 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:32.682762 21759 raft_consensus.cc:1240] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:32.684710 26113 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.651669 26193 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:32.733163 26135 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.768950 26157 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:32.673715 26229 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:32.735406 21756 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:32.839694 21756 raft_consensus.cc:1240] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:09:32.736976 26291 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.738195 21805 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:32.738663 21758 raft_consensus.cc:1240] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:32.740322 21663 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52326 (request call id 154) took 7611 ms. Trace:
I20260709 13:09:32.740613 21879 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:32.741281 22450 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:32.746585 21764 raft_consensus.cc:1240] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:32.749817 25629 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:32.753046 25944 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 10. Current term is 11.
I20260709 13:09:32.763998 26195 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.786950 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:32.788046 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:32.790819 21760 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:09:32.826189 26239 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.795411 21837 raft_consensus.cc:1275] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:09:32.853147 22485 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:32.798589 26126 raft_consensus.cc:993] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:09:32.855870 26126 raft_consensus.cc:1081] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:09:32.673564 26038 consensus_queue.cc:1059] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:32.856983 26038 raft_consensus.cc:3055] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:32.857323 26038 raft_consensus.cc:740] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:32.858090 26038 consensus_queue.cc:260] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:32.859236 26038 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:32.860584 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 47308.6us
I20260709 13:09:32.808107 21762 raft_consensus.cc:1240] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:32.818141 21728 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:32.824052 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 197395us
I20260709 13:09:32.863791 26232 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:32.864463 26232 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:32.865059 26232 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:32.866793 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:32.826545 26163 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:09:32.870362 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:32.871719 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:32.872797 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:32.841933 26135 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.876013 26135 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:32.832085 26127 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:32.858106 21758 raft_consensus.cc:1240] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:32.889578 26239 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:32.891052 26302 log.cc:927] Time spent T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:09:32.892028 26269 log.cc:927] Time spent T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:09:32.819782 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:32.828169 22476 raft_consensus.cc:1240] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:32.830526 21839 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:32.832585 21905 raft_consensus.cc:1240] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 8. Current term is 9. Ops: []
W20260709 13:09:32.842970 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 104852us
I20260709 13:09:32.898919 21805 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:09:32.843694 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 102494us
I20260709 13:09:32.900127 22450 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:32.900261 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:09:32.846112 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 105574us
I20260709 13:09:32.902002 21879 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:32.847002 21759 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:32.793813 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:32.841795 21661 catalog_manager.cc:5697] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.901150 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:32.907279 21764 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:32.836457 26193 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:32.914774 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 97361.1us
I20260709 13:09:32.915657 21728 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:32.917272 21835 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:32.917917 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:32.918148 21879 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:32.920662 21805 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:32.919766 21879 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:32.924101 26229 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:32.924151 21661 catalog_manager.cc:5697] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 8 to 11, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 11 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:32.926354 26233 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:32.925901 21661 catalog_manager.cc:5697] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 8 to 11, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 11 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.927536 21661 catalog_manager.cc:5697] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 11 to 12, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 12 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:32.851202 26188 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:32.932457 21831 raft_consensus.cc:1240] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:32.934466 21728 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:32.935417 21879 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:32.935583 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:32.931638 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:32.928998 26256 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:32.937129 21762 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:32.854097 26157 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:32.948004 21661 catalog_manager.cc:5697] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 9 to 10, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 10 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:32.951342 22448 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:32.922127 26297 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:32.930195 26145 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:32.931679 26091 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:32.965891 21661 catalog_manager.cc:5697] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.968142 21728 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:32.934191 26181 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:32.970713 21805 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:32.852030 26291 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:32.945246 26188 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:32.946038 26119 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:32.946822 26194 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:32.978680 21909 raft_consensus.cc:1240] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:32.842837 21663 rpcz_store.cc:276] 0709 13:09:25.129182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:25.183414 (+ 54232us) service_pool.cc:224] Handling call
0709 13:09:32.740230 (+7556816us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:29.305828 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:29.306489 (+   661us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:29.306525 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:09:29.306552 (+    27us) tablet.cc:662] Decoding operations
0709 13:09:29.312005 (+  5453us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:29.312076 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:29.312104 (+    28us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:09:29.402489 (+ 90385us) tablet.cc:701] Row locks acquired
0709 13:09:29.402521 (+    32us) write_op.cc:260] PREPARE: finished
0709 13:09:29.402740 (+   219us) write_op.cc:270] Start()
0709 13:09:29.402898 (+   158us) write_op.cc:276] Timestamp: P: 1783602569402665 usec, L: 0
0709 13:09:29.402933 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:09:29.403926 (+   993us) log.cc:844] Serialized 7401 byte log entry
0709 13:09:30.668951 (+1265025us) op_driver.cc:464] REPLICATION: finished
0709 13:09:31.013618 (+344667us) write_op.cc:301] APPLY: starting
0709 13:09:31.017156 (+  3538us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:31.291429 (+274273us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:31.291519 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:31.835130 (+543611us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:31.835478 (+   348us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:09:31.835522 (+    44us) write_op.cc:312] APPLY: finished
0709 13:09:31.904001 (+ 68479us) log.cc:844] Serialized 172 byte log entry
0709 13:09:32.107739 (+203738us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:32.133079 (+ 25340us) write_op.cc:454] Released schema lock
0709 13:09:32.137751 (+  4672us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:32.165371 (+ 27620us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:32.165407 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":356842,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":325657,"apply.run_cpu_time_us":60763,"apply.run_wall_time_us":1152605,"cfile_cache_hit":74,"cfile_cache_hit_bytes":77404,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6219,"cfile_init":2,"lbm_read_time_us":1111,"lbm_reads_lt_1ms":12,"num_ops":19,"prepare.queue_time_us":54163,"prepare.run_cpu_time_us":6696,"prepare.run_wall_time_us":98456,"replication_time_us":1200638,"spinlock_wait_cycles":3968,"thread_start_us":353108,"threads_started":3,"wal-append.queue_time_us":242494}]]}
I20260709 13:09:32.980129 21914 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:32.981716 21913 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:32.991097 21764 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:09:32.980140 26142 consensus_queue.cc:1048] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:09:33.004863 21913 raft_consensus.cc:1240] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:33.007583 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:33.008404 21909 raft_consensus.cc:1275] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:09:33.007575 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 56343.2us
I20260709 13:09:33.011886 21838 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:32.957867 26157 raft_consensus.cc:697] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:33.005896 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:09:33.014812 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 79472us
I20260709 13:09:32.948622 26233 consensus_queue.cc:1059] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:09:32.974123 26135 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:33.020309 21831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:56424
I20260709 13:09:33.025068 21762 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:33.025624 21831 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:33.026145 21831 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:33.021552 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:32.979570 26145 raft_consensus.cc:697] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:32.971182 26297 raft_consensus.cc:697] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:33.023617 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:33.023910 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.029366 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:33.006292 26173 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:33.010131 26188 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:32.982630 26128 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:32.982791 26177 consensus_queue.cc:1059] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:09:33.022411 21879 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:33.007674 26091 raft_consensus.cc:697] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:32.982923 26181 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:33.034497 26190 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:09:33.036507 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 74268.7us
I20260709 13:09:33.049165 21661 catalog_manager.cc:5697] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 7 to 8, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 8 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:33.024101 26203 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:33.015761 26212 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:33.081314 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 62578.9us
I20260709 13:09:33.085191 21879 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:33.093528 21661 catalog_manager.cc:5697] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:33.056931 26119 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.029831 26163 consensus_queue.cc:1059] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:09:33.041471 26254 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:09:33.035066 26220 consensus_queue.cc:1059] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:09:33.034798 25944 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
W20260709 13:09:33.082324 26293 log.cc:927] Time spent T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 13:09:33.070087 26173 raft_consensus.cc:697] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:33.100512 26203 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:33.104118 21661 catalog_manager.cc:5697] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 11 to 10, leader changed from <none> to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 10 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:09:33.102510 26233 consensus_queue.cc:1243] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer 3843e9b794a245dd8608e04ec7915239 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:09:33.103313 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 87692.7us
I20260709 13:09:33.125929 21661 catalog_manager.cc:5697] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 5 to 8, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 8 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:33.130724 21661 catalog_manager.cc:5697] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 9 to 10, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 10 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:33.090481 26138 consensus_queue.cc:1059] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:09:33.139819 26195 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:33.142462 21661 catalog_manager.cc:5697] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 6 to 8, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 8 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:33.139819 26163 raft_consensus.cc:3055] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:33.140973 26181 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:33.114283 26177 raft_consensus.cc:3055] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:33.181938 26177 raft_consensus.cc:740] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:33.148265 26163 raft_consensus.cc:740] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
W20260709 13:09:33.145999 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 60885.9us
I20260709 13:09:33.107029 25629 consensus_queue.cc:1059] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:09:33.106480 26119 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:33.138448 26190 raft_consensus.cc:697] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:33.128376 26203 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:33.123764 26175 consensus_queue.cc:1059] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:09:33.147928 26297 consensus_queue.cc:237] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:33.182664 26091 consensus_queue.cc:237] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:33.194121 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 51480.1us
I20260709 13:09:33.151443 21661 catalog_manager.cc:5697] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 9 to 10, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 10 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:33.201397 21879 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:33.216217 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:33.218796 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 81797.3us
I20260709 13:09:33.213112 26203 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:33.220832 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:33.220572 26190 consensus_queue.cc:237] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:33.224140 26306 log.cc:927] Time spent T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:09:33.225167 26137 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:33.269145 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:33.229485 26305 log.cc:927] Time spent T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:09:33.230389 26252 consensus_queue.cc:1059] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:33.231257 26315 raft_consensus.cc:3055] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:33.231292 26195 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:33.234644 26227 raft_consensus.cc:3055] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:33.151675 26113 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:33.236125 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 130891us
W20260709 13:09:33.201861 26293 log.cc:927] Time spent T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:09:33.226778 26301 log.cc:927] Time spent T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:09:33.199972 26317 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:33.270486 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 69165.5us
I20260709 13:09:33.107795 26157 consensus_queue.cc:237] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:09:33.294085 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 173064us
I20260709 13:09:33.273653 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:33.267331 26277 log.cc:927] Time spent T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:09:33.124527 26145 consensus_queue.cc:237] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:33.297982 21762 raft_consensus.cc:2393] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 10: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:33.298046 21877 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:33.292829 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:33.311610 21834 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
W20260709 13:09:33.314502 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 279504us
I20260709 13:09:33.315647 21805 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:33.283226 26315 raft_consensus.cc:740] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:33.288905 26227 raft_consensus.cc:740] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:33.281806 26291 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:33.345700 21805 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:33.266461 26173 consensus_queue.cc:237] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:33.354631 21661 catalog_manager.cc:5697] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 7 to 8, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 8 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:33.314952 26313 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:33.290781 26195 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:33.362545 21805 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:33.290748 26177 consensus_queue.cc:260] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:33.328634 26304 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:09:33.350502 26252 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:33.286113 26163 consensus_queue.cc:260] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:33.321668 26113 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:09:33.363488 26310 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:33.380260 26193 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:33.381608 26195 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:33.366037 26318 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.370157 26304 consensus_queue.cc:1059] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:09:33.366968 26119 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:33.385254 26316 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:09:33.363850 26291 consensus_queue.cc:1059] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:09:33.386180 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1603) took 1074 ms. Trace:
I20260709 13:09:33.427405 21912 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:33.363585 26321 raft_consensus.cc:3055] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:33.365564 25943 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:09:33.370710 26038 consensus_meta.cc:287] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.000s
I20260709 13:09:33.370760 26137 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:09:33.387964 26218 consensus_meta.cc:287] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.000s
I20260709 13:09:33.388408 26315 consensus_queue.cc:260] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:33.390173 26229 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:33.411155 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 84562.1us
I20260709 13:09:33.384567 21831 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:33.366216 26177 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:33.424381 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 67495.9us
I20260709 13:09:33.424482 26163 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:33.423208 26318 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:33.426695 21761 rpcz_store.cc:276] 0709 13:09:32.312192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.661784 (+349592us) service_pool.cc:224] Handling call
0709 13:09:32.662102 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.662462 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.662497 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.690131 (+ 27634us) log.cc:844] Serialized 26 byte log entry
0709 13:09:32.837056 (+146925us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:32.852124 (+ 15068us) log.cc:844] Serialized 14 byte log entry
0709 13:09:32.933470 (+ 81346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:32.933539 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.385970 (+452431us) raft_consensus.cc:1685] finished
0709 13:09:33.385990 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.386123 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81091,"prepare.queue_time_us":83706,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":7422,"raft.queue_time_us":82166,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":15353,"thread_start_us":119225,"threads_started":1,"wal-append.queue_time_us":254354}
I20260709 13:09:33.388909 26203 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:33.453334 25943 raft_consensus.cc:697] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:33.388922 26188 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:33.413230 26113 consensus_queue.cc:1243] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer 3843e9b794a245dd8608e04ec7915239 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:09:33.436479 26321 raft_consensus.cc:740] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:33.467684 21838 raft_consensus.cc:1240] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:33.421918 26181 consensus_queue.cc:1175] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3843e9b794a245dd8608e04ec7915239" responder_term: 10 status { last_received { term: 10 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 10 index: 9 } }
I20260709 13:09:33.458467 26137 raft_consensus.cc:697] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:09:33.533998 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 182646us
I20260709 13:09:33.534629 22476 raft_consensus.cc:1240] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:33.535494 21831 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:33.544899 22449 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:33.545754 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 57910.8us
W20260709 13:09:33.545976 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 68665.5us
I20260709 13:09:33.545288 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:33.468488 26315 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:33.550347 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 85078.5us
I20260709 13:09:33.439109 26310 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:33.460958 26038 consensus_queue.cc:1059] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 13:09:33.547528 21804 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:33.478497 26296 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:33.563454 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:33.613343 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2949) took 1294 ms. Trace:
I20260709 13:09:33.613875 21763 rpcz_store.cc:276] 0709 13:09:32.323098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.830201 (+507103us) service_pool.cc:224] Handling call
0709 13:09:32.830562 (+   361us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:32.841839 (+ 11277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.841868 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:32.842464 (+   596us) log.cc:844] Serialized 52 byte log entry
0709 13:09:33.024093 (+181629us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:33.051497 (+ 27404us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.612813 (+561316us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.612989 (+   176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.613057 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.613093 (+    36us) raft_consensus.cc:1685] finished
0709 13:09:33.613108 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.613267 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":611602,"prepare.queue_time_us":28310,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":35,"raft.queue_time_us":5864,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":14994,"thread_start_us":136565,"threads_started":1,"wal-append.queue_time_us":216431}
W20260709 13:09:33.666047 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 357802us
I20260709 13:09:33.669420 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:33.670079 21761 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:33.670117 21763 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:33.555164 26329 consensus_queue.cc:1059] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 13:09:33.673195 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:33.674993 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:33.675925 21763 raft_consensus.cc:2393] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 12: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:33.677270 21764 raft_consensus.cc:1275] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:09:33.678155 21764 pending_rounds.cc:85] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 5
I20260709 13:09:33.678426 21764 pending_rounds.cc:107] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:09:33.678694 21764 raft_consensus.cc:2889] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:33.679375 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:33.688598 21756 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:09:33.689059 21756 pending_rounds.cc:85] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 7
I20260709 13:09:33.689509 21759 raft_consensus.cc:1275] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:33.611497 26195 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:33.553822 26252 consensus_queue.cc:1048] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.109s
I20260709 13:09:33.689342 21756 pending_rounds.cc:107] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:09:33.711715 21756 raft_consensus.cc:2889] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:33.708480 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:33.714591 21762 raft_consensus.cc:1240] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:33.719002 21834 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:33.767144 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 83950.9us
I20260709 13:09:33.669893 26311 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:33.768075 21729 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:33.768605 21831 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:33.683295 26128 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.558208 25943 consensus_queue.cc:237] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:33.783879 26335 log.cc:927] Time spent T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:09:33.784484 26323 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:33.784775 26328 log.cc:927] Time spent T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.157s	user 0.003s	sys 0.007s
I20260709 13:09:33.785365 26334 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:33.789942 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:33.792738 21757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1608) took 1465 ms. Trace:
W20260709 13:09:33.775880 26303 log.cc:927] Time spent T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:09:33.799008 21757 rpcz_store.cc:276] 0709 13:09:32.313394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.666564 (+353170us) service_pool.cc:224] Handling call
0709 13:09:32.666825 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.668108 (+  1283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.668139 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.686317 (+ 18178us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.015821 (+329504us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:33.023238 (+  7417us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.557641 (+534403us) spinlock_profiling.cc:243] Waited 7.08 ms on lock 0x7b18002d34c0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab1e4c0a 00007fc6b4924219 00007fc6ab26ca40 00007fc6ab2674e4 00007fc6ab267455 00007fc6ae34f060 00007fc6ae361716 00007fc6ae372287 00007fc6ae372208
0709 13:09:33.762615 (+204974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.762687 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:33.762726 (+    39us) raft_consensus.cc:1685] finished
0709 13:09:33.777737 (+ 15011us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:33.778543 (+   806us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108386,"prepare.queue_time_us":12709,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":575250,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":24445,"spinlock_wait_cycles":16292224,"thread_start_us":533752,"threads_started":2,"wal-append.queue_time_us":437984}
I20260709 13:09:33.793787 26193 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:33.689761 26321 consensus_queue.cc:260] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:33.794463 26128 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:33.760035 26137 consensus_queue.cc:237] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:33.826658 26342 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:33.832448 26342 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:33.833925 26212 consensus_meta.cc:287] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.741s	user 0.010s	sys 0.000s
I20260709 13:09:33.834378 26212 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:33.795034 26323 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:33.834714 26342 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:33.836963 26323 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:33.837445 26333 log.cc:927] Time spent T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:09:33.838258 21906 raft_consensus.cc:1275] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:09:33.823771 26232 consensus_meta.cc:287] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.958s	user 0.007s	sys 0.006s
I20260709 13:09:33.820825 26135 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:33.840955 21910 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:09:33.845518 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:33.860298 21909 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:33.826136 26188 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:33.827266 26203 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:33.790748 26311 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:33.879347 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:33.877525 22448 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:33.885367 21909 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:33.880389 26318 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:33.883423 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 115423us
I20260709 13:09:33.922070 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:33.924854 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:33.925963 21729 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:33.925513 21835 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
W20260709 13:09:33.933557 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:33.865721 26232 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:33.931277 21728 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:33.950939 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:33.951766 21831 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:09:33.953083 21757 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:09:33.953251 22448 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:33.913395 26145 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:33.976063 21906 raft_consensus.cc:1240] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:33.938987 26116 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:33.950500 26185 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.088605 21757 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:34.059811 21836 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:34.089233 21879 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:34.090739 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 300994us
I20260709 13:09:33.955111 26142 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.102068 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:34.104707 21762 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:33.938721 26137 consensus_queue.cc:1048] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.151s
I20260709 13:09:33.954943 26145 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:34.107403 21838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 3167) took 1094 ms. Trace:
W20260709 13:09:34.068861 26339 log.cc:927] Time spent T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 13:09:34.107824 21838 rpcz_store.cc:276] 0709 13:09:33.013524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.014448 (+   924us) service_pool.cc:224] Handling call
0709 13:09:33.014700 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.468156 (+453456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.102774 (+634618us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54000717d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:34.107339 (+  4565us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1041377152}
I20260709 13:09:34.004653 26310 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:34.110112 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.088454 26233 raft_consensus.cc:3055] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:33.941931 26314 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.152s
I20260709 13:09:34.057829 26349 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:34.118577 21906 raft_consensus.cc:2393] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 10: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:34.069577 26229 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:34.112064 26239 consensus_meta.cc:287] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 1.222s	user 0.013s	sys 0.000s
I20260709 13:09:34.110759 26193 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:34.111207 26145 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:34.131147 21762 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:09:34.126137 26351 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.134202 26188 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.134676 26135 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:34.134570 26351 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.134743 26188 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.135367 26135 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.122700 26349 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.136940 26349 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:34.098006 26185 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.111794 26142 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.117326 26127 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.124579 26116 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.142715 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.143286 21906 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:34.120939 26233 raft_consensus.cc:740] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:34.149080 21906 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:34.149248 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:34.113632 26291 consensus_queue.cc:1059] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:09:34.127259 26193 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.117952 26157 consensus_queue.cc:1059] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:09:34.137365 26135 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:34.118484 26350 consensus_queue.cc:1059] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:09:34.188150 26356 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:34.188844 26356 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.189292 26356 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:34.191044 26331 log.cc:927] Time spent T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.328s	user 0.001s	sys 0.000s
W20260709 13:09:34.198629 26360 log.cc:927] Time spent T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:09:34.200011 26142 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:34.200320 26163 consensus_meta.cc:287] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.742s	user 0.010s	sys 0.000s
I20260709 13:09:34.202411 26185 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:34.203050 26323 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:34.203671 26323 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:34.206326 26347 log.cc:927] Time spent T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 13:09:34.149091 26127 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.211580 26127 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:34.159422 26128 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:34.167088 26193 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:34.213028 26311 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:34.127665 26239 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.142263 26116 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.219575 26239 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:34.126750 26229 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.221199 26116 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:34.198503 26366 log.cc:927] Time spent T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:09:34.234640 26229 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:34.201152 26233 consensus_queue.cc:260] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.245273 26233 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:34.244110 26142 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:34.248723 26142 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.252105 26142 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:34.254890 26315 consensus_meta.cc:287] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.701s	user 0.005s	sys 0.005s
I20260709 13:09:34.257014 26232 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:34.262965 21839 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
W20260709 13:09:34.263686 26177 consensus_meta.cc:287] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.802s	user 0.006s	sys 0.004s
I20260709 13:09:34.264621 21911 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1843) took 1047 ms. Trace:
I20260709 13:09:34.265103 21911 rpcz_store.cc:276] 0709 13:09:33.217261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.217369 (+   108us) service_pool.cc:224] Handling call
0709 13:09:33.217676 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.235444 (+ 17768us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.235473 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:33.258390 (+ 22917us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.477942 (+219552us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:33.478011 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:33.478138 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.264347 (+786209us) raft_consensus.cc:1685] finished
0709 13:09:34.264375 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.264553 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35401,"raft.queue_time_us":51486,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":13112,"thread_start_us":165179,"threads_started":1,"wal-append.queue_time_us":333455}
W20260709 13:09:34.268286 21913 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1657) took 1265 ms (client timeout 1510 ms). Trace:
W20260709 13:09:34.268671 21913 rpcz_store.cc:269] 0709 13:09:33.003042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.005667 (+  2625us) service_pool.cc:224] Handling call
0709 13:09:34.268089 (+1262422us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b540021a554. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:34.268213 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1943990016}
W20260709 13:09:34.276254 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 323099us
W20260709 13:09:34.278524 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 124928us
I20260709 13:09:34.280870 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:34.281546 22485 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:34.281630 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:34.238476 26291 raft_consensus.cc:3055] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:34.273780 26367 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:34.296648 22485 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:09:34.298619 21731 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:34.300616 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:34.301235 21761 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:34.288483 26291 raft_consensus.cc:740] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:34.305835 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.307579 21879 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:34.309077 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.302418 26142 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:34.292943 26145 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.309662 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.310230 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.310283 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.311896 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.311985 21910 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 14.
I20260709 13:09:34.293586 26367 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.315757 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:34.315984 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.315647 26323 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:34.312516 26318 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:09:34.316639 26371 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.319342 26371 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.321725 26371 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:34.323987 26368 log.cc:927] Time spent T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:09:34.313769 26157 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:34.323217 26193 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.326360 26157 raft_consensus.cc:697] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:34.327292 26157 consensus_queue.cc:237] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.317832 26142 raft_consensus.cc:697] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 12 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:34.333814 26177 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:34.334075 26367 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:34.334357 26177 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.335134 26142 consensus_queue.cc:237] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:34.338249 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.336426 26177 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:34.333554 26349 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.350844 26145 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:34.350950 26193 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:34.351616 26349 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:34.345458 26232 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.352274 26232 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.354828 26232 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:34.355835 26233 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:34.356535 26233 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.358919 26310 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:34.359566 26175 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.359481 26310 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.360168 26175 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.361407 26310 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:34.362412 26175 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:34.358976 26233 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:34.364084 26314 consensus_queue.cc:1048] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:34.364133 26233 consensus_queue.cc:1048] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:09:34.367019 26356 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.368101 26314 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:34.370334 26356 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:34.377784 26375 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:34.391418 26371 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:34.391666 26375 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.391978 26371 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.393918 26375 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:34.386783 26349 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:34.386190 26314 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:34.394260 26371 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:34.387348 26291 consensus_queue.cc:260] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.406385 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1623) took 2088 ms. Trace:
I20260709 13:09:34.407116 21765 rpcz_store.cc:276] 0709 13:09:32.317724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.765383 (+447659us) service_pool.cc:224] Handling call
0709 13:09:32.765749 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:32.894847 (+129098us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:32.894877 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:32.907775 (+ 12898us) log.cc:844] Serialized 26 byte log entry
0709 13:09:33.072776 (+165001us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:33.090581 (+ 17805us) log.cc:844] Serialized 14 byte log entry
0709 13:09:33.627541 (+536960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.405998 (+778457us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400359b54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:34.406048 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.406096 (+    48us) raft_consensus.cc:1685] finished
0709 13:09:34.406180 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.406323 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":546797,"prepare.queue_time_us":24046,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":631883,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":70340,"spinlock_wait_cycles":295895808,"thread_start_us":118825,"threads_started":1,"wal-append.queue_time_us":183653,"wal-append.run_cpu_time_us":2333,"wal-append.run_wall_time_us":1112525}
I20260709 13:09:34.406311 26291 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:34.413717 26322 raft_consensus.cc:3055] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:34.414276 26322 raft_consensus.cc:740] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:34.415325 26322 consensus_queue.cc:260] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.403789 26349 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.423156 21877 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:34.423740 26349 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:34.424918 21877 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:34.425449 26298 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:34.426102 26298 consensus_queue.cc:1059] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:34.427022 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:34.427771 22481 raft_consensus.cc:2368] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12.
I20260709 13:09:34.430392 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:34.431443 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:34.406574 26314 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.432025 22485 raft_consensus.cc:3055] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:34.432354 22485 raft_consensus.cc:740] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:34.433884 26314 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:34.390482 26229 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:34.434876 26229 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.435133 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:34.427716 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:34.435968 22479 raft_consensus.cc:2368] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 14. Current term is 15.
I20260709 13:09:34.436924 26296 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:09:34.437995 21914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1840) took 1222 ms. Trace:
I20260709 13:09:34.438761 21877 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:34.440225 26298 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:34.440565 26298 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:34.440933 26298 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:34.443221 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.438371 21914 rpcz_store.cc:276] 0709 13:09:33.215262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.215360 (+    98us) service_pool.cc:224] Handling call
0709 13:09:33.215630 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.234655 (+ 19025us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.234686 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:33.235218 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:09:34.246820 (+1011602us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b18001c4a40. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab24ce07 00007fc6b40a7ab9 00007fc6ab26969b 00007fc6ab26793f 00007fc6ab269c02 00007fc6adef120b 00007fc6adef6d23 00007fc6adef70d1 00007fc6ae312a0f
0709 13:09:34.307040 (+ 60220us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:09:34.307076 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.307142 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.437694 (+130552us) raft_consensus.cc:1685] finished
0709 13:09:34.437713 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.437910 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20351,"raft.queue_time_us":52100,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":12844,"spinlock_wait_cycles":5525760,"thread_start_us":59934,"threads_started":1,"wal-append.queue_time_us":1121544}
I20260709 13:09:34.444664 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:34.445415 26188 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:34.446120 26321 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:34.446338 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:34.447207 21837 raft_consensus.cc:2410] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:09:34.449014 26298 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.449622 21912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 874) took 1613 ms. Trace:
I20260709 13:09:34.450035 21912 rpcz_store.cc:276] 0709 13:09:32.835793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:32.837791 (+  1998us) service_pool.cc:224] Handling call
0709 13:09:32.838082 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.437421 (+599339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.449359 (+1011938us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b54003af7d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:34.449558 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1354962304}
I20260709 13:09:34.450937 21806 leader_election.cc:400] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12.
I20260709 13:09:34.451251 21806 leader_election.cc:403] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:34.451438 26298 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:34.452107 26298 consensus_queue.cc:1059] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:34.452726 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:34.453276 21837 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:34.453627 26173 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:09:34.454278 26322 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:34.456053 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:34.456415 21877 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:34.456954 22479 raft_consensus.cc:2393] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 15: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:09:34.433099 22485 consensus_queue.cc:260] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.458168 21806 leader_election.cc:400] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 14. Current term is 15.
I20260709 13:09:34.458456 22485 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:34.458621 21806 leader_election.cc:403] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:09:34.453276 26193 raft_consensus.cc:3055] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:34.473747 26193 raft_consensus.cc:740] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:09:34.455554 26362 log.cc:927] Time spent T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.281s	user 0.004s	sys 0.000s
I20260709 13:09:34.480414 21761 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:09:34.476528 26193 consensus_queue.cc:260] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.437179 26229 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:34.478456 26317 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:34.493705 22485 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:34.473223 26220 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:09:34.495267 21806 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:34.477612 26291 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.498860 26330 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:34.499478 26324 raft_consensus.cc:3055] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:34.499889 26324 raft_consensus.cc:740] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:34.500665 26324 consensus_queue.cc:260] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.504201 26173 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12.
I20260709 13:09:34.506131 26193 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:34.515655 21837 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:09:34.513456 26317 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:34.518067 26317 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.520351 26317 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:34.520977 22476 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36278 (request call id 658) took 1152 ms. Trace:
W20260709 13:09:34.521267 26363 log.cc:927] Time spent T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.632s	user 0.001s	sys 0.018s
I20260709 13:09:34.524600 22476 rpcz_store.cc:276] 0709 13:09:33.368740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.370229 (+  1489us) service_pool.cc:224] Handling call
0709 13:09:33.370524 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:33.544995 (+174471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.520658 (+975663us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54004885d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:34.520878 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":267849088}
W20260709 13:09:34.528625 21878 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.528803 26212 consensus_queue.cc:1059] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:34.529685 26212 raft_consensus.cc:3055] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:34.530014 26212 raft_consensus.cc:740] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:34.530823 26212 consensus_queue.cc:260] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.532032 26212 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:34.533105 26138 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.533632 26138 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.534684 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.535722 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:34.520989 26324 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:34.511832 26314 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:34.536384 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.536509 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.542068 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:34.542196 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:34.542606 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.543159 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.543761 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.538856 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:34.541067 21912 raft_consensus.cc:2393] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 14: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:09:34.545756 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.540942 26310 consensus_queue.cc:1059] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:09:34.547135 26310 raft_consensus.cc:3055] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:34.547482 26138 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:34.547523 26310 raft_consensus.cc:740] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:34.545347 21913 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:34.548640 26310 consensus_queue.cc:260] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:34.554337 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.558192 26310 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:34.559577 26314 raft_consensus.cc:697] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:34.552956 26142 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.560824 26119 raft_consensus.cc:3055] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:34.551992 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.560024 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:34.513139 26291 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.545828 21836 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
I20260709 13:09:34.562076 22479 raft_consensus.cc:2393] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 15: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:09:34.561043 26142 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.563117 22485 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:34.563942 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:34.564333 21912 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:34.564886 26229 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.561311 26119 raft_consensus.cc:740] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:34.540006 26173 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:34.565570 26229 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.566131 26173 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.566450 26119 consensus_queue.cc:260] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.566612 26227 consensus_queue.cc:260] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.567649 26119 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:34.567674 26227 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:34.573055 26351 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:34.580307 22483 raft_consensus.cc:1275] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:34.581622 26230 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.582136 26230 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.583407 26229 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:34.584127 26230 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:34.583842 26314 consensus_queue.cc:237] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.594010 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:34.596189 26230 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.596846 26230 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.597653 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:34.598284 22479 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:34.599608 26230 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:34.585266 21910 raft_consensus.cc:1275] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:34.585371 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 1839) took 1370 ms. Trace:
I20260709 13:09:34.601276 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:34.601028 21905 rpcz_store.cc:276] 0709 13:09:33.214949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.215090 (+   141us) service_pool.cc:224] Handling call
0709 13:09:33.215426 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:33.270445 (+ 55019us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:33.270474 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:33.270927 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:09:34.336207 (+1065280us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b18003e0a40. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab24ce07 00007fc6b40a7ab9 00007fc6ab26969b 00007fc6ab26793f 00007fc6ab269c02 00007fc6adef120b 00007fc6adef6d23 00007fc6adef70d1 00007fc6ae312a0f
0709 13:09:34.482082 (+145875us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:09:34.495977 (+ 13895us) log.cc:844] Serialized 14 byte log entry
0709 13:09:34.496642 (+   665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:34.578215 (+ 81573us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b18003e0a40. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab2382a6 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419
0709 13:09:34.578597 (+   382us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b54001f31d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:34.578637 (+    40us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:34.585203 (+  6566us) raft_consensus.cc:1685] finished
0709 13:09:34.585220 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:34.585323 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14921,"prepare.queue_time_us":14018,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":30196,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":16945,"spinlock_wait_cycles":113511936,"thread_start_us":145670,"threads_started":1,"wal-append.queue_time_us":1236871}
I20260709 13:09:34.601025 26230 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:34.602095 22485 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:34.586948 21836 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:34.600458 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:34.607029 22485 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEARNER]: Advancing to term 13
I20260709 13:09:34.603797 21880 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:34.608155 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:34.608740 21764 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:34.609046 21758 raft_consensus.cc:1240] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:34.610100 21756 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:34.610304 22448 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:34.610558 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:34.611400 21763 raft_consensus.cc:2393] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 12: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:34.612412 21765 raft_consensus.cc:1275] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:34.563469 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.616922 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:34.617385 21838 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:09:34.618638 21731 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:34.619854 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:34.621752 21731 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:34.623390 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.623797 21831 raft_consensus.cc:1240] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:34.625262 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:34.625512 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:34.626876 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:34.627416 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:34.628150 21910 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:34.635105 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:34.638931 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.639652 21909 raft_consensus.cc:2393] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:34.563479 26291 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:34.643504 21836 raft_consensus.cc:2410] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:09:34.618705 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:34.644731 22450 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:34.640697 21761 raft_consensus.cc:1240] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:34.641494 21835 raft_consensus.cc:1240] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:34.641741 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:34.642066 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:34.647531 21834 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:09:34.647897 21834 pending_rounds.cc:85] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 7
I20260709 13:09:34.640403 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.648098 21834 pending_rounds.cc:107] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:09:34.648347 21834 raft_consensus.cc:2889] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:34.648485 21831 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:34.645184 21758 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:34.655021 21763 raft_consensus.cc:1275] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:34.655782 21834 raft_consensus.cc:1275] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:34.658484 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:34.659560 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:34.660337 21762 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:34.668051 21764 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:34.670975 21729 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:34.681454 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.681890 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.683626 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.684417 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:34.683516 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:34.686134 21907 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:34.611904 26342 raft_consensus.cc:2764] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:09:34.689019 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.693214 21905 raft_consensus.cc:2393] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 9: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:34.693245 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:34.693480 21729 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:34.604641 26230 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.702628 21837 raft_consensus.cc:1240] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:34.690521 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:34.591441 26352 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:09:34.695251 21729 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:34.659544 26375 raft_consensus.cc:2804] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:34.723594 21729 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:34.725157 21729 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:34.727244 22485 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
W20260709 13:09:34.689795 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 67793.6us
I20260709 13:09:34.680655 26336 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:34.692442 26329 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:09:34.698665 26194 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:34.692557 26256 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:34.705482 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 65959.9us
I20260709 13:09:34.653745 26371 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:34.727586 22485 pending_rounds.cc:85] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd: Aborting all ops after (but not including) 7
I20260709 13:09:34.692296 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:34.704232 21831 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:34.750937 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:34.712080 21835 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:09:34.729105 22449 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:34.731387 21907 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:34.669255 26351 consensus_queue.cc:1059] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 13:09:34.714443 26304 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:34.739063 21906 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:34.749990 22485 pending_rounds.cc:107] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:09:34.773752 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:34.774286 22485 raft_consensus.cc:2889] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:34.722249 26346 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.680305 26038 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:09:34.670076 26274 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:34.749635 26194 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.732525 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:34.805962 22483 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:09:34.723431 26375 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.706454 26142 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:34.787364 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 58336.5us
I20260709 13:09:34.732532 26116 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:34.753744 26371 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:34.844482 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:34.845161 21838 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:09:34.851245 21731 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:34.790661 26327 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:34.774910 26291 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:09:34.789232 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:34.861887 21838 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:34.788537 21910 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 15.
I20260709 13:09:34.796514 21833 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:34.745764 26185 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:34.745537 26135 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:34.705916 26330 consensus_queue.cc:1059] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
W20260709 13:09:34.868063 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.867980 21834 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:34.704656 26323 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:34.749267 26336 raft_consensus.cc:697] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:34.765502 26256 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.812446 26194 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:34.813668 26320 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:34.813846 26181 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:34.845712 26347 log.cc:927] Time spent T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:09:34.860114 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:34.864897 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:34.909406 21831 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:09:34.909803 21833 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:34.863008 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:34.912575 21838 raft_consensus.cc:2410] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:09:34.812713 26375 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:34.795171 21877 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:34.820807 26371 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:34.866536 22449 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:34.819959 26142 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:34.839938 26173 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:34.804314 26337 consensus_queue.cc:1048] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:09:34.800593 26346 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.818424 26298 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:09:34.873208 26215 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:35.025797 26357 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.026368 26357 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:35.028339 26357 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:34.811820 26274 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:34.875861 26336 consensus_queue.cc:237] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:34.866967 26327 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:35.030174 26274 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:35.030485 21840 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:09:35.030946 26327 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:34.882009 26220 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 14. Current term is 15.
I20260709 13:09:34.798369 26304 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:35.032871 26195 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.033370 26195 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:35.033779 26304 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:34.866631 26296 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:34.900872 26389 log.cc:927] Time spent T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.223s	user 0.005s	sys 0.000s
I20260709 13:09:34.860395 26116 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:09:34.918921 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 52476.2us
I20260709 13:09:35.036836 26116 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.037247 26116 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:34.930155 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 135055us
I20260709 13:09:35.039207 26194 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:35.040328 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:34.946692 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.951433 21908 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:09:35.041266 26194 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:35.042783 26342 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:35.042869 22448 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:35.046276 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:35.018332 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.962527 26142 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:35.024158 26256 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:35.024618 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 51265.5us
I20260709 13:09:34.860050 26345 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.193s
I20260709 13:09:35.044138 26334 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:35.051529 21914 raft_consensus.cc:2393] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 12: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:35.061141 21728 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:35.070176 21728 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:35.062888 21804 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.40.3:43881 timed out after 1.510s (SENT) [suppressed 35 similar messages]
W20260709 13:09:35.073036 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:34.961287 26358 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:34.961999 26193 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:35.074714 26256 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:35.075219 26357 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:35.076112 21728 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:35.084080 21728 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:34.945541 26297 consensus_queue.cc:1059] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.150s
I20260709 13:09:35.111340 26239 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:35.114955 26324 raft_consensus.cc:3055] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:35.117328 21728 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:35.125811 21840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 2170) took 1440 ms. Trace:
I20260709 13:09:35.137537 21840 rpcz_store.cc:276] 0709 13:09:33.685913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:33.707338 (+ 21425us) service_pool.cc:224] Handling call
0709 13:09:33.707681 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.030868 (+1323187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.125560 (+ 94692us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400185e54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:35.125724 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3041447808}
I20260709 13:09:35.128479 26345 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:35.086249 26185 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:35.129860 26193 raft_consensus.cc:697] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:34.947291 26181 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:35.125262 26212 consensus_meta.cc:287] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
I20260709 13:09:34.947082 26320 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:35.084924 26334 raft_consensus.cc:697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:35.137130 26324 raft_consensus.cc:740] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:09:35.180842 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.182693 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:35.182636 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:35.188099 22476 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:09:35.186805 22484 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:35.190894 26321 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.195928 26321 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:35.202401 21806 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:35.153877 21728 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:35.132020 26358 raft_consensus.cc:697] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:35.203956 26310 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:09:35.210300 26358 consensus_queue.cc:237] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:35.211417 26227 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:35.211858 26227 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:35.212229 26227 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:35.136127 26297 consensus_queue.cc:1243] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer 6fadfd81c5a645f1806a284ddbb6bf0d log is divergent from this leader: its last log entry 12.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:09:35.150424 26119 consensus_meta.cc:287] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.580s	user 0.007s	sys 0.003s
I20260709 13:09:35.147601 22483 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:35.162349 26142 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:35.154201 26239 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:35.150532 26345 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:35.158449 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 415585us
W20260709 13:09:35.170091 26391 log.cc:927] Time spent T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.093s	user 0.002s	sys 0.000s
I20260709 13:09:35.153625 26346 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:35.173738 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:35.195652 26193 consensus_queue.cc:237] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:35.177702 21839 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 15.
I20260709 13:09:35.177472 26371 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:35.227458 21763 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:35.228006 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:35.228772 21764 raft_consensus.cc:2393] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 10: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:35.217365 26194 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:35.217756 21912 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:09:35.174072 26334 consensus_queue.cc:237] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:35.239511 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:35.233033 21764 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:09:35.241892 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:35.242853 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:35.214627 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 60842us
I20260709 13:09:35.236574 21763 raft_consensus.cc:1240] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:35.244144 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:35.244899 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:35.236728 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:35.246173 21759 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
W20260709 13:09:35.246553 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 183688us
I20260709 13:09:35.247054 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:35.248081 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:35.248560 21758 raft_consensus.cc:1240] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:35.235136 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:35.220556 26239 raft_consensus.cc:697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:35.250794 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:35.251284 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:35.251945 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:35.252007 21804 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:35.251969 21762 raft_consensus.cc:2393] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:35.248833 21728 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:35.255221 21879 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:35.254506 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:35.227180 26274 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:35.256584 21760 raft_consensus.cc:1240] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:35.257196 26327 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:35.214797 26324 consensus_queue.cc:260] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:35.257625 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:35.258499 21762 pending_rounds.cc:85] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 7
I20260709 13:09:35.269956 21762 pending_rounds.cc:107] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:09:35.270213 21762 raft_consensus.cc:2889] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:35.270295 21879 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:35.271374 21805 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:35.269450 21757 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:35.271960 21879 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:35.258092 26239 consensus_queue.cc:237] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:35.259172 21804 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:35.237313 26181 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:35.237552 26194 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.292886 21757 raft_consensus.cc:1240] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:09:35.294904 21757 raft_consensus.cc:1217] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Deduplicated request from leader. Original: 6.3->[8.4-8.4]   Dedup: 8.4->[]
I20260709 13:09:35.295351 21757 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:09:35.264771 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:35.296820 21765 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:09:35.274159 21805 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:09:35.305637 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 56911.8us
I20260709 13:09:35.269062 26304 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:35.291939 26119 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:35.323753 21765 raft_consensus.cc:1275] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:09:35.298838 26233 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:35.331974 26233 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:35.324513 26116 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:35.332422 26233 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:35.273177 26274 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:35.301885 26194 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:35.335692 26274 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:35.338460 21756 raft_consensus.cc:2393] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 9: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:35.300978 26346 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:35.339444 26346 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:35.339865 26346 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:35.340098 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 66005.7us
I20260709 13:09:35.343019 21805 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:35.310911 26348 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.311110 26324 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:35.275158 26212 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:09:35.291718 26329 consensus_queue.cc:1048] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:09:35.320171 26138 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:35.322090 26395 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:09:35.349246 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.304816 26340 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:09:35.328964 26119 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:35.346496 26116 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:35.408944 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.413028 26396 log.cc:927] Time spent T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:09:35.353914 26091 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:35.413681 26091 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:35.415711 26091 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:35.422591 21761 raft_consensus.cc:1275] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:35.423636 26230 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:35.432124 22478 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:09:35.426494 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:35.434510 26252 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.407639 26119 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:35.427152 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:35.427570 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:35.439924 22482 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:35.428772 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:35.345461 26173 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
W20260709 13:09:35.426813 26397 log.cc:927] Time spent T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:09:35.407291 26137 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:35.355965 26348 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:35.452327 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:35.454241 21832 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:09:35.455592 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:35.458012 21838 raft_consensus.cc:1275] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:35.455724 21731 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:35.445499 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:35.436548 26323 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.447453 21757 raft_consensus.cc:1275] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:09:35.462769 21877 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:35.446434 26195 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:35.463080 21906 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:09:35.463016 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:35.462165 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:35.470290 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:35.470827 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:35.471101 21906 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:09:35.472319 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:35.477617 21765 raft_consensus.cc:1275] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:35.468334 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:35.478600 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:35.485013 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:35.485724 21757 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:35.487977 21757 raft_consensus.cc:1240] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:09:35.488778 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 180326us
I20260709 13:09:35.490278 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:35.491596 21913 raft_consensus.cc:1275] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:35.457760 26345 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:35.503103 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:35.464499 26116 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:35.435006 26252 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:35.503530 21728 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:35.467396 26137 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:35.465397 26371 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:35.511974 21879 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:35.443070 26375 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:35.525709 21804 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:35.530457 22450 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:35.476840 26320 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:35.533671 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:35.568423 21728 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:35.534874 26345 raft_consensus.cc:2764] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:09:35.535064 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:35.576236 21908 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:35.535631 26351 consensus_queue.cc:1048] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:35.536787 26296 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.537065 26375 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:35.580211 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 237253us
I20260709 13:09:35.537221 26322 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:35.539877 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:35.540275 26252 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:35.540869 26338 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:35.541322 26400 log.cc:927] Time spent T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:09:35.525343 26116 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:35.554045 26233 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:35.556456 26227 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:35.458257 26230 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:09:35.558101 26135 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:35.559383 26348 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:35.480427 26038 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:35.564566 26346 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:35.572926 22482 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:35.581801 22477 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:35.658975 21731 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:35.659888 26233 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:35.660537 26233 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:35.581995 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:35.582957 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:35.603986 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:35.610146 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 84512.3us
I20260709 13:09:35.474252 26323 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:35.630007 21839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56424 (request call id 602) took 1055 ms. Trace:
I20260709 13:09:35.603292 26357 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.580856 26274 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:35.629352 26116 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:35.666621 21913 raft_consensus.cc:1240] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 13. Current term is 14. Ops: []
W20260709 13:09:35.685786 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.664065 21804 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:35.670011 21839 rpcz_store.cc:276] 0709 13:09:34.558047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.563667 (+  5620us) service_pool.cc:224] Handling call
0709 13:09:35.613639 (+1049972us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54002e6b54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:35.613768 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1107719040}
I20260709 13:09:35.678459 22477 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:35.679126 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:35.679641 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:35.688431 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:35.635993 26138 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:35.689774 21731 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:35.683334 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:35.689121 21909 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:09:35.692080 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:35.605661 26296 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:35.727767 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:35.728484 21805 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:09:35.734077 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 44413.2us
W20260709 13:09:35.739317 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 202890us
I20260709 13:09:35.668407 26195 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.660988 26233 raft_consensus.cc:697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:35.737954 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:35.633896 26194 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:35.636747 26371 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 13:09:35.665139 26038 raft_consensus.cc:697] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:35.746258 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:35.748153 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:35.754539 21914 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:35.685081 26337 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.756776 26337 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:35.758344 21909 raft_consensus.cc:2393] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 9: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:09:35.759335 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 72966.9us
W20260709 13:09:35.760872 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 96898.2us
I20260709 13:09:35.762014 21804 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:35.751894 21879 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:35.671645 26404 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:35.745549 26256 raft_consensus.cc:2804] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:35.739601 26322 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:35.690181 26324 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:09:35.779243 21759 raft_consensus.cc:2393] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 9: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:35.692416 26357 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:35.784154 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:35.755198 26239 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:35.835856 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 107470us
I20260709 13:09:35.751091 26330 consensus_queue.cc:1048] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:09:35.836953 21805 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:35.752614 26195 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:35.783592 26404 raft_consensus.cc:697] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:35.792795 26256 raft_consensus.cc:697] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:09:35.870800 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 108853us
W20260709 13:09:35.874737 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 107022us
I20260709 13:09:35.875779 21879 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:35.835646 26157 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:35.881798 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:35.866724 26138 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:35.883594 21804 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:35.793771 26322 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:35.895244 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:35.873114 26173 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:35.874997 26320 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:35.879173 26314 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:35.875656 26409 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:35.920022 22482 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:35.839121 26239 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:35.922288 21806 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:35.865840 26410 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:09:35.879781 26157 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:35.891623 26138 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.928496 21805 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:35.871721 26417 consensus_queue.cc:1059] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 13:09:35.898144 26227 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:35.897223 26252 consensus_queue.cc:1048] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:09:35.927541 26422 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:35.870566 26233 consensus_queue.cc:237] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:35.928671 26413 log.cc:927] Time spent T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 13:09:35.934383 26327 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:09:35.941418 26406 log.cc:927] Time spent T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:09:35.877153 26038 consensus_queue.cc:237] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:35.929020 26157 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:35.901890 26119 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:35.932317 26138 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:35.935132 26346 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:35.957783 26414 log.cc:927] Time spent T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 13:09:35.971310 26426 log.cc:927] Time spent T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:09:35.964366 26296 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:35.997937 26321 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:35.989737 26323 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:36.006072 21907 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 896) took 1154 ms. Trace:
I20260709 13:09:36.006521 21907 rpcz_store.cc:276] 0709 13:09:34.851891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.854289 (+  2398us) service_pool.cc:224] Handling call
0709 13:09:34.854650 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:35.063396 (+208746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.063438 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:35.063977 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:09:35.252794 (+188817us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:35.252830 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:35.426346 (+173516us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:09:36.005724 (+579378us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54001969d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:36.005799 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.005851 (+    52us) raft_consensus.cc:1685] finished
0709 13:09:36.005869 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.006008 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":10760,"spinlock_wait_cycles":491059840,"thread_start_us":188477,"threads_started":1,"wal-append.queue_time_us":255290}
I20260709 13:09:36.011292 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 2188) took 1259 ms. Trace:
I20260709 13:09:36.011826 21831 rpcz_store.cc:276] 0709 13:09:34.751909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.911054 (+159145us) service_pool.cc:224] Handling call
0709 13:09:34.911330 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.044778 (+133448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.044824 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:35.044894 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:35.044933 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.011035 (+966102us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b5400339ad4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:36.011091 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.011228 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306334464}
I20260709 13:09:35.967052 26229 consensus_queue.cc:1048] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
W20260709 13:09:35.978681 26418 log.cc:927] Time spent T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:09:35.979859 26322 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:35.927614 26320 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:35.960023 26409 consensus_queue.cc:1048] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:09:35.961174 26256 consensus_queue.cc:237] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:35.982009 26429 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:35.958676 26422 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:35.931666 26421 consensus_queue.cc:1059] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:09:35.988312 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:35.988924 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:36.051575 22482 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:35.961174 26404 consensus_queue.cc:237] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:35.974340 26195 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:36.059684 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:36.029843 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:35.987578 26327 raft_consensus.cc:697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:09:36.049544 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 311012us
I20260709 13:09:36.053066 21806 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:36.062170 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:36.065073 21760 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:36.066583 22450 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:36.069630 21729 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:36.086203 26407 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:36.086802 26407 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.087222 26407 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:36.075572 26376 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:36.051254 26422 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:36.050165 26429 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:36.098165 26425 log.cc:927] Time spent T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.177s	user 0.003s	sys 0.000s
I20260709 13:09:36.098862 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:36.100914 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:36.102269 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:36.102679 26375 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:36.102684 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:36.106592 26401 log.cc:927] Time spent T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.441s	user 0.002s	sys 0.000s
W20260709 13:09:36.108404 26420 log.cc:927] Time spent T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 13:09:36.112862 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:36.115075 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:36.115979 21905 raft_consensus.cc:2393] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 12: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:36.118079 21905 raft_consensus.cc:1240] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:36.131393 21877 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:36.132567 26338 consensus_meta.cc:287] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.517s	user 0.005s	sys 0.013s
I20260709 13:09:36.133213 26338 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.134127 21729 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
W20260709 13:09:36.137811 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 61209.8us
W20260709 13:09:36.132660 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 166545us
I20260709 13:09:36.138566 21729 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:36.133460 21877 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:36.150703 21729 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:36.176884 21729 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:36.182817 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:36.129864 26409 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:36.148325 26345 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:36.184199 21729 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:36.152222 26038 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:36.170444 26348 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:36.172030 26173 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:36.179522 26423 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:36.186750 26405 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:36.186335 26323 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:36.185695 26119 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:36.192655 26291 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:36.195561 26345 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:36.186975 26432 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:36.212241 26185 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:36.230206 26429 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:36.197886 26409 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:36.222301 26430 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:36.238484 26320 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:36.253933 26409 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:36.232410 26423 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:36.267475 26314 raft_consensus.cc:3055] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:36.268136 26314 raft_consensus.cc:740] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:36.231518 26337 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:36.279814 26423 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:36.237586 26345 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:36.290588 26357 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:36.218067 26327 consensus_queue.cc:237] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:36.347461 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 163493us
I20260709 13:09:36.351395 21729 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:36.355234 21763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1645) took 1111 ms. Trace:
I20260709 13:09:36.355751 21763 rpcz_store.cc:276] 0709 13:09:35.243263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.259295 (+ 16032us) service_pool.cc:224] Handling call
0709 13:09:35.259559 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:35.275785 (+ 16226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.275813 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:35.276271 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 13:09:35.672869 (+396598us) spinlock_profiling.cc:243] Waited 8.87 ms on lock 0x7b4800002958. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b3280aa1 00007fc6b3277b37 00007fc6b32779ca 00007fc6b336f26f 00007fc6b336ef37 00007fc6b338355c 00007fc6b3383508 00007fc6b3383488 00007fc6b3383443 00007fc6b33826ec 00007fc6b22aca96
0709 13:09:36.079698 (+406829us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b18003e8d20. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab24ce07 00007fc6b40a7ab9 00007fc6ab26969b 00007fc6ab26793f 00007fc6ab269c02 00007fc6adef120b 00007fc6adef6d23 00007fc6adef70d1 00007fc6ae312a0f
0709 13:09:36.354265 (+274567us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:36.354381 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.354546 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.354634 (+    88us) raft_consensus.cc:1685] finished
0709 13:09:36.354648 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.354944 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15828,"raft.queue_time_us":29184,"raft.run_cpu_time_us":6759,"raft.run_wall_time_us":395186,"spinlock_wait_cycles":25030784,"thread_start_us":273988,"threads_started":1,"wal-append.queue_time_us":1029051}
I20260709 13:09:36.362564 21763 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:36.370695 21763 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:09:36.371408 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 237958us
W20260709 13:09:36.286149 26310 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.025s	sys 0.035s
I20260709 13:09:36.219727 26038 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:36.394444 26116 consensus_meta.cc:287] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.667s	user 0.012s	sys 0.000s
W20260709 13:09:36.396528 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 47178.7us
I20260709 13:09:36.239095 26185 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:36.444406 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 52229.2us
I20260709 13:09:36.445093 26352 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.445960 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:36.449570 26357 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:09:36.450305 26310 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.025s	sys 0.036s
I20260709 13:09:36.231065 26173 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:36.480093 21913 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:09:36.481287 21759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 1653) took 1230 ms. Trace:
I20260709 13:09:36.471364 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:36.482230 21759 rpcz_store.cc:276] 0709 13:09:35.251151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.251727 (+   576us) service_pool.cc:224] Handling call
0709 13:09:36.469166 (+1217439us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b54003dac54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:36.481090 (+ 11924us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1193883520}
I20260709 13:09:36.482720 21907 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:09:36.483186 21840 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 3199) took 1029 ms. Trace:
I20260709 13:09:36.483402 26038 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:36.484308 26185 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:36.484799 26173 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:36.488548 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:36.488996 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:36.456269 21760 raft_consensus.cc:2468] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:36.425205 26116 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:36.483620 21840 rpcz_store.cc:276] 0709 13:09:35.454036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.455470 (+  1434us) service_pool.cc:224] Handling call
0709 13:09:35.455757 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:35.574226 (+118469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.574268 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:35.574811 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:09:35.834611 (+259800us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:09:35.834663 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.482468 (+647805us) spinlock_profiling.cc:243] Waited 84.8 ms on lock 0x7b540025dfd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:36.482546 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.482633 (+    87us) raft_consensus.cc:1685] finished
0709 13:09:36.482647 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.482971 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53582,"raft.queue_time_us":94110,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":20033,"spinlock_wait_cycles":194971392,"thread_start_us":202249,"threads_started":1,"wal-append.queue_time_us":291837}
I20260709 13:09:36.269215 26314 consensus_queue.cc:260] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:36.492571 26116 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:36.249711 26239 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:36.493673 21906 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:36.493793 21758 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
I20260709 13:09:36.471306 21764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 1638) took 1230 ms. Trace:
I20260709 13:09:36.489980 21905 raft_consensus.cc:2393] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 13: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:36.494549 21764 rpcz_store.cc:276] 0709 13:09:35.241171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.242660 (+  1489us) service_pool.cc:224] Handling call
0709 13:09:36.470763 (+1228103us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b5400039b54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:36.471045 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127545088}
I20260709 13:09:36.489162 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:36.495908 26352 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:36.501411 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:36.505754 26448 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:36.506505 26448 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:36.507025 26352 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:36.510017 21910 raft_consensus.cc:3055] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:36.510497 21910 raft_consensus.cc:740] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:36.511008 26448 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:36.511713 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:36.512023 21910 consensus_queue.cc:260] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:36.514550 21912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49554 (request call id 1684) took 1875 ms. Trace:
I20260709 13:09:36.515069 21912 rpcz_store.cc:276] 0709 13:09:34.638891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:34.640197 (+  1306us) service_pool.cc:224] Handling call
0709 13:09:36.514005 (+1873808us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b5400288054. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:36.514294 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1309649152}
I20260709 13:09:36.515805 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:36.500970 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:36.516611 22485 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:36.516963 21913 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:36.517962 21914 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 15.
I20260709 13:09:36.518921 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:36.521553 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 1655) took 1220 ms. Trace:
I20260709 13:09:36.522018 21765 rpcz_store.cc:276] 0709 13:09:35.253133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.331843 (+ 78710us) service_pool.cc:224] Handling call
0709 13:09:35.332168 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:35.477992 (+145824us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.473068 (+995076us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b540017d254. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:36.473403 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":333778688}
I20260709 13:09:36.525885 21910 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:36.528026 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:36.530536 21840 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:36.543354 26038 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:36.544227 26038 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:36.548291 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:36.548328 26330 raft_consensus.cc:3055] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:36.549703 26330 raft_consensus.cc:740] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:36.551285 26330 consensus_queue.cc:260] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:36.552627 26330 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:36.556890 26443 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:36.557721 26443 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:36.560658 26443 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:36.562399 21834 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:36.569540 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:36.569308 26376 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:09:36.571779 26320 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:36.574353 22485 raft_consensus.cc:1240] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
I20260709 13:09:36.588514 21840 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:36.595170 22482 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:36.561250 26443 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:36.575922 26038 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:36.621635 26227 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:36.622666 26304 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:36.623407 26304 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:36.625607 26038 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.627522 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:36.625763 22449 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:36.626946 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:36.625840 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:36.646580 21833 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 15.
I20260709 13:09:36.647178 26230 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.647918 26230 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:36.648697 21832 raft_consensus.cc:1240] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:36.649569 26274 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:36.650496 26274 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:36.653187 26138 consensus_meta.cc:287] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.658s	user 0.012s	sys 0.019s
I20260709 13:09:36.675418 21913 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:36.676426 21880 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:36.671072 26038 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:36.679663 26038 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:36.662266 21839 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:09:36.697687 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 80729.1us
I20260709 13:09:36.657989 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:36.645617 26304 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:36.658077 26338 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.155s
W20260709 13:09:36.753263 26415 log.cc:927] Time spent T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:09:36.759228 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:36.761500 26321 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:36.762490 26321 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:36.768046 26352 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:36.768580 26352 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:36.769002 26352 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:36.667084 26227 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:36.667171 26438 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:36.663435 26194 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:36.639568 26443 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:36.797694 26443 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:36.798455 26463 log.cc:927] Time spent T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.188s	user 0.003s	sys 0.000s
I20260709 13:09:36.653417 26274 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:36.773681 26038 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:36.781158 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:36.782639 21759 raft_consensus.cc:1240] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 13:09:36.782884 26185 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:36.785833 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:36.786614 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:36.791997 21731 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:09:36.807629 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 173096us
I20260709 13:09:36.791003 26432 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:36.791216 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:36.791983 26448 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.792796 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:36.793974 26230 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:36.807101 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:36.807627 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:36.808769 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:36.809051 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:36.810380 21840 raft_consensus.cc:1275] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:09:36.781226 26422 consensus_meta.cc:287] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.689s	user 0.011s	sys 0.007s
I20260709 13:09:36.814986 21910 raft_consensus.cc:1275] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:09:36.823414 21910 pending_rounds.cc:85] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 5
I20260709 13:09:36.776336 26227 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:36.823698 21910 pending_rounds.cc:107] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 13:09:36.831136 21910 raft_consensus.cc:2889] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:36.835134 21759 raft_consensus.cc:2393] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 15: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
W20260709 13:09:36.839603 26345 consensus_meta.cc:287] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.005s
I20260709 13:09:36.757601 26138 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:36.840096 26345 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:36.852252 21832 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:36.856096 21836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56424 (request call id 612) took 1319 ms. Trace:
I20260709 13:09:36.865669 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:36.848548 26316 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
W20260709 13:09:36.889248 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:36.889405 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:36.889832 26195 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.890643 26195 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:36.891492 21763 raft_consensus.cc:1240] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:09:36.894580 21756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 2998) took 1326 ms. Trace:
I20260709 13:09:36.895131 21756 rpcz_store.cc:276] 0709 13:09:35.491864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.494206 (+  2342us) service_pool.cc:224] Handling call
0709 13:09:35.494570 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:35.523663 (+ 29093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.523708 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:36.562185 (+1038477us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b2c00000f48. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6acc50a11 00007fc6acc60372 00007fc6ae392a01 00007fc6ae35743a 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2
0709 13:09:36.562822 (+   637us) log.cc:844] Serialized 26 byte log entry
0709 13:09:36.610140 (+ 47318us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:09:36.610181 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.610299 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.797681 (+187382us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:09:36.801343 (+  3662us) raft_consensus.cc:1685] finished
0709 13:09:36.801362 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.818311 (+ 16949us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35750,"raft.queue_time_us":35074,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":13082752,"thread_start_us":46844,"threads_started":1,"wal-append.queue_time_us":47267}
I20260709 13:09:36.901543 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:36.905548 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 84923.4us
I20260709 13:09:36.906783 26233 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:36.907403 26233 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:36.910001 26138 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:36.912892 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 142036us
I20260709 13:09:36.913978 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:36.914475 26404 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:36.914134 26230 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:36.915095 26404 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:36.915478 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 79839.7us
I20260709 13:09:36.913033 26274 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:36.889343 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:36.927575 21880 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:36.850827 26321 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:36.934034 21910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 1687) took 1879 ms. Trace:
I20260709 13:09:36.835405 26422 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:36.837232 26448 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:36.936812 21910 rpcz_store.cc:276] 0709 13:09:35.047579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.047785 (+   206us) service_pool.cc:224] Handling call
0709 13:09:35.048035 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:36.509703 (+1461668us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54002a7ea0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae2cedc0 00007fc6ae3591c0 00007fc6ae35a231 00007fc6ae356d8f 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c
0709 13:09:36.841418 (+331715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.926365 (+ 84947us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":385139584}
I20260709 13:09:36.967515 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:36.967855 26233 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:36.968309 21804 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:09:36.969079 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 53181.5us
I20260709 13:09:36.970247 21728 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:36.970317 26230 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:36.973361 26345 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:36.931154 26274 raft_consensus.cc:697] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:36.974747 26274 consensus_queue.cc:237] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:36.977443 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:36.837281 26438 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:36.925619 26195 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:36.859557 21836 rpcz_store.cc:276] 0709 13:09:35.500465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:35.501440 (+   975us) service_pool.cc:224] Handling call
0709 13:09:35.501787 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:35.524613 (+ 22826us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:35.524643 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:36.487191 (+962548us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b2c0000e678. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6acc50a11 00007fc6acc60372 00007fc6ae392a01 00007fc6ae35743a 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2
0709 13:09:36.487994 (+   803us) log.cc:844] Serialized 26 byte log entry
0709 13:09:36.596945 (+108951us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:36.601532 (+  4587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:36.616592 (+ 15060us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:36.801145 (+184553us) raft_consensus.cc:1685] finished
0709 13:09:36.801163 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:36.819984 (+ 18821us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48297,"raft.queue_time_us":100102,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":17014,"spinlock_wait_cycles":3234560,"thread_start_us":108496,"threads_started":1,"wal-append.queue_time_us":155392}
I20260709 13:09:36.973124 26230 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:36.849054 26432 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:36.992625 21756 raft_consensus.cc:1240] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:37.008154 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 149579us
I20260709 13:09:36.991169 26194 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:09:37.017421 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 49389us
I20260709 13:09:37.019090 26203 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:37.019984 26195 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:37.020514 26393 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:37.022274 26291 consensus_queue.cc:1059] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 13:09:37.023039 26407 consensus_meta.cc:287] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.774s	user 0.003s	sys 0.014s
I20260709 13:09:37.023334 26438 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:37.025357 26448 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:37.030807 26422 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:37.033145 26340 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:09:37.036731 26157 consensus_meta.cc:287] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 1.050s	user 0.010s	sys 0.011s
I20260709 13:09:37.047614 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:37.057942 22482 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:37.060990 21877 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:37.042529 26203 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.089887 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:37.078012 26334 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.164s
I20260709 13:09:37.091523 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:37.092140 22482 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:37.083218 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:37.076709 26203 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:37.076264 26185 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:37.085392 26195 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:37.102661 26330 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:37.103173 26330 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:37.103626 26330 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:37.106724 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 49848.3us
I20260709 13:09:37.103711 26195 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:37.105571 26417 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 13:09:37.105996 26466 log.cc:927] Time spent T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:09:37.110450 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:37.123780 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:37.127790 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:37.070042 26407 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:37.126139 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:37.134119 21835 raft_consensus.cc:2393] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 13: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:09:37.137418 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.078429 26157 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:37.085232 26233 consensus_queue.cc:1059] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:09:37.146876 21764 raft_consensus.cc:1240] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:37.150933 21831 raft_consensus.cc:2368] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12.
I20260709 13:09:37.094101 26194 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:37.159087 21914 raft_consensus.cc:1240] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:37.169255 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:37.177716 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 108544us
I20260709 13:09:37.178532 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:37.182435 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:37.194675 26447 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:37.195822 26374 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:37.195720 26447 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:37.196743 26374 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:37.182652 26252 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:37.194581 26194 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:37.211715 26447 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:37.212342 21905 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:09:37.176050 26404 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:37.223613 21879 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:37.228732 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:37.231158 26296 raft_consensus.cc:2804] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:37.247718 26296 raft_consensus.cc:697] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:37.248016 26233 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:37.248677 26233 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:37.248811 26296 consensus_queue.cc:237] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:37.250542 26195 raft_consensus.cc:3055] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:37.250872 26233 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:37.250962 26195 raft_consensus.cc:740] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:37.231837 26327 consensus_queue.cc:1059] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:37.252242 26195 consensus_queue.cc:260] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:37.236824 26432 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:37.237715 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:37.240947 26304 raft_consensus.cc:3055] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:37.268010 26304 raft_consensus.cc:740] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:37.269058 26304 consensus_queue.cc:260] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:37.243618 26352 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:37.271849 26352 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 16 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:37.273900 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 253695us
I20260709 13:09:37.277050 26314 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:37.286859 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:37.287531 21905 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:37.245919 26407 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:37.254602 21880 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:37.252784 26233 raft_consensus.cc:3055] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:37.289563 26233 raft_consensus.cc:740] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:37.263439 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:37.290504 26233 consensus_queue.cc:260] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:37.291121 26351 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:37.291348 21838 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
I20260709 13:09:37.291539 26351 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:37.279349 26230 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:37.291983 26351 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:37.292382 26230 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:37.260828 26423 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:37.294739 26230 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:37.280413 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 251776us
I20260709 13:09:37.298661 26091 raft_consensus.cc:1064] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:09:37.298920 26322 raft_consensus.cc:1064] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:09:37.281016 26421 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.301293 26421 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:37.303571 26421 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:37.291864 26233 raft_consensus.cc:3060] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:37.234807 21804 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:37.307687 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:37.308513 22476 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:37.313527 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:37.314029 26304 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:37.324644 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:37.327032 26195 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:35.764670 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:37.337716 26091 consensus_queue.cc:237] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:37.357483 26336 consensus_queue.cc:1059] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:37.358680 26336 raft_consensus.cc:3055] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:37.359122 26336 raft_consensus.cc:740] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:37.363811 21905 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 16.
I20260709 13:09:37.365789 22449 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:09:37.369772 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 135380us
I20260709 13:09:37.372653 26376 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:37.373243 26376 raft_consensus.cc:697] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 16 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:37.374500 26376 consensus_queue.cc:237] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:37.375409 26330 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:37.371701 26157 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:37.360208 26336 consensus_queue.cc:260] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:37.380869 26443 consensus_queue.cc:1048] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:37.390388 22476 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:37.425690 21879 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:37.378549 26203 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:37.436250 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:37.437330 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:37.436496 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:37.440836 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:37.380466 26351 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:37.455423 21879 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:37.424191 26421 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:09:37.467126 21831 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:09:37.475979 21910 raft_consensus.cc:1240] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:37.479943 21912 raft_consensus.cc:1240] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:37.486856 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:37.487594 21840 raft_consensus.cc:2368] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12.
I20260709 13:09:37.488624 21838 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:37.489032 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:09:37.491616 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 220317us
I20260709 13:09:37.460928 26374 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:37.496858 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:37.498548 22450 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:37.498806 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:37.472862 26421 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:37.500083 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 44750us
I20260709 13:09:37.497790 21839 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:37.501072 21879 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:37.504194 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:37.504125 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:37.485502 26336 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:37.496131 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:37.510097 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:37.513789 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:37.509483 21914 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:09:37.484627 26038 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:37.500131 26157 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:37.525543 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:37.506294 26421 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:09:37.525929 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.518654 26349 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:37.536057 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:37.520246 26338 raft_consensus.cc:2764] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:09:37.541375 21831 raft_consensus.cc:2410] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:09:37.541900 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:37.525141 26432 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.524524 26316 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:37.546731 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:37.539088 21805 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:37.548753 21806 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:37.543618 26274 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:37.549569 26274 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:37.551128 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:37.551791 26274 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:37.521729 26443 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:09:37.557475 26346 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:37.540845 26038 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:37.558255 26193 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:37.560088 26038 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:37.562326 26351 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:37.565642 26432 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:37.566080 26349 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:37.567824 26432 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:37.568154 26349 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:37.577653 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 128047us
W20260709 13:09:37.591327 26227 consensus_meta.cc:287] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.750s	user 0.012s	sys 0.000s
I20260709 13:09:37.600751 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:37.607424 21838 raft_consensus.cc:1275] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:09:37.611063 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:37.617849 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:37.617982 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:37.619455 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.587244 26349 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:37.623584 26349 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:37.628618 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:37.630652 22483 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:09:37.640793 21914 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:37.644876 26203 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:37.653865 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 58419.7us
I20260709 13:09:37.654623 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:37.594092 26443 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:09:37.668514 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 136646us
I20260709 13:09:37.674292 21914 raft_consensus.cc:2410] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:09:37.631949 26349 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:37.679816 26137 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:09:37.682607 26476 log.cc:927] Time spent T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.060s	user 0.003s	sys 0.000s
W20260709 13:09:37.686414 26322 raft_consensus.cc:1068] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb: Unable to promote non-voter 8c6c2207af3d47b3acf352d81959f4dd: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }.
  Pending config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:37.687660 21832 raft_consensus.cc:1240] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:37.579329 26157 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:37.653254 26447 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.601526 26227 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:37.709343 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:37.713282 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.688696 26443 raft_consensus.cc:697] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:37.712980 21833 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:09:37.725837 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:37.732568 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:37.733844 21831 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:37.735946 21877 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:37.736951 21728 leader_election.cc:400] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12.
W20260709 13:09:37.743654 26477 log.cc:927] Time spent T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:09:37.749670 26193 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.750167 26193 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:37.751186 26432 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.751739 26432 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:37.753834 26443 consensus_queue.cc:237] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:37.757164 26482 log.cc:927] Time spent T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.136s	user 0.001s	sys 0.001s
W20260709 13:09:37.760672 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 56955.7us
I20260709 13:09:37.761919 21805 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:37.763550 21805 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:37.765590 26407 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:37.766041 22476 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:37.766300 26407 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:37.767052 26407 consensus_queue.cc:1059] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:37.768146 26407 raft_consensus.cc:3055] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:37.768447 26407 raft_consensus.cc:740] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:37.773111 22448 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
W20260709 13:09:37.774113 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 57609.7us
I20260709 13:09:37.739416 26137 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:09:37.778694 26340 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:37.779132 26340 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:37.779557 26340 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:37.780232 21880 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:37.782218 26449 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:37.782711 26449 raft_consensus.cc:697] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:37.783672 26449 consensus_queue.cc:237] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:37.787034 26227 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:37.708037 26447 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:37.727303 26330 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:37.737931 21729 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:37.765254 21805 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:37.794167 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 58309us
I20260709 13:09:37.794682 21804 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:37.795456 21831 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 16.
I20260709 13:09:37.797922 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:37.810983 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:37.811937 21832 raft_consensus.cc:2393] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 10: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:37.812068 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38352 (request call id 3218) took 1025 ms. Trace:
I20260709 13:09:37.812455 21833 rpcz_store.cc:276] 0709 13:09:36.786548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:36.792436 (+  5888us) service_pool.cc:224] Handling call
0709 13:09:37.811911 (+1019475us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b540033a9d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:37.812013 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2053930368}
W20260709 13:09:37.813681 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 102307us
I20260709 13:09:37.814352 21831 raft_consensus.cc:1275] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:09:37.817896 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 52720.5us
W20260709 13:09:37.827872 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 104235us
I20260709 13:09:37.834183 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:37.839709 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:37.843083 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:37.837976 22482 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:37.843137 22483 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:37.856105 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:37.822201 26038 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:37.862293 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:37.863006 21910 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:37.866571 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:37.827425 26137 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:09:37.872697 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 131864us
I20260709 13:09:37.876856 22448 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:37.833580 26194 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:37.881037 21912 raft_consensus.cc:1240] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:37.883275 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:37.881446 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:37.883726 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:37.892405 21729 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:37.895124 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:37.837374 26091 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:37.900164 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:37.861838 26404 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:37.885715 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:37.897686 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:37.844913 26314 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:37.895880 21836 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 14.
I20260709 13:09:37.868904 26432 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:37.904452 21832 raft_consensus.cc:2393] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 15: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:37.769354 26407 consensus_queue.cc:260] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:37.905725 21804 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:37.913205 21831 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:37.916613 26256 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:37.917689 21906 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:37.890751 26194 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:37.921960 21839 raft_consensus.cc:1240] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:37.896353 26352 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:37.928452 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:37.929212 21911 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:37.933535 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:37.934345 21909 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:37.940110 26193 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:37.883569 26316 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:09:37.925015 26404 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:37.952144 26404 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:37.920781 26091 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:37.955261 26091 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:37.899855 26349 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:09:37.960793 21910 raft_consensus.cc:2410] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
W20260709 13:09:37.970027 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 64396.2us
I20260709 13:09:37.974673 22483 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
W20260709 13:09:37.982360 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 167756us
I20260709 13:09:37.925800 26194 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:37.981498 21880 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:37.981680 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:37.987246 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 104462us
I20260709 13:09:37.971859 26432 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:37.973202 26137 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:37.997916 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:37.940740 26340 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:38.006156 26230 consensus_queue.cc:1059] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:38.007023 26256 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:37.984591 26447 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:37.994697 26091 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:37.985473 26404 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:09:38.024711 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 118458us
I20260709 13:09:37.998943 26407 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:38.042286 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 51689.1us
I20260709 13:09:38.044199 21728 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:38.044672 21911 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:09:37.997527 26432 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:38.052090 21877 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:38.059598 21728 leader_election.cc:400] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12.
I20260709 13:09:38.061902 26329 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:38.062517 26329 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.064482 26274 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:38.041850 26091 raft_consensus.cc:697] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:38.064796 26329 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:38.071851 26091 consensus_queue.cc:237] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:38.076323 26421 consensus_meta.cc:287] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.000s
I20260709 13:09:38.076929 26421 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.078168 21834 raft_consensus.cc:2393] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 9: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:38.079139 26421 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:38.079967 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 46627.8us
I20260709 13:09:38.080860 21729 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:38.081712 26274 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:38.082183 26274 raft_consensus.cc:697] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:38.045953 26256 raft_consensus.cc:3055] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:38.061295 21728 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:38.055801 26349 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:09:38.119158 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 57918.2us
I20260709 13:09:38.119423 26349 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:38.119895 26349 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:38.120285 26349 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:38.123553 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.090731 21877 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:38.093791 26432 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:38.094185 26316 consensus_queue.cc:1048] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:38.095256 26157 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:38.099994 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:38.110001 26489 log.cc:927] Time spent T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.268s	user 0.000s	sys 0.003s
W20260709 13:09:38.115031 26484 log.cc:927] Time spent T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.493s	user 0.000s	sys 0.003s
I20260709 13:09:38.038167 26404 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:38.048957 26338 consensus_queue.cc:1059] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.067s
W20260709 13:09:38.137645 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 46997.9us
I20260709 13:09:38.085489 26256 raft_consensus.cc:740] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:38.174764 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:38.175442 21832 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
W20260709 13:09:38.116464 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.176517 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:38.177194 21831 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:09:38.091588 26291 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:38.115751 26332 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.181213 21804 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:38.183444 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:38.183662 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:38.184854 21833 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:38.131345 26304 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:38.186663 21836 raft_consensus.cc:2410] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:09:38.192225 21877 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:38.190615 21804 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:38.198050 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:38.198774 22476 raft_consensus.cc:2393] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 11: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:38.201490 22476 raft_consensus.cc:1240] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:38.197145 21877 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:38.200716 21804 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:38.207337 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:38.208362 21905 raft_consensus.cc:2393] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 9: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
W20260709 13:09:38.169137 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 43879.5us
I20260709 13:09:38.221415 26193 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:38.222033 26193 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:38.222425 26193 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:38.222541 26338 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.223309 26338 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:38.221649 26435 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:38.133145 26230 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:09:38.189716 26421 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:38.206701 26448 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:38.180377 26432 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:09:38.194806 26227 consensus_queue.cc:1059] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:09:38.234200 26233 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:38.125478 26499 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 13:09:38.230993 26340 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:38.186506 26332 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:38.199764 26314 consensus_queue.cc:1059] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:09:38.235476 26435 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:38.253715 26448 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:38.267365 26338 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:38.247478 26498 consensus_queue.cc:1059] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:09:38.175745 26274 consensus_queue.cc:237] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.281009 21833 raft_consensus.cc:1275] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:38.260547 26322 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:38.281451 22476 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:09:38.274665 26435 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:38.282503 26448 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:38.291087 22485 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:38.288995 26173 raft_consensus.cc:3055] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:09:38.305588 26493 log.cc:927] Time spent T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:09:38.288775 26252 raft_consensus.cc:3055] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:38.305684 26173 raft_consensus.cc:740] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:38.294510 26233 raft_consensus.cc:697] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:38.307780 26332 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:38.317406 26498 raft_consensus.cc:3055] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:09:38.333241 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 116571us
I20260709 13:09:38.314744 26252 raft_consensus.cc:740] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:38.338088 21728 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:38.276346 26256 consensus_queue.cc:260] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.339733 21728 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:38.306166 21662 catalog_manager.cc:5697] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 6 to 9, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 9 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.341282 26340 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
W20260709 13:09:38.350271 26497 log.cc:927] Time spent T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:09:38.353304 26491 log.cc:927] Time spent T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.284s	user 0.002s	sys 0.000s
W20260709 13:09:38.357064 21661 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45762 (request call id 244) took 20418 ms (client timeout 15000 ms). Trace:
W20260709 13:09:38.357553 21661 rpcz_store.cc:269] 0709 13:09:17.866076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:17.866503 (+   427us) service_pool.cc:224] Handling call
0709 13:09:38.274343 (+20407840us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:33.833028 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:33.833620 (+   592us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:33.833659 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:09:33.833678 (+    19us) tablet.cc:662] Decoding operations
0709 13:09:33.834897 (+  1219us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:33.834978 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:33.835005 (+    27us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:09:33.836074 (+  1069us) tablet.cc:701] Row locks acquired
0709 13:09:33.836090 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:09:33.836234 (+   144us) write_op.cc:270] Start()
0709 13:09:33.836348 (+   114us) write_op.cc:276] Timestamp: P: 1783602573836183 usec, L: 0
0709 13:09:33.836367 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:09:33.911676 (+ 75309us) log.cc:844] Serialized 5554 byte log entry
0709 13:09:34.412438 (+500762us) op_driver.cc:464] REPLICATION: finished
0709 13:09:34.485227 (+ 72789us) write_op.cc:301] APPLY: starting
0709 13:09:34.485333 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:34.524154 (+ 38821us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:34.524265 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:34.889519 (+365254us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:34.889826 (+   307us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:09:34.889892 (+    66us) write_op.cc:312] APPLY: finished
0709 13:09:34.890256 (+   364us) log.cc:844] Serialized 129 byte log entry
0709 13:09:34.891086 (+   830us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:34.891244 (+   158us) write_op.cc:454] Released schema lock
0709 13:09:34.891298 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:34.891802 (+   504us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:34.891833 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":99133,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":72525,"apply.run_cpu_time_us":20097,"apply.run_wall_time_us":406461,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62703,"num_ops":14,"prepare.queue_time_us":282833,"prepare.run_cpu_time_us":39664,"prepare.run_wall_time_us":290152,"raft.queue_time_us":87137,"raft.run_cpu_time_us":35462,"raft.run_wall_time_us":66692,"replication_time_us":575907,"thread_start_us":505217,"threads_started":4,"wal-append.queue_time_us":323025,"wal-append.run_cpu_time_us":44092,"wal-append.run_wall_time_us":1661895}]]}
I20260709 13:09:38.363430 26443 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:38.366945 26376 raft_consensus.cc:3055] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:38.367368 26376 raft_consensus.cc:740] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:38.368345 26376 consensus_queue.cc:260] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:38.369179 26291 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:38.369750 26291 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:09:38.381165 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 297660us
I20260709 13:09:38.333189 26499 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.382019 21729 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:38.382480 26499 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:38.383450 26194 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.384645 26499 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:38.389762 26173 consensus_queue.cc:260] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:38.332826 26422 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:38.391148 26422 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:38.332482 26038 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:09:38.398052 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 58403.3us
I20260709 13:09:38.406625 21880 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:09:38.412009 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.318081 26322 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:38.419773 21662 catalog_manager.cc:5697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 9 to 12, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 12 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.336912 26498 raft_consensus.cc:740] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:38.431789 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:38.437325 21909 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:38.432566 26252 consensus_queue.cc:260] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.433143 26193 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.397682 26194 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:38.434551 21839 raft_consensus.cc:1240] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:38.435314 26500 log.cc:927] Time spent T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:09:38.436255 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:38.425865 26038 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.438757 26091 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:38.438848 26506 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:38.439525 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:38.460129 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:38.430732 26376 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:38.440420 26185 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:38.427474 26404 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:38.516945 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.482254 26203 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.520268 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:38.522647 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.500639 26091 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:38.533972 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 152035us
I20260709 13:09:38.534458 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:38.535071 21729 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:38.535646 22476 raft_consensus.cc:2410] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:09:38.514448 26194 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:38.508450 26185 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:38.515239 26252 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:38.516328 26256 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:38.546193 22485 raft_consensus.cc:1240] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 13:09:38.537331 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 175453us
I20260709 13:09:38.536509 26091 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:38.531391 26507 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:38.552973 21662 catalog_manager.cc:5697] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:38.540606 26194 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:38.547552 26185 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:38.590217 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.532285 26203 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.557358 26351 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:38.625636 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:38.596881 26194 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:38.626917 26519 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:38.627502 26519 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:38.549216 26349 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.536049 26233 consensus_queue.cc:237] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.531060 26498 consensus_queue.cc:260] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:38.629455 26038 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:38.569001 26157 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:09:38.645597 26193 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:38.674093 26511 log.cc:927] Time spent T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:09:38.678490 26349 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:38.679260 21662 catalog_manager.cc:5697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 4 to 8, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 8 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.683132 26203 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:38.686724 26515 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:38.687256 26515 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:38.689927 26492 log.cc:927] Time spent T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.605s	user 0.000s	sys 0.008s
I20260709 13:09:38.693109 26518 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:38.608207 26507 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:38.714288 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 143980us
I20260709 13:09:38.714412 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:38.700240 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:38.715390 21729 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:38.680986 21662 catalog_manager.cc:5697] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.624305 26351 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.637250 26404 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:38.717415 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:38.719523 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 101867us
I20260709 13:09:38.729204 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:38.689260 26515 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:38.734568 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:38.735391 21839 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:38.665689 26498 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:38.755720 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:38.731122 21662 catalog_manager.cc:5697] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 9 to 12, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 12 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.718068 26508 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.786173 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:38.786914 21831 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:38.774678 26520 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:38.796152 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:38.765268 26316 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:38.754559 26404 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.824443 26530 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:38.825101 26530 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:38.827065 26530 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:38.827525 26530 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:38.827970 26530 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.829756 26517 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:38.829898 26523 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:38.830050 26525 consensus_queue.cc:1059] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:09:38.830410 26517 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.830775 26523 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:38.831075 26525 consensus_queue.cc:1059] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:38.831327 26523 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.832450 26517 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:38.832813 26507 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:38.833022 26517 raft_consensus.cc:3055] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:38.833590 26499 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:38.833877 26523 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:38.836628 26091 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:38.849385 26194 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.851495 26404 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:38.854612 26351 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:38.776364 26518 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.859650 26518 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:38.794080 26508 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.797185 26322 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:38.871345 26508 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:38.872888 26435 consensus_meta.cc:287] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.001s
I20260709 13:09:38.873306 26435 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.834075 26499 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:38.793542 26519 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:38.877981 26499 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:38.857163 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:38.878880 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:38.871518 26291 consensus_meta.cc:287] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.000s
I20260709 13:09:38.809638 26316 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.855640 21908 raft_consensus.cc:2393] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 10: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:09:38.877233 26521 log.cc:927] Time spent T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:09:38.886936 21839 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:09:38.911448 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:38.912163 21839 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:38.845155 26506 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:38.908164 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:38.915987 21835 raft_consensus.cc:1240] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:38.909560 22483 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:38.931229 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:38.932018 21877 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:38.939136 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:38.939942 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:38.833395 26517 raft_consensus.cc:740] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:38.943289 21877 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:38.908411 26291 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:38.950461 21877 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:38.951360 21877 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:38.960100 21662 catalog_manager.cc:5697] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 8 to 11, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 11 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
W20260709 13:09:38.975534 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 210753us
W20260709 13:09:38.978329 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 263019us
I20260709 13:09:38.978714 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:38.979319 21729 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:38.946686 26329 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:38.950465 26157 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:38.984843 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:38.957774 26091 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:38.992465 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:38.975751 26435 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:38.990180 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:38.994915 22476 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:38.994844 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:38.972564 26193 raft_consensus.cc:2804] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:38.993547 21729 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:38.977121 26322 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:39.004071 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:39.006187 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:39.007025 21836 raft_consensus.cc:2410] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:09:38.981405 26230 consensus_queue.cc:1059] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:09:38.986783 26157 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.012558 21729 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:39.015786 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:38.993198 26530 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:39.017920 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 62774.6us
I20260709 13:09:39.006028 26322 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.015129 26157 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:38.994308 22483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71a084e9c0014661925a846711e7a18f"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:44346
I20260709 13:09:39.026288 22483 raft_consensus.cc:606] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 16 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:39.016274 26404 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:39.028443 26404 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:39.030738 26404 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:39.034243 26194 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:39.012332 26193 raft_consensus.cc:697] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 15 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:39.035427 26193 consensus_queue.cc:237] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:39.035444 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:39.037650 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:39.038105 26230 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:39.038400 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:39.016808 26517 consensus_queue.cc:260] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:39.039573 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:39.039840 26517 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:39.023057 26435 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:39.040764 26435 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:39.041618 26522 raft_consensus.cc:3055] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:39.042002 26522 raft_consensus.cc:740] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:39.021140 26322 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:39.014933 26448 consensus_meta.cc:287] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.694s	user 0.008s	sys 0.003s
I20260709 13:09:39.008596 26535 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:39.017729 26340 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:09:39.025029 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:39.045796 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.050299 21662 catalog_manager.cc:5697] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 3 to 10, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 10 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:39.058390 21662 catalog_manager.cc:5697] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 6 to 8, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 8 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.009609 26329 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
W20260709 13:09:39.072731 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 60289us
W20260709 13:09:39.084534 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 163936us
I20260709 13:09:39.042920 26435 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:39.087489 26349 consensus_queue.cc:1059] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
W20260709 13:09:39.082667 26376 consensus_meta.cc:287] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.000s
I20260709 13:09:39.095728 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.103752 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.096115 21804 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:39.099854 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.094269 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:39.106561 21804 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:39.119515 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 137013us
I20260709 13:09:39.104430 21757 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:09:39.102926 21759 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
I20260709 13:09:39.131273 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.081883 26499 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:39.062376 26448 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:39.146142 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.146916 21757 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
W20260709 13:09:39.151396 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 44925.9us
I20260709 13:09:39.134502 26233 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:39.152657 21762 raft_consensus.cc:1240] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:39.154652 26349 raft_consensus.cc:3055] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:39.155131 26349 raft_consensus.cc:740] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:39.156059 26349 consensus_queue.cc:260] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:39.042797 26522 consensus_queue.cc:260] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:39.161613 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.173898 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.174278 22476 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
W20260709 13:09:39.151473 26185 consensus_meta.cc:287] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.002s
I20260709 13:09:39.182226 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:39.182596 26185 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:39.184769 26185 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:39.185385 26529 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:39.190582 21757 raft_consensus.cc:1275] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:09:39.198613 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:39.199244 21913 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:39.205804 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:39.158275 26522 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:39.209800 21759 raft_consensus.cc:1275] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:39.210443 21906 raft_consensus.cc:2393] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 13: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:39.213968 21757 raft_consensus.cc:1240] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:39.157419 26349 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:39.158965 26137 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:39.197551 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.158715 26316 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:39.216756 21762 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
W20260709 13:09:39.225991 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 82531.7us
I20260709 13:09:39.249604 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:39.256155 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.260963 26173 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:39.263162 26508 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.263741 26508 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:39.277158 21913 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:39.279191 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.279989 21764 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:39.279341 26508 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:39.323220 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:39.323419 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.324165 21764 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:39.331852 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.332442 21764 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:09:39.338577 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:39.350663 26422 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:39.356630 21763 raft_consensus.cc:1275] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:09:39.374688 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.362172 26157 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:39.436024 26553 log.cc:927] Time spent T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:09:39.439878 21763 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:39.434652 26510 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:39.440701 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.438078 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:39.451725 26546 log.cc:927] Time spent T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
W20260709 13:09:39.454932 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.402892 26448 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:39.447597 21761 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:39.185947 26529 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:39.460126 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.462741 21880 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:09:39.442906 26528 log.cc:927] Time spent T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:09:39.473878 26447 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:39.474563 26447 raft_consensus.cc:697] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:39.474632 21759 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:39.475682 26447 consensus_queue.cc:237] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:39.465004 21765 raft_consensus.cc:2410] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:09:39.466424 26533 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.455037 26322 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:39.468863 26157 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:39.483346 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:39.501541 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:39.521886 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.523123 21759 raft_consensus.cc:2393] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 14: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:39.525586 21832 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:09:39.458946 26510 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:39.479585 26533 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:39.548202 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:39.558427 26557 log.cc:927] Time spent T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:09:39.559691 26556 log.cc:927] Time spent T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:09:39.527158 26376 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:39.561511 26376 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:39.564090 26376 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:39.562894 21804 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:39.569646 26512 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:39.570406 26512 raft_consensus.cc:697] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:39.571641 26512 consensus_queue.cc:237] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:39.575024 26157 raft_consensus.cc:2955] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index 7 to 9, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:39.581851 26291 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:39.586715 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:39.588063 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:39.588666 21831 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:09:39.589550 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:39.589618 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:39.591663 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.594276 21762 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:39.596364 22448 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:39.597062 21907 raft_consensus.cc:1275] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:39.598179 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:39.601047 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:39.607340 21839 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:09:39.608378 21834 raft_consensus.cc:2368] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 14. Current term is 15.
I20260709 13:09:39.616515 26422 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:39.618491 26322 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:39.602980 26352 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:39.619016 26352 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:39.619419 26352 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:39.602491 26532 log.cc:927] Time spent T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:09:39.620937 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.622526 21759 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:39.629994 21833 raft_consensus.cc:2955] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 7 to 9, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:39.633319 21728 leader_election.cc:400] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 14. Current term is 15.
W20260709 13:09:39.633498 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.633695 21728 leader_election.cc:403] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:09:39.649206 26517 raft_consensus.cc:3060] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:39.654521 26529 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:39.695344 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:39.696089 21911 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:39.674336 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:39.697539 21913 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
I20260709 13:09:39.705112 21804 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:39.654964 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:39.654304 26510 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:39.707459 21804 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:39.722824 21759 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:09:39.716759 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.712647 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:39.732153 21908 raft_consensus.cc:2393] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 13: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:39.725207 21731 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:39.736212 21731 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:39.718971 21834 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:39.743376 21731 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:39.706700 26529 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.726504 26515 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:39.730319 26421 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:09:39.751935 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 109172us
I20260709 13:09:39.739975 26522 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:39.760448 22483 raft_consensus.cc:1275] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:09:39.765663 26569 log.cc:927] Time spent T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:09:39.765806 26340 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:39.766331 26340 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:39.756013 26421 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:39.770602 26421 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:39.748610 26274 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:39.776932 22476 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:39.774487 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.753393 26194 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:39.752960 26515 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:39.787889 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:09:39.821462 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.836800 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:39.830961 26256 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:09:39.847612 26533 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:39.752348 26529 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:39.854408 26529 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:39.856650 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.801402 26515 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:39.863123 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:39.869372 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:39.806320 26091 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:09:39.889263 21762 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:09:39.889714 21762 pending_rounds.cc:85] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 9
I20260709 13:09:39.889931 21762 pending_rounds.cc:107] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:09:39.890139 21762 raft_consensus.cc:2889] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:39.894282 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:39.894959 21914 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:39.878808 22484 raft_consensus.cc:2955] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 7 to 9, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:39.906668 21911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a860581d33304a09b6bd77ea24698076"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:09:39.907572 21911 raft_consensus.cc:606] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:39.908027 21911 raft_consensus.cc:614] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:39.908095 21834 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
W20260709 13:09:39.914963 26570 log.cc:927] Time spent T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:09:39.918113 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.924641 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:39.925323 21765 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:39.930599 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.933251 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.935083 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.935667 21760 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:39.936206 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:39.936525 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:39.937291 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:39.937685 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:39.938014 21758 raft_consensus.cc:2393] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 14: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:39.938840 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:39.941713 21758 raft_consensus.cc:2376] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13. Re-sending same reply.
I20260709 13:09:39.942521 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.944317 21758 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:39.939845 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.940490 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.949959 21763 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:39.939522 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:39.941215 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.951035 21756 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
W20260709 13:09:39.939118 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:39.947721 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:39.948413 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:39.951668 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.948505 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:39.952356 21762 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:39.939482 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:39.953403 21760 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:39.962808 21764 raft_consensus.cc:2393] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 15: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:39.963500 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:39.964367 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:39.970463 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:39.972455 26352 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:39.979605 26517 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 14. Current term is 15.
I20260709 13:09:39.993418 21906 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:40.023933 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:40.030423 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:09:40.036175 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 74523.8us
W20260709 13:09:40.046887 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:40.060583 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.061911 26421 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:40.065738 21759 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:40.067173 21879 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.053814 26230 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.086016 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:40.078656 21879 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.089619 21761 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:09:40.090828 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:40.073414 26203 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:09:40.091604 21761 raft_consensus.cc:2393] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 13: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:40.092394 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:40.092926 21761 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:40.094092 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:40.094686 21758 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:40.098505 26581 log.cc:927] Time spent T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:09:40.099637 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:40.100464 21764 raft_consensus.cc:2410] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:09:40.104696 21758 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:09:40.105387 22450 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:40.105753 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:40.107406 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:40.107270 22450 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.108060 21758 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
I20260709 13:09:40.108929 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:40.109731 21758 raft_consensus.cc:2410] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:09:40.110522 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:40.111301 21758 raft_consensus.cc:2410] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:09:40.112062 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:40.111943 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 46131.5us
I20260709 13:09:40.113291 21758 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 12: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:40.118237 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:40.119092 21760 raft_consensus.cc:2410] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 13:09:40.122100 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:40.064034 26449 consensus_queue.cc:1059] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:09:40.064762 26304 consensus_queue.cc:1048] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 13:09:40.123278 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 44656.4us
I20260709 13:09:40.128005 26329 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:40.068531 26447 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:09:40.101241 26535 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.087920 26193 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:40.126147 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:40.068081 26157 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:09:40.071303 26522 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:40.128170 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:40.112692 26252 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:40.125948 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:40.136582 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:40.114570 26256 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:40.141642 21906 raft_consensus.cc:2393] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 13: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:40.123929 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:40.143265 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:40.143898 21764 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:40.144771 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:40.146049 26421 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:40.147164 26256 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:40.153390 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:40.153613 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:40.154481 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:40.154682 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:40.155460 21912 raft_consensus.cc:2410] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:09:40.155488 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:40.156281 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:40.156751 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:40.158876 21905 raft_consensus.cc:1240] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:40.158964 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:40.159768 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:40.160948 21905 raft_consensus.cc:1240] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: []
W20260709 13:09:40.161545 26578 log.cc:927] Time spent T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:09:40.161765 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:40.182403 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:40.149205 26256 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:40.157259 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:40.190255 21757 raft_consensus.cc:2468] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:09:40.099951 26230 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:40.126407 26352 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:40.196478 22477 raft_consensus.cc:1240] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:40.200150 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:40.196969 26376 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:40.137658 26535 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:40.197988 26592 raft_consensus.cc:2764] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:09:40.234642 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:40.258244 21758 raft_consensus.cc:2410] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:09:40.190871 26252 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:40.261866 21761 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
I20260709 13:09:40.263003 21764 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:40.264139 21764 raft_consensus.cc:1240] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:09:40.265278 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:40.266088 21758 raft_consensus.cc:2410] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:09:40.266718 21764 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:09:40.267037 21764 pending_rounds.cc:85] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 9
W20260709 13:09:40.253140 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 142027us
I20260709 13:09:40.267194 21758 raft_consensus.cc:1275] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:40.267246 21764 pending_rounds.cc:107] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:09:40.269353 21764 raft_consensus.cc:2889] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:40.270026 21760 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:40.250272 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:40.202641 26515 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:40.196682 26522 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:40.296943 21764 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:40.300347 22484 raft_consensus.cc:1275] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:09:40.308727 21833 raft_consensus.cc:1240] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:40.290777 26334 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.297768 21765 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
W20260709 13:09:40.366581 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 152655us
I20260709 13:09:40.350423 26340 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:40.380666 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.341060 26334 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:40.359735 26349 consensus_queue.cc:1059] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
W20260709 13:09:40.412390 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 201720us
I20260709 13:09:40.425819 21761 raft_consensus.cc:1240] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 13. Current term is 15. Ops: []
I20260709 13:09:40.426954 21756 raft_consensus.cc:1275] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:40.433315 26533 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:09:40.447388 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 315736us
I20260709 13:09:40.448952 21879 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.450140 26203 raft_consensus.cc:3055] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:40.450645 26203 raft_consensus.cc:740] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:40.451385 26203 consensus_queue.cc:260] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:40.452541 26203 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:40.454736 21805 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 3.201s (SENT) [suppressed 21 similar messages]
I20260709 13:09:40.465301 21879 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:40.477078 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.496652 21804 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:40.454069 26515 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:40.460068 26544 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:40.463213 26535 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:40.510335 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 421568us
I20260709 13:09:40.515189 21729 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.500612 26510 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:40.509260 26529 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:40.509143 26602 consensus_queue.cc:1059] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:09:40.501475 26449 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:40.505982 26274 raft_consensus.cc:3055] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:40.531072 21729 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:09:40.533452 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 68286us
I20260709 13:09:40.500203 26157 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:09:40.539553 22483 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:44346
I20260709 13:09:40.554759 21879 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.556303 22483 raft_consensus.cc:606] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEADER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:40.533973 26535 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:40.558719 21879 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.559298 21729 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:40.557467 26544 raft_consensus.cc:2764] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:09:40.561503 26421 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:40.552429 26600 raft_consensus.cc:3055] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:40.535868 26529 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.567147 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:40.561264 26559 raft_consensus.cc:993] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:09:40.567579 21879 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.569344 21729 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:40.554057 26274 raft_consensus.cc:740] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:40.578631 26274 consensus_queue.cc:260] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:40.579847 26274 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:40.571236 26608 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:40.564714 26602 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:40.575168 26334 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:40.576421 26544 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:40.571468 26610 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:40.583262 26544 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.573235 26421 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:40.583554 26610 raft_consensus.cc:697] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:40.583702 26544 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:40.584488 26610 consensus_queue.cc:237] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:40.576686 26559 raft_consensus.cc:1081] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 16 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:09:40.567827 26522 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:40.572175 26600 raft_consensus.cc:740] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:40.537457 26510 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:40.575574 26529 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:40.585395 26421 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:40.586593 26600 consensus_queue.cc:260] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:40.603396 26600 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:40.605737 26252 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:40.587728 26510 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:40.598914 26334 raft_consensus.cc:993] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: : Instructing follower 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:09:40.607300 26334 raft_consensus.cc:1081] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEADER]: Signalling peer 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:09:40.608182 26230 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:40.613247 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 43984.6us
I20260709 13:09:40.614352 21729 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.615271 21833 raft_consensus.cc:1275] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:40.613251 26522 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:40.617661 21729 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.618523 26230 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:40.619240 26230 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:09:40.620685 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 53177.1us
I20260709 13:09:40.621378 21879 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.621814 21729 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.622434 21879 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.623829 21879 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.624843 21879 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.626956 21729 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.630398 21729 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:40.632146 21879 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.633277 21835 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:09:40.636652 21729 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:40.644033 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.646486 21729 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.625739 26533 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:40.635380 21912 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:45202
I20260709 13:09:40.650355 21912 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:40.650856 21912 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:40.625977 26157 raft_consensus.cc:2764] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:09:40.648797 21729 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.625634 26091 raft_consensus.cc:2764] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:09:40.628435 26522 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:40.643466 26304 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:40.644440 26447 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:40.686820 26447 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:40.687238 26447 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:40.707001 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:40.714425 22448 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:40.715662 26591 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:40.716189 26591 raft_consensus.cc:697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:40.657927 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:40.658174 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:40.658602 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:40.638267 26602 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:40.644829 26608 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:40.662510 26598 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:40.721143 26598 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:40.723320 26157 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:40.723654 26598 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:40.663110 26594 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:40.653021 26533 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:40.723963 26157 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:40.724706 26533 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:40.726385 26157 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:40.731168 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:40.601073 26529 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:40.734113 26529 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:40.724900 26591 consensus_queue.cc:237] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:40.736796 26533 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:40.670766 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.648382 26193 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.739827 26193 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:40.648128 26349 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:40.647967 26256 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:40.742156 26193 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:40.748086 26533 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:40.753890 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:40.762960 21912 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:40.664712 26544 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:40.777755 21728 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:40.778813 21877 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:40.779994 21728 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:40.780337 21877 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.783504 21912 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:40.784549 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:40.785148 22483 raft_consensus.cc:3055] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:40.785461 22483 raft_consensus.cc:740] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:40.789409 21833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71a084e9c0014661925a846711e7a18f"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:56424
I20260709 13:09:40.789996 21833 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:40.790378 21833 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:40.798149 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:40.799453 21834 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 15.
I20260709 13:09:40.786206 22483 consensus_queue.cc:260] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:40.782539 26349 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:40.808820 21663 catalog_manager.cc:5697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 9 to 12, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 12 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:40.783396 26594 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:40.786971 26193 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:09:40.815095 26536 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.017s	sys 0.028s
I20260709 13:09:40.830284 22448 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:40.831269 21877 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:40.834703 21663 catalog_manager.cc:5697] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 6 to 8, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 8 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:40.798132 26447 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:40.844970 21662 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45778 (request call id 285) took 20239 ms (client timeout 15000 ms). Trace:
I20260709 13:09:40.853394 21833 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:40.853729 21663 catalog_manager.cc:5697] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:09:40.857988 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 209255us
W20260709 13:09:40.868920 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:40.876523 21729 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.835613 26091 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:40.879509 26193 raft_consensus.cc:697] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:40.874956 26604 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:40.880520 26604 raft_consensus.cc:697] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 15 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:40.880683 26449 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:40.879571 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:40.881297 26449 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:40.881860 22484 raft_consensus.cc:3055] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:40.879070 21833 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:40.882200 22484 raft_consensus.cc:740] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:40.858814 21877 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:40.883710 26449 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:40.884397 26449 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:40.880700 26193 consensus_queue.cc:237] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:40.881366 26604 consensus_queue.cc:237] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:40.883039 22484 consensus_queue.cc:260] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:40.887918 22484 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:40.847654 26536 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.018s	sys 0.028s
I20260709 13:09:40.857316 21663 catalog_manager.cc:5697] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 8 to 9, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 9 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.855399 26593 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:40.890913 21877 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
W20260709 13:09:40.852211 21662 rpcz_store.cc:269] 0709 13:09:20.605883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:20.606055 (+   172us) service_pool.cc:224] Handling call
0709 13:09:40.844881 (+20238826us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:39.434718 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:39.474210 (+ 39492us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:39.474268 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:09:39.474282 (+    14us) tablet.cc:662] Decoding operations
0709 13:09:39.475425 (+  1143us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:39.475501 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:39.475538 (+    37us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:09:39.476417 (+   879us) tablet.cc:701] Row locks acquired
0709 13:09:39.476469 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:09:39.476721 (+   252us) write_op.cc:270] Start()
0709 13:09:39.476879 (+   158us) write_op.cc:276] Timestamp: P: 1783602579476590 usec, L: 0
0709 13:09:39.476904 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:09:39.512783 (+ 35879us) log.cc:844] Serialized 3587 byte log entry
0709 13:09:40.034591 (+521808us) op_driver.cc:464] REPLICATION: finished
0709 13:09:40.338940 (+304349us) write_op.cc:301] APPLY: starting
0709 13:09:40.351613 (+ 12673us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:40.526457 (+174844us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:40.527170 (+   713us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:40.563301 (+ 36131us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:40.563660 (+   359us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:09:40.563712 (+    52us) write_op.cc:312] APPLY: finished
0709 13:09:40.577161 (+ 13449us) log.cc:844] Serialized 89 byte log entry
0709 13:09:40.577372 (+   211us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:40.577534 (+   162us) write_op.cc:454] Released schema lock
0709 13:09:40.577604 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:40.578059 (+   455us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:40.578094 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":280287,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":261416,"apply.run_cpu_time_us":15371,"apply.run_wall_time_us":269952,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41783,"num_ops":9,"prepare.queue_time_us":112772,"prepare.run_cpu_time_us":7086,"prepare.run_wall_time_us":206949,"raft.queue_time_us":152495,"raft.run_cpu_time_us":43432,"raft.run_wall_time_us":72122,"replication_time_us":557525,"thread_start_us":202306,"threads_started":4,"wal-append.queue_time_us":213454}]]}
I20260709 13:09:40.892190 21663 catalog_manager.cc:5697] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.894996 26544 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:40.895129 21663 catalog_manager.cc:5697] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 12 to 15, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 15 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.898066 21663 catalog_manager.cc:5697] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 9 to 11, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 11 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.898919 21729 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.902269 21729 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.904106 21914 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:40.910022 26256 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:40.910291 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:40.902443 26349 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:40.901345 26544 consensus_queue.cc:1048] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:09:40.890704 26594 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:40.942833 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:40.913838 26447 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:40.902060 26449 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:40.903420 21663 catalog_manager.cc:5697] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.892365 26593 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:40.952860 21663 catalog_manager.cc:5697] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 6 to 8, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 8 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.924518 21906 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:40.925663 22484 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 17.
I20260709 13:09:40.927426 21912 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:40.930011 21729 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.949286 22483 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:40.952953 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:40.955327 21806 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:40.955792 21729 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:40.940652 26616 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:40.959486 21663 catalog_manager.cc:5697] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:40.964161 21663 catalog_manager.cc:5697] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.965266 21663 catalog_manager.cc:5697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 9 to 10, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 10 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.966639 21663 catalog_manager.cc:5697] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:40.969686 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:40.967703 21663 catalog_manager.cc:5697] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:09:40.942056 26256 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:40.973551 26256 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:40.975989 22483 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 16.
I20260709 13:09:40.956756 26593 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:40.958205 26137 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:40.957993 26602 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:40.956893 26600 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:40.985772 22450 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:40.989665 21880 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:41.016705 22450 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:40.991509 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:40.992085 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:40.958221 26608 consensus_queue.cc:1059] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:09:40.992806 26536 consensus_queue.cc:1048] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:40.996199 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:09:41.023147 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:41.023706 21905 raft_consensus.cc:2393] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 13: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:40.996961 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:40.997764 26137 raft_consensus.cc:697] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:41.027238 26137 consensus_queue.cc:237] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:41.001677 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:41.007210 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:41.030723 21838 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:41.007424 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:41.008431 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:41.032265 21832 raft_consensus.cc:2393] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 13: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:41.009572 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:40.961529 26449 raft_consensus.cc:697] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:41.012142 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:41.012809 21805 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:40.987514 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:41.036463 21833 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 14.
I20260709 13:09:41.024605 21913 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:40.962366 26510 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:09:41.029510 26447 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:41.048669 26447 raft_consensus.cc:697] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 16 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:41.049517 26421 consensus_queue.cc:1059] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:41.049651 26447 consensus_queue.cc:237] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:41.050730 26422 raft_consensus.cc:3055] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:41.051086 26422 raft_consensus.cc:740] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:41.051322 26616 raft_consensus.cc:3055] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:41.051729 26616 raft_consensus.cc:740] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:41.051893 26422 consensus_queue.cc:260] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:41.038196 21840 raft_consensus.cc:2410] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:09:41.041815 21908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:09:41.053573 21908 raft_consensus.cc:606] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:41.053918 21908 raft_consensus.cc:614] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:41.055095 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:41.021148 26606 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:41.020596 26203 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:09:41.045949 26449 consensus_queue.cc:237] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:41.021744 26340 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:41.064780 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:41.058053 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 45324.8us
I20260709 13:09:40.978724 21663 catalog_manager.cc:5697] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:41.025054 26529 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:41.057324 21877 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:41.066737 21805 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:41.059625 26422 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:41.070531 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:41.071053 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:41.092095 21913 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 17.
I20260709 13:09:41.060225 26510 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:41.073655 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:41.052500 26616 consensus_queue.cc:260] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:41.102042 26604 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:41.081796 26608 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:41.063064 26515 consensus_queue.cc:1059] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:09:41.118122 21914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:09:41.119374 21914 raft_consensus.cc:606] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:41.065148 26252 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:09:41.119745 21914 raft_consensus.cc:614] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:09:41.126071 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 66358.9us
I20260709 13:09:41.103250 26602 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:41.095503 26529 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:41.114074 26600 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:41.118865 26256 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:41.156447 21758 raft_consensus.cc:1275] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:09:41.162204 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 93380.2us
I20260709 13:09:41.135823 26616 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:09:41.180827 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 114173us
I20260709 13:09:41.184154 21805 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:41.189925 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:41.191066 21759 raft_consensus.cc:2393] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 14: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:41.193092 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:41.195209 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:09:41.199703 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 72777.6us
I20260709 13:09:41.193009 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:41.203678 21757 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:41.212761 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:41.213580 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:41.214172 21765 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:41.154685 26349 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:41.123138 26608 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:41.226929 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:41.229537 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:41.230301 21756 raft_consensus.cc:2393] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 13: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:41.169283 26515 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:09:41.238014 21757 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:09:41.238095 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:41.240625 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:41.241086 21762 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:41.231346 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:41.148245 26602 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:41.257061 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:41.263096 21729 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:41.268389 21765 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:41.244230 21764 raft_consensus.cc:2955] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 7 to 9, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:41.270529 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:41.229179 26137 raft_consensus.cc:3055] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:41.271610 21762 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:41.284075 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:41.284757 21762 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 15.
I20260709 13:09:41.161317 26256 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:41.270674 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:41.275107 21765 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 12: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:41.283560 21879 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:41.296655 21879 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:41.177676 26600 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:41.303958 21879 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:41.308403 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:41.314775 21728 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:41.275419 26594 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:41.302892 26091 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:41.286142 26624 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:41.304740 26611 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:41.283353 26137 raft_consensus.cc:740] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:41.403342 26137 consensus_queue.cc:260] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:41.404376 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:41.269865 26203 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:09:41.405153 26421 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:41.405743 26421 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:41.239301 26349 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:41.281713 26252 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:41.405853 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:09:41.357897 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 173807us
I20260709 13:09:41.424448 21762 raft_consensus.cc:2376] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15. Re-sending same reply.
I20260709 13:09:41.311304 26515 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:41.404670 26137 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:41.466006 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:41.317970 26535 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:41.486644 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:41.347167 26194 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:41.479692 21757 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:09:41.360913 26622 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:41.400943 26447 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:41.487547 21762 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:09:41.477931 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 53038.9us
I20260709 13:09:41.489979 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:41.509078 21757 raft_consensus.cc:2376] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13. Re-sending same reply.
I20260709 13:09:41.509848 21838 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 16.
I20260709 13:09:41.489046 26194 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:41.497643 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:41.519300 21765 raft_consensus.cc:2393] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 13: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:09:41.530036 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 226175us
I20260709 13:09:41.531308 21879 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:41.490141 26598 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:41.537604 21879 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:41.539554 21805 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:41.483952 26515 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:41.521688 26194 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:41.418619 26624 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:41.487929 26535 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:41.522158 26447 raft_consensus.cc:697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:41.483140 26252 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:41.561715 26598 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:41.571910 26529 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:41.652809 26421 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:41.699931 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 126158us
W20260709 13:09:41.773837 21803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.006s	sys 0.014s
W20260709 13:09:41.835157 21803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.006s	sys 0.014s
W20260709 13:09:41.774802 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 427209us
I20260709 13:09:41.530812 26233 consensus_queue.cc:1059] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:09:41.653340 26630 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.126s
I20260709 13:09:41.536307 26632 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.138s
W20260709 13:09:41.781806 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 242325us
I20260709 13:09:41.852200 21805 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:41.783563 21762 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 16.
I20260709 13:09:41.794219 26647 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:41.797539 26510 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:41.798622 26616 consensus_meta.cc:287] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.000s
W20260709 13:09:41.801285 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 223964us
W20260709 13:09:41.848238 26634 log.cc:927] Time spent T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.213s	user 0.006s	sys 0.000s
I20260709 13:09:41.869921 21759 raft_consensus.cc:2368] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10.
I20260709 13:09:41.870453 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:41.870846 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:41.834903 26304 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:09:41.867373 21756 consensus_meta.cc:287] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.528s	user 0.008s	sys 0.000s
I20260709 13:09:41.876892 21756 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
W20260709 13:09:41.866605 26628 log.cc:927] Time spent T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.327s	user 0.000s	sys 0.006s
I20260709 13:09:41.879647 21805 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:41.887617 21762 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:41.896991 21762 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:41.900532 26256 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:41.902438 26252 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:41.903106 26422 consensus_meta.cc:287] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.807s	user 0.010s	sys 0.007s
I20260709 13:09:41.889955 26304 raft_consensus.cc:697] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:41.903967 26422 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:41.904233 26304 consensus_queue.cc:237] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:41.908599 21756 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:41.909626 26447 consensus_queue.cc:237] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:41.912173 26091 consensus_meta.cc:287] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.001s
I20260709 13:09:41.912637 26091 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:41.917631 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:41.930841 22450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.012s	sys 0.024s
I20260709 13:09:41.931728 22483 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:09:41.931932 22450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.012s	sys 0.024s
I20260709 13:09:41.882158 26600 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:41.950065 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 70482.9us
I20260709 13:09:41.951378 21805 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:41.952755 21805 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:41.951462 22450 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:41.954540 21805 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:41.957242 21840 raft_consensus.cc:1240] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 15. Current term is 16. Ops: []
W20260709 13:09:41.958351 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 58921.5us
I20260709 13:09:41.915330 26650 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:41.959939 26334 raft_consensus.cc:2804] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:41.965101 26624 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:41.965274 26334 raft_consensus.cc:697] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:41.966374 26334 consensus_queue.cc:237] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:41.899435 26194 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:41.960639 26630 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:41.975015 26632 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:41.982343 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 122030us
I20260709 13:09:41.958305 26622 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
W20260709 13:09:42.008893 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 48985us
W20260709 13:09:42.006466 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 52003us
I20260709 13:09:42.012163 21805 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:42.015036 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:42.014966 21729 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:42.021607 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:42.025614 26650 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:41.982510 26645 consensus_queue.cc:1059] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:09:42.028427 26645 raft_consensus.cc:3055] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:42.028838 26645 raft_consensus.cc:740] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:42.028997 26510 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:42.029806 26645 consensus_queue.cc:260] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.031050 26645 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:42.031685 26422 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:42.036747 26598 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:42.046119 26593 consensus_meta.cc:287] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 1.037s	user 0.016s	sys 0.000s
I20260709 13:09:42.046700 26593 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:42.049530 26194 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:42.054193 26515 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:42.018219 26657 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:42.056535 26657 raft_consensus.cc:697] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:42.057714 26657 consensus_queue.cc:237] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:42.062916 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 50867.6us
I20260709 13:09:42.066057 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:42.066632 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:42.066025 21805 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:42.070091 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:42.073166 21804 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:42.049404 26593 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 16 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:42.065069 26647 raft_consensus.cc:697] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:09:42.119315 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 50336.7us
I20260709 13:09:42.120401 26632 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:42.131394 26647 consensus_queue.cc:237] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.118350 26665 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:09:42.205947 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.206696 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.208633 26663 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:42.209365 26663 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:42.214768 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:42.217288 26663 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:42.237797 26536 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.238615 26536 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.242084 26536 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:42.273207 26622 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:42.274277 26622 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:42.283253 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:42.286815 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:42.125236 26645 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:42.293609 26645 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.296571 26645 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:42.293555 21805 leader_election.cc:336] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Timed out: RequestConsensusVote RPC to 127.20.40.1:46645 timed out after 1.613s (SENT)
I20260709 13:09:42.297818 21805 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:42.302874 26624 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:42.303617 26624 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.305540 26658 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:09:42.306344 26624 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:42.306409 26658 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.307272 26658 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.309840 26658 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:42.309716 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:42.311676 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:42.337661 26622 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:42.391319 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 97816.4us
I20260709 13:09:42.402729 26624 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:42.403899 26624 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:42.407886 26624 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:42.408212 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:42.408766 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:42.398737 22448 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.006s	sys 0.010s
W20260709 13:09:42.414945 22448 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.006s	sys 0.010s
I20260709 13:09:42.415966 26591 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:42.416612 26591 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:42.419240 26157 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:42.419901 26591 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:42.419929 26157 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:42.423287 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 408479us
I20260709 13:09:42.424350 21729 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:42.425710 26659 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:42.426568 26659 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:42.427057 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 3079) took 1211 ms. Trace:
I20260709 13:09:42.428399 26616 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.428651 21840 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:42.428966 26194 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.430485 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:42.431995 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:42.438539 21765 rpcz_store.cc:276] 0709 13:09:41.215742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.520068 (+304326us) service_pool.cc:224] Handling call
0709 13:09:41.539521 (+ 19453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.569713 (+ 30192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.569747 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:41.570237 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.860285 (+290048us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:41.870955 (+ 10670us) log.cc:844] Serialized 14 byte log entry
0709 13:09:42.419883 (+548928us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b18003ed100. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab1e4c0a 00007fc6b4924219 00007fc6ab26ca40 00007fc6ab2674e4 00007fc6ab267455 00007fc6ae34f060 00007fc6ae361716 00007fc6ae372287 00007fc6ae372208
0709 13:09:42.426533 (+  6650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.426652 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.426708 (+    56us) raft_consensus.cc:1685] finished
0709 13:09:42.426833 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.426981 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":199251,"prepare.queue_time_us":11101,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":644614,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":20455,"spinlock_wait_cycles":4821248,"thread_start_us":288857,"threads_started":1,"wal-append.queue_time_us":336275}
W20260709 13:09:42.467764 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 75672.4us
I20260709 13:09:42.472296 21805 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:42.481496 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:42.482721 21765 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:09:42.484198 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:42.484968 21765 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:09:42.485675 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:42.486308 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:42.486572 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:42.487193 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:42.487977 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:42.490993 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:42.492609 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:42.492987 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:42.493546 21757 raft_consensus.cc:2393] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 13: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:09:42.487694 21758 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:42.494055 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:42.494621 21763 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:42.494856 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:42.498131 21757 raft_consensus.cc:1240] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:42.498456 21758 raft_consensus.cc:2393] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 10: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:42.499408 21758 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:09:42.470567 26624 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:42.489472 26639 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:42.458307 26194 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.475981 26642 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:42.458062 26616 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.504395 21760 raft_consensus.cc:1240] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:42.489091 26422 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:09:42.548951 26157 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:42.563508 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 71280.1us
I20260709 13:09:42.557962 26091 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:42.577345 21758 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:09:42.592849 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 113078us
I20260709 13:09:42.556645 26650 consensus_queue.cc:1059] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:09:42.569357 26639 raft_consensus.cc:697] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:42.584456 26598 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:42.592994 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 107638us
W20260709 13:09:42.607872 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 105603us
I20260709 13:09:42.578272 26624 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:42.610953 21805 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:42.604421 26157 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:42.605465 26647 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:42.615665 26639 consensus_queue.cc:237] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.616150 21805 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:42.591094 26091 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.619050 26256 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.621012 21763 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 16.
I20260709 13:09:42.634497 21805 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:42.623040 26616 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:42.579550 26642 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:42.607203 26352 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:42.606041 26598 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.630080 21762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 3080) took 1067 ms. Trace:
I20260709 13:09:42.639043 21805 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:42.605249 26682 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:42.643936 26091 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:42.630578 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:42.635416 26652 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:42.629280 26624 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:42.635710 22450 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:42.633088 26650 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:42.637364 26422 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:42.638260 26352 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:42.642526 26642 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:42.633679 26647 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.639394 21762 rpcz_store.cc:276] 0709 13:09:41.563167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.899801 (+336634us) service_pool.cc:224] Handling call
0709 13:09:41.915075 (+ 15274us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:09:42.421042 (+505967us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:42.421071 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:09:42.421658 (+   587us) log.cc:844] Serialized 52 byte log entry
0709 13:09:42.475245 (+ 53587us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:42.540472 (+ 65227us) log.cc:844] Serialized 14 byte log entry
0709 13:09:42.564555 (+ 24083us) log.cc:844] Serialized 14 byte log entry
0709 13:09:42.579283 (+ 14728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.579384 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.629883 (+ 50499us) raft_consensus.cc:1685] finished
0709 13:09:42.629900 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.630026 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":542650,"prepare.queue_time_us":65537,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":537869,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":10102,"spinlock_wait_cycles":39859328,"thread_start_us":104012,"threads_started":2,"wal-append.queue_time_us":137036}
I20260709 13:09:42.643837 26682 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:42.655119 26608 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:42.655553 26352 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:42.655699 21759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59108 (request call id 1710) took 1434 ms (client timeout 1613 ms). Trace:
I20260709 13:09:42.649549 26685 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:42.622272 26194 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:42.656306 21759 rpcz_store.cc:269] 0709 13:09:41.221598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.222971 (+  1373us) service_pool.cc:224] Handling call
0709 13:09:42.655506 (+1432535us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54003dac54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:42.655642 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1476423936}
I20260709 13:09:42.658396 26647 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:42.659507 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:42.649189 21805 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:42.633198 26157 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:42.636251 26256 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.643224 26598 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:42.649610 26687 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:42.664729 26663 raft_consensus.cc:3060] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:42.665544 26687 raft_consensus.cc:697] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:42.666476 26687 consensus_queue.cc:237] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:42.648743 26650 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:42.669682 26650 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:42.655824 26682 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:42.605885 26193 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:42.674400 26193 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:42.677651 26352 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:42.678197 26352 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:42.679526 21833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 3298) took 1110 ms. Trace:
I20260709 13:09:42.680156 21762 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:42.681074 21758 raft_consensus.cc:1240] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:42.677152 26157 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:42.683516 26602 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:42.684078 26602 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:42.684525 26602 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.686043 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:42.686733 21759 raft_consensus.cc:2376] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10. Re-sending same reply.
I20260709 13:09:42.675158 26256 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:42.689596 26631 consensus_queue.cc:1059] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:42.689997 21805 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:42.690289 26626 consensus_queue.cc:1059] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:42.690836 26624 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:42.691071 26626 raft_consensus.cc:3055] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:42.691321 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:42.691463 26626 raft_consensus.cc:740] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:42.680322 26352 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:42.692404 26352 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.692278 26626 consensus_queue.cc:260] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:42.691341 26624 raft_consensus.cc:697] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:42.694300 26624 consensus_queue.cc:237] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.697232 26230 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:42.697764 26230 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.698326 26194 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:42.679901 21833 rpcz_store.cc:276] 0709 13:09:41.569404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.575887 (+  6483us) service_pool.cc:224] Handling call
0709 13:09:41.576153 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:41.851783 (+275630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.851824 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:41.851866 (+    42us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:41.851904 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:42.679309 (+827405us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b540025dfd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:42.679357 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:42.679473 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":633429888}
I20260709 13:09:42.677119 26193 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:42.693006 26352 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:42.707795 26194 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.711369 26230 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:42.712860 26626 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:42.724514 26591 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:42.727433 26230 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:42.742499 26352 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:42.749235 26230 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.751384 26230 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:42.754797 26650 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.757364 21905 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:42.758673 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:42.762322 26504 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:42.766026 26504 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:42.768021 26504 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:42.769845 22483 raft_consensus.cc:1240] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:42.744587 26663 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:42.745150 26194 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:42.732249 26591 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:42.746320 26602 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:42.781221 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:42.786188 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:42.788090 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:42.788615 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:42.789558 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:42.792019 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:42.792371 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:42.793793 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:42.785635 26626 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.797806 26626 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.798365 26591 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:42.799219 26510 raft_consensus.cc:3055] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:42.799602 26510 raft_consensus.cc:740] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:42.799845 26626 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:42.800455 26510 consensus_queue.cc:260] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.801748 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:42.802330 21759 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
I20260709 13:09:42.803443 26510 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:42.808758 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:42.810158 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:42.810925 21756 raft_consensus.cc:2393] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 15: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:42.811059 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:42.812618 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:42.813184 21833 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 16.
I20260709 13:09:42.812774 22449 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:42.812740 22450 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:42.817088 21839 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:09:42.816653 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:42.818950 21910 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:09:42.821280 26687 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:42.821740 26687 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:42.822121 26687 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:42.827147 26631 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:42.827750 26631 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.828061 26352 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:42.828908 21910 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:42.830006 26624 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:42.819741 26665 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:42.830544 26624 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.830880 26665 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:42.831213 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:42.832592 26624 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:42.832913 26665 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:42.833717 26631 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:42.833060 26624 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:42.834980 26624 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:42.837132 26624 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:42.838500 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:42.841385 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:42.841938 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:42.843026 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:42.846308 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:42.846841 21839 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
W20260709 13:09:42.852814 26629 log.cc:927] Time spent T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 1.371s	user 0.015s	sys 0.000s
I20260709 13:09:42.846432 22448 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:42.854152 21833 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:09:42.855003 22448 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:42.867027 26664 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:42.868140 26664 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:42.853865 26591 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:42.874565 26650 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:42.876144 26687 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:42.880685 26681 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:09:42.902437 26664 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:42.904918 26687 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:43.063987 26659 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:43.065716 26659 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:43.066152 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 221117us
I20260709 13:09:43.064857 26640 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:43.067776 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 218975us
I20260709 13:09:43.067669 26640 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:43.068555 21804 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:43.069861 26640 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:43.070123 26659 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:43.072525 26663 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:43.073562 26652 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:43.074157 26652 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:43.076176 26652 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:43.076941 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:43.077610 21765 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:43.083168 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:43.083799 21758 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:43.083722 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.090420 21804 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:43.092063 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.093014 21804 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:43.094655 21765 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
I20260709 13:09:43.094816 26515 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:43.095818 21805 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:43.096509 26515 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:43.092695 26652 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:43.093261 21835 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:43.097337 26515 raft_consensus.cc:697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:42.855553 21837 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:43.090871 21831 raft_consensus.cc:1275] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:43.098197 26515 consensus_queue.cc:237] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:43.104281 26652 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:43.104939 26652 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:43.106873 21805 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:43.109828 26650 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:43.111132 21758 raft_consensus.cc:2468] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
I20260709 13:09:43.112341 22450 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:43.112540 26652 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:43.113299 26687 raft_consensus.cc:2804] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:09:43.114368 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 259447us
I20260709 13:09:43.115528 22448 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:43.114877 26654 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:43.117355 21804 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:43.118306 26510 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:43.118983 21804 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:43.121681 26652 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:43.122484 26652 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:43.122669 26658 consensus_queue.cc:1059] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:43.124365 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:43.124989 21759 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:09:43.128803 26654 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:09:43.129230 26654 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.129602 26654 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:43.158174 26687 raft_consensus.cc:697] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 12 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:43.159356 26687 consensus_queue.cc:237] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:43.164242 26510 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:43.164855 26510 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:43.167272 26510 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:43.174371 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:43.179824 21805 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:43.180526 26422 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:43.180907 26422 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:43.181280 26422 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:43.183893 26687 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:09:43.194821 26233 raft_consensus.cc:3055] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:43.195291 26233 raft_consensus.cc:740] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:43.196103 26233 consensus_queue.cc:260] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:43.197058 26233 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:43.197152 26422 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:43.201403 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.206965 26644 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:43.207525 26644 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:43.209605 26644 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:43.209156 26640 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.210723 26640 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:43.213158 26640 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:43.215512 26352 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:43.222208 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.226846 21758 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:09:43.229568 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:43.230208 21758 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:43.239015 21838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 3299) took 1668 ms. Trace:
I20260709 13:09:43.239459 21838 rpcz_store.cc:276] 0709 13:09:41.571078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.573120 (+  2042us) service_pool.cc:224] Handling call
0709 13:09:41.778637 (+205517us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:41.857589 (+ 78952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.857626 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:41.857667 (+    41us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:09:41.857705 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:43.238797 (+1381092us) spinlock_profiling.cc:243] Waited 78.7 ms on lock 0x7b5400020b54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:43.238846 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.238957 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":181064576}
I20260709 13:09:43.242132 26622 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:43.243796 21765 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:43.169096 26654 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:43.245565 26640 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.245756 26654 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:42.861524 26645 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:43.246109 26640 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:43.246578 26645 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:43.247740 26624 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:43.248621 26645 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:43.249747 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.249958 21765 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:09:43.251133 26640 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:43.233251 26627 log.cc:927] Time spent T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 1.721s	user 0.002s	sys 0.016s
I20260709 13:09:43.228964 26422 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:43.265084 26654 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:43.266768 26422 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.267354 26422 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:43.270267 26422 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:43.274616 21758 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:09:43.276341 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:43.277097 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:43.279438 21805 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:43.281533 26233 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:43.282122 26233 raft_consensus.cc:697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:43.283336 26233 consensus_queue.cc:237] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:43.292966 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.295526 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:43.298852 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 3065) took 2145 ms. Trace:
I20260709 13:09:43.299300 21761 rpcz_store.cc:276] 0709 13:09:41.153365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.153513 (+   148us) service_pool.cc:224] Handling call
0709 13:09:41.176671 (+ 23158us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.196551 (+ 19880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.196589 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:41.197155 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:09:41.251078 (+ 53923us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:09:41.359058 (+107980us) log.cc:844] Serialized 14 byte log entry
0709 13:09:41.419485 (+ 60427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.419591 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:43.232768 (+1813177us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:09:43.298555 (+ 65787us) raft_consensus.cc:1685] finished
0709 13:09:43.298652 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.298773 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65853,"prepare.queue_time_us":151568,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":85121,"raft.run_cpu_time_us":389,"raft.run_wall_time_us":10875,"spinlock_wait_cycles":31733632,"thread_start_us":125880,"threads_started":2,"wal-append.queue_time_us":152076}
W20260709 13:09:43.307221 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.311406 21761 raft_consensus.cc:1240] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:43.312888 26710 consensus_queue.cc:1059] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:43.313271 26606 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:43.313927 26606 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:43.315871 26606 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:43.315903 21764 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 3062) took 2164 ms. Trace:
I20260709 13:09:43.316677 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:43.316401 21764 rpcz_store.cc:276] 0709 13:09:41.151549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:41.151682 (+   133us) service_pool.cc:224] Handling call
0709 13:09:41.158876 (+  7194us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:09:41.159246 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:41.159270 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:09:41.160240 (+   970us) log.cc:844] Serialized 548 byte log entry
0709 13:09:41.244066 (+ 83826us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:41.357177 (+113111us) log.cc:844] Serialized 14 byte log entry
0709 13:09:41.524120 (+166943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:41.524237 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:09:42.852447 (+1328210us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b240017e388. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab0f09c4 00007fc6ab0eeacb 00007fc6ab2a9dc9 00007fc6ab2a9a55 00007fc6ab2a909d 00007fc6adedb10e 00007fc6adef288c 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221
0709 13:09:43.315619 (+463172us) raft_consensus.cc:1685] finished
0709 13:09:43.315719 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:43.315851 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":111570,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5536,"spinlock_wait_cycles":108561280,"thread_start_us":218612,"threads_started":2,"wal-append.queue_time_us":152281}
I20260709 13:09:43.317936 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.318152 22448 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:43.319231 26606 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:43.319566 26606 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:43.319931 26606 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:43.321553 21763 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:43.322865 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.323447 21832 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:43.332547 21804 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:43.332732 26606 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:43.333683 26631 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:43.336478 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.337307 21840 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:09:43.338603 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.339206 21839 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:43.340226 26606 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:43.343945 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 487812us
I20260709 13:09:43.349516 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:43.350171 21757 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
W20260709 13:09:43.351369 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:43.350204 26233 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:43.352538 21879 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:43.352982 26233 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:43.353613 26611 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:43.354036 26611 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.354106 21805 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:43.354430 26611 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:43.355202 26233 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:43.355713 26233 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:43.356043 26233 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.356353 26233 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:43.357161 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.358362 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:43.362437 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:43.363457 22482 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 16. Current term is 17. Ops: []
I20260709 13:09:43.365160 22485 raft_consensus.cc:1240] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:43.365710 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:43.368374 26535 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:43.368412 26664 consensus_queue.cc:1059] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:43.369488 26604 raft_consensus.cc:3055] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:43.369851 26604 raft_consensus.cc:740] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:43.370594 26604 consensus_queue.cc:260] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:43.372151 26645 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:43.377122 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:43.382323 26544 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.382836 26544 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:43.384394 26683 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:43.385972 21877 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:43.391809 26641 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:43.392356 26641 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:43.394657 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:43.396166 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:43.398483 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:43.399170 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:43.399824 21763 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:43.400986 26641 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:43.404002 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.404611 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:43.405277 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.405833 21836 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:43.407174 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.407730 21833 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:09:43.408509 26631 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:43.408571 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.410634 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:43.412536 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:43.412863 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:43.414345 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.414824 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.415063 21840 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 14.
I20260709 13:09:43.415848 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.416389 21833 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:43.418566 21839 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 15.
I20260709 13:09:43.419170 21731 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:43.419813 26233 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:43.420434 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.422320 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.426597 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:43.427167 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.427698 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:43.384685 26544 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:43.428366 26641 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:43.429272 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:43.430061 22485 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:43.432391 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.432428 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.433497 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.434294 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.435688 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:43.448877 21761 raft_consensus.cc:1275] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:43.431835 21806 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:43.450881 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:43.452196 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 63152.6us
I20260709 13:09:43.451069 22449 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:43.455332 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.455843 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.457798 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:43.458215 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.458854 21907 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:43.463627 26349 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:43.464579 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:43.465698 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.467384 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.467510 21728 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:43.468433 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.469775 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.470420 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.470734 21905 raft_consensus.cc:2410] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:09:43.470404 21906 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:43.474833 21831 raft_consensus.cc:2393] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 13: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:43.475304 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.469058 21877 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:09:43.477246 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 45496us
I20260709 13:09:43.469826 26647 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:43.478183 21728 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:43.485000 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.485911 21763 raft_consensus.cc:1240] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:43.488454 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.499012 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.490309 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:43.478264 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 157724us
I20260709 13:09:43.502731 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:43.503360 21758 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:43.505089 21761 raft_consensus.cc:1275] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:43.506855 21879 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:43.499198 21728 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:43.508775 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:43.510473 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:43.510886 21806 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:43.511222 21831 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:09:43.516386 21834 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:09:43.516765 21834 pending_rounds.cc:85] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 12
I20260709 13:09:43.516688 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:43.517123 21834 pending_rounds.cc:107] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:09:43.517376 21834 raft_consensus.cc:2889] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:43.517592 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.478797 26594 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:43.518198 21910 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 14.
W20260709 13:09:43.518718 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 67733.6us
I20260709 13:09:43.515043 21728 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:43.516053 21877 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:43.527101 21728 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:09:43.594539 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 67539.8us
W20260709 13:09:43.595883 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 71485us
I20260709 13:09:43.500684 26665 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:43.520428 26639 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:43.500490 26683 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:43.508715 26193 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:43.522691 26685 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:43.513332 26641 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:43.603060 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.517729 26659 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:43.520871 26535 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:43.596493 26714 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:43.648499 21831 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 17.
I20260709 13:09:43.604872 26449 raft_consensus.cc:2804] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:43.597976 26274 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:43.508117 26536 consensus_queue.cc:1048] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 13:09:43.603334 26616 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:09:43.658349 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 135678us
I20260709 13:09:43.519443 26611 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:43.617658 26683 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:43.671206 21731 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:43.672653 21731 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:43.673811 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.629055 26639 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:43.653131 26659 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.649293 26641 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:43.686192 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 170192us
I20260709 13:09:43.687696 21877 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:43.666785 26533 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:43.663524 26449 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:43.667562 26274 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.666605 26340 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:43.674986 26683 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:43.702405 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.703617 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.704739 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.704840 21729 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:43.705714 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.706130 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.706391 21729 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:43.707980 26594 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:43.709179 26594 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:43.710793 21729 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:43.711942 26594 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:43.694233 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.673370 26616 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.713501 26616 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:43.650211 26193 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:43.691980 26233 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:43.719739 26193 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:43.721385 26604 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:43.677815 26203 consensus_queue.cc:1048] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:09:43.727211 26340 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:43.695809 26649 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:43.700484 26611 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:43.723860 26193 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:09:43.733335 26703 log.cc:927] Time spent T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.561s	user 0.017s	sys 0.018s
I20260709 13:09:43.742138 21728 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:43.685967 26349 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:43.677211 26644 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:43.752805 21729 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:43.692318 21877 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:43.688874 26659 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:43.750162 26274 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:43.767724 21729 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:43.758343 26649 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:43.764508 21880 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:43.696743 26449 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:09:43.758042 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 160509us
I20260709 13:09:43.688632 26641 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:43.761299 21910 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:09:43.769758 26594 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:43.771453 21729 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:43.775990 21729 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:43.770885 26194 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:43.765584 26349 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:43.800051 21880 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:43.772688 26649 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:43.801644 26349 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:43.759387 26091 consensus_queue.cc:1059] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:09:43.828773 26091 raft_consensus.cc:3055] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:09:43.829223 26091 raft_consensus.cc:740] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:43.797191 26594 raft_consensus.cc:697] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 15 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:43.830199 26091 consensus_queue.cc:260] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:43.831449 26594 consensus_queue.cc:237] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:43.801946 26722 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:43.773084 26533 consensus_queue.cc:1059] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:09:43.811082 26304 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:43.837446 26304 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:43.837966 26304 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:43.838564 26636 raft_consensus.cc:3055] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:09:43.811931 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 119687us
I20260709 13:09:43.839030 26636 raft_consensus.cc:740] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:43.812765 21879 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:43.839912 26636 consensus_queue.cc:260] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:43.842300 26660 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:43.842703 26660 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.843021 26660 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:43.844244 26536 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:43.846272 26536 consensus_queue.cc:1059] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:43.849380 26611 raft_consensus.cc:3055] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:43.849887 26611 raft_consensus.cc:740] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:43.850162 21757 raft_consensus.cc:1275] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:09:43.850826 26611 consensus_queue.cc:260] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:43.814507 26340 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:43.852308 26535 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:43.815747 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.815789 26194 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:43.841238 26636 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:43.818754 26616 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:43.777014 26644 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:43.821310 26683 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:43.766646 26193 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:43.773847 26656 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:43.875026 21907 raft_consensus.cc:1240] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:43.884042 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:43.884677 21839 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:09:43.880950 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:43.886407 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.876955 21911 raft_consensus.cc:2410] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:09:43.879858 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.879053 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.880992 21908 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 13:09:43.888734 21908 pending_rounds.cc:85] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 8
I20260709 13:09:43.889046 21908 pending_rounds.cc:107] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 13:09:43.889298 21908 raft_consensus.cc:2889] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:43.890483 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.879540 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.895449 21839 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:43.900043 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:43.900511 21728 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:43.227535 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:43.933921 22482 raft_consensus.cc:1240] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 12 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:43.848904 26536 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:43.938373 21914 raft_consensus.cc:3055] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:09:43.857374 26720 log.cc:927] Time spent T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:09:43.942529 21914 raft_consensus.cc:740] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:43.867892 26704 raft_consensus.cc:3055] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:43.831468 26091 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:09:43.880683 21694 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee9e0 after lost signal to thread 20643
I20260709 13:09:43.873453 26616 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:43.952965 21694 debug-util.cc:398] Leaking SignalData structure 0x7b08000346e0 after lost signal to thread 21697
I20260709 13:09:43.852331 26611 raft_consensus.cc:3060] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:43.870461 26639 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:43.874861 26683 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:43.949515 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 257093us
I20260709 13:09:43.876505 26193 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:43.953202 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:43.961041 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:43.961719 21834 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:43.962121 22448 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:43.912781 26421 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.974939 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.897688 26233 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:43.958820 21694 debug-util.cc:398] Leaking SignalData structure 0x7b08002acc00 after lost signal to thread 21789
I20260709 13:09:43.939760 26535 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:09:43.976833 21694 debug-util.cc:398] Leaking SignalData structure 0x7b0800247340 after lost signal to thread 21790
I20260709 13:09:43.959550 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.960695 21833 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:09:43.978520 21840 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:43.965965 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:43.992976 21834 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:43.966977 22448 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:43.971334 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:43.947156 21914 consensus_queue.cc:260] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:43.995631 21914 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:43.957407 26449 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:43.978075 21694 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5ca0 after lost signal to thread 21864
W20260709 13:09:43.998378 21694 debug-util.cc:398] Leaking SignalData structure 0x7b0800364e80 after lost signal to thread 21865
I20260709 13:09:43.999601 26449 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:43.974119 26334 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:44.002296 26334 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:09:44.002851 26334 raft_consensus.cc:697] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:44.003789 26334 consensus_queue.cc:237] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:43.949070 26704 raft_consensus.cc:740] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:44.007220 26704 consensus_queue.cc:260] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:44.010880 21663 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52326 (request call id 155) took 5903 ms. Trace:
I20260709 13:09:44.013278 21840 raft_consensus.cc:1240] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:43.999624 21694 debug-util.cc:398] Leaking SignalData structure 0x7b0800345900 after lost signal to thread 21938
W20260709 13:09:44.013929 21694 debug-util.cc:398] Leaking SignalData structure 0x7b08003d3300 after lost signal to thread 21939
I20260709 13:09:44.011263 21663 rpcz_store.cc:276] 0709 13:09:38.107121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.107445 (+   324us) service_pool.cc:224] Handling call
0709 13:09:44.010795 (+5903350us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:41.951604 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:41.966361 (+ 14757us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:41.966396 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:09:41.966409 (+    13us) tablet.cc:662] Decoding operations
0709 13:09:41.967685 (+  1276us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:41.967737 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:41.967767 (+    30us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:09:41.968812 (+  1045us) tablet.cc:701] Row locks acquired
0709 13:09:41.968830 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:09:41.968963 (+   133us) write_op.cc:270] Start()
0709 13:09:41.969067 (+   104us) write_op.cc:276] Timestamp: P: 1783602581968917 usec, L: 0
0709 13:09:41.969090 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:09:42.027369 (+ 58279us) log.cc:844] Serialized 5866 byte log entry
0709 13:09:42.392530 (+365161us) op_driver.cc:464] REPLICATION: finished
0709 13:09:42.460478 (+ 67948us) write_op.cc:301] APPLY: starting
0709 13:09:42.460580 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:42.645330 (+184750us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:42.646042 (+   712us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:42.769655 (+123613us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:42.769970 (+   315us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:09:42.770018 (+    48us) write_op.cc:312] APPLY: finished
0709 13:09:42.770379 (+   361us) log.cc:844] Serialized 139 byte log entry
0709 13:09:42.770564 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:42.770735 (+   171us) write_op.cc:454] Released schema lock
0709 13:09:42.770794 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:42.771186 (+   392us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:42.771215 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":54551,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":67633,"apply.run_cpu_time_us":26667,"apply.run_wall_time_us":310706,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66887,"num_ops":15,"prepare.queue_time_us":599755,"prepare.run_cpu_time_us":24652,"prepare.run_wall_time_us":183552,"raft.queue_time_us":220803,"raft.run_cpu_time_us":64421,"raft.run_wall_time_us":67890,"replication_time_us":423246,"thread_start_us":568522,"threads_started":4,"wal-append.queue_time_us":93616,"wal-append.run_cpu_time_us":23712,"wal-append.run_wall_time_us":1677191}]]}
W20260709 13:09:44.015050 21694 debug-util.cc:398] Leaking SignalData structure 0x7b08002d3540 after lost signal to thread 22509
W20260709 13:09:44.015336 21694 debug-util.cc:398] Leaking SignalData structure 0x7b08002cbdc0 after lost signal to thread 22510
I20260709 13:09:43.992656 26233 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:43.993984 26535 raft_consensus.cc:697] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:09:43.901742 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 100514us
I20260709 13:09:44.054536 21880 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:43.901397 26349 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:43.879297 26274 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.076188 21914 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:09:44.080505 21914 pending_rounds.cc:85] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 7
I20260709 13:09:44.080873 21914 pending_rounds.cc:107] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:09:44.081223 21914 raft_consensus.cc:2889] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:44.083105 21804 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:44.084620 21804 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:44.088917 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:44.089726 21838 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:09:44.099884 21804 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:43.949278 26536 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:43.976958 26712 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.117s
I20260709 13:09:44.093055 21877 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:44.077602 26656 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:44.108981 21804 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:44.031064 26421 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.114362 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:09:44.111500 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 437904us
I20260709 13:09:44.088357 26624 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:44.120057 26536 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:44.115232 26630 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:44.120417 26535 consensus_queue.cc:237] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.121554 21831 raft_consensus.cc:1275] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:44.124935 26641 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.119359 26233 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:44.119304 26421 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:44.102240 26650 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:09:44.127785 26641 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:44.131875 26252 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:44.135604 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:44.130327 26649 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.136229 21838 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:44.093524 26631 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:09:44.138118 26649 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:44.139099 26647 consensus_meta.cc:287] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.002s
I20260709 13:09:44.139529 26647 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:44.139765 22448 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:44.140990 26659 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.141748 21905 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:09:44.143021 26659 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:44.116413 26664 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:44.144244 26664 raft_consensus.cc:697] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:44.150658 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:44.151341 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:44.154328 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:44.154887 21838 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:44.156181 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:44.158934 21728 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:44.161689 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:44.160734 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:44.165359 21838 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:09:44.171478 21806 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:44.145027 26664 consensus_queue.cc:237] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.154129 26727 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:44.171233 26631 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.115399 26660 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.178331 26644 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:44.178184 26252 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:44.174665 26659 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:44.170188 26650 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:09:44.188681 26727 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:44.197894 26645 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:09:44.222421 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:44.224738 21838 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:44.213325 26644 raft_consensus.cc:697] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:44.217996 26727 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:44.205907 26631 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.219928 26349 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:44.230423 21877 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:09:44.245206 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 469310us
I20260709 13:09:44.214972 26659 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.254036 26449 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:44.254524 26449 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:44.255074 26449 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:44.256275 21838 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 15.
I20260709 13:09:44.258246 21840 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:44.238580 26274 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:44.227581 26304 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.282868 21729 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:44.284173 21729 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:44.275353 26533 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:44.266449 26203 consensus_queue.cc:1059] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:09:44.321982 21912 raft_consensus.cc:1275] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:44.324189 21913 raft_consensus.cc:1240] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:44.326586 21729 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:44.293924 26736 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:44.273149 26644 consensus_queue.cc:237] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.318519 26533 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:44.344444 26533 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:44.349282 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:44.358755 26711 consensus_queue.cc:1059] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:44.361408 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:44.323927 26626 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:44.384945 26660 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:44.397881 26304 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:44.445930 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 119491us
I20260709 13:09:44.446033 21760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59102 (request call id 3089) took 1070 ms. Trace:
I20260709 13:09:44.449128 21729 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:44.449995 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:44.448499 21728 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:09:44.453738 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.449839 21760 rpcz_store.cc:276] 0709 13:09:43.376021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:43.390673 (+ 14652us) service_pool.cc:224] Handling call
0709 13:09:43.826602 (+435929us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b5800000098. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab232b71 00007fc6ab232a22 00007fc6b414bc09 00007fc6b32a5ee0 00007fc6b336f0ab 00007fc6b336f131 00007fc6b3330fc0 00007fc6b331b929 00007fc6b331b3d2 00007fc6ac892bd4
0709 13:09:43.826860 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:43.827253 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:09:44.154122 (+326869us) log.cc:844] Serialized 14 byte log entry
0709 13:09:44.322714 (+168592us) log.cc:844] Serialized 14 byte log entry
0709 13:09:44.445351 (+122637us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b18003bf200. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab1e4c0a 00007fc6b4924219 00007fc6ab26ca40 00007fc6ab2674e4 00007fc6ab267455 00007fc6ae34f060 00007fc6ae361716 00007fc6ae372287 00007fc6ae372208
0709 13:09:44.445580 (+   229us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:44.445633 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:44.445697 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:44.445795 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:44.445954 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2008,"prepare.queue_time_us":175140,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":15298,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3893,"spinlock_wait_cycles":250316800,"thread_start_us":478939,"threads_started":2,"wal-append.queue_time_us":178488}
I20260709 13:09:44.457616 26349 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:44.460486 26721 raft_consensus.cc:3055] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:44.460995 26721 raft_consensus.cc:740] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:44.461992 26721 consensus_queue.cc:260] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.463354 26721 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:44.466280 26616 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.466846 26616 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.471779 26729 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:44.472445 26729 raft_consensus.cc:697] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 15 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:44.473464 26729 consensus_queue.cc:237] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.475651 26504 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:09:44.383044 26701 consensus_queue.cc:1175] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" responder_term: 11 status { last_received { term: 11 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:44.482136 21729 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:44.483611 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:44.488880 21834 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 14.
I20260709 13:09:44.469041 26616 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:44.407334 26626 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:44.443619 26639 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:44.447278 26274 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:44.482384 26659 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:44.492420 26631 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:44.497390 26626 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:44.498447 26349 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:44.500005 26449 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.479782 26641 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:09:44.504513 26636 consensus_meta.cc:287] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.003s
I20260709 13:09:44.505029 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:44.508538 26727 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:44.509035 26710 raft_consensus.cc:3055] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:09:44.514060 21835 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:44.526837 26594 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.535807 26594 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.538093 26449 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:44.520040 26644 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:44.533828 26710 raft_consensus.cc:740] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:44.534186 21729 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:44.540926 26710 consensus_queue.cc:260] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:44.538089 26594 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:44.542826 26594 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:44.543685 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:44.544319 21908 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:44.545748 22484 raft_consensus.cc:1240] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:44.546936 26727 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:44.548318 26449 consensus_queue.cc:1059] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:44.549542 21907 raft_consensus.cc:1240] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:44.550094 26640 consensus_queue.cc:1059] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:44.550513 26641 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:44.550643 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:44.551175 26641 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.551522 26194 raft_consensus.cc:3055] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:44.552109 26194 raft_consensus.cc:740] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:44.552536 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:44.551474 21913 raft_consensus.cc:2393] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 11: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:44.549302 26449 raft_consensus.cc:3055] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:44.552914 26194 consensus_queue.cc:260] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.553396 26641 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:44.553695 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:44.558871 26741 log.cc:927] Time spent T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.148s	user 0.000s	sys 0.002s
I20260709 13:09:44.554191 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:44.560338 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:44.560958 21913 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 14.
I20260709 13:09:44.543284 26594 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:44.562299 21913 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:09:44.558820 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:44.562702 26594 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:44.563022 21905 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:44.555272 26449 raft_consensus.cc:740] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:44.566674 26449 consensus_queue.cc:260] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:44.556012 26194 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:44.525786 26659 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:44.570118 26659 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.562703 21913 pending_rounds.cc:85] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 8
I20260709 13:09:44.572999 21913 pending_rounds.cc:107] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:09:44.573341 21913 raft_consensus.cc:2889] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:44.554359 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:44.555814 21908 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:44.582682 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:44.583273 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:44.584038 21759 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:44.585518 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:44.591982 21756 raft_consensus.cc:1240] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:44.592407 21764 raft_consensus.cc:1240] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:09:44.595192 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:44.596887 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:44.597555 21763 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.598882 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:44.594523 21905 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 15.
I20260709 13:09:44.600891 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:44.601788 21758 raft_consensus.cc:2393] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 14: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:44.601642 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:44.605041 21759 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:44.606683 21762 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:44.608227 26736 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:44.608769 26736 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.610860 26736 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:44.588238 26593 consensus_queue.cc:1048] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:09:44.615597 21763 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:44.592242 26449 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:44.619305 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:44.623980 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:44.649864 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:44.650802 21763 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:44.631582 26616 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:09:44.666347 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:44.676952 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:44.676874 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:44.678059 21763 raft_consensus.cc:2393] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 14: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:44.659031 26659 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:44.683562 21763 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:09:44.688015 26704 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:44.692112 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:44.693740 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:44.694883 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:44.695441 21756 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:09:44.693305 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:44.696578 21758 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:09:44.697450 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:44.698834 21758 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:44.702822 21756 raft_consensus.cc:1275] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:44.707103 21879 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:44.708369 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:44.710211 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:44.712970 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:44.713227 21805 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:44.714566 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:44.715973 21805 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:44.716217 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:44.717849 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:44.720525 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:44.721730 21756 raft_consensus.cc:1240] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 7. Current term is 8. Ops: []
I20260709 13:09:44.707442 21728 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:44.726990 21911 raft_consensus.cc:1240] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 6. Current term is 7. Ops: []
I20260709 13:09:44.730417 21756 raft_consensus.cc:1240] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 10. Current term is 11. Ops: []
I20260709 13:09:44.730867 21835 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 13: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:44.658018 26616 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:44.736469 21879 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:44.736799 21840 raft_consensus.cc:1275] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:44.736183 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:44.738124 21729 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:44.729105 26640 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:44.741119 21805 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:44.742224 26626 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:44.742631 26421 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:44.743010 26664 consensus_queue.cc:1059] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:44.786237 26664 raft_consensus.cc:3055] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:44.786625 26664 raft_consensus.cc:740] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:44.787379 26664 consensus_queue.cc:260] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.788475 26664 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:44.788851 26421 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:44.744315 26640 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.789279 26421 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:44.789606 26640 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:44.789711 26421 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:44.791287 22477 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:44.740464 26536 consensus_queue.cc:1059] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:09:44.735040 26659 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:09:44.793905 21765 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:09:44.793993 26533 raft_consensus.cc:3055] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:44.794497 26533 raft_consensus.cc:740] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:44.795285 26533 consensus_queue.cc:260] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:44.795444 21660 catalog_manager.cc:5697] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.796370 26626 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:44.796577 26533 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:44.739544 21879 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:44.733227 26727 consensus_queue.cc:1048] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:09:44.733361 26639 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:09:44.738822 26594 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.751721 26616 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:44.752326 26641 consensus_queue.cc:1059] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:44.729328 26721 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:44.753455 26644 consensus_queue.cc:1048] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:44.739993 26091 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:09:44.765615 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:44.773874 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:44.774049 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:44.777118 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:44.777768 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:44.779727 26710 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:44.784636 21905 raft_consensus.cc:1240] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 7. Current term is 8. Ops: []
W20260709 13:09:44.807982 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 68514.3us
W20260709 13:09:44.810824 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 69752.9us
I20260709 13:09:44.855609 21834 raft_consensus.cc:2393] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:44.851148 21906 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:09:44.812403 21908 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
I20260709 13:09:44.806057 21660 catalog_manager.cc:5697] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 11 to 12, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 12 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:44.814951 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 76899.8us
I20260709 13:09:44.856323 21805 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:44.857986 21729 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:44.817754 21835 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:09:44.838862 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 86170.3us
I20260709 13:09:44.853355 21759 raft_consensus.cc:1240] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:44.822791 26647 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:44.836428 26274 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:09:44.869565 22449 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:44.873528 21764 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:44.875289 21729 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:44.875705 21728 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:44.879489 21729 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:44.881937 21879 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:44.884651 21729 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:44.874814 26650 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:44.906373 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 50119.2us
I20260709 13:09:44.907078 21879 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:44.880571 26194 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:44.912195 21879 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:44.891078 26654 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:44.949961 26721 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:44.910257 26449 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:09:44.893857 26736 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:44.919099 26421 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:44.920779 26759 log.cc:927] Time spent T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:09:44.889225 26641 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:09:44.922892 21660 catalog_manager.cc:5697] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:44.924566 21836 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:09:44.926903 26594 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:44.932582 26762 raft_consensus.cc:3055] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:44.933262 26729 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:44.981070 21877 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:44.944377 26647 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:09:44.944837 26732 raft_consensus.cc:2804] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:44.892663 26728 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:44.950022 26654 raft_consensus.cc:697] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:44.917855 26640 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:44.884689 26616 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:09:44.955586 26421 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:44.908469 26650 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:44.958673 26626 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:45.009341 21879 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:44.979596 26762 raft_consensus.cc:740] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:09:45.020176 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 135614us
I20260709 13:09:45.010185 26721 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:45.013871 26732 raft_consensus.cc:697] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:09:45.075582 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:45.077400 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 56078.1us
I20260709 13:09:45.078248 21729 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:45.080392 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:09:45.080879 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 213853us
I20260709 13:09:45.071743 26721 raft_consensus.cc:697] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:45.105334 26732 consensus_queue.cc:237] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:45.109532 26193 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.110167 26193 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:45.078796 26654 consensus_queue.cc:237] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:45.112390 26193 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:45.113948 26721 consensus_queue.cc:237] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:45.114913 21835 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:09:45.117173 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:45.120419 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:45.125521 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:45.126430 21908 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:45.127931 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:45.134109 26650 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:45.141682 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:45.142575 22484 raft_consensus.cc:2393] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 12: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:09:45.102774 26610 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.143702 26610 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:45.148097 21728 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:45.148999 26641 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:45.148468 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:45.150485 26640 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:45.146067 26610 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:45.152225 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:45.152915 21834 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 17.
I20260709 13:09:45.156255 26702 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:45.059491 26762 consensus_queue.cc:260] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:45.157300 21877 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:45.079206 26616 consensus_queue.cc:1059] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:09:45.158866 26616 raft_consensus.cc:3055] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:09:45.159286 26616 raft_consensus.cc:740] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:45.159644 26610 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:45.160055 26610 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.160454 26610 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:45.160166 26616 consensus_queue.cc:260] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:45.153354 26626 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.169696 21804 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:45.170562 26421 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:45.171010 26421 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:45.171403 26421 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:45.169915 26626 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:45.181923 26610 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:45.183095 21907 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 17. Current term is 18. Ops: []
I20260709 13:09:45.134195 21838 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:45.197036 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:45.209842 21831 raft_consensus.cc:1275] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:09:45.216260 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:45.219836 21834 raft_consensus.cc:1240] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 9. Current term is 10. Ops: []
I20260709 13:09:45.082932 26647 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:09:45.222859 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 144698us
I20260709 13:09:45.225466 26647 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:45.197114 26711 consensus_queue.cc:1059] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:09:45.210457 26728 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:09:45.227792 26768 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:45.231600 26774 consensus_queue.cc:1048] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:09:45.238564 26647 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:45.242664 26616 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:45.246996 26711 consensus_queue.cc:1243] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer 6d698a5544b946939790e7a3972db9fb log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:09:45.255133 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:45.239348 26727 consensus_queue.cc:1059] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:09:45.252549 26610 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:45.259913 26710 raft_consensus.cc:3055] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:09:45.260331 26710 raft_consensus.cc:740] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:45.261207 26710 consensus_queue.cc:260] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:45.262735 26710 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:45.264356 26727 raft_consensus.cc:3055] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:09:45.264801 26727 raft_consensus.cc:740] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:45.265775 26727 consensus_queue.cc:260] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:45.267968 26727 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:45.288209 21805 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:45.290910 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:45.294355 26774 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.294651 21908 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:45.294929 26774 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:45.296774 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:45.297245 26774 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:45.298349 21906 raft_consensus.cc:1275] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:09:45.298758 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:45.301810 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:45.302522 21911 raft_consensus.cc:1275] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:45.298235 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:45.248016 26762 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:45.302712 21879 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:45.318089 26664 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:45.318769 26664 raft_consensus.cc:697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:45.319880 26664 consensus_queue.cc:237] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:45.300329 26665 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:45.327535 26665 raft_consensus.cc:697] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:45.328478 26665 consensus_queue.cc:237] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:45.307695 21877 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:45.310495 26626 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:45.299355 26233 consensus_queue.cc:1059] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:09:45.232314 26767 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:09:45.348565 21731 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:45.355557 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:45.362673 21833 raft_consensus.cc:2393] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 15: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:45.340423 26203 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:09:45.384209 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:45.390028 21763 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:45.363148 26728 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:45.399200 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:45.390038 26736 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:09:45.404158 21790 heartbeater.cc:646] Failed to heartbeat to 127.20.40.62:38057 (1 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.20.40.62:38057 timed out after 15.000s (SENT)
I20260709 13:09:45.404377 26736 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:45.415489 21879 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:45.422824 21805 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:45.375492 26421 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:45.429195 26533 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:45.496428 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 50291.1us
W20260709 13:09:45.511874 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 87454.3us
I20260709 13:09:45.446100 26769 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:09:45.479039 26788 log.cc:927] Time spent T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:09:45.546712 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 114500us
I20260709 13:09:45.547904 21729 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:45.477816 26536 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 13:09:45.571925 21729 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:45.620110 26421 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:45.576700 26762 consensus_queue.cc:1048] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:09:45.621014 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:45.621816 22476 raft_consensus.cc:2393] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 12: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:09:45.573199 26535 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:45.605036 26640 consensus_queue.cc:1048] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:09:45.584342 26768 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:45.627491 21911 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:45.629375 26711 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:09:45.638628 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 112939us
I20260709 13:09:45.555452 26770 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:09:45.641063 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:45.648093 21763 raft_consensus.cc:2393] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 15: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:45.636818 26647 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:45.650583 26626 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:45.732084 26790 log.cc:927] Time spent T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:09:45.760790 26795 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:45.761467 26795 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:45.763751 26795 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:45.764412 26710 consensus_meta.cc:287] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.001s
W20260709 13:09:45.765479 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 318743us
I20260709 13:09:45.783617 21763 raft_consensus.cc:1275] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:09:45.789615 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 84031.8us
I20260709 13:09:45.792309 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:45.766599 26785 log.cc:927] Time spent T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.318s	user 0.002s	sys 0.000s
W20260709 13:09:45.766825 26792 log.cc:927] Time spent T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:09:45.793107 21763 raft_consensus.cc:2393] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 12: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:09:45.766357 26786 log.cc:927] Time spent T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.242s	user 0.000s	sys 0.002s
W20260709 13:09:45.797730 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 355824us
W20260709 13:09:45.799448 26789 log.cc:927] Time spent T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:09:45.822981 26631 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:45.806789 26533 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 13:09:45.831707 26727 consensus_meta.cc:287] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.000s
W20260709 13:09:45.831219 26787 log.cc:927] Time spent T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 13:09:45.834323 26631 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:45.861027 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:45.861855 21762 raft_consensus.cc:1240] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:45.869225 22477 raft_consensus.cc:1275] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:09:45.859617 26631 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:45.874291 26665 consensus_queue.cc:1059] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:09:45.884022 21914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:09:45.884671 21914 raft_consensus.cc:606] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:45.890393 21840 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:45.899827 21840 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:09:45.907532 26782 log.cc:927] Time spent T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.345s	user 0.000s	sys 0.001s
I20260709 13:09:45.908471 26664 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:09:45.913254 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:45.914342 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:09:45.936728 26797 log.cc:927] Time spent T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:09:45.939661 26771 raft_consensus.cc:3055] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:45.940174 26771 raft_consensus.cc:740] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:45.940984 26771 consensus_queue.cc:260] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:45.945544 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:45.946916 26193 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.947440 26193 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:45.948429 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:45.957134 26783 log.cc:927] Time spent T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: Append to log took a long time: real 0.427s	user 0.002s	sys 0.000s
I20260709 13:09:45.962107 26193 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:45.965171 21906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:09:46.035763 21906 raft_consensus.cc:606] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:46.036182 21906 raft_consensus.cc:614] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:45.966796 26647 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:45.971455 21839 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:46.037057 21761 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:09:45.972962 21908 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:45.978796 21838 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:45.981750 21913 raft_consensus.cc:1240] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:45.990446 26593 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.039016 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:46.039146 26593 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:46.039752 21761 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:46.041069 21763 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:45.992641 26736 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:46.041303 26593 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:46.043361 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:46.046554 26647 raft_consensus.cc:993] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:09:46.043012 26704 consensus_queue.cc:1059] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:09:46.052311 26704 raft_consensus.cc:3055] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:46.052634 26704 raft_consensus.cc:740] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:46.048785 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:46.053597 26704 consensus_queue.cc:260] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:46.055826 26704 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:46.020483 26701 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:46.056428 26701 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:46.008461 26771 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:46.047254 26711 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.061715 26711 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:46.051393 26449 raft_consensus.cc:1081] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:09:46.065230 26701 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:46.065454 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:46.066064 21908 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
I20260709 13:09:46.067328 22449 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:46.068697 26701 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:46.069175 26701 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:46.069710 26701 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:46.073938 26711 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:46.075335 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:46.075991 21908 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
I20260709 13:09:46.076970 22449 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:46.081842 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:46.086935 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:46.088640 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:46.090042 21838 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:46.103420 21910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a860581d33304a09b6bd77ea24698076"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:09:46.104099 21910 raft_consensus.cc:606] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:46.104498 21910 raft_consensus.cc:614] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:46.107620 21804 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:46.114326 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:46.115386 21761 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:09:46.117080 26421 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:09:46.096302 26449 consensus_queue.cc:1059] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:09:46.096762 26799 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:46.123337 26799 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.123697 26799 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:46.124152 26304 raft_consensus.cc:3055] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:46.124457 21879 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:46.124596 26304 raft_consensus.cc:740] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:46.126145 26304 consensus_queue.cc:260] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:46.126679 26647 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:46.127084 26647 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.127337 26304 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:46.127475 26647 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:46.127130 26610 consensus_queue.cc:1175] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3843e9b794a245dd8608e04ec7915239" responder_term: 15 status { last_received { term: 13 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:09:46.126493 26649 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:46.129982 22477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:44346
I20260709 13:09:46.131331 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:46.133983 22477 raft_consensus.cc:606] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEADER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:46.161479 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:46.163888 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:46.165015 21759 raft_consensus.cc:2393] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 12: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:46.170288 21804 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:46.209640 21804 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:46.216281 22450 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:46.218218 21760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:09:46.218801 22477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:44346
I20260709 13:09:46.219341 22477 raft_consensus.cc:606] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:46.219790 22477 raft_consensus.cc:614] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:46.218818 21760 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:46.221261 21760 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:46.225520 21804 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:46.173961 26636 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:09:46.224534 26796 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:46.236819 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:46.240447 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:46.228446 26631 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:46.247416 26631 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:46.253491 26795 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:46.216014 26806 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:46.215555 26252 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:46.262763 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 45363.7us
I20260709 13:09:46.204186 26421 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:09:46.262105 26636 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.283146 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:46.271533 21760 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:46.284001 21757 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:09:46.257001 26799 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:46.311635 21760 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:46.312844 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:46.278021 26795 raft_consensus.cc:697] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:46.314863 21805 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:46.302510 26631 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:46.295115 26636 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:46.334919 26639 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:46.346969 22476 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
W20260709 13:09:46.347225 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 113944us
I20260709 13:09:46.299153 26701 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:46.389086 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:46.389971 21914 raft_consensus.cc:2393] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 7: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:46.358500 26807 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:09:46.398391 26807 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:46.398847 26807 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:09:46.399072 26799 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:46.401773 26817 log.cc:927] Time spent T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:09:46.407575 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:46.408648 21760 raft_consensus.cc:2393] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 12: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:46.410276 21911 raft_consensus.cc:3055] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:46.410368 21907 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 13:09:46.410892 21907 pending_rounds.cc:85] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 6
I20260709 13:09:46.357244 26729 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:46.395711 26701 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:46.396190 22484 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:46.396430 26636 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:46.410787 21911 raft_consensus.cc:740] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:46.426975 21911 consensus_queue.cc:260] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:46.411255 21907 pending_rounds.cc:107] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:09:46.358170 26805 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.428416 21907 raft_consensus.cc:2889] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:09:46.428681 26819 log.cc:927] Time spent T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:09:46.392688 26795 consensus_queue.cc:237] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:46.411988 21728 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:46.412410 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:46.413604 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:46.437513 26728 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:46.413775 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:46.450830 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:46.451520 21837 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:46.415062 26702 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:09:46.456032 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:46.382710 26639 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:46.479904 21880 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:46.481595 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:46.482405 21914 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:46.428593 26805 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:46.426877 26729 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:46.491120 26704 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.500036 26203 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:09:46.555480 21914 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
W20260709 13:09:46.587548 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 50351.5us
I20260709 13:09:46.612986 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:46.555549 26704 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:46.626219 26834 log.cc:927] Time spent T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:09:46.639168 26805 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:46.640829 26804 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:46.642822 26729 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:46.645506 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:46.675701 21835 raft_consensus.cc:2393] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 10: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:46.697314 26804 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:46.700599 26804 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:46.650067 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:46.655287 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:46.702647 21833 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:46.702659 22484 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:46.648314 26701 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:46.704437 26701 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:46.704784 21731 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:46.705866 26729 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:09:46.706221 26729 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:46.670845 26639 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:46.720844 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 60569.8us
I20260709 13:09:46.726909 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:46.727315 21837 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 15.
I20260709 13:09:46.727937 21908 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:09:46.735540 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:46.736852 21908 raft_consensus.cc:2393] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 12: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:46.737584 21877 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:46.729730 21728 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:46.608487 26203 raft_consensus.cc:697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:46.706568 26729 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:09:46.752614 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:09:46.758038 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 139262us
I20260709 13:09:46.751366 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:46.759290 21760 raft_consensus.cc:2393] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 14: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:46.743533 21804 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:09:46.685287 26647 consensus_meta.cc:287] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.557s	user 0.012s	sys 0.000s
I20260709 13:09:46.706547 26701 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:46.760700 26639 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:09:46.757855 26640 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:46.764364 26640 raft_consensus.cc:697] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 15 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:46.765144 26640 consensus_queue.cc:237] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:46.755345 26611 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.693238 26704 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:46.766606 26611 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:46.770624 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 57313.8us
I20260709 13:09:46.775815 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:46.776391 21833 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 17.
I20260709 13:09:46.756178 26770 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.785287 26770 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:46.781860 26665 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:09:46.788144 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 66455.2us
W20260709 13:09:46.789601 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 52229.7us
I20260709 13:09:46.793653 26533 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:46.806941 26533 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.807364 26533 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:46.798400 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:46.787946 26846 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.810423 21910 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 18.
I20260709 13:09:46.810912 26846 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:46.800468 22449 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:46.821316 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 48606.4us
I20260709 13:09:46.769752 26647 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:46.793394 26611 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:46.785459 26842 raft_consensus.cc:993] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd: : Instructing follower 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:09:46.799952 26203 consensus_queue.cc:237] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:46.785583 26807 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:46.788863 26665 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:46.787578 26770 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:46.848003 26846 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:46.825995 26702 raft_consensus.cc:2804] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:46.874389 26665 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:46.875895 26729 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:46.876801 26647 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:46.877357 26807 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:46.879304 26729 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:46.910756 21759 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:46.936429 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:46.943780 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:46.951236 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:46.956439 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 152243us
I20260709 13:09:46.968518 21879 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:09:46.957546 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 134423us
I20260709 13:09:46.964212 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:46.977317 22449 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:46.978029 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:46.978523 21839 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:46.966071 21913 raft_consensus.cc:2368] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 12. Current term is 13.
I20260709 13:09:46.979087 21914 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:09:46.978073 21837 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:46.983968 21877 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:46.981139 21911 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:47.003229 26616 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:47.002259 21663 catalog_manager.cc:5697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 12 to 13, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 13 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.004312 26616 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:47.020094 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 62683.8us
W20260709 13:09:47.029682 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 52794.6us
I20260709 13:09:47.037883 21663 catalog_manager.cc:5697] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 13 to 17, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 17 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:47.039428 22449 leader_election.cc:400] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 12. Current term is 13.
I20260709 13:09:47.039851 22449 leader_election.cc:403] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:09:47.040045 21663 catalog_manager.cc:5697] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 10 to 12, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 12 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:47.052292 26805 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:47.043136 26711 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:09:47.073498 26805 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.045958 26704 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:47.073750 26729 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.073961 26805 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:47.074507 26729 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:47.047956 26654 raft_consensus.cc:1081] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEADER]: Signalling peer 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:09:47.051381 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:47.054152 26702 raft_consensus.cc:697] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:47.072583 21663 catalog_manager.cc:5697] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.064253 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:47.064642 26616 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:47.079257 26702 consensus_queue.cc:237] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:47.054352 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 53111.9us
I20260709 13:09:47.080475 26729 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:47.035440 21877 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:47.073647 26711 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:47.101801 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 116420us
I20260709 13:09:47.092729 26711 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:09:47.113862 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:47.116127 26721 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:47.116627 26721 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.114647 21837 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:47.122637 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:47.123791 21839 raft_consensus.cc:2393] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 10: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:09:47.125984 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:09:47.127928 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:47.128499 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 59485us
W20260709 13:09:47.132985 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 70151.9us
I20260709 13:09:47.117028 26721 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:47.105683 21913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:45202
I20260709 13:09:47.141500 21913 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:47.141969 21913 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:47.142360 26732 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:47.161947 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:47.168079 22450 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:47.170152 26701 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:47.170972 26851 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:47.171707 26851 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:47.173100 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:47.174726 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:47.179963 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:47.182796 22477 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:47.183931 21911 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 15.
I20260709 13:09:47.185547 26533 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:47.192610 21906 raft_consensus.cc:2393] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 15: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:47.195338 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:47.196300 26533 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:47.204378 21757 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 7.
I20260709 13:09:47.205091 21731 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:47.210551 21663 catalog_manager.cc:5697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 10 to 11, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 11 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:47.212456 21663 catalog_manager.cc:5697] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 9 to 11, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 11 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:09:47.222432 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 62397.4us
I20260709 13:09:47.215255 21728 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:47.224555 26616 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:47.224970 26616 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.225301 26616 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:47.216235 22476 raft_consensus.cc:1240] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:47.217067 26728 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:09:47.226955 26728 raft_consensus.cc:697] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 10 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:47.228080 26728 consensus_queue.cc:237] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:47.232134 26807 consensus_queue.cc:1059] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:47.233595 26807 consensus_queue.cc:1243] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer 8c6c2207af3d47b3acf352d81959f4dd log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:09:47.234985 26767 raft_consensus.cc:3055] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:47.235359 26767 raft_consensus.cc:740] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:47.236351 26767 consensus_queue.cc:260] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:47.237682 26767 raft_consensus.cc:3060] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:47.240604 26616 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:47.241884 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:47.245115 21913 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:47.255115 21910 raft_consensus.cc:1240] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 15. Current term is 16. Ops: []
I20260709 13:09:47.260488 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:47.250527 26729 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:47.263418 26729 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:47.265640 21663 catalog_manager.cc:5697] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 11 to 12, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 12 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.267509 21663 catalog_manager.cc:5697] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 10 to 11, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 11 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.269418 26654 consensus_queue.cc:1059] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:47.270303 26850 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.270282 26729 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:47.271634 26850 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:47.272403 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:47.276885 26850 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:47.256982 26851 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:47.270576 26654 raft_consensus.cc:3055] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:09:47.279394 26654 raft_consensus.cc:740] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:47.280684 26654 consensus_queue.cc:260] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:47.284185 26616 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:47.284790 26654 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:47.290172 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:47.296212 21913 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:47.286458 21663 catalog_manager.cc:5697] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 7 to 9, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:47.307921 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:47.311043 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:47.322006 21833 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 15.
I20260709 13:09:47.324558 21910 raft_consensus.cc:1240] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:47.322463 21805 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:47.314484 21663 catalog_manager.cc:5697] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 8 to 10, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 10 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:47.333662 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:47.334322 21833 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:09:47.330988 21663 catalog_manager.cc:5697] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.341887 21728 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:47.340266 21663 catalog_manager.cc:5697] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 7 to 10, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 10 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:47.350174 21840 raft_consensus.cc:1275] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:47.348461 26728 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:09:47.351902 26728 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.352246 26728 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:47.354368 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:47.326861 26711 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:47.357484 21833 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:09:47.354990 21765 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:09:47.357896 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:47.363778 21837 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:47.344048 26704 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 12. Current term is 13.
I20260709 13:09:47.383570 21728 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:47.384442 26850 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:47.384964 26850 raft_consensus.cc:697] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:47.363484 26807 raft_consensus.cc:2764] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:09:47.385969 26850 consensus_queue.cc:237] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:47.395167 22485 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:47.379932 21663 catalog_manager.cc:5697] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 10 to 11, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 11 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:47.364301 26721 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:47.417659 26665 consensus_meta.cc:287] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.541s	user 0.012s	sys 0.004s
I20260709 13:09:47.418190 26665 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:47.419682 21839 raft_consensus.cc:2410] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:09:47.421584 26665 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:47.423970 22476 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:47.427109 21880 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:47.428373 26203 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:47.430287 26203 raft_consensus.cc:2804] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:47.394984 26616 consensus_queue.cc:1048] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:09:47.432516 26203 raft_consensus.cc:697] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:47.433739 26203 consensus_queue.cc:237] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:47.439740 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:47.442312 21910 raft_consensus.cc:2368] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 14. Current term is 15.
I20260709 13:09:47.445178 21914 raft_consensus.cc:2368] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8.
I20260709 13:09:47.448110 21804 leader_election.cc:400] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 14. Current term is 15.
I20260709 13:09:47.448459 21804 leader_election.cc:403] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:09:47.445211 26851 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.450491 26851 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:47.453295 26851 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:47.460320 26728 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:47.408718 26805 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:47.472295 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:47.476854 21839 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:09:47.487650 21837 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 16.
I20260709 13:09:47.491060 21877 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:47.475620 26767 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:47.492841 21804 leader_election.cc:400] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8.
I20260709 13:09:47.493216 21804 leader_election.cc:403] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:09:47.494629 26801 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:47.495316 26801 raft_consensus.cc:697] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 16 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:47.495746 26728 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:47.496413 26801 consensus_queue.cc:237] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:47.502331 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:47.507944 21914 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:09:47.509529 26851 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:47.510418 26851 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:47.513376 21660 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45746 (request call id 229) took 17129 ms (client timeout 15000 ms). Trace:
I20260709 13:09:47.513862 26704 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:47.518354 26851 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:47.521214 26711 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 19 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:47.526582 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:47.527400 21910 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:09:47.513965 21660 rpcz_store.cc:269] 0709 13:09:30.391741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:30.391859 (+   118us) service_pool.cc:224] Handling call
0709 13:09:47.513044 (+17121185us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:45.241953 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:45.242525 (+   572us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:45.242563 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:09:45.242582 (+    19us) tablet.cc:662] Decoding operations
0709 13:09:45.243121 (+   539us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:45.243206 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:45.243230 (+    24us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:09:45.243525 (+   295us) tablet.cc:701] Row locks acquired
0709 13:09:45.243542 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:09:45.243680 (+   138us) write_op.cc:270] Start()
0709 13:09:45.243788 (+   108us) write_op.cc:276] Timestamp: P: 1783602585243631 usec, L: 0
0709 13:09:45.243808 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:09:45.244408 (+   600us) log.cc:844] Serialized 1299 byte log entry
0709 13:09:45.956300 (+711892us) spinlock_profiling.cc:243] Waited 6.69 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:09:46.390409 (+434109us) op_driver.cc:464] REPLICATION: finished
0709 13:09:46.620300 (+229891us) write_op.cc:301] APPLY: starting
0709 13:09:46.620419 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:46.623233 (+  2814us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:46.623271 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:46.756233 (+132962us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:46.783847 (+ 27614us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:09:46.818302 (+ 34455us) write_op.cc:312] APPLY: finished
0709 13:09:46.828972 (+ 10670us) log.cc:844] Serialized 41 byte log entry
0709 13:09:46.829162 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:46.829272 (+   110us) write_op.cc:454] Released schema lock
0709 13:09:46.829314 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:46.838230 (+  8916us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:46.838265 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":943,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":225989,"apply.run_cpu_time_us":7476,"apply.run_wall_time_us":217888,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16679,"num_ops":3,"prepare.queue_time_us":172100,"prepare.run_cpu_time_us":24515,"prepare.run_wall_time_us":113663,"raft.queue_time_us":380310,"raft.run_cpu_time_us":41050,"raft.run_wall_time_us":229496,"replication_time_us":1114118,"spinlock_wait_cycles":15393664,"thread_start_us":639320,"threads_started":4,"wal-append.queue_time_us":187943}]]}
W20260709 13:09:47.529795 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 58042.4us
I20260709 13:09:47.540162 21728 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:47.553048 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:47.543213 26807 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:47.549311 26851 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:09:47.564527 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.544926 26721 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:47.566043 26851 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.579039 22484 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 16.
I20260709 13:09:47.591926 21910 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 19.
I20260709 13:09:47.583719 26851 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:47.599251 26721 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:47.624934 26767 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 14. Current term is 15.
I20260709 13:09:47.638239 26850 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:47.640479 26721 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:47.665037 26640 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:47.667129 26640 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:47.671275 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:47.672468 26807 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8.
I20260709 13:09:47.673174 26640 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:47.676229 21765 raft_consensus.cc:1240] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 15 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:47.681020 21837 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:47.669137 26721 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:47.662355 26850 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:47.706128 22449 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:47.695778 26807 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.709195 26702 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:09:47.709569 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:47.709764 26702 raft_consensus.cc:697] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:47.710237 21759 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:47.710687 26702 consensus_queue.cc:237] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:47.711434 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:47.712121 21761 raft_consensus.cc:3060] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:47.715449 26729 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:47.716625 26807 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:47.717469 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:47.717212 26729 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:47.718056 21762 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:47.719120 26807 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:47.719646 26729 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:47.701126 26805 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:47.732669 26850 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:47.728642 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:47.729172 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:47.736088 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:47.736589 21835 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:47.733502 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:47.736135 21839 raft_consensus.cc:2393] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 13: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:47.738687 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:47.739274 21833 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:09:47.740904 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:47.741320 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:47.740257 21839 raft_consensus.cc:1275] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:09:47.741565 21836 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:47.744815 21839 pending_rounds.cc:85] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 10
I20260709 13:09:47.744705 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:47.745302 21839 pending_rounds.cc:107] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:09:47.745712 21839 raft_consensus.cc:2889] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:47.747637 21877 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:47.754056 26721 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:47.754647 26721 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:47.755146 26721 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:47.696072 22484 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:09:47.761797 26701 consensus_queue.cc:1048] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:47.765703 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:47.771848 21836 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 16.
I20260709 13:09:47.772732 21761 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:47.775359 21877 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:47.778332 26850 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:47.784065 21762 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:09:47.789855 26721 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:47.794035 26656 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:09:47.794611 26656 raft_consensus.cc:697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:47.795650 26656 consensus_queue.cc:237] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:47.797266 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:47.802666 26721 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:47.814488 21836 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:47.824131 21833 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 19.
I20260709 13:09:47.716219 26851 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:47.839510 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:47.840327 21762 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:47.846247 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:47.846836 21765 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:47.850626 21877 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:47.851676 26805 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:47.852203 26805 raft_consensus.cc:697] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:47.862259 21765 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:09:47.864228 26721 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.865149 26851 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:47.864817 26721 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:47.867115 26721 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:47.870107 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:47.870985 21835 raft_consensus.cc:2393] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 16: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:09:47.871454 26805 consensus_queue.cc:237] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:47.879074 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:47.880460 21765 raft_consensus.cc:2368] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 13. Current term is 14.
I20260709 13:09:47.888010 21762 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 8.
I20260709 13:09:47.893376 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:47.915961 21728 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:47.923698 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:47.924389 21834 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:47.925354 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:47.926296 21762 raft_consensus.cc:2368] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 13. Current term is 14.
I20260709 13:09:47.924844 26728 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:09:47.921307 26729 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:09:47.969318 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:47.992668 21833 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:09:48.049517 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 52609.5us
I20260709 13:09:48.021330 21834 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 14.
I20260709 13:09:48.029467 21831 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 13:09:48.089184 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 136440us
I20260709 13:09:48.092655 21728 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:48.097832 21729 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:48.087760 26656 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:48.107128 26656 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:48.108064 26616 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:48.110728 26656 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:48.113375 26851 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:48.114017 26851 raft_consensus.cc:697] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 14 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:48.116112 21729 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:48.117944 26850 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:48.118309 21834 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:09:48.124750 26876 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:48.092137 26728 raft_consensus.cc:697] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 16 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:48.114995 26851 consensus_queue.cc:237] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:48.095310 26721 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:09:48.143487 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:48.145886 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:48.142474 26850 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:48.163009 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:48.165306 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:48.167657 21910 raft_consensus.cc:2410] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:09:48.176767 26728 consensus_queue.cc:237] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:48.184059 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:48.185165 21913 raft_consensus.cc:2393] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 13: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:09:48.189724 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 173179us
I20260709 13:09:48.195628 21913 raft_consensus.cc:1275] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:09:48.196810 21835 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:09:48.228983 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 53071.9us
I20260709 13:09:48.229882 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:48.235411 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 78863.4us
I20260709 13:09:48.242154 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:48.243952 21914 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:09:48.255852 26729 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:48.256745 26875 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:48.257391 26875 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:48.258299 26640 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:48.258919 26640 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:48.260584 26850 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:48.256556 26729 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:48.261174 26850 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:48.273092 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:48.275712 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:48.276768 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:48.279371 22485 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:48.280815 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:48.284281 21913 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:09:48.284281 22485 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:09:48.287930 26850 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:48.290304 26701 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:48.291036 26701 consensus_queue.cc:1243] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer 6d698a5544b946939790e7a3972db9fb log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:09:48.293553 21913 pending_rounds.cc:85] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 13
I20260709 13:09:48.293664 26656 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:48.293879 21913 pending_rounds.cc:107] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:09:48.294276 21913 raft_consensus.cc:2889] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:48.294435 26729 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:48.303049 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:48.303334 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:48.304772 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:48.316335 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 124324us
I20260709 13:09:48.317849 26874 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:09:48.322129 21914 raft_consensus.cc:2410] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:09:48.337859 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:48.346035 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 72226us
I20260709 13:09:48.294319 26656 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:48.352108 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:48.354681 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:48.355441 21758 raft_consensus.cc:2368] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 14. Current term is 15.
I20260709 13:09:48.355262 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:48.371738 21879 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:48.336256 26721 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:09:48.376025 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:48.378279 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:48.379726 21914 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:09:48.380940 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:48.385640 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:48.391131 21756 raft_consensus.cc:1275] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:09:48.402895 26656 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:48.390151 21729 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:48.410202 26721 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:48.410827 26721 raft_consensus.cc:697] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 15 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:48.411720 26721 consensus_queue.cc:237] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:48.413822 26640 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:48.413966 26880 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 13:09:48.415609 26728 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:48.415943 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:48.419250 21729 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:48.422555 21731 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:48.455650 26876 consensus_queue.cc:1048] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:48.459579 21805 leader_election.cc:400] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 14. Current term is 15.
I20260709 13:09:48.460593 21805 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:48.462217 26875 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:48.462499 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 54820.1us
I20260709 13:09:48.449149 26851 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:48.464332 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:48.477171 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 54694.5us
I20260709 13:09:48.486691 26851 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:48.462253 26252 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:09:48.512908 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 141239us
W20260709 13:09:48.518093 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 65284.1us
I20260709 13:09:48.542570 21729 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:48.543978 26876 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:48.547505 21729 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:48.538136 21879 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:48.555696 26872 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:48.556396 26536 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:48.558298 21879 leader_election.cc:400] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 13. Current term is 14.
I20260709 13:09:48.529009 21839 raft_consensus.cc:1240] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:48.559949 26721 consensus_queue.cc:1059] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:48.561009 26536 raft_consensus.cc:3055] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:48.561386 26536 raft_consensus.cc:740] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:48.562227 26536 consensus_queue.cc:260] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:48.563241 26536 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:48.581212 26876 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:09:48.592428 21837 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:09:48.604384 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 56966.5us
I20260709 13:09:48.605309 21729 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:48.606148 26876 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:48.609201 26876 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:48.559636 21879 leader_election.cc:400] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 13. Current term is 14.
W20260709 13:09:48.623979 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 64476.4us
I20260709 13:09:48.628432 21663 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52326 (request call id 156) took 2617 ms. Trace:
I20260709 13:09:48.626049 21729 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:48.643090 26876 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:48.644516 26876 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:09:48.645300 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 147995us
I20260709 13:09:48.650928 21729 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:48.655103 26876 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:48.663620 26875 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:48.664144 26875 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:48.666531 26875 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:48.679311 21833 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:48.680518 26875 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:48.681164 26875 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:48.683023 26805 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:09:48.687736 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:48.690783 26880 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:48.691816 26880 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:48.693284 21659 catalog_manager.cc:5697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 12 to 13, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 13 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:48.693986 26880 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:48.695878 21659 catalog_manager.cc:5697] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 10 to 13, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 13 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:48.699242 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:48.702836 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:48.707734 21762 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:09:48.708458 21879 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:48.709650 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:48.711107 26536 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:48.711969 21879 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:48.712570 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:48.713587 26805 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:48.714891 26805 consensus_queue.cc:1048] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:09:48.715140 21914 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:09:48.715260 21731 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:48.715538 21914 pending_rounds.cc:85] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 9
I20260709 13:09:48.715799 21914 pending_rounds.cc:107] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:09:48.716008 21914 raft_consensus.cc:2889] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:48.716355 26640 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:48.698679 21659 catalog_manager.cc:5697] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 8 to 11, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 11 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.723711 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:48.725250 21756 raft_consensus.cc:1240] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 14 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:48.725986 21659 catalog_manager.cc:5697] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.639627 21663 rpcz_store.cc:276] 0709 13:09:46.010573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.010729 (+   156us) service_pool.cc:224] Handling call
0709 13:09:48.628340 (+2617611us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:47.694556 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:47.695210 (+   654us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:47.695260 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:09:47.695283 (+    23us) tablet.cc:662] Decoding operations
0709 13:09:47.697680 (+  2397us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:47.697777 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:47.697806 (+    29us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:09:47.775131 (+ 77325us) tablet.cc:701] Row locks acquired
0709 13:09:47.798173 (+ 23042us) write_op.cc:260] PREPARE: finished
0709 13:09:47.798376 (+   203us) write_op.cc:270] Start()
0709 13:09:47.798518 (+   142us) write_op.cc:276] Timestamp: P: 1783602587798310 usec, L: 0
0709 13:09:47.798556 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:09:47.831201 (+ 32645us) log.cc:844] Serialized 5112 byte log entry
0709 13:09:47.847885 (+ 16684us) spinlock_profiling.cc:243] Waited 6.84 ms on lock 0x7b54002ae254. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae352e28 00007fc6b1d8d581 00007fc6b1d8cd58 00007fc6b1d919f1 00007fc6b1d919a9 00007fc6b1d91939 00007fc6b1d91901 00007fc6b1d90b2d 000000000038f354 000000000038f199
0709 13:09:48.136967 (+289082us) op_driver.cc:464] REPLICATION: finished
0709 13:09:48.265809 (+128842us) spinlock_profiling.cc:243] Waited 9.78 ms on lock 0x7b1800351700. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab26a3f3 00007fc6ab26c7c1 00007fc6ab26c779 00007fc6ab26c709 00007fc6ab26c6d1 00007fc6ab26b9cd 000000000038f354 000000000038f199 00007fc6ab24d83a
0709 13:09:48.265971 (+   162us) write_op.cc:301] APPLY: starting
0709 13:09:48.266075 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:48.397407 (+131332us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:48.417605 (+ 20198us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:48.590801 (+173196us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:48.591193 (+   392us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:09:48.591256 (+    63us) write_op.cc:312] APPLY: finished
0709 13:09:48.591640 (+   384us) log.cc:844] Serialized 121 byte log entry
0709 13:09:48.594009 (+  2369us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:48.594158 (+   149us) write_op.cc:454] Released schema lock
0709 13:09:48.594230 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:48.603525 (+  9295us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:48.603558 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":185099,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":92310,"apply.run_cpu_time_us":19508,"apply.run_wall_time_us":337448,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58519,"mutex_wait_us":7661,"num_ops":13,"prepare.queue_time_us":165497,"prepare.run_cpu_time_us":8653,"prepare.run_wall_time_us":154813,"raft.queue_time_us":293589,"raft.run_cpu_time_us":44624,"raft.run_wall_time_us":89822,"replication_time_us":338184,"spinlock_wait_cycles":38246656,"thread_start_us":384082,"threads_started":3,"wal-append.queue_time_us":632}]]}
I20260709 13:09:48.727963 26875 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:48.739590 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:48.748652 21659 catalog_manager.cc:5697] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 10 to 11, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 11 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:48.756345 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:48.756227 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:48.757206 21879 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:48.758893 21659 catalog_manager.cc:5697] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 7 to 10, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 10 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.761505 26880 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:09:48.772912 26872 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:09:48.798800 21729 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:48.799098 21659 catalog_manager.cc:5697] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 6 to 7, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 7 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:48.806195 21659 catalog_manager.cc:5697] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 11 to 12, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 12 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.811074 21659 catalog_manager.cc:5697] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 6 to 10, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 10 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:48.812520 21659 catalog_manager.cc:5697] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 7 to 11, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 11 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.820701 26640 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:48.825476 26616 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:48.821624 26729 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:48.826078 26616 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:48.828161 21659 catalog_manager.cc:5697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 5 to 6, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 6 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:48.829339 26616 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:48.829732 21659 catalog_manager.cc:5697] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 11 to 15, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 15 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.830608 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:48.833312 21659 catalog_manager.cc:5697] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 9 to 10, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 10 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.834403 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:48.834935 21659 catalog_manager.cc:5697] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 10 to 11, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 11 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.836933 21659 catalog_manager.cc:5697] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 8 to 9, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 9 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:48.838474 21659 catalog_manager.cc:5697] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:48.839496 21833 raft_consensus.cc:1275] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 13:09:48.839720 21659 catalog_manager.cc:5697] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 8 to 9, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 9 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:48.843631 21728 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:48.822585 21729 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:48.864807 26729 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:48.865849 21879 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:48.865044 26640 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:09:48.868206 26872 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:48.864620 21659 catalog_manager.cc:5697] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 8 to 9, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 9 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:48.871325 26851 consensus_queue.cc:1048] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:48.871547 21659 catalog_manager.cc:5697] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 10 to 11, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 11 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:48.877036 21908 raft_consensus.cc:1275] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 7. (term mismatch)
I20260709 13:09:48.881060 21908 pending_rounds.cc:85] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 6
I20260709 13:09:48.881367 21908 pending_rounds.cc:107] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 13.7
I20260709 13:09:48.881664 21908 raft_consensus.cc:2889] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:48.924064 26851 consensus_queue.cc:1048] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:09:48.933352 21836 raft_consensus.cc:1275] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:48.936422 26611 consensus_queue.cc:1048] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:49.008698 21757 raft_consensus.cc:1275] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:09:49.011324 26890 consensus_queue.cc:1048] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:49.011688 21911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:09:49.012342 21911 raft_consensus.cc:606] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:49.012674 21911 raft_consensus.cc:614] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:49.047559 21908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:09:49.048167 21908 raft_consensus.cc:606] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:49.073355 22477 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44346
I20260709 13:09:49.074352 22477 raft_consensus.cc:606] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:49.079852 21911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:09:49.080413 21911 raft_consensus.cc:606] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:49.083966 21911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a860581d33304a09b6bd77ea24698076"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:09:49.084465 26880 raft_consensus.cc:993] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:09:49.084513 21911 raft_consensus.cc:606] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:49.085070 26611 raft_consensus.cc:1081] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:09:49.085216 21911 raft_consensus.cc:614] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:09:49.086457 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:49.087037 21761 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:09:49.087572 21761 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.087880 21761 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:49.088241 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:49.103129 26711 raft_consensus.cc:993] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:09:49.103786 26704 raft_consensus.cc:1081] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:09:49.105965 21756 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44772
I20260709 13:09:49.106552 21756 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.106906 21756 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:49.126410 21761 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:49.144587 21756 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:49.149652 21756 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:49.151168 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:49.151520 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:49.151816 21908 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:49.152163 22477 raft_consensus.cc:3055] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:09:49.152510 22477 raft_consensus.cc:740] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:09:49.153293 22477 consensus_queue.cc:260] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:49.154471 22477 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:09:49.155925 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:49.156281 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:49.156582 21911 raft_consensus.cc:3055] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:49.156885 22485 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:49.157063 21911 raft_consensus.cc:740] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:49.158061 21911 consensus_queue.cc:260] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:49.162686 22477 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:49.163960 21731 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:49.164863 26616 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:09:49.164965 21761 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:49.165369 26616 raft_consensus.cc:697] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:49.166378 26616 consensus_queue.cc:237] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:49.175122 22485 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:49.176153 21911 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:49.177541 21908 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:09:49.177486 21731 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:49.180089 26729 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:49.180728 26729 raft_consensus.cc:697] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:49.181872 26729 consensus_queue.cc:237] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:49.188073 21911 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:49.364398 26880 raft_consensus.cc:993] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:09:49.364912 26880 raft_consensus.cc:1081] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:09:49.366861 21756 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:09:49.367394 21756 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:49.367748 21756 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:49.380206 21756 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:49.409953 21756 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:49.413265 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:49.418300 21837 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:49.412081 21663 catalog_manager.cc:5697] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 9 to 10, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 10 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:49.410955 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:49.423410 21908 raft_consensus.cc:3055] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:49.423708 21908 raft_consensus.cc:740] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:49.424468 21908 consensus_queue.cc:260] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:49.425766 21908 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:49.423727 21663 catalog_manager.cc:5697] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 15 to 16, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 16 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:49.424808 21837 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:09:49.449589 21728 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:49.450405 26616 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:49.450759 21908 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:09:49.450922 26616 raft_consensus.cc:697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:49.451977 26616 consensus_queue.cc:237] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:49.454551 21663 catalog_manager.cc:5697] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 7 to 8, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 8 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:49.478148 21663 catalog_manager.cc:5697] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 11 to 13, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 13 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.479919 21663 catalog_manager.cc:5697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 11 to 12, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 12 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:49.481243 21663 catalog_manager.cc:5697] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.482631 21663 catalog_manager.cc:5697] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:49.487285 21659 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45778 (request call id 286) took 8961 ms. Trace:
I20260709 13:09:49.487658 21659 rpcz_store.cc:276] 0709 13:09:40.532766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:40.552118 (+ 19352us) service_pool.cc:224] Handling call
0709 13:09:49.487199 (+8935081us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:49.002273 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:49.002881 (+   608us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:49.002918 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:09:49.002939 (+    21us) tablet.cc:662] Decoding operations
0709 13:09:49.004685 (+  1746us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:49.004774 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:49.004803 (+    29us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:09:49.038764 (+ 33961us) tablet.cc:701] Row locks acquired
0709 13:09:49.038783 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:09:49.038923 (+   140us) write_op.cc:270] Start()
0709 13:09:49.039054 (+   131us) write_op.cc:276] Timestamp: P: 1783602589038879 usec, L: 0
0709 13:09:49.039078 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:09:49.039760 (+   682us) log.cc:844] Serialized 7408 byte log entry
0709 13:09:49.143482 (+103722us) op_driver.cc:464] REPLICATION: finished
0709 13:09:49.201092 (+ 57610us) write_op.cc:301] APPLY: starting
0709 13:09:49.201219 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:49.307576 (+106357us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:49.307678 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:49.392044 (+ 84366us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:49.392340 (+   296us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 13:09:49.392383 (+    43us) write_op.cc:312] APPLY: finished
0709 13:09:49.392761 (+   378us) log.cc:844] Serialized 172 byte log entry
0709 13:09:49.403474 (+ 10713us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:49.403659 (+   185us) write_op.cc:454] Released schema lock
0709 13:09:49.403709 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:49.405941 (+  2232us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:49.405987 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":171572,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":56846,"apply.run_cpu_time_us":23666,"apply.run_wall_time_us":204837,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83623,"num_ops":19,"prepare.queue_time_us":79337,"prepare.run_cpu_time_us":5925,"prepare.run_wall_time_us":37800,"replication_time_us":104245,"thread_start_us":129314,"threads_started":2}]]}
I20260709 13:09:49.561019 21662 catalog_manager.cc:5697] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 9 to 10, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 10 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:49.563284 21662 catalog_manager.cc:5697] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 10 to 15, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 15 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.564858 21662 catalog_manager.cc:5697] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:49.566322 21662 catalog_manager.cc:5697] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 11 to 16, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 16 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:49.567654 21662 catalog_manager.cc:5697] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 6 to 13, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 13 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:49.570580 21662 catalog_manager.cc:5697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:49.572616 21662 catalog_manager.cc:5697] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:49.585922 21662 catalog_manager.cc:5697] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 9 to 10, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 10 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:49.587678 21662 catalog_manager.cc:5697] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 11 to 15, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 15 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.589639 21910 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:49.589331 21662 catalog_manager.cc:5697] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:49.590998 21662 catalog_manager.cc:5697] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 8 to 13, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 13 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:49.592310 21662 catalog_manager.cc:5697] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.593674 21662 catalog_manager.cc:5697] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 7 to 11, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 11 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.595064 26616 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:09:49.595567 21662 catalog_manager.cc:5697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:49.658617 21911 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:49.666714 26640 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:09:49.758750 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 47673.5us
I20260709 13:09:49.770323 22477 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:09:49.774267 26640 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:49.778256 22485 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:49.781322 26729 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:09:49.803751 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 95655us
I20260709 13:09:49.828706 21662 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45746 (request call id 230) took 2917 ms. Trace:
I20260709 13:09:49.829250 21662 rpcz_store.cc:276] 0709 13:09:46.912193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:46.917720 (+  5527us) service_pool.cc:224] Handling call
0709 13:09:49.828635 (+2910915us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:09:49.609733 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:09:49.610244 (+   511us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:09:49.610278 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:09:49.610294 (+    16us) tablet.cc:662] Decoding operations
0709 13:09:49.611385 (+  1091us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:09:49.611432 (+    47us) write_op.cc:641] Partition lock acquired for write op
0709 13:09:49.611458 (+    26us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:09:49.612511 (+  1053us) tablet.cc:701] Row locks acquired
0709 13:09:49.612530 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:09:49.612658 (+   128us) write_op.cc:270] Start()
0709 13:09:49.612774 (+   116us) write_op.cc:276] Timestamp: P: 1783602589612616 usec, L: 0
0709 13:09:49.612796 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:09:49.613498 (+   702us) log.cc:844] Serialized 5502 byte log entry
0709 13:09:49.615904 (+  2406us) op_driver.cc:464] REPLICATION: finished
0709 13:09:49.616390 (+   486us) write_op.cc:301] APPLY: starting
0709 13:09:49.616459 (+    69us) tablet.cc:1367] starting BulkCheckPresence
0709 13:09:49.623273 (+  6814us) tablet.cc:1370] finished BulkCheckPresence
0709 13:09:49.623381 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:09:49.630867 (+  7486us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:09:49.631144 (+   277us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:09:49.631189 (+    45us) write_op.cc:312] APPLY: finished
0709 13:09:49.631528 (+   339us) log.cc:844] Serialized 129 byte log entry
0709 13:09:49.637581 (+  6053us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:49.637744 (+   163us) write_op.cc:454] Released schema lock
0709 13:09:49.637818 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:09:49.657696 (+ 19878us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:09:49.657728 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":264,"apply.run_cpu_time_us":15509,"apply.run_wall_time_us":41250,"cfile_cache_hit":56,"cfile_cache_hit_bytes":58576,"num_ops":14,"prepare.queue_time_us":8172,"prepare.run_cpu_time_us":4059,"prepare.run_wall_time_us":11841,"replication_time_us":2979}]]}
W20260709 13:09:49.884970 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 59266.3us
I20260709 13:09:49.908866 21661 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45762 (request call id 245) took 11042 ms. Trace:
I20260709 13:09:49.909760 21661 rpcz_store.cc:276] 0709 13:09:38.865976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:38.866154 (+   178us) service_pool.cc:224] Handling call
0709 13:09:49.908446 (+11042292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108456,"reported_tablets":50}
I20260709 13:09:49.935089 21662 catalog_manager.cc:5697] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 8 to 9, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 9 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:49.937270 21662 catalog_manager.cc:5697] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 10 to 11, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 11 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:09:49.942919 26929 log.cc:927] Time spent T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
W20260709 13:09:49.975941 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 83197.7us
W20260709 13:09:50.002072 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 148051us
W20260709 13:09:50.027940 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 137184us
I20260709 13:09:50.060712 21911 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:09:50.062707 26616 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:50.089846 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:50.116544 21833 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:09:50.135020 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 66821.1us
I20260709 13:09:50.167694 26729 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:50.183331 21662 catalog_manager.cc:5697] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 13 to 16, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 16 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:50.186745 21662 catalog_manager.cc:5697] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 12 to 15, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 15 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:50.188712 21662 catalog_manager.cc:5697] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:50.213778 21662 catalog_manager.cc:5697] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 14 to 15, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 15 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:50.216542 21662 catalog_manager.cc:5697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 6 to 8, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 8 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:50.219411 21662 catalog_manager.cc:5697] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 12 to 14, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 14 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:09:50.350965 21661 catalog_manager.cc:5697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 12 to 13, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 13 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.602474 21910 consensus_queue.cc:237] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:50.642270 22485 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:50.643980 26924 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:50.677726 21837 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:09:50.679795 26924 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:50.755168 26923 raft_consensus.cc:2955] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:50.766078 22485 raft_consensus.cc:2955] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:50.792237 21837 raft_consensus.cc:2955] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:50.806135 21662 catalog_manager.cc:5697] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 9 to 10, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New cstate: current_term: 13 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:09:50.808498 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d76fbf464db84dbeb90facb1538a9ca1 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:50.913504 21749 tablet_service.cc:1558] Processing DeleteTablet for tablet d76fbf464db84dbeb90facb1538a9ca1 with delete_type TABLET_DATA_TOMBSTONED (TS 3843e9b794a245dd8608e04ec7915239 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:48338
I20260709 13:09:50.932086 26958 tablet_replica.cc:333] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:09:50.940060 26958 raft_consensus.cc:2243] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:50.949245 26958 raft_consensus.cc:2272] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:50.954276 26958 ts_tablet_manager.cc:1916] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:51.116979 26958 ts_tablet_manager.cc:1929] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.9
I20260709 13:09:51.117547 26958 log.cc:1199] T d76fbf464db84dbeb90facb1538a9ca1 P 3843e9b794a245dd8608e04ec7915239: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-0-root/wals/d76fbf464db84dbeb90facb1538a9ca1
I20260709 13:09:51.119666 21649 catalog_manager.cc:5028] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): tablet d76fbf464db84dbeb90facb1538a9ca1 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:09:52.218803 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:52.229188 26967 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:52.230120 26967 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:52.233168 26967 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:52.320664 26976 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:09:52.321296 22449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.002s	sys 0.011s
I20260709 13:09:52.321246 26976 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:52.321862 22449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.002s	sys 0.011s
I20260709 13:09:52.323662 26976 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:52.330018 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:52.349933 26971 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:52.350579 26971 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:52.352840 26971 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:52.353343 22450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.006s	sys 0.015s
W20260709 13:09:52.353752 22450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.007s	sys 0.015s
I20260709 13:09:52.354429 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:52.362353 26971 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:52.364717 26971 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:52.368945 21879 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.006s	sys 0.009s
W20260709 13:09:52.369315 21879 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.006s	sys 0.010s
I20260709 13:09:52.371528 26934 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:52.371701 26935 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:52.372074 26934 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:52.372362 26935 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:52.374603 26934 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:52.374709 26935 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:52.375109 26934 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:52.375555 26939 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:52.375629 26934 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:52.376245 26939 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:52.378010 26934 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:52.378491 26939 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:52.376688 21880 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.009s	sys 0.004s
W20260709 13:09:52.379115 21880 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.009s	sys 0.005s
W20260709 13:09:52.379421 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 608144us
I20260709 13:09:52.382891 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:52.388108 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:52.394068 21877 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.005s	sys 0.001s
W20260709 13:09:52.394443 21877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.006s	sys 0.001s
I20260709 13:09:52.398523 26973 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:52.399101 26973 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:52.403679 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:52.405577 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:52.406220 21908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:09:52.406780 21908 raft_consensus.cc:606] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:52.411535 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:52.415092 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:52.417841 26971 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:52.420686 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:52.401242 26973 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:52.421101 26933 raft_consensus.cc:993] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:09:52.421599 26933 raft_consensus.cc:1081] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:09:52.421589 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:52.427553 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:52.432509 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:52.433182 21760 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:09:52.437755 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:52.443866 21878 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.004s	sys 0.008s
I20260709 13:09:52.477187 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:52.481922 21877 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:52.489621 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:52.491927 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:52.496788 26966 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:09:52.499351 21805 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:52.500212 26973 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:52.500643 26973 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:52.501019 26973 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:52.504573 21728 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:52.505848 26971 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:52.508602 21728 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:52.519503 21837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38352
I20260709 13:09:52.520162 21837 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:52.509403 26971 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:52.520524 21837 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:52.519450 26973 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:52.525918 21879 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:52.526686 26934 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:52.532788 21837 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:52.534036 21834 raft_consensus.cc:1240] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 13. Current term is 14. Ops: []
I20260709 13:09:52.538426 21837 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:52.540520 26973 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:52.547195 21729 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:52.547603 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:52.548023 26935 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:52.549677 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:52.555238 21729 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:52.556041 26935 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:52.558085 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:52.558647 21756 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:52.560571 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:52.566182 21756 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:09:52.567564 21805 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:09:52.568624 26959 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:52.571235 26959 raft_consensus.cc:697] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:52.571764 21804 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:52.576076 26939 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:52.572257 26959 consensus_queue.cc:237] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:52.573019 26978 consensus_queue.cc:1059] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:52.577171 26978 raft_consensus.cc:3055] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:52.577572 26978 raft_consensus.cc:740] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:52.578423 26978 consensus_queue.cc:260] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:52.579639 26978 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:52.573473 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:52.592947 21914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:09:52.593618 21914 raft_consensus.cc:606] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:52.595554 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:52.597409 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:52.596860 21804 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:52.604061 26939 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:09:52.604976 21911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:09:52.605671 21911 raft_consensus.cc:606] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:09:52.606931 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:52.608659 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:52.620239 21914 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:09:52.627435 21804 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:52.628381 26939 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:09:52.637382 21663 catalog_manager.cc:5697] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 13 to 14, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 14 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.810122 26978 raft_consensus.cc:993] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:09:52.811609 26965 raft_consensus.cc:1081] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:09:52.814648 21765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:09:52.815186 21765 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:52.815495 21765 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:52.823493 21765 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:52.828115 21765 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:52.835175 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:52.835743 22485 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:52.838478 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:52.839118 21910 raft_consensus.cc:3055] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:09:52.839396 21910 raft_consensus.cc:740] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:52.840097 21910 consensus_queue.cc:260] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:52.841181 21910 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:52.874810 22485 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:52.875583 22477 raft_consensus.cc:1240] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
W20260709 13:09:52.877526 21786 debug-util.cc:398] Leaking SignalData structure 0x7b08002cdba0 after lost signal to thread 20643
W20260709 13:09:52.878600 21786 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee000 after lost signal to thread 21697
W20260709 13:09:52.879909 21786 debug-util.cc:398] Leaking SignalData structure 0x7b08001ed020 after lost signal to thread 21789
W20260709 13:09:52.881004 21786 debug-util.cc:398] Leaking SignalData structure 0x7b08000b0980 after lost signal to thread 21864
W20260709 13:09:52.882525 21786 debug-util.cc:398] Leaking SignalData structure 0x7b08003728c0 after lost signal to thread 21938
W20260709 13:09:52.883850 21786 debug-util.cc:398] Leaking SignalData structure 0x7b08003937a0 after lost signal to thread 22509
I20260709 13:09:52.896206 21731 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:52.896322 21911 consensus_queue.cc:237] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:52.897459 26971 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:09:52.898742 26971 raft_consensus.cc:697] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:52.899639 26971 consensus_queue.cc:237] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:52.905825 26978 raft_consensus.cc:993] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:09:52.906378 26978 raft_consensus.cc:1081] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:09:52.908555 21837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38352
I20260709 13:09:52.909065 21837 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:52.909459 21837 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:52.933085 21910 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:09:52.941182 21663 catalog_manager.cc:5697] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 10 to 11, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 11 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.956485 21834 raft_consensus.cc:1240] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:52.963308 26965 consensus_queue.cc:1059] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:52.964529 26965 raft_consensus.cc:3055] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:09:52.964883 26965 raft_consensus.cc:740] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:52.974120 21837 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:52.982751 21837 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:52.973703 26965 consensus_queue.cc:260] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:52.993342 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:52.994331 22485 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:53.006376 22485 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:09:53.009292 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:53.010049 21911 raft_consensus.cc:3055] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:09:53.009375 21806 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:53.010399 21911 raft_consensus.cc:740] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:53.006762 26965 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:09:52.984494 26966 consensus_queue.cc:1175] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "3843e9b794a245dd8608e04ec7915239" responder_term: 12 status { last_received { term: 12 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 12 index: 8 } }
I20260709 13:09:53.012904 21911 consensus_queue.cc:260] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:53.012439 26937 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:09:53.022040 26937 raft_consensus.cc:697] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:53.022954 26937 consensus_queue.cc:237] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:53.028542 21911 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:09:53.032815 21880 consensus_peers.cc:597] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 773a4e5c42d942629a59d30efb0870f6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.039768 21837 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:53.041642 26992 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:53.055383 21911 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:09:53.060673 21765 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:09:53.069811 21663 catalog_manager.cc:5697] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 13 to 14, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 14 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.084808 26990 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:09:53.123751 26965 raft_consensus.cc:2955] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:09:53.134903 21837 raft_consensus.cc:2955] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:09:53.139752 21759 raft_consensus.cc:2955] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:09:53.154392 21765 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:53.155856 26937 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:09:53.174845 21663 catalog_manager.cc:5697] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index -1 to 9, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 12 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.167763 21765 consensus_queue.cc:237] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:53.205312 21911 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:09:53.207175 26976 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:09:53.229691 21731 consensus_peers.cc:597] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c6406f8b01c041c58abe3add218f6b41. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.232395 21910 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:53.234033 26972 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:09:53.235937 21837 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:09:53.247627 26972 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:09:53.315428 26971 raft_consensus.cc:2955] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
W20260709 13:09:53.372659 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 88968.7us
W20260709 13:09:53.378926 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 91859.7us
I20260709 13:09:53.397703 21914 raft_consensus.cc:1275] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:53.407284 21839 raft_consensus.cc:2955] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:09:53.421551 22477 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:53.426321 22485 raft_consensus.cc:1275] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:09:53.430189 27007 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:09:53.443014 26974 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:09:53.448419 21910 raft_consensus.cc:2955] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:09:53.455444 26970 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:09:53.471990 21761 consensus_queue.cc:237] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:53.485737 21661 catalog_manager.cc:5697] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index -1 to 10, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 15 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:09:53.526257 21910 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:09:53.529980 26959 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
W20260709 13:09:53.566216 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 116136us
I20260709 13:09:53.609896 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:53.614125 21908 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:09:53.621568 26935 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:09:53.645354 21839 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:09:53.645987 21731 consensus_peers.cc:597] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5e295b8b73874adcb77878c1ca4897ea. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:53.646482 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 50546.3us
I20260709 13:09:53.652267 26971 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:09:53.676398 27022 ts_tablet_manager.cc:933] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:53.681038 26935 raft_consensus.cc:2955] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:09:53.689886 27022 tablet_copy_client.cc:323] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:09:53.692037 21923 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet 773a4e5c42d942629a59d30efb0870f6 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:09:53.692883 21923 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet 773a4e5c42d942629a59d30efb0870f6 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-773a4e5c42d942629a59d30efb0870f6
I20260709 13:09:53.689359 21839 raft_consensus.cc:2955] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:09:53.776867 21923 tablet_copy_source_session.cc:215] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:53.780709 27021 ts_tablet_manager.cc:933] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645)
I20260709 13:09:53.788574 27022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 773a4e5c42d942629a59d30efb0870f6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:53.825937 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 66387.1us
I20260709 13:09:53.838548 27021 tablet_copy_client.cc:323] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.1:46645
I20260709 13:09:53.885399 21661 catalog_manager.cc:5697] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index -1 to 8, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 13 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:09:53.907670 21837 consensus_queue.cc:237] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:09:53.919855 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 100006us
I20260709 13:09:53.926934 21774 tablet_copy_service.cc:140] P 3843e9b794a245dd8608e04ec7915239: Received BeginTabletCopySession request for tablet c6406f8b01c041c58abe3add218f6b41 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:44772)
I20260709 13:09:53.927538 21774 tablet_copy_service.cc:161] P 3843e9b794a245dd8608e04ec7915239: Beginning new tablet copy session on tablet c6406f8b01c041c58abe3add218f6b41 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:44772: session id = 8c6c2207af3d47b3acf352d81959f4dd-c6406f8b01c041c58abe3add218f6b41
I20260709 13:09:53.938786 21774 tablet_copy_source_session.cc:215] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:53.946594 27022 tablet_copy_client.cc:806] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:53.947281 27022 tablet_copy_client.cc:670] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
W20260709 13:09:54.869213 27019 log.cc:927] Time spent T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.221s	user 0.000s	sys 0.000s
I20260709 13:09:55.045889 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:09:55.441092 22448 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.005s	sys 0.006s
W20260709 13:09:55.452560 22448 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.940s	user 0.006s	sys 0.006s
W20260709 13:09:55.634526 22449 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.123s	user 0.009s	sys 0.005s
W20260709 13:09:55.635208 22449 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.010s	sys 0.005s
W20260709 13:09:55.671969 21879 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.005s	sys 0.009s
W20260709 13:09:55.672622 21879 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.006s	sys 0.009s
W20260709 13:09:55.760334 22450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.175s	user 0.009s	sys 0.017s
W20260709 13:09:55.817047 22450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.241s	user 0.010s	sys 0.017s
W20260709 13:09:55.818403 21880 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.059s	user 0.018s	sys 0.008s
W20260709 13:09:55.824638 21878 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.065s	user 0.012s	sys 0.013s
W20260709 13:09:55.844210 21878 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.084s	user 0.012s	sys 0.013s
W20260709 13:09:55.842686 21880 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.083s	user 0.018s	sys 0.008s
W20260709 13:09:55.824692 21877 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.064s	user 0.007s	sys 0.019s
W20260709 13:09:55.849961 21877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.090s	user 0.008s	sys 0.019s
I20260709 13:09:55.855930 27039 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:55.856590 27039 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:55.863627 27046 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:55.864233 27046 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:55.867733 27040 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:55.868094 27041 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:55.868319 27040 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:55.868847 27041 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:55.884938 27038 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:55.885542 27038 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:55.888216 27038 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:55.888855 27038 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:55.890709 27048 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:55.891439 27048 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:55.899855 27053 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:55.904093 27052 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:55.909528 22451 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.064s	user 0.009s	sys 0.017s
W20260709 13:09:55.909915 22451 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.150s	user 0.009s	sys 0.017s
I20260709 13:09:55.897532 27038 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:55.920392 27038 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:55.905555 27043 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:09:55.931192 21728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.097s	user 0.012s	sys 0.002s
W20260709 13:09:55.932416 21728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.099s	user 0.013s	sys 0.003s
W20260709 13:09:55.932825 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 2.09915e+06us
I20260709 13:09:55.927690 27043 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:55.958335 27056 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:55.958963 27056 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:55.961079 27056 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:55.913679 27053 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:55.963411 27053 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:55.963371 27054 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:55.964208 27053 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:55.964315 27054 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:55.913513 27052 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:55.964828 27053 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:55.985343 27058 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:55.986570 27061 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:55.986171 27058 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:55.987277 27061 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:55.989223 27058 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:55.989976 27061 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:55.957331 27043 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:55.980921 27056 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:55.996387 27057 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:55.981539 27050 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:55.995288 27039 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:55.995877 27046 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:55.994789 27048 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:55.991665 27041 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:56.008419 27054 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:56.008450 27053 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:56.014225 27064 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:56.017400 27048 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:56.017499 27060 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:56.018136 27038 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:56.018510 27055 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:56.018827 27041 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:56.019466 27040 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:56.020210 27051 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:56.005555 27050 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:56.114693 27050 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:56.116974 27046 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:56.117694 27046 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:56.074174 27038 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:56.122767 27038 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:56.124325 27043 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:56.125048 27043 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:56.127895 27043 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:56.073299 27039 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:56.130910 27039 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:56.134039 27041 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:56.136745 27041 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:56.137388 27055 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:56.140450 27055 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:56.141191 27051 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:56.144240 27051 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:56.083778 27060 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:56.158339 27053 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:56.159194 27040 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:56.159066 27053 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:56.160007 27040 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:56.161603 27054 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:56.162292 27054 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:56.173818 27063 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:56.174602 27063 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:56.164108 27046 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:56.190676 27064 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:56.194260 27064 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:56.004786 27056 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:56.026031 27062 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:56.219235 27062 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:56.027494 27048 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:56.220713 27056 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:56.222779 27048 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:56.111817 27069 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:56.196329 27039 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:56.149351 27060 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:56.208205 27053 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:56.218384 27052 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:56.021795 21803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.956s	user 0.014s	sys 0.015s
I20260709 13:09:56.027144 27057 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:56.409075 27040 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:56.412173 21803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.347s	user 0.015s	sys 0.016s
I20260709 13:09:56.418879 27039 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:56.419626 27039 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:56.421980 27070 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:56.422731 27070 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:56.428730 27039 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:56.437875 27062 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:56.439858 27065 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:56.440670 27065 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:56.444415 27070 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:56.456362 27070 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:56.456741 27054 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:56.457079 27070 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:56.458811 27063 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:56.433101 27039 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:56.460191 27039 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:56.414324 27069 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:56.463691 27069 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:56.464003 27039 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:56.477622 27053 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:56.478437 27053 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:56.481117 27053 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:56.460659 27070 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:56.499395 27062 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:56.500541 27068 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:56.500247 27062 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:56.501179 27071 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:56.501238 27068 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:56.499426 27061 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:56.501952 27071 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:56.502420 27061 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:56.503769 27068 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:56.504487 27071 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:56.500380 27063 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:56.505330 27063 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:56.506098 27061 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:56.507741 27063 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:56.511286 27052 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:56.512272 27054 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:56.513243 27073 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:56.514118 27053 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:56.525627 27060 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:56.540675 27073 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:56.543969 27052 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:56.527772 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:56.409399 27057 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:09:56.525836 21879 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.041s	sys 0.037s
W20260709 13:09:56.794688 21879 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.126s	sys 0.160s
I20260709 13:09:56.794989 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:56.795320 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:56.795876 21910 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
I20260709 13:09:56.595788 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:56.797341 22484 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:09:56.560761 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:56.798697 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:56.704934 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:56.528293 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:56.517652 27040 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:56.517412 27062 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:56.817893 21910 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:09:56.819857 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:57.407240 22482 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:57.407686 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:57.398739 21728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.881s	user 0.008s	sys 0.028s
W20260709 13:09:57.408897 21728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.008s	sys 0.028s
I20260709 13:09:56.990288 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:57.411723 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:57.412984 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:56.903466 27076 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:57.478962 27076 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:56.820422 27066 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:57.488845 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:57.490489 22485 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 17.
I20260709 13:09:56.887362 27062 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:56.824219 27072 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:56.805632 27065 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:57.640188 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:56.808990 27060 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:56.807474 27053 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:56.821802 27040 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:57.655332 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:57.633742 27072 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:57.664574 27072 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:57.656167 22485 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:56.557415 27054 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:57.634290 27079 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:57.692682 21880 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.026s	sys 0.080s
W20260709 13:09:57.693152 21880 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.027s	sys 0.080s
W20260709 13:09:57.693555 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 896420us
I20260709 13:09:57.694036 21913 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:09:57.695093 21880 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:57.695806 27022 tablet_copy_client.cc:538] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:57.696053 27085 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:57.696743 27085 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:57.698622 27079 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:57.643254 27066 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:57.636441 27062 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:57.688654 27076 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:57.702100 22448 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.543s (SENT) [suppressed 2 similar messages]
I20260709 13:09:57.703476 27081 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:09:57.714773 27054 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:57.703842 27060 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:57.715685 27053 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:57.713199 27062 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:57.705238 27040 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:57.744746 27081 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:57.746333 27081 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:57.721930 27073 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:09:57.708065 27079 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:57.710633 27066 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:57.752620 27085 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:57.780128 21803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.195s	user 0.005s	sys 0.022s
W20260709 13:09:57.780449 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 83200.8us
W20260709 13:09:57.782913 21803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.198s	user 0.006s	sys 0.023s
I20260709 13:09:57.782716 21880 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:57.785837 21880 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:57.787818 21880 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:57.702244 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:57.719496 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:57.794344 21908 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 17.
I20260709 13:09:57.713397 21911 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
W20260709 13:09:57.800454 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 82529.6us
I20260709 13:09:57.802829 27066 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:57.803032 22449 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:57.803973 27066 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:57.804774 27066 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:57.806488 27073 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:57.807188 27073 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:57.807796 27073 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:57.810534 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:57.809984 27081 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:57.811559 22482 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:57.812500 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:57.827785 27022 tablet_bootstrap.cc:492] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:09:57.828383 27091 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:57.828909 27091 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:57.829319 27091 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:57.836318 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:57.836920 27085 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:09:57.837394 27085 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:57.837953 27085 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:57.837334 22476 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:57.852337 27085 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:57.857764 27085 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:57.859375 21880 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:57.860479 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:57.862082 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:57.862890 22484 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:09:57.864434 27090 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:57.864938 27090 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:57.865378 27090 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:09:57.895948 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 90810us
I20260709 13:09:57.897455 27081 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:57.977526 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:57.978072 21661 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52326 (request call id 166) took 1962 ms. Trace:
I20260709 13:09:57.978425 22476 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:57.978523 21661 rpcz_store.cc:276] 0709 13:09:55.944577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.894711 (+1950134us) service_pool.cc:224] Handling call
0709 13:09:57.906394 (+ 11683us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":0}
I20260709 13:09:57.979171 22484 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:57.983942 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:57.976390 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 73222.5us
I20260709 13:09:57.984663 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:57.985646 21907 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:09:57.984817 21906 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:09:57.985096 22449 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:57.991657 21880 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:57.999037 27062 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:09:58.000218 27062 raft_consensus.cc:697] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:57.989116 21908 raft_consensus.cc:2955] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
W20260709 13:09:58.262802 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 277910us
I20260709 13:09:58.000391 27073 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:58.013043 27062 consensus_queue.cc:237] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:58.386476 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 295627us
I20260709 13:09:58.389755 22476 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
W20260709 13:09:58.390913 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 86200.2us
I20260709 13:09:58.391036 27095 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:09:58.391777 27095 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:58.392241 27095 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:09:58.393571 27092 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:58.394443 27092 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:58.400880 27086 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:58.401842 27086 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:58.404412 27086 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:58.418462 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:58.419483 21907 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:58.420434 27021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6406f8b01c041c58abe3add218f6b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:58.415182 27092 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:58.425164 27066 consensus_meta.cc:287] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.613s	user 0.012s	sys 0.000s
I20260709 13:09:58.457393 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:58.472672 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:58.460582 27092 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:58.452381 27066 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:58.494944 21906 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:09:58.497479 27092 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:58.500319 27092 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:58.505339 27102 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:58.505944 27100 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:58.506529 27102 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:58.506922 27100 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:58.508551 27095 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:58.463382 27086 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:58.510471 27086 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:58.512565 27079 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:58.513523 27079 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:58.514900 21805 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.481s	user 0.038s	sys 0.051s
W20260709 13:09:58.485271 27090 consensus_meta.cc:287] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.619s	user 0.007s	sys 0.006s
I20260709 13:09:58.475852 27094 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:58.524523 27098 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:58.525622 27100 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:58.527035 27073 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:58.528427 27101 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:58.528787 27102 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:58.529372 27101 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:58.532318 27101 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:58.524523 27094 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:09:58.546566 27091 consensus_meta.cc:287] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.717s	user 0.013s	sys 0.000s
I20260709 13:09:58.547019 27091 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:09:58.584656 21805 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.551s	user 0.039s	sys 0.052s
I20260709 13:09:58.554392 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:09:58.555114 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 58848.7us
W20260709 13:09:58.559441 21837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 4.637s	user 0.033s	sys 0.038s
W20260709 13:09:58.679260 21913 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45202 (request call id 1193) took 1884 ms (client timeout 1813 ms). Trace:
I20260709 13:09:58.714067 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:58.604856 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:58.523361 27095 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 18 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:58.730027 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:58.732908 21912 raft_consensus.cc:2393] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 15: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:09:58.733716 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 229143us
I20260709 13:09:58.733855 21880 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:58.622447 27100 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:58.734599 22483 raft_consensus.cc:1240] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12. Ops: []
W20260709 13:09:58.726456 21913 rpcz_store.cc:269] 0709 13:09:56.794652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.794764 (+   112us) service_pool.cc:224] Handling call
0709 13:09:58.678835 (+1884071us) spinlock_profiling.cc:243] Waited 898 ms on lock 0x7b5400033c54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:58.679017 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2065924992}
I20260709 13:09:58.617615 27096 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:58.558187 27066 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:58.600510 26974 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:58.621536 27104 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:09:58.742288 21837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.820s	user 0.039s	sys 0.045s
I20260709 13:09:58.617206 27099 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:58.722795 27086 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:58.606061 27092 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:58.547849 27090 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:58.617376 27102 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:58.534125 27098 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:58.758827 27111 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:58.749938 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:58.755709 27109 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:09:58.757248 27102 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:58.761399 22485 raft_consensus.cc:2393] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 18: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:09:58.753949 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:58.768015 27115 ts_tablet_manager.cc:933] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645)
I20260709 13:09:58.769311 21909 raft_consensus.cc:2393] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 18: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:58.776319 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:09:58.776432 27099 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:58.805629 21913 raft_consensus.cc:2393] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 12: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:58.777622 27104 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:58.764820 27109 raft_consensus.cc:697] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 15 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:09:58.807327 27109 consensus_queue.cc:237] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:58.807909 27104 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:58.779371 27094 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:58.781272 26974 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:58.783201 27090 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:58.786620 27096 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:58.811240 26974 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:58.811637 27096 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:58.788693 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:09:58.759696 27098 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:58.794406 27092 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:58.795361 27100 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:58.796862 21914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 1197) took 1975 ms. Trace:
I20260709 13:09:58.798065 27102 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:58.762166 27091 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:58.800990 21911 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45202 (request call id 1199) took 1911 ms (client timeout 2072 ms). Trace:
W20260709 13:09:58.814832 21911 rpcz_store.cc:269] 0709 13:09:56.889400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.889662 (+   262us) service_pool.cc:224] Handling call
0709 13:09:58.800568 (+1910906us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b5400195fd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:58.800751 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":701255424}
I20260709 13:09:58.813654 21914 rpcz_store.cc:276] 0709 13:09:56.820822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.820999 (+   177us) service_pool.cc:224] Handling call
0709 13:09:56.821239 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:57.710878 (+889639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:57.710921 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:57.710981 (+    60us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:09:57.711028 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:58.796310 (+1085282us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b540032d554. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:09:58.796399 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:58.796631 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2045470464}
I20260709 13:09:58.815234 27100 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:09:58.819324 27118 log.cc:927] Time spent T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:09:58.825749 27079 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:58.826625 27114 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:58.827494 27114 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:58.830224 27010 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:58.830875 27010 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:58.759599 27111 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:58.834843 27111 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:58.835438 27111 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:58.836037 27111 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:58.838478 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:58.820756 27021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36270 (request call id 863) took 5172 ms. Trace:
I20260709 13:09:58.839296 21911 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:09:58.839258 27021 rpcz_store.cc:276] 0709 13:09:53.648339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.649948 (+  1609us) service_pool.cc:224] Handling call
0709 13:09:53.781174 (+131226us) ts_tablet_manager.cc:934] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645)
0709 13:09:58.418421 (+4637247us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:09:58.608053 (+189632us) tablet_metadata.cc:665] Metadata flushed
0709 13:09:58.608213 (+   160us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:09:58.819768 (+211555us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:09:58.820166 (+   398us) tablet_replica.cc:206] Creating consensus instance
0709 13:09:58.820552 (+   386us) ts_tablet_manager.cc:989] Replica registered.
0709 13:09:58.820651 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":279,"tablet-copy.queue_time_us":118799,"thread_start_us":78743,"threads_started":2}
I20260709 13:09:58.827960 27099 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:58.845017 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:58.847502 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:58.848383 21911 raft_consensus.cc:2393] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 12: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:09:58.850618 27114 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:58.851312 27021 tablet_copy_client.cc:806] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:58.852128 27021 tablet_copy_client.cc:670] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:58.854473 27113 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:58.833220 27010 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:58.816731 27092 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:58.875401 26959 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:58.876058 26959 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:58.879204 27111 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:58.868978 26974 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:58.892177 26974 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:58.883358 27113 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:58.896729 27113 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:58.878268 26959 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:58.904956 27116 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:58.908430 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:58.980659 21663 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45778 (request call id 297) took 1046 ms. Trace:
I20260709 13:09:58.981129 21663 rpcz_store.cc:276] 0709 13:09:57.811020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.819327 (+  8307us) service_pool.cc:224] Handling call
0709 13:09:58.856915 (+1037588us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
W20260709 13:09:58.991189 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 90715.4us
I20260709 13:09:58.885107 27111 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:09:58.999979 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 56736.2us
I20260709 13:09:59.001680 27120 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:59.002592 27120 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:59.004688 26974 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:58.921250 27010 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:59.025601 27114 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:59.026445 27114 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:59.026806 27120 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:59.031464 27116 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:09:59.033562 21905 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49544 (request call id 2140) took 1049 ms. Trace:
I20260709 13:09:59.033679 27010 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:59.033995 21905 rpcz_store.cc:276] 0709 13:09:57.983598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:57.983814 (+   216us) service_pool.cc:224] Handling call
0709 13:09:59.032074 (+1048260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:09:59.032313 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:09:59.032338 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:09:59.032376 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:09:59.032418 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:09:59.032475 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:09:59.033256 (+   781us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000a1750. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:59.033359 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2409798016}
I20260709 13:09:59.036046 27010 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:59.032166 21910 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45202 (request call id 1195) took 2233 ms (client timeout 2216 ms). Trace:
I20260709 13:09:59.036734 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:59.036636 21910 rpcz_store.cc:269] 0709 13:09:56.798335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:56.798478 (+   143us) service_pool.cc:224] Handling call
0709 13:09:59.031803 (+2233325us) spinlock_profiling.cc:243] Waited 18.4 ms on lock 0x7b54000a1754. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:09:59.031970 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42330496}
I20260709 13:09:59.037783 27111 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:59.038605 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:59.040096 27111 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:59.028900 27114 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:59.028961 22481 raft_consensus.cc:1240] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 14. Current term is 15. Ops: []
I20260709 13:09:59.029743 27123 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:59.042697 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:09:59.040053 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 44954.2us
I20260709 13:09:59.049410 22476 raft_consensus.cc:1240] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13. Ops: []
I20260709 13:09:59.045717 27123 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:59.047857 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:59.084796 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:59.044914 27111 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:59.104595 27102 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:59.149643 27111 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:59.149869 27102 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:59.151010 27120 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:59.151669 27120 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:59.105254 27079 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:09:59.145150 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 48529.1us
W20260709 13:09:59.145865 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 49083us
I20260709 13:09:59.146625 27116 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:59.074692 27114 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:59.226655 27010 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:59.227607 27010 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:59.230522 27010 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:59.233814 27079 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:59.237725 27010 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:59.512079 27010 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:59.217717 27100 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:59.441715 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.513813 27100 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:59.514393 21839 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:09:59.237828 27098 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:59.510604 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:59.435077 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.517392 21834 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:09:59.515611 27098 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:59.243147 27114 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:09:59.218393 27022 log.cc:927] Time spent T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.069s	user 0.003s	sys 0.000s
I20260709 13:09:59.522403 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:09:59.525113 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 105538us
I20260709 13:09:59.529289 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.530037 21764 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
I20260709 13:09:59.530969 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.533061 27114 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:59.534965 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.535687 21838 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:59.535087 27010 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:59.544526 21833 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 19.
I20260709 13:09:59.546135 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.546970 21834 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:09:59.526211 27115 tablet_copy_client.cc:323] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.1:46645
I20260709 13:09:59.549696 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.550637 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.551023 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.552508 21833 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:59.551980 21756 raft_consensus.cc:2468] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:09:59.556188 27102 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:59.551257 22483 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:09:59.557399 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.560214 21840 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 16.
I20260709 13:09:59.560595 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.562294 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.562853 21831 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:59.557785 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.558177 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.558727 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.563764 21833 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:09:59.574676 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.574179 27079 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:59.579396 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.580489 21764 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
I20260709 13:09:59.581418 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.574615 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.582125 21764 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 7.
I20260709 13:09:59.584352 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.585894 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.586192 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.586892 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.586870 21838 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:59.588555 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.589778 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.586359 27120 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:59.591653 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:59.594008 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.595306 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.594305 21756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:32926
I20260709 13:09:59.602871 21756 raft_consensus.cc:606] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:09:59.595367 21834 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:59.598872 27098 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:59.601402 27100 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:59.606578 27075 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:59.612967 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.613354 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.613667 21833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:09:59.614853 21833 raft_consensus.cc:606] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:09:59.615054 27075 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:59.617954 27111 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:59.620055 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.620843 27075 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:59.621420 27075 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:09:59.622008 27075 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:59.624045 27075 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:59.625806 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:59.616588 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.615880 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.615870 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.643118 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.645368 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.648619 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.648933 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.649282 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.650208 27075 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:09:59.650352 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.651369 21757 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:09:59.650223 27123 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:59.653090 27128 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:59.653823 27128 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:59.654261 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.654940 21757 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:59.655076 21759 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:59.655834 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.655925 27128 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:59.655995 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.657008 21838 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:59.653213 27075 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:59.657639 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.651262 21834 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:59.658352 21836 raft_consensus.cc:2468] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:59.659601 27075 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:59.660786 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.661091 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.661455 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.661722 21838 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:59.659792 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.665064 21836 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:59.660249 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.667217 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.664063 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.663066 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.662007 21760 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
I20260709 13:09:59.669730 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.673242 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.674273 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.674890 21760 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:59.675673 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.663398 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.705927 21757 raft_consensus.cc:2468] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 6.
I20260709 13:09:59.708278 21760 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:09:59.667660 27075 raft_consensus.cc:993] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:09:59.665771 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:59.709775 21759 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 16.
I20260709 13:09:59.811859 21756 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:09:59.668301 21764 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:59.846730 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:59.846156 27075 raft_consensus.cc:1081] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:09:59.849406 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.850512 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.851384 21760 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 9.
I20260709 13:09:59.852586 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:09:59.854875 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.855551 21761 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:09:59.859226 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.859778 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.860422 21760 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:59.860872 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.861199 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:59.861464 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.861982 21764 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:09:59.859303 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.862947 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.858428 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.869167 27052 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:09:59.870443 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 219476us
I20260709 13:09:59.873800 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.874593 21662 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45746 (request call id 242) took 2007 ms. Trace:
I20260709 13:09:59.875002 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.874946 21662 rpcz_store.cc:276] 0709 13:09:57.867141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.000508 (+133367us) service_pool.cc:224] Handling call
0709 13:09:59.874417 (+1873909us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":181927,"reported_tablets":2}
I20260709 13:09:59.875551 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.876133 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.876720 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.876852 21836 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:09:59.877345 21833 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 7.
I20260709 13:09:59.877825 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.878451 21838 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:59.878609 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.879405 21835 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:59.881502 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:59.882352 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.882766 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.883018 21835 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:59.884294 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.884895 21836 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:59.886124 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.884794 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.886451 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.886857 21833 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:59.887123 21831 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:09:59.887681 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.888232 21834 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:09:59.889150 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.889317 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.889843 21765 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:09:59.889151 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:09:59.891695 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.891772 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.892526 21765 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:59.899641 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.895116 21729 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:59.900358 21834 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:09:59.901304 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.903900 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.904572 21833 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:09:59.905561 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.908793 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.909341 21839 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:09:59.908627 21729 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:59.911608 27100 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:59.911736 21729 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:59.912030 27100 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:59.912457 27100 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:59.912776 21729 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:09:59.908322 27111 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:09:59.915354 27111 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:59.917811 27079 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:59.918458 27079 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:59.918927 27079 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:59.919955 27096 raft_consensus.cc:993] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239: : Instructing follower 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:09:59.920392 27096 raft_consensus.cc:1081] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Signalling peer 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:09:59.917847 27120 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:09:59.916002 27111 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:09:59.917755 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:59.925940 27120 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:59.926637 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.926646 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:59.926793 21839 raft_consensus.cc:3055] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:09:59.930222 21839 raft_consensus.cc:740] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:09:59.926285 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.933212 21831 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 19.
I20260709 13:09:59.933879 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:59.929123 27120 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:09:59.935621 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:59.941295 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:59.943223 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:59.943565 21839 consensus_queue.cc:260] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:59.944679 21839 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:09:59.945771 27100 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:59.948421 27079 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:59.950912 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:59.953472 21731 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:09:59.954646 27098 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:59.957772 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:09:59.960006 27111 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:09:59.962399 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.962920 27111 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:59.948043 27100 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:59.968189 26976 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:09:59.968833 26976 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:09:59.970196 22450 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:59.971716 27097 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:09:59.972199 26976 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:09:59.972262 27097 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:59.973069 27097 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:09:59.973318 22450 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:09:59.974368 27083 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:09:59.974797 27083 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:09:59.975205 27083 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:09:59.975247 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:09:59.984048 27111 consensus_queue.cc:1059] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:09:59.985496 21909 raft_consensus.cc:1240] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12. Ops: []
I20260709 13:09:59.986830 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:09:59.988054 27079 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:09:59.990192 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:09:59.998764 27111 raft_consensus.cc:3055] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:09:59.999363 27111 raft_consensus.cc:740] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:09:59.999575 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.000252 21907 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:10:00.000413 27111 consensus_queue.cc:260] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:00.001101 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.002342 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.003520 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.004177 21909 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 16.
I20260709 13:10:00.006470 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.009174 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.011053 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.011447 27120 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:00.013700 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.015300 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.016048 21911 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:10:00.016379 27120 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:00.017099 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.022542 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:10:00.023550 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.024485 27111 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:00.032403 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:00.023273 21909 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:10:00.035848 27075 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:00.038137 27075 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:00.040407 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.041797 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.043004 21910 raft_consensus.cc:1240] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:00.043828 27075 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:00.043905 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.044184 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.043836 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.047125 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.047732 21837 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 16.
I20260709 13:10:00.048481 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.050154 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.052291 27021 tablet_copy_client.cc:538] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:00.055636 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:00.055871 27075 consensus_queue.cc:1059] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:00.056980 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:00.057118 27101 raft_consensus.cc:3055] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:00.057533 27101 raft_consensus.cc:740] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:00.057742 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:00.058444 27101 consensus_queue.cc:260] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:00.059571 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:00.060755 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.061305 21911 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:10:00.067487 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.068174 21913 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
I20260709 13:10:00.071812 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.074057 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:00.075412 21907 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:00.075608 22484 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:00.077291 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:10:00.081367 21806 consensus_peers.cc:597] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d28f4c429d54450dbbeb1ac9f6b7cd55. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:00.081964 27083 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:00.082715 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.084095 27083 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:00.084888 21914 raft_consensus.cc:1240] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 15 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:00.088728 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.089594 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.089960 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.091079 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.092199 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.092814 21759 raft_consensus.cc:1240] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:00.094280 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 74629.5us
I20260709 13:10:00.095249 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.095849 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.096093 22450 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:00.093910 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.097142 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.097977 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.098714 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.091295 27128 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:00.099977 27128 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:00.095758 21763 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:10:00.095418 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.099301 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.102588 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.098744 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.104516 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.105122 21907 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:10:00.105688 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.105979 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.106312 21910 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 15.
I20260709 13:10:00.106580 21909 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:10:00.108014 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.108585 27083 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:00.102118 21765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59108
I20260709 13:10:00.109225 21765 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.095202 27022 tablet_bootstrap.cc:492] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:00.109382 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.094373 27116 consensus_queue.cc:1059] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
I20260709 13:10:00.099295 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.110395 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.110643 27022 tablet_bootstrap.cc:492] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:10:00.108598 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.111490 27022 ts_tablet_manager.cc:1403] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 2.360s	user 0.043s	sys 0.026s
I20260709 13:10:00.111824 21908 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
W20260709 13:10:00.109395 22448 leader_election.cc:336] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.543s (SENT)
I20260709 13:10:00.112373 21913 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 14.
I20260709 13:10:00.114549 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.114758 21759 raft_consensus.cc:1240] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:00.115892 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.118710 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.118927 27124 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:00.119546 27124 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:00.120162 27128 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:00.123926 27124 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:00.123848 27097 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:00.109679 21765 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:00.128329 22479 raft_consensus.cc:2393] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 12: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:10:00.124604 27116 raft_consensus.cc:3055] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:00.130944 27116 raft_consensus.cc:740] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:00.131870 27116 consensus_queue.cc:260] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:00.133042 22484 raft_consensus.cc:1240] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:00.133931 27116 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:00.136106 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.136152 27097 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:00.140554 27021 tablet_bootstrap.cc:492] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:10:00.145798 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.147212 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.147424 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:00.148522 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.148906 21774 tablet_copy_service.cc:140] P 3843e9b794a245dd8608e04ec7915239: Received BeginTabletCopySession request for tablet 5e295b8b73874adcb77878c1ca4897ea from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:44772)
W20260709 13:10:00.149542 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.149624 21774 tablet_copy_service.cc:161] P 3843e9b794a245dd8608e04ec7915239: Beginning new tablet copy session on tablet 5e295b8b73874adcb77878c1ca4897ea from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:44772: session id = 8c6c2207af3d47b3acf352d81959f4dd-5e295b8b73874adcb77878c1ca4897ea
I20260709 13:10:00.150893 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.152092 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.153244 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.153579 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.154219 21838 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:10:00.154973 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.157879 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.159997 27022 raft_consensus.cc:359] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:00.160871 27022 raft_consensus.cc:740] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:10:00.161262 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:00.162225 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:00.163851 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:00.163866 27075 consensus_queue.cc:1059] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:00.166018 27075 raft_consensus.cc:3055] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:00.167171 27075 raft_consensus.cc:740] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:00.168078 27075 consensus_queue.cc:260] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:00.127702 27101 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:00.169320 27075 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:00.172192 21774 tablet_copy_source_session.cc:215] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:00.173770 21908 raft_consensus.cc:1275] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:00.165829 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.181773 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.183092 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.184398 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.187882 21765 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:00.188870 21879 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:00.190114 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.190074 27072 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:00.190804 21910 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:10:00.191514 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.192122 21764 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 13. Current term is 15. Ops: []
I20260709 13:10:00.192108 21879 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:00.192670 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.193650 27072 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:00.193512 21879 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:00.194260 27072 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:00.194681 27063 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:00.194764 27072 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:00.196044 21879 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:00.196805 27063 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:00.197183 27063 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:00.197569 27063 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:00.193421 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.188573 21662 catalog_manager.cc:5697] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 12 to 13, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 13 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.205664 21765 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:00.206861 21662 catalog_manager.cc:5697] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 14 to 15, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 15 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.208112 27063 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:00.194948 27022 consensus_queue.cc:260] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:00.222187 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.223038 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.223829 21838 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 16.
I20260709 13:10:00.225360 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.226652 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.228269 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.228844 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.228974 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.230361 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.232230 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.232828 21834 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:10:00.246708 21877 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:00.247741 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.249153 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.247291 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.250173 27109 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:00.250934 27109 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:00.251006 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.251391 27109 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:00.251780 21839 raft_consensus.cc:2468] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
W20260709 13:10:00.255820 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 56296us
I20260709 13:10:00.256531 21880 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:00.257252 27052 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:00.257551 27022 ts_tablet_manager.cc:1434] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.146s	user 0.007s	sys 0.002s
I20260709 13:10:00.259711 21923 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-773a4e5c42d942629a59d30efb0870f6 received from {username='slave'} at 127.0.0.1:45202
I20260709 13:10:00.260246 21923 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-773a4e5c42d942629a59d30efb0870f6 on tablet 773a4e5c42d942629a59d30efb0870f6 with peer 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:10:00.262197 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.264150 21880 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:00.269791 27052 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:00.261197 27072 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:00.272105 21805 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:00.273005 27101 consensus_queue.cc:1059] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:00.273461 27075 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:00.274108 27075 raft_consensus.cc:3055] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:00.274448 27075 raft_consensus.cc:740] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:00.275468 27075 consensus_queue.cc:260] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:00.276106 27022 ts_tablet_manager.cc:933] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:00.276674 27075 raft_consensus.cc:3060] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:00.277418 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.278988 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.279883 21805 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:00.281958 22450 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:00.282379 27116 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:00.283401 27097 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:00.266140 27063 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:00.284205 21805 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:00.286455 21805 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:00.294626 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.298131 21805 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:00.284588 27131 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:00.293102 22450 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:00.283939 27097 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:00.304123 26976 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:00.304009 27125 consensus_queue.cc:1059] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:10:00.291688 27124 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:00.306694 27124 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.307103 27124 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:00.303936 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.309959 27109 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:00.310376 22484 raft_consensus.cc:1240] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:00.311581 22450 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:00.312218 27109 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:00.312405 27047 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:00.312332 27129 consensus_queue.cc:1059] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:00.313004 21729 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:00.313596 27129 raft_consensus.cc:3055] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:00.313681 27131 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:00.313983 26976 consensus_queue.cc:1059] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:00.314965 27116 raft_consensus.cc:3055] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:00.315161 27100 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:00.315331 27116 raft_consensus.cc:740] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:00.316277 27116 consensus_queue.cc:260] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:00.317171 27116 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:00.317297 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.319888 21729 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:00.320606 27100 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:00.320987 27100 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:00.321480 27100 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:00.316269 27097 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:00.321743 27072 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:00.292140 27101 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:00.313994 27129 raft_consensus.cc:740] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:00.323194 27129 consensus_queue.cc:260] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:00.325273 27129 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:00.324301 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 57314.2us
I20260709 13:10:00.310305 27125 raft_consensus.cc:3055] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:00.327402 27125 raft_consensus.cc:740] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:00.327538 27115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e295b8b73874adcb77878c1ca4897ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:00.326893 27097 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:00.328840 27097 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:00.330639 22448 leader_election.cc:336] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.525s (SENT)
I20260709 13:10:00.332537 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:00.333129 21907 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:00.335762 21910 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:49544
I20260709 13:10:00.337903 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.338132 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:10:00.339100 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.340312 21906 raft_consensus.cc:1240] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:00.329787 27125 consensus_queue.cc:260] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:00.341969 21910 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.342348 21910 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:00.342548 27125 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:00.345950 21877 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:00.346829 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:00.347421 21912 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:00.347792 21877 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:00.347895 21907 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:10:00.348615 27132 raft_consensus.cc:2804] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:00.348908 21877 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:00.349056 27132 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:00.320971 27047 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:00.349874 27132 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:00.350205 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:00.347007 27072 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:00.351908 27072 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:00.353399 27072 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:00.355290 27109 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:00.354955 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:00.355602 27022 tablet_copy_client.cc:323] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.2:34765
I20260709 13:10:00.361032 21912 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 14.
I20260709 13:10:00.361311 21729 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:00.362144 27111 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:00.353708 27097 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:00.363194 21729 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:00.364032 21910 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:00.366009 21910 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:00.366393 27111 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:00.366976 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:00.367267 21729 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:00.367592 22482 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:00.366828 27111 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:00.372830 27111 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:00.374017 27079 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:00.375166 27109 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:00.375597 27109 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:00.375947 27109 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:00.379442 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:00.381778 22448 leader_election.cc:336] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.528s (SENT)
I20260709 13:10:00.382206 22448 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:00.383140 22482 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:10:00.383281 27097 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:00.389334 27100 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:00.390082 21877 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:00.390681 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.391714 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.392036 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.393131 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.398415 21834 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:10:00.395951 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.397524 21729 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:00.400918 21729 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:00.401381 21880 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:00.394781 27132 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:00.402590 22482 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:00.402673 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.403439 21833 raft_consensus.cc:2368] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 14. Current term is 15.
I20260709 13:10:00.404060 27052 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:00.404520 27052 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.404554 27079 raft_consensus.cc:2804] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:00.405020 27052 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:00.405097 27079 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:00.405692 27079 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:00.410465 27072 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:00.404060 27132 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:00.412463 27098 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:00.413676 27063 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:00.413198 21729 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:00.401892 21877 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:00.415644 27098 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:00.415169 21729 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:00.420454 21831 raft_consensus.cc:2410] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:00.420923 21729 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:00.358045 27124 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:00.417987 21877 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:00.423291 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:00.424611 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:00.424646 21833 raft_consensus.cc:2368] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 14. Current term is 15.
I20260709 13:10:00.423450 21729 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:00.423162 27096 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:00.426874 27114 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:00.428866 27114 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:00.429260 27114 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:00.420075 27098 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:00.429762 27098 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:00.432394 27079 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:00.422479 27120 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:00.433827 27120 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:00.434226 27120 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:00.447029 27134 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:00.447607 27098 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:00.450037 27072 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:00.455060 21837 raft_consensus.cc:2368] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 13. Current term is 14.
I20260709 13:10:00.455971 27063 raft_consensus.cc:697] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:00.450376 27052 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:00.422727 27132 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:00.458848 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:00.445119 27114 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:00.456328 27138 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:00.463660 21877 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:00.465560 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:00.467224 21837 raft_consensus.cc:2410] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:00.474128 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:00.481375 27079 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:00.463127 27138 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:00.462615 27132 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:10:00.483959 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.485985 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.493919 27052 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:00.487512 21836 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 14.
I20260709 13:10:00.459432 27109 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:00.485316 27143 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:00.499259 27120 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:00.506453 27098 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:00.507455 27063 consensus_queue.cc:237] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:00.512478 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.523424 27114 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:00.523780 21838 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:10:00.513705 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.514056 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.514182 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.525345 21835 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
I20260709 13:10:00.514910 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.518631 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.518853 27100 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:00.518656 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:10:00.519235 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 57586.5us
I20260709 13:10:00.520135 27111 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:00.521484 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.522074 27109 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:00.499935 27132 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:00.530005 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 103594us
I20260709 13:10:00.528821 21877 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:00.531100 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.531796 21832 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:10:00.527992 21834 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 15.
I20260709 13:10:00.529662 21836 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 18.
I20260709 13:10:00.497799 27138 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:00.533249 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.520165 27120 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:00.517666 27143 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:00.535831 21877 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:00.536369 21729 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
W20260709 13:10:00.536629 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 77052.4us
I20260709 13:10:00.539906 22482 raft_consensus.cc:1217] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 13:10:00.542112 21877 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:00.543889 21877 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:00.542743 27141 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:00.550580 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:00.538439 21729 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:00.545284 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.556317 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.556990 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.554437 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.596894 22482 raft_consensus.cc:1240] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:00.555789 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.544477 27140 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:00.557730 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.555351 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.555076 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.621165 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:00.556037 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.554849 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.545791 27079 consensus_queue.cc:1059] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.216s
I20260709 13:10:00.558111 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.822175 21913 raft_consensus.cc:1240] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 7. Current term is 8. Ops: []
W20260709 13:10:00.692780 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 46316.9us
I20260709 13:10:00.821214 21759 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
W20260709 13:10:00.705920 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.742141 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:10:00.624176 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 70794.7us
I20260709 13:10:00.822898 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:00.824688 21877 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:00.822690 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:00.544751 27109 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:00.621315 21762 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 15: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
W20260709 13:10:00.625763 22448 leader_election.cc:336] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.772s (SENT)
I20260709 13:10:00.829716 22448 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:00.825336 21765 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:00.830713 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 204985us
I20260709 13:10:00.550210 27141 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:00.768580 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:10:00.833086 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.654240 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.835950 21911 raft_consensus.cc:1240] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:00.693486 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:10:00.625083 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.842664 21763 raft_consensus.cc:2393] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:00.844609 21914 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:10:00.845075 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:00.693090 21906 raft_consensus.cc:1240] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:00.693827 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:00.845811 21833 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:10:00.846446 21912 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:00.741299 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:10:00.831816 22448 leader_election.cc:336] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.772s (SENT)
I20260709 13:10:00.827232 21908 raft_consensus.cc:2393] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 16: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:00.827371 21909 raft_consensus.cc:2368] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 13. Current term is 14.
W20260709 13:10:00.609057 21861 debug-util.cc:398] Leaking SignalData structure 0x7b08001b7ca0 after lost signal to thread 20643
I20260709 13:10:00.848882 22448 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:00.538352 27143 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:00.850236 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 227518us
I20260709 13:10:00.854190 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:00.618046 27098 raft_consensus.cc:2764] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 13:10:00.857517 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.875946 21833 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
W20260709 13:10:00.867146 21861 debug-util.cc:398] Leaking SignalData structure 0x7b080032ca60 after lost signal to thread 21697
I20260709 13:10:00.620833 27072 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:10:00.877594 21861 debug-util.cc:398] Leaking SignalData structure 0x7b0800271740 after lost signal to thread 21711
I20260709 13:10:00.878186 21914 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:10:00.882699 21912 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 15.
I20260709 13:10:00.827524 27140 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:00.620800 27139 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:00.830615 27131 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:00.896397 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.894191 21765 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:10:00.829406 27109 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:00.902653 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.754871 27120 consensus_queue.cc:1059] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.126s
I20260709 13:10:00.914000 21758 raft_consensus.cc:2368] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 14. Current term is 15.
W20260709 13:10:00.916424 21861 debug-util.cc:398] Leaking SignalData structure 0x7b0800271ee0 after lost signal to thread 21789
I20260709 13:10:00.753731 27132 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:00.866303 27124 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:00.921763 21861 debug-util.cc:398] Leaking SignalData structure 0x7b08001357a0 after lost signal to thread 21864
W20260709 13:10:00.927408 21861 debug-util.cc:398] Leaking SignalData structure 0x7b080019a5c0 after lost signal to thread 21865
W20260709 13:10:00.928789 21861 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0160 after lost signal to thread 21938
I20260709 13:10:00.928570 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:10:00.930305 21861 debug-util.cc:398] Leaking SignalData structure 0x7b08003a2be0 after lost signal to thread 22509
I20260709 13:10:00.849998 27141 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:00.922998 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.897943 27140 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:00.886446 27072 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:00.945679 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.914438 27047 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:00.917183 27109 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:00.922358 27139 raft_consensus.cc:697] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:00.950064 27111 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:00.951913 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:10:00.955408 27115 consensus_meta.cc:287] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.000s
I20260709 13:10:00.950234 21907 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:00.954864 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:00.970525 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 145889us
I20260709 13:10:00.948622 27072 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:00.953399 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:10:00.951658 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 95378.3us
I20260709 13:10:00.980394 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:00.981053 21833 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 16.
I20260709 13:10:00.984879 27139 consensus_queue.cc:237] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:00.979941 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.990049 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.991072 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:00.993373 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:00.994078 27132 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:00.969007 27150 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:10:00.995471 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.003504 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:01.003849 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:01.004405 21832 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:10:01.004765 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:01.005263 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:01.005759 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:01.005820 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:00.996695 27150 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:01.006970 27150 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:01.007005 21850 tablet_copy_service.cc:140] P 6fadfd81c5a645f1806a284ddbb6bf0d: Received BeginTabletCopySession request for tablet d28f4c429d54450dbbeb1ac9f6b7cd55 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:56424)
I20260709 13:10:01.007678 21850 tablet_copy_service.cc:161] P 6fadfd81c5a645f1806a284ddbb6bf0d: Beginning new tablet copy session on tablet d28f4c429d54450dbbeb1ac9f6b7cd55 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:56424: session id = 8c6c2207af3d47b3acf352d81959f4dd-d28f4c429d54450dbbeb1ac9f6b7cd55
I20260709 13:10:01.009716 27115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36270 (request call id 867) took 2326 ms. Trace:
I20260709 13:10:01.010147 27115 rpcz_store.cc:276] 0709 13:09:58.681136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:58.681326 (+   190us) service_pool.cc:224] Handling call
0709 13:09:58.848391 (+167065us) ts_tablet_manager.cc:934] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645)
0709 13:10:00.326281 (+1477890us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:00.346759 (+ 20478us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:00.346874 (+   115us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:00.981129 (+634255us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:00.995018 (+ 13889us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:00.995330 (+   312us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:00.996992 (+  1662us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":483285,"tablet-copy.queue_time_us":85757,"thread_start_us":275620,"threads_started":2}
I20260709 13:10:01.011485 27115 tablet_copy_client.cc:806] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:01.011796 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:01.012023 27115 tablet_copy_client.cc:670] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:01.014101 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:01.016448 21836 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 18.
I20260709 13:10:01.020792 21839 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:10:01.011821 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.025271 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:01.025534 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:01.025583 22450 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:01.030280 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:01.031680 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:01.032477 21762 raft_consensus.cc:2393] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 14: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:01.033676 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:01.036814 21757 raft_consensus.cc:1240] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:01.039315 21764 raft_consensus.cc:1240] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:01.039922 27114 raft_consensus.cc:3055] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:01.040369 27114 raft_consensus.cc:740] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:01.040544 21764 raft_consensus.cc:1240] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:01.041323 27109 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:01.070833 27129 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:01.041379 27114 consensus_queue.cc:260] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:01.050813 21912 raft_consensus.cc:1240] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:01.044623 21759 raft_consensus.cc:3055] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:01.048080 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:01.072616 21759 raft_consensus.cc:740] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:01.041939 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:01.073477 21759 consensus_queue.cc:260] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:01.074548 21759 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:01.046198 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:01.076181 21756 raft_consensus.cc:2393] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 14: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:01.042472 27097 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:01.055635 27138 consensus_meta.cc:287] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.000s
I20260709 13:10:01.078502 27138 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:01.049984 21764 raft_consensus.cc:1240] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:01.080456 27138 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:01.071359 21805 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:01.043681 21879 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.042162 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:01.083523 27097 consensus_queue.cc:1059] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:10:01.068512 27125 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:01.091800 21914 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:01.092098 27125 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.041860 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:01.068286 27116 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:01.093987 27116 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.094156 27125 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:01.097976 21837 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
I20260709 13:10:01.088374 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:01.102846 21759 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:10:01.106097 27075 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:01.107517 21804 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.20.40.62:38057, user_credentials={real_user=slave}} blocked reactor thread for 56668us
W20260709 13:10:01.107774 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 48336.2us
I20260709 13:10:01.109174 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:10:01.109974 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 82962.8us
I20260709 13:10:01.070531 21850 tablet_copy_source_session.cc:215] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:10:01.114416 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 62573.3us
I20260709 13:10:01.111219 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:10:01.112053 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 280280us
I20260709 13:10:01.113391 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.096313 27116 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:01.063817 27072 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.116315 22479 raft_consensus.cc:1240] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:01.051975 27109 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:01.122939 27072 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:01.133961 27111 consensus_queue.cc:1059] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:01.071501 27129 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.136205 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.136979 21839 raft_consensus.cc:2368] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 13. Current term is 14.
I20260709 13:10:01.137215 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:10:01.116008 22448 leader_election.cc:336] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Timed out: RequestConsensusVote RPC to 127.20.40.2:34765 timed out after 1.813s (SENT)
I20260709 13:10:01.094204 27140 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:01.136739 27129 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:01.109967 27156 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:10:01.139253 21911 raft_consensus.cc:1240] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:01.139896 22448 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.140021 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.142133 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:01.142308 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.056488 27141 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.143162 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:01.143620 21729 leader_election.cc:400] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 13. Current term is 14.
I20260709 13:10:01.143896 21729 leader_election.cc:403] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:10:01.053164 27143 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:01.143318 27096 consensus_queue.cc:1059] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:10:01.144848 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:01.145409 21834 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:10:01.145689 21907 raft_consensus.cc:1240] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:01.146307 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:01.146585 27114 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.147131 27097 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:01.147444 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:10:01.148152 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 104535us
I20260709 13:10:01.148571 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:01.149103 21879 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:01.150424 21879 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.151182 27138 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:01.153110 27140 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:01.153615 27134 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:10:01.154443 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 182891us
I20260709 13:10:01.155464 21877 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:01.149155 21832 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 8.
I20260709 13:10:01.158753 27131 raft_consensus.cc:3055] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:01.159148 27131 raft_consensus.cc:740] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:01.160004 27131 consensus_queue.cc:260] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:01.161881 27111 raft_consensus.cc:3055] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:01.156778 27150 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:01.162285 27111 raft_consensus.cc:740] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:01.162842 21912 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:01.163266 27111 consensus_queue.cc:260] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:01.162304 22448 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.164419 27111 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:10:01.165077 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 48305.6us
I20260709 13:10:01.172865 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:01.115231 27154 consensus_queue.cc:1059] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 13:10:01.166555 27144 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:01.174194 27097 raft_consensus.cc:3055] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:01.174378 27144 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:01.174598 27097 raft_consensus.cc:740] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:01.174865 27144 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:01.175657 27097 consensus_queue.cc:260] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:01.176970 27097 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:01.169471 21910 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:01.169811 27165 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:01.161221 27131 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:01.180835 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 62034.2us
I20260709 13:10:01.180750 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.181862 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:01.182073 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.184403 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:01.184906 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:01.188989 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.189899 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:01.190557 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.174453 27139 raft_consensus.cc:3055] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:01.193645 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:01.214082 22483 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:01.194370 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:01.190487 21729 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:01.196442 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:01.198213 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.215158 27164 consensus_queue.cc:1059] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:01.214287 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.216135 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.216279 27164 raft_consensus.cc:3055] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:01.216725 27164 raft_consensus.cc:740] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:01.216725 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.217268 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.218540 27150 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 20 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:01.189657 27161 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 13. Current term is 14.
I20260709 13:10:01.220278 27139 raft_consensus.cc:740] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:01.198902 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.199326 27072 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:01.223599 22448 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.224361 27047 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:01.224730 22448 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:01.205925 27143 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:01.221203 27139 consensus_queue.cc:260] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.206157 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.189853 27165 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:01.226559 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 76200.6us
I20260709 13:10:01.207829 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.207924 21838 raft_consensus.cc:2468] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:10:01.195621 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:01.215337 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.228319 21831 raft_consensus.cc:2393] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 14: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:01.225440 27047 raft_consensus.cc:2764] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:10:01.230293 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:01.231120 21838 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:10:01.227649 21879 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:01.204759 27141 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:01.232507 21833 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:10:01.235567 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:01.237175 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:10:01.247016 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 56603.3us
I20260709 13:10:01.238070 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:01.225128 27138 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:01.240867 21879 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:01.241393 27109 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:01.241854 27143 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:01.243170 27165 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:01.225910 27083 consensus_queue.cc:1059] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:01.252836 27161 raft_consensus.cc:2804] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:01.247781 21729 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:01.253367 27161 raft_consensus.cc:697] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 10 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:01.253829 27083 raft_consensus.cc:3055] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:01.232504 27154 consensus_queue.cc:1059] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
I20260709 13:10:01.254213 27161 consensus_queue.cc:237] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.254236 27083 raft_consensus.cc:740] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:01.256008 27083 consensus_queue.cc:260] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:01.256620 21662 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45778 (request call id 298) took 1078 ms. Trace:
I20260709 13:10:01.245023 21836 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:10:01.254796 27154 raft_consensus.cc:3055] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:01.257136 27083 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.246392 27072 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:01.258172 21805 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:01.259493 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:01.265080 27154 raft_consensus.cc:740] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:01.265574 27079 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:01.266252 21912 raft_consensus.cc:1240] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:01.257943 27021 tablet_bootstrap.cc:492] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:01.271941 22448 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.269445 21833 raft_consensus.cc:2393] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 12: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:10:01.269596 21663 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52326 (request call id 168) took 1043 ms. Trace:
I20260709 13:10:01.266433 27155 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:01.290885 21663 rpcz_store.cc:276] 0709 13:10:00.225972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.226116 (+   144us) service_pool.cc:224] Handling call
0709 13:10:01.269383 (+1043267us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
W20260709 13:10:01.295670 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.296350 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.266660 27098 consensus_queue.cc:1059] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
W20260709 13:10:01.295882 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 98938.7us
I20260709 13:10:01.312974 21910 raft_consensus.cc:1240] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:01.301824 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:01.302116 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:01.314795 21879 leader_election.cc:400] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 14. Current term is 15.
I20260709 13:10:01.315110 21879 leader_election.cc:403] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:01.315662 27072 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 14. Current term is 15.
I20260709 13:10:01.317389 21879 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.318240 27138 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:01.319793 21879 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:01.270079 27109 raft_consensus.cc:697] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:01.304725 21804 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:01.306710 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:01.270813 27156 consensus_queue.cc:1059] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:10:01.307085 27154 consensus_queue.cc:260] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:01.275991 27164 consensus_queue.cc:260] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:01.275455 27165 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:01.310418 27075 consensus_queue.cc:1059] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:01.310524 27125 consensus_queue.cc:1059] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:10:01.310850 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.340672 21765 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:01.273816 27114 consensus_queue.cc:1059] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:10:01.277768 27129 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:01.311271 27116 consensus_queue.cc:1059] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:01.299930 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:01.322398 21911 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:01.323699 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:01.256992 21662 rpcz_store.cc:276] 0709 13:10:00.177759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.177925 (+   166us) service_pool.cc:224] Handling call
0709 13:10:01.256557 (+1078632us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:00.290851 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:00.391277 (+100426us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:00.391356 (+    79us) write_op.cc:435] Acquired schema lock
0709 13:10:00.391397 (+    41us) tablet.cc:662] Decoding operations
0709 13:10:00.391890 (+   493us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:00.391977 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:00.392004 (+    27us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:10:00.392586 (+   582us) tablet.cc:701] Row locks acquired
0709 13:10:00.392629 (+    43us) write_op.cc:260] PREPARE: finished
0709 13:10:00.392837 (+   208us) write_op.cc:270] Start()
0709 13:10:00.392975 (+   138us) write_op.cc:276] Timestamp: P: 1783602600392773 usec, L: 0
0709 13:10:00.393016 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:10:00.396003 (+  2987us) log.cc:844] Serialized 907 byte log entry
0709 13:10:01.138998 (+742995us) op_driver.cc:464] REPLICATION: finished
0709 13:10:01.237948 (+ 98950us) write_op.cc:301] APPLY: starting
0709 13:10:01.238033 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:01.240722 (+  2689us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:01.240845 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:01.243294 (+  2449us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:01.243589 (+   295us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:10:01.243645 (+    56us) write_op.cc:312] APPLY: finished
0709 13:10:01.243927 (+   282us) log.cc:844] Serialized 33 byte log entry
0709 13:10:01.244109 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:01.244197 (+    88us) write_op.cc:454] Released schema lock
0709 13:10:01.244254 (+    57us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":98691,"apply.run_cpu_time_us":5173,"apply.run_wall_time_us":29463,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12495,"num_ops":2,"prepare.queue_time_us":75289,"prepare.run_cpu_time_us":16414,"prepare.run_wall_time_us":477498,"raft.queue_time_us":139205,"raft.run_cpu_time_us":10467,"raft.run_wall_time_us":50831,"replication_time_us":745822,"thread_start_us":462678,"threads_started":4,"wal-append.queue_time_us":527968}]]}
I20260709 13:10:01.324501 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:01.324533 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:01.268441 27139 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.346967 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:01.347744 21759 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
I20260709 13:10:01.352844 21907 raft_consensus.cc:1240] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:01.330678 21804 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:01.327615 21877 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.331812 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:01.332201 21910 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 13. Current term is 15. Ops: []
I20260709 13:10:01.333269 21879 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.339546 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.339819 21762 raft_consensus.cc:1240] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:01.334278 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:01.310702 27124 consensus_queue.cc:1059] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:01.342777 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:01.343523 27021 tablet_bootstrap.cc:492] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:10:01.343235 27129 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.343717 21763 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:01.326903 27138 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:01.361945 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.362653 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:01.367823 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:10:01.366761 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 140607us
W20260709 13:10:01.397219 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 66583.8us
W20260709 13:10:01.397682 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.376731 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.391901 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.342211 27131 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:01.403904 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 59307.2us
I20260709 13:10:01.343753 27098 raft_consensus.cc:3055] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:10:01.397219 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 69655.1us
I20260709 13:10:01.413932 21877 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:01.416667 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 50927.4us
W20260709 13:10:01.419673 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.420439 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.421963 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 150072us
W20260709 13:10:01.423986 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 90792.5us
I20260709 13:10:01.430212 27075 raft_consensus.cc:3055] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:01.430744 27075 raft_consensus.cc:740] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:01.431712 27075 consensus_queue.cc:260] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.441087 21877 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:10:01.452167 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 47548.3us
I20260709 13:10:01.455144 21728 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.458564 21804 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:01.403506 27165 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:01.435544 27075 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:01.466023 22450 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:01.413115 27098 raft_consensus.cc:740] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:10:01.468468 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 45860.2us
I20260709 13:10:01.474596 22448 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.433667 27021 ts_tablet_manager.cc:1403] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 1.293s	user 0.034s	sys 0.033s
I20260709 13:10:01.480595 27079 raft_consensus.cc:697] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 15 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:01.482183 27079 consensus_queue.cc:237] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.436710 27052 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:01.433269 27132 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:01.496981 21804 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
W20260709 13:10:01.499307 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 58332.4us
I20260709 13:10:01.519752 21877 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.466017 27138 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:01.473031 27116 raft_consensus.cc:3055] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:10:01.523032 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 48548.1us
W20260709 13:10:01.523444 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 101271us
W20260709 13:10:01.512423 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 55658.3us
I20260709 13:10:01.526636 21877 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.530642 22448 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:01.531666 21728 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.506897 27141 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:01.510576 27174 raft_consensus.cc:3055] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:01.547180 27132 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:01.549742 21877 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.543072 27138 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
W20260709 13:10:01.542387 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 109221us
I20260709 13:10:01.552090 27140 raft_consensus.cc:1064] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
W20260709 13:10:01.553304 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.469400 27120 consensus_queue.cc:1059] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:10:01.530264 27116 raft_consensus.cc:740] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:01.577387 27185 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:01.540961 27177 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:01.525202 27173 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:01.460099 27109 consensus_queue.cc:237] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.566386 27171 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:01.570806 21728 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.573084 21804 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:01.582288 27116 consensus_queue.cc:260] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.525516 27150 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:01.555269 27174 raft_consensus.cc:740] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:01.598799 21804 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:10:01.601029 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 244636us
I20260709 13:10:01.603374 21805 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:01.604115 21804 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:10:01.600205 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 50819.8us
I20260709 13:10:01.585273 27175 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:01.610391 27116 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:01.613794 27075 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:01.613914 27190 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:01.615053 27151 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:01.617233 27115 tablet_copy_client.cc:538] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:01.605854 27185 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:01.622294 27185 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:01.622778 27185 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:01.623149 27184 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:01.623606 27184 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:01.623967 27184 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:01.601532 27098 consensus_queue.cc:260] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.626782 27098 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.628219 27021 raft_consensus.cc:359] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:01.581570 27129 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:01.631053 27171 raft_consensus.cc:697] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 18 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:01.636538 21877 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.629372 27021 raft_consensus.cc:740] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:10:01.614293 27075 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:01.639077 27075 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:01.639050 27021 consensus_queue.cc:260] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:01.644286 27187 consensus_queue.cc:1059] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:10:01.645084 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 114450us
I20260709 13:10:01.645782 27182 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:01.647082 27174 consensus_queue.cc:260] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.648664 27174 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:01.631088 27129 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:01.655254 22479 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:10:01.656666 21877 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:01.658703 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.660295 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:01.658560 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 87527us
I20260709 13:10:01.662319 21728 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.665562 21877 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.668587 21877 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.675385 21877 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.633421 27175 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:10:01.684316 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 153751us
I20260709 13:10:01.631716 27140 consensus_queue.cc:237] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:01.664011 27150 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:01.688905 22448 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:01.669234 27138 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:01.686012 27143 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:01.675545 27151 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:01.682667 27155 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:01.696019 22448 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:01.685163 27175 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:01.698360 27097 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:01.698583 27183 consensus_queue.cc:1059] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:10:01.699374 27097 raft_consensus.cc:697] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:01.701318 27154 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:01.700898 27097 consensus_queue.cc:237] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:01.666507 27129 consensus_queue.cc:1059] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:10:01.674957 27144 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.708321 27111 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:10:01.712848 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.717131 21662 catalog_manager.cc:5697] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 10 to 11, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 11 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.718530 27165 raft_consensus.cc:3055] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:01.718956 27165 raft_consensus.cc:740] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:01.719074 21662 catalog_manager.cc:5697] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 9 to 10, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 10 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.719939 27165 consensus_queue.cc:260] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.717461 21877 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:01.725641 27180 raft_consensus.cc:3055] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:01.734599 27194 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:01.735291 27194 raft_consensus.cc:697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:01.738422 21877 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.744937 21877 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:01.721237 27165 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:01.632251 27171 consensus_queue.cc:237] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:01.751322 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 147325us
I20260709 13:10:01.756917 21804 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:01.768069 21877 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.768184 21804 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:01.743140 27132 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:01.775080 21804 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:01.775758 21877 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:01.778968 27022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d28f4c429d54450dbbeb1ac9f6b7cd55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.750308 27143 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:01.774354 27150 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:01.784144 27155 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:01.760717 27134 raft_consensus.cc:2804] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:01.797742 27021 ts_tablet_manager.cc:1434] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.299s	user 0.008s	sys 0.001s
I20260709 13:10:01.798015 27134 raft_consensus.cc:697] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:01.799203 27134 consensus_queue.cc:237] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.790544 27192 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:01.788355 27109 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:01.789542 27186 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:01.789722 21877 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.790066 27199 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:01.804193 27155 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:01.790709 27075 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:01.794373 21804 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:01.751160 27180 raft_consensus.cc:740] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:01.806171 21877 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:01.810031 21804 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:01.812114 21804 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:01.829205 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:01.805555 27183 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:01.837687 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:01.849733 21838 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:01.847342 27175 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:01.822623 27177 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.855477 27177 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:01.858615 27177 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:01.823176 27155 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:10:01.859472 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:01.860289 21763 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
I20260709 13:10:01.823762 27199 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:01.823998 27129 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:01.851794 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 189730us
I20260709 13:10:01.863065 21774 tablet_copy_service.cc:342] P 3843e9b794a245dd8608e04ec7915239: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-c6406f8b01c041c58abe3add218f6b41 received from {username='slave'} at 127.0.0.1:44772
I20260709 13:10:01.864120 22450 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:01.869513 27194 consensus_queue.cc:237] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:01.871575 27075 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:01.872403 27180 consensus_queue.cc:260] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.772751 27185 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.872907 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:01.834157 27125 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:01.873466 27189 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:01.884114 21728 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:01.885386 21838 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 17.
I20260709 13:10:01.895392 21728 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:01.899436 21774 tablet_copy_service.cc:434] P 3843e9b794a245dd8608e04ec7915239: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-c6406f8b01c041c58abe3add218f6b41 on tablet c6406f8b01c041c58abe3add218f6b41 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:01.889286 27131 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:01.908177 22479 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
W20260709 13:10:01.908573 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.910183 21806 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:10:01.913272 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 76865.4us
I20260709 13:10:01.899700 27202 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:01.946691 21728 leader_election.cc:400] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 14. Current term is 15.
I20260709 13:10:01.903796 27189 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:01.959275 27189 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:01.946157 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:01.909283 27192 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:01.965782 27192 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:01.966046 27187 raft_consensus.cc:3055] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:01.966471 27187 raft_consensus.cc:740] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:01.967253 27187 consensus_queue.cc:260] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.966334 27192 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:01.968894 27162 raft_consensus.cc:3055] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:01.969278 27162 raft_consensus.cc:740] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:01.970847 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:01.971680 21905 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
I20260709 13:10:01.911262 27131 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.946767 21804 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:01.949396 27161 raft_consensus.cc:3055] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:01.915349 27125 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:01.952904 27124 raft_consensus.cc:3055] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:01.955819 27175 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:01.957965 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:01.958122 27197 raft_consensus.cc:3055] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:01.958418 27184 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:01.916375 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 81586.1us
I20260709 13:10:01.977124 21804 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:01.968410 21663 catalog_manager.cc:5697] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 9 to 10, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 10 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:01.951352 27144 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:01.915555 27180 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:01.983639 27131 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:01.992808 21728 leader_election.cc:400] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 14. Current term is 15.
I20260709 13:10:01.970140 27162 consensus_queue.cc:260] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:02.009639 27162 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:01.994174 27199 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.011304 27022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:36278 (request call id 881) took 1747 ms. Trace:
I20260709 13:10:02.011740 27022 rpcz_store.cc:276] 0709 13:10:00.264252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:00.264566 (+   314us) service_pool.cc:224] Handling call
0709 13:10:00.276424 (+ 11858us) ts_tablet_manager.cc:934] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
0709 13:10:01.777125 (+1500701us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:01.882476 (+105351us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:01.882606 (+   130us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:02.010489 (+127883us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:02.010816 (+   327us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:02.011155 (+   339us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:02.011222 (+    67us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":223,"tablet-copy.queue_time_us":9994,"thread_start_us":98713,"threads_started":2}
I20260709 13:10:02.012856 27184 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:02.013119 27022 tablet_copy_client.cc:806] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:02.036645 27022 tablet_copy_client.cc:670] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:01.982445 27161 raft_consensus.cc:740] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:02.000897 27164 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:01.991997 27197 raft_consensus.cc:740] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:02.014221 27210 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:02.014873 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:02.015055 21880 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:02.016268 27185 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:01.968351 27189 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:02.048640 27185 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:02.049021 27189 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:02.049204 27185 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:02.050563 27197 consensus_queue.cc:260] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:01.995723 21804 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:01.985807 27124 raft_consensus.cc:740] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:02.052284 27197 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:01.989223 27125 raft_consensus.cc:697] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:02.030224 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:02.053247 27124 consensus_queue.cc:260] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:02.053807 27125 consensus_queue.cc:237] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:02.029096 27115 tablet_bootstrap.cc:492] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:10:02.054726 27187 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:02.035435 27192 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:02.036886 21759 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:02.043370 27161 consensus_queue.cc:260] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:02.017237 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:02.056545 22479 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:02.058514 21914 raft_consensus.cc:1240] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:02.056762 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 61089.9us
I20260709 13:10:02.059921 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:01.995658 21728 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:02.061118 21905 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:02.083232 27180 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:02.083319 21804 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:10:02.083376 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 87809.1us
I20260709 13:10:02.085307 21728 leader_election.cc:400] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 13. Current term is 14.
I20260709 13:10:02.086201 21728 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:02.088210 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:02.054730 27124 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.089169 21728 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:02.061653 27210 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:02.061992 27185 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:02.088863 27180 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:02.098161 27114 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.097507 27189 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:02.126789 21728 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:02.132364 21728 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:02.134147 27159 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:02.134701 27159 raft_consensus.cc:697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:02.132072 27096 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:02.136011 27096 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:02.135627 27159 consensus_queue.cc:237] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:02.110268 27072 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:10:02.090464 27186 consensus_queue.cc:1059] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:10:02.147253 21728 leader_election.cc:400] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for earlier term 13. Current term is 14.
I20260709 13:10:02.148587 21728 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:02.157910 21728 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:02.162343 21728 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:02.161166 27184 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.155803 27210 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:02.165701 27075 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:02.166672 27075 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:02.168794 27075 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:02.168455 27131 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:02.164986 27184 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:02.171353 27184 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:02.161147 27116 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.166082 27199 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:02.173818 27116 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:02.173894 27199 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:02.176155 27199 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:02.176544 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:02.163435 27096 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:02.177770 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:02.177201 21759 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:10:02.165789 27210 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:02.150156 27189 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:10:02.185266 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.186998 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:02.187217 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:02.187565 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:02.187667 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:02.190735 21759 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:02.192627 21728 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:02.193967 21762 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 16.
I20260709 13:10:02.138348 27109 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:10:02.157757 27161 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:02.196254 21805 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:02.196159 21728 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:02.160467 27180 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:02.199926 21728 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:02.198096 27187 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:02.203353 27096 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:02.203569 21837 raft_consensus.cc:1275] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:02.205546 27162 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:02.206378 27022 tablet_copy_client.cc:538] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:02.208418 21805 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:02.209182 27197 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:02.201550 21728 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:02.214063 27162 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:02.214627 27162 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:02.214396 27189 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:02.215210 27162 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:02.216840 27189 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:02.217547 27165 raft_consensus.cc:2804] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:02.192184 27186 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:02.217993 27165 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:02.218076 27186 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:02.218451 27165 raft_consensus.cc:3060] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:02.218524 27186 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.191076 27131 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:02.227986 27162 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:02.230125 27192 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:02.233604 27097 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:02.235357 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:02.176152 27116 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:02.229387 21728 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:02.239445 21728 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:02.239799 27180 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:02.197206 27199 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:02.240965 27199 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:02.242353 27162 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:02.244096 27199 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:02.244437 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:02.244797 27192 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:02.245209 27192 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:02.245587 27192 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:02.247406 27114 raft_consensus.cc:3055] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:02.247637 27210 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:02.247819 27114 raft_consensus.cc:740] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:02.248716 27114 consensus_queue.cc:260] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:02.249845 27114 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:02.253860 27192 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:02.255537 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:02.264348 21759 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:10:02.274832 21756 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:02.275264 22450 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:02.276503 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:02.277133 21833 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:10:02.277624 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:02.277839 21839 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:02.278649 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:02.279211 21836 raft_consensus.cc:1275] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:02.279706 21762 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 16.
I20260709 13:10:02.280969 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:02.281262 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:02.281895 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:02.278460 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:02.285838 21805 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:02.287803 21834 raft_consensus.cc:1275] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:10:02.288213 21834 pending_rounds.cc:85] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 6
I20260709 13:10:02.290488 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:02.290973 21905 raft_consensus.cc:3060] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:02.288618 21805 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:02.291965 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:02.292718 21805 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:02.293073 21835 raft_consensus.cc:1240] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:02.292613 21757 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
I20260709 13:10:02.294837 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:02.288443 21834 pending_rounds.cc:107] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 10.7
I20260709 13:10:02.306617 21805 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:02.288517 27180 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.289808 27097 raft_consensus.cc:2804] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:02.292562 27116 raft_consensus.cc:2804] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:02.321651 21836 raft_consensus.cc:1240] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:02.308048 21834 raft_consensus.cc:2917] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Aborting config change with OpId 10.7: Aborted: Op aborted by new leader
I20260709 13:10:02.288287 27141 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.317518 27197 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:02.317747 27120 consensus_queue.cc:1048] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:02.360157 21728 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:02.322307 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.323417 21839 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:02.301612 27189 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:02.303158 27199 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.359079 21831 raft_consensus.cc:1275] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:02.326122 22482 raft_consensus.cc:2468] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:10:02.371443 21910 raft_consensus.cc:1275] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:02.372756 21911 raft_consensus.cc:1275] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:02.362498 21728 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:02.366618 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:02.359550 27197 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:02.367164 27189 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:02.376924 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:02.361765 27116 raft_consensus.cc:697] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:02.361284 27097 raft_consensus.cc:697] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:02.359201 27192 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:02.363436 27162 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:02.375761 21728 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:02.381060 21838 raft_consensus.cc:1240] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:02.381959 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:02.390890 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:02.376861 27197 raft_consensus.cc:3060] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:02.381314 27189 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:02.382858 27221 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.394712 21911 raft_consensus.cc:2393] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 12: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:02.359798 27141 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:02.378022 27202 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:10:02.394289 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 282660us
I20260709 13:10:02.398222 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:02.399855 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:02.400087 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:02.400512 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:02.405921 21907 raft_consensus.cc:2393] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 14: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:02.401183 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:02.406685 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:02.401809 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:02.407331 21906 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:10:02.407634 21908 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
I20260709 13:10:02.408339 21764 raft_consensus.cc:1240] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:02.408373 21910 raft_consensus.cc:2393] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 16: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:02.409660 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:02.410095 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:02.410188 21877 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:02.411427 21909 raft_consensus.cc:2393] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 16: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:02.412420 22482 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36290 (request call id 1369) took 1168 ms. Trace:
I20260709 13:10:02.413957 21914 raft_consensus.cc:2393] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 16: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:02.412850 22482 rpcz_store.cc:276] 0709 13:10:01.235190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.235327 (+   137us) service_pool.cc:224] Handling call
0709 13:10:02.403517 (+1168190us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400602cd4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:10:02.403634 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2431469824}
I20260709 13:10:02.416548 21912 raft_consensus.cc:2393] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 15: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:02.417732 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:10:02.418458 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.423470 21913 raft_consensus.cc:2393] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 8: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:02.429270 21880 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:02.427874 21728 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:02.431044 21728 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:02.412526 27098 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:10:02.445590 27148 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:02.437814 21905 raft_consensus.cc:2468] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:10:02.431948 21834 raft_consensus.cc:2889] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:02.438237 21756 raft_consensus.cc:1275] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:10:02.411891 27203 consensus_queue.cc:1048] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:10:02.413727 27221 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:02.453919 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:56408 (request call id 7) took 8563 ms. Trace:
I20260709 13:10:02.462708 27229 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:10:02.450367 27210 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:02.467298 27210 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:02.466842 21834 rpcz_store.cc:276] 0709 13:09:53.898667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:09:53.898837 (+   170us) service_pool.cc:224] Handling call
0709 13:09:53.921139 (+ 22302us) log.cc:844] Serialized 492 byte log entry
0709 13:09:59.702148 (+5781009us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b5400541b20. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae2d7b26 00007fc6ae2d149a 00007fc6ae2d0714 00007fc6ae2b0eaa 00007fc6ae2b7d53 00007fc6ae2b7cd9 00007fc6ae2b7c69 00007fc6ae2b7c31 00007fc6ae2b6dfd 000000000038f354
0709 13:09:59.956587 (+254439us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5400541b20. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae2d0142 00007fc6ae2b0eaa 00007fc6ae2b7d53 00007fc6ae2b7cd9 00007fc6ae2b7c69 00007fc6ae2b7c31 00007fc6ae2b6dfd 000000000038f354 000000000038f199 00007fc6ab26a475
0709 13:10:02.453795 (+2497208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79848,"raft.queue_time_us":116187,"raft.run_cpu_time_us":37235,"raft.run_wall_time_us":1593396,"spinlock_wait_cycles":76682752,"thread_start_us":4984220,"threads_started":2,"wal-append.queue_time_us":1308281,"wal-append.run_cpu_time_us":2021,"wal-append.run_wall_time_us":1159789}
I20260709 13:10:02.454654 21840 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:02.455070 27022 tablet_bootstrap.cc:492] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:10:02.451432 27171 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.433326 27097 consensus_queue.cc:237] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:02.484513 21711 auto_rebalancer.cc:629] Failed to schedule move for tablet d28f4c429d54450dbbeb1ac9f6b7cd55: Aborted: Op aborted by new leader
I20260709 13:10:02.426331 27134 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:10:02.488162 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 58975.5us
W20260709 13:10:02.490152 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 71424.9us
I20260709 13:10:02.414261 27114 consensus_queue.cc:1059] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:10:02.461763 27111 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:02.450428 27162 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:02.491922 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:02.465035 27141 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:02.501605 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:02.504680 22480 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 20.
I20260709 13:10:02.505703 21806 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:02.480882 27210 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:02.433588 27116 consensus_queue.cc:237] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:02.490180 27194 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:10:02.510754 27184 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:02.492375 27072 raft_consensus.cc:2804] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:02.513846 27184 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:02.517822 27184 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:02.503935 27161 raft_consensus.cc:3055] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:02.510756 27186 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:02.519480 27161 raft_consensus.cc:740] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:02.521407 27186 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:02.522322 27221 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:02.522740 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:02.523142 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:02.524461 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:02.481284 27165 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:02.489202 27079 consensus_queue.cc:1048] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:10:02.502166 27134 raft_consensus.cc:697] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 17 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:02.530289 21728 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:02.489452 27171 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:02.542261 21763 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 16.
I20260709 13:10:02.545584 27111 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.520779 27161 consensus_queue.cc:260] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:02.550650 27142 consensus_queue.cc:1059] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:02.551986 27140 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:02.552677 21834 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:02.552796 27142 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:02.530367 27072 raft_consensus.cc:697] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:02.556999 21804 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:02.559132 22480 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:10:02.548045 27047 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:02.560619 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:02.565461 21905 raft_consensus.cc:2393] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 20: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:02.554489 27140 raft_consensus.cc:3055] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:02.572592 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:02.574126 21840 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 18.
I20260709 13:10:02.575106 21804 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:02.577695 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:02.515296 27197 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:02.579672 21764 raft_consensus.cc:1275] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:02.582597 21758 raft_consensus.cc:1240] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:02.582257 21762 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:02.585095 21804 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:02.568563 27140 raft_consensus.cc:740] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:02.569205 27114 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.588506 21877 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:02.600013 27142 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:02.599750 27114 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:02.600477 27142 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.600910 27142 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:02.602113 27114 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:02.582003 27138 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:10:02.547837 27151 consensus_queue.cc:1059] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:10:02.603911 27151 raft_consensus.cc:3055] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:02.603951 27150 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:02.604454 27151 raft_consensus.cc:740] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:02.604580 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:02.570147 27047 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:02.569669 27124 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:10:02.590595 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.591059 21804 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:02.588011 27125 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:02.592216 27140 consensus_queue.cc:260] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:02.622710 27140 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:02.592866 27210 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:02.605652 21761 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:10:02.609371 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:02.595131 27165 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:02.571902 27189 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:02.614552 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:02.615185 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:02.630033 21757 raft_consensus.cc:1240] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:02.616101 27209 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:02.607839 27047 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:02.616863 21804 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:02.558188 27134 consensus_queue.cc:237] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:02.594043 27171 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:02.609140 27161 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:02.642673 21804 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:02.642660 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:02.642210 27159 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:10:02.625963 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:02.657153 21765 raft_consensus.cc:2468] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:10:02.629662 27210 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.660439 21905 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
I20260709 13:10:02.662611 21805 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:02.660801 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:02.663967 22449 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:02.638079 27209 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.661785 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:02.641021 27202 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.669804 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:02.670660 21905 raft_consensus.cc:2393] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 15: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:02.669261 21913 raft_consensus.cc:2393] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 8: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:02.667105 27197 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:02.667341 22448 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:02.644963 27116 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:02.621312 27184 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:02.638455 27138 consensus_queue.cc:1059] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:10:02.659965 27165 raft_consensus.cc:3060] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:02.666287 27210 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.690351 27209 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:02.669581 27075 raft_consensus.cc:2804] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:02.605394 27151 consensus_queue.cc:260] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:02.694440 27047 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:02.692485 27194 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:02.606299 27072 consensus_queue.cc:237] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:02.722911 27047 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.731983 27047 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:02.735206 27079 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.735760 27079 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:02.741930 27151 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:02.700467 27202 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:02.730283 27075 raft_consensus.cc:697] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:02.751590 27075 consensus_queue.cc:237] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:02.773751 21880 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:02.777633 27189 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:02.785288 27223 raft_consensus.cc:3055] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:02.785821 27223 raft_consensus.cc:740] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:02.788924 27180 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:02.791502 27202 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:02.791987 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:02.792620 21831 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:10:02.797462 21764 raft_consensus.cc:2468] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
I20260709 13:10:02.797608 21805 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:02.786684 27223 consensus_queue.cc:260] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:02.801026 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:02.802139 21728 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:02.802352 21756 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:02.802132 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:02.803085 27141 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:02.807296 21840 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:02.807382 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:02.815615 21905 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:10:02.809799 21805 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:02.826074 27079 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:02.830408 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:02.818375 27141 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:02.854668 27141 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:02.806814 27189 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:02.818235 27192 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:02.819900 27116 raft_consensus.cc:2804] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:02.546368 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:02.861217 27223 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:02.828811 27154 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.148s
I20260709 13:10:02.870012 27192 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.004336 27189 raft_consensus.cc:697] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:10:03.023579 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:02.861801 27153 raft_consensus.cc:2955] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:03.015585 27192 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:03.074136 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 217076us
W20260709 13:10:03.075860 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 224312us
I20260709 13:10:03.082345 21905 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:03.086382 22480 raft_consensus.cc:2955] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:03.087651 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:03.094583 21729 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:03.095988 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:03.096889 21909 raft_consensus.cc:2393] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 16: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:03.097530 21913 raft_consensus.cc:1275] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:03.040445 27184 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 20 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:03.090695 27178 consensus_queue.cc:1059] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:10:03.114869 27229 raft_consensus.cc:3055] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:03.115357 27229 raft_consensus.cc:740] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:03.104820 27187 consensus_queue.cc:1048] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:10:03.106670 27242 log.cc:927] Time spent T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:10:03.109273 27189 consensus_queue.cc:237] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:03.022927 27116 raft_consensus.cc:697] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:03.122788 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:03.130854 21908 raft_consensus.cc:2393] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 20: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:03.141105 21910 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:03.150457 21910 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:03.152406 21758 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 16.
I20260709 13:10:03.027343 27142 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:03.160626 27047 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:03.165768 27209 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:03.166934 27229 consensus_queue.cc:260] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:03.170128 21912 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 18. Current term is 19. Ops: []
W20260709 13:10:03.179133 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 176558us
I20260709 13:10:03.182196 27229 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:03.182693 27142 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:03.203569 21835 raft_consensus.cc:1240] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:03.201174 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:03.148402 27184 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:10:03.157958 27194 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:10:03.158387 27199 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:10:03.186328 27047 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:03.189330 27165 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:03.255769 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 441059us
I20260709 13:10:03.254805 27197 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:03.270622 27237 log.cc:927] Time spent T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.060s	user 0.001s	sys 0.007s
I20260709 13:10:03.290115 22482 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:10:03.301512 21838 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:03.302366 21759 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:03.302382 21805 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:03.308208 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:03.272137 27203 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:03.312667 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:03.280021 27165 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.266855 27047 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:10:03.287254 27197 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:03.342355 27140 consensus_meta.cc:287] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.001s
W20260709 13:10:03.343339 27256 log.cc:927] Time spent T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:10:03.347242 27114 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.347781 27114 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:03.220907 27116 consensus_queue.cc:237] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:03.354988 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:10:03.353061 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 135473us
W20260709 13:10:03.364774 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:03.365202 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:03.366811 21756 raft_consensus.cc:3060] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.317842 27196 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.379850 21838 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:03.379981 21756 raft_consensus.cc:2468] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:10:03.325946 27252 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.397166 22482 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 20.
W20260709 13:10:03.399827 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 76066.8us
I20260709 13:10:03.405930 22450 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:03.407631 21758 raft_consensus.cc:1275] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:03.374157 27075 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:03.353515 27165 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:03.416028 27209 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:03.405156 27196 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:03.449276 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 49175.5us
W20260709 13:10:03.450448 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 148126us
I20260709 13:10:03.453789 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:03.440120 27209 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.435117 27114 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:03.460230 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:03.460925 21760 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 17.
W20260709 13:10:03.466046 27161 consensus_meta.cc:287] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.802s	user 0.008s	sys 0.003s
I20260709 13:10:03.409829 27252 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:03.449968 27272 raft_consensus.cc:2804] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:03.466954 27271 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:10:03.469869 27165 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:03.469940 27196 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:03.459985 27192 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:03.482872 27192 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:03.470064 27209 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:03.486670 27141 consensus_meta.cc:287] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.631s	user 0.011s	sys 0.000s
I20260709 13:10:03.487090 27209 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:03.472260 27272 raft_consensus.cc:697] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:03.473356 27252 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:03.458693 27125 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:10:03.498193 27194 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.500007 27141 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:03.501230 27194 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:03.501811 21914 raft_consensus.cc:2393] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 13: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:03.505125 27272 consensus_queue.cc:237] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:03.514179 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 56147us
I20260709 13:10:03.515018 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:03.515733 21758 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
I20260709 13:10:03.503573 27194 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:03.527556 27075 raft_consensus.cc:697] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:03.530612 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:03.531524 21759 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:10:03.537318 21805 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:03.547976 27142 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.527958 27196 consensus_queue.cc:1048] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
W20260709 13:10:03.540771 27210 consensus_meta.cc:287] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.819s	user 0.006s	sys 0.007s
W20260709 13:10:03.562345 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 305683us
I20260709 13:10:03.554298 21805 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:03.564579 21805 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:03.569553 27264 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.569695 27209 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:03.573294 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:03.573565 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:03.574000 21912 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:10:03.574065 21910 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.554772 27155 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.577267 27155 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:03.579380 27155 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:03.582754 22484 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:03.583995 21910 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:10:03.555292 27189 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:03.568611 27141 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:03.600627 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:03.601789 21913 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
I20260709 13:10:03.554700 27142 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:03.593572 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:03.599475 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:03.586875 27264 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:03.607048 27142 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:03.599390 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:03.604571 21912 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
I20260709 13:10:03.566283 27132 raft_consensus.cc:476] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Not starting pre-election -- already a leader
I20260709 13:10:03.604558 22449 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:03.605536 27178 consensus_queue.cc:1059] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:03.565850 27210 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:03.606567 27203 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.572063 27209 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:03.618283 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 53742.7us
I20260709 13:10:03.591517 27189 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.625468 21757 raft_consensus.cc:1240] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:03.640300 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:03.641326 21764 raft_consensus.cc:2393] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 13: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:10:03.643651 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:03.644973 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:03.645629 21765 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:10:03.627426 21756 raft_consensus.cc:2955] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:10:03.662879 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 58411.3us
I20260709 13:10:03.663975 22449 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:03.667526 21839 raft_consensus.cc:1240] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:10:03.668848 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:03.669744 21763 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 16.
I20260709 13:10:03.670639 27154 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:03.671248 27154 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.671763 27154 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.673815 27178 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:03.674441 27178 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.674926 27178 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.683631 27270 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:03.684201 27270 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.684584 27270 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:03.616315 27264 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:03.637651 27209 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:03.730870 27154 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:03.707103 21835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 2626) took 1041 ms. Trace:
W20260709 13:10:03.713539 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 51953.4us
I20260709 13:10:03.714550 27210 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:03.688572 27134 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:03.705881 27132 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.743806 21729 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:03.716986 27212 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.717615 27114 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:03.720275 27287 log.cc:927] Time spent T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:10:03.727108 27226 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:03.728174 27280 log.cc:927] Time spent T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:10:03.633800 27203 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:03.662407 27189 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:03.732941 21835 rpcz_store.cc:276] 0709 13:10:02.663032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.663573 (+   541us) service_pool.cc:224] Handling call
0709 13:10:02.663869 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:03.204144 (+540275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:03.704142 (+499998us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b5400147154. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:10:03.704326 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1215282048}
W20260709 13:10:03.688869 27115 log.cc:927] Time spent T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:03.747151 21729 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:03.781517 21729 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:03.600526 27075 consensus_queue.cc:237] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:03.735272 21879 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
W20260709 13:10:03.757400 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 344090us
I20260709 13:10:03.761983 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:10:03.784891 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 49701.8us
W20260709 13:10:03.767310 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 78938us
I20260709 13:10:03.762202 27192 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:03.794793 21764 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:03.829609 21879 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
W20260709 13:10:03.830288 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 48881.1us
I20260709 13:10:03.777792 27210 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:03.838126 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 47293.5us
I20260709 13:10:03.842372 21806 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:03.763190 27212 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:03.757164 27221 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:10:03.762552 27132 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:03.756069 27134 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:03.866149 21833 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:03.787989 27111 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:03.861855 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:03.865092 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:03.790000 27052 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:03.793895 27192 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.831372 27161 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:03.831542 27096 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.875072 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:03.763742 27114 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:03.876909 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:03.877290 21837 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:03.863548 21835 raft_consensus.cc:2955] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:03.902644 21914 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:03.938722 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 66157.9us
I20260709 13:10:03.870152 27155 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:03.787747 27226 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:03.870800 27165 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:03.857383 27199 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:10:03.947733 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 66021.3us
I20260709 13:10:03.963789 21877 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:03.870657 27052 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.869781 27197 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:03.971189 21912 raft_consensus.cc:1240] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:10:03.844163 27222 consensus_queue.cc:1059] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 13:10:03.860548 27210 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:03.878103 27154 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:03.874472 27192 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:03.943264 27144 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.993546 27282 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.983310 27223 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:03.986958 27161 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:03.979871 27165 raft_consensus.cc:697] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:04.033012 27153 raft_consensus.cc:3055] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:04.013185 27262 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:04.029614 27144 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.034680 27178 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:04.036801 22482 raft_consensus.cc:3060] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEARNER]: Advancing to term 16
I20260709 13:10:04.085347 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:04.038617 27226 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:04.014997 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 51350.2us
I20260709 13:10:04.043128 21914 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:10:04.054104 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:04.091715 21764 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:10:04.038663 27249 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:10:03.941022 27096 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.058058 27210 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.058753 27114 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:04.018199 27288 log.cc:927] Time spent T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:10:04.062505 27212 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:04.066145 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:04.131325 21758 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:10:04.068627 21759 raft_consensus.cc:1275] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:03.976356 27052 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.022389 27203 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.133607 21839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38348 (request call id 2625) took 1458 ms. Trace:
I20260709 13:10:04.016237 27247 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:03.947340 27155 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.134032 21839 rpcz_store.cc:276] 0709 13:10:02.660493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.660604 (+   111us) service_pool.cc:224] Handling call
0709 13:10:02.660920 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:03.668057 (+1007137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.118624 (+450567us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540025f3d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:10:04.118849 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2314371840}
I20260709 13:10:03.979192 27199 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:03.988881 27197 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:04.099687 21879 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
W20260709 13:10:04.146591 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 47033.5us
I20260709 13:10:04.024748 27270 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.104609 22484 raft_consensus.cc:1275] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:04.106209 21763 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 16.
I20260709 13:10:04.071283 27153 raft_consensus.cc:740] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:04.133077 21805 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:04.155107 27210 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:04.155520 27210 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.155848 27210 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.158399 27144 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:04.055841 27142 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.161579 27189 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.143580 21877 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:04.081698 27223 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.067099 27111 raft_consensus.cc:697] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:04.163951 27210 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.165251 27111 consensus_queue.cc:237] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.165908 27223 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:04.081882 27282 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.168963 27210 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.170181 27165 consensus_queue.cc:237] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:04.171537 27282 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.151963 27199 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.143337 27155 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:04.152510 27150 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:04.177686 27150 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.178085 27150 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:04.097621 27159 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:10:04.152346 27197 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.117319 22482 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 LEARNER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:04.183094 27197 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.161690 27142 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:04.185210 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:04.185526 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:04.185838 21758 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:04.186975 27142 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:04.187732 27270 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.188050 27203 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.188638 27203 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.193516 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:04.070480 27161 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.094475 27262 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.151695 27096 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.163731 27209 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.133087 27194 raft_consensus.cc:3055] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:04.191407 27162 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.195741 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:04.196950 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:04.218295 21764 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:04.192539 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:04.201058 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.220302 21759 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.199571 21758 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 18.
I20260709 13:10:04.202854 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.221784 21912 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 16.
I20260709 13:10:04.222050 21805 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:04.241894 21831 raft_consensus.cc:2393] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 12: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:04.203989 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.205655 21880 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:10:04.206768 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 63255us
I20260709 13:10:04.133868 27226 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:10:04.207940 21756 raft_consensus.cc:2393] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 9: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:04.170161 27189 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.199376 27270 consensus_queue.cc:1048] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:10:04.192026 27192 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.210991 27151 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:04.245904 21764 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 16.
I20260709 13:10:04.212033 27194 raft_consensus.cc:740] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:04.251101 21759 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:10:04.236603 27096 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.251976 21805 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:04.261864 27178 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.263626 27161 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.274541 27209 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.276654 27192 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.247915 27142 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:04.278096 27203 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.239660 27162 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:04.278973 27194 consensus_queue.cc:260] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:04.279994 27194 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:04.280977 27162 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:04.261636 27096 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.291087 27096 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.261729 27140 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:04.286742 21805 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:04.247133 27134 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:04.288550 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.295776 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:04.296454 21912 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:04.296798 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:04.297380 21758 raft_consensus.cc:3060] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.294476 21907 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 16.
I20260709 13:10:04.246954 27282 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.249511 27275 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:04.300735 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.310490 21729 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:04.311551 21912 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:10:04.294798 27197 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:04.300549 27184 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:04.300763 27270 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:04.318833 21758 raft_consensus.cc:2468] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:10:04.321818 27184 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:04.310501 27165 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:04.335456 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:04.333778 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:04.338862 21839 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:10:04.339072 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:04.305614 27282 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:04.335076 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:04.314499 27199 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.342121 21833 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:10:04.345638 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:04.339840 21729 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:04.346493 21840 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 16.
I20260709 13:10:04.320075 27275 raft_consensus.cc:697] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:04.302205 27155 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.347347 21729 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:04.354423 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:04.354909 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:04.348042 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:04.399626 21838 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 14.
I20260709 13:10:04.354697 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:04.328778 27210 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.336546 27132 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:04.439208 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:10:04.440523 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 179446us
I20260709 13:10:04.330245 27124 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:04.428251 21836 raft_consensus.cc:2393] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 16: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:04.429337 21839 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:10:04.330055 27223 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:10:04.432394 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 85142us
I20260709 13:10:04.362823 27148 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:04.378053 27297 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.343870 27111 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:04.342226 27116 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:04.451166 21833 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:10:04.381912 27262 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.460630 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:04.460898 27262 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.333331 27162 consensus_queue.cc:1059] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:10:04.397214 27184 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:04.461959 27184 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:04.462483 27184 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:04.463413 21805 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:04.464643 27186 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:04.465174 27186 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.452461 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.466462 21912 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:10:04.467610 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:04.468384 21758 raft_consensus.cc:2393] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:04.469875 27304 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.427193 21840 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:10:04.451610 21728 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:04.470512 27304 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:04.438933 27161 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:04.456748 21764 raft_consensus.cc:1275] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:04.457078 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:04.457830 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:04.395496 27282 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.458635 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:04.457731 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:04.476073 21756 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:10:04.457719 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:04.438761 27270 raft_consensus.cc:697] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:04.466272 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:04.363051 27114 consensus_queue.cc:1059] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 13:10:04.330914 27052 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.388629 27150 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.467645 21729 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:04.343010 27165 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:04.453749 27148 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:04.348342 27199 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.481979 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:04.454872 27111 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.461506 27262 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.454293 27197 raft_consensus.cc:697] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:04.438549 27210 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:04.487069 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:04.485728 27148 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:04.479568 27184 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:04.482121 27161 raft_consensus.cc:697] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:04.507550 27079 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:04.507200 27197 consensus_queue.cc:237] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.508126 27079 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.508742 27079 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:04.510278 27115 tablet_bootstrap.cc:492] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=2 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:04.488579 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:04.511538 27115 tablet_bootstrap.cc:492] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:10:04.511894 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:04.512307 27115 ts_tablet_manager.cc:1403] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 2.483s	user 0.051s	sys 0.022s
I20260709 13:10:04.488777 27111 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:04.477584 27096 raft_consensus.cc:3055] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:04.513705 27096 raft_consensus.cc:740] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:04.514602 27096 consensus_queue.cc:260] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.478071 27203 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:04.491375 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.515677 27203 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.515894 21912 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 16.
I20260709 13:10:04.516115 27203 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.516170 27199 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.516858 27304 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:04.516932 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.517647 21912 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 16.
I20260709 13:10:04.476121 27116 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:04.507233 27161 consensus_queue.cc:237] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.518496 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:04.518998 21912 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.519660 27116 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:04.494937 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.520479 21908 raft_consensus.cc:2393] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 12: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:04.521384 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:04.521534 27262 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.522302 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:04.454751 27297 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.495968 27254 raft_consensus.cc:2804] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:04.523399 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:04.523928 27254 raft_consensus.cc:697] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:04.524475 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:04.524993 27297 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.524750 27254 consensus_queue.cc:237] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.485275 27275 consensus_queue.cc:237] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.526296 27155 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:04.496650 27052 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:04.529078 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:04.530242 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:04.530539 21912 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:10:04.531991 21804 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:04.532001 21833 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
I20260709 13:10:04.533035 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.498019 21910 raft_consensus.cc:1275] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:04.498237 27165 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:04.498852 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:04.498943 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.492489 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:04.493149 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.536170 21908 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 16: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:04.534134 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:04.531018 21839 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 16.
I20260709 13:10:04.529085 21837 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 17.
I20260709 13:10:04.455457 27124 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.536895 21912 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:10:04.537793 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:04.534937 21911 raft_consensus.cc:2376] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12. Re-sending same reply.
I20260709 13:10:04.538806 21877 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:04.549311 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.549988 21910 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:10:04.551445 21804 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:04.551196 21836 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 14.
I20260709 13:10:04.473153 27223 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:04.559587 21832 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:10:04.562410 21912 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 18.
I20260709 13:10:04.563380 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:04.539954 27116 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:04.561723 27307 consensus_queue.cc:1048] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:10:04.566066 21912 raft_consensus.cc:2393] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 12: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:04.566957 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.568521 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.559296 27304 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:04.585404 27304 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.594053 27304 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:04.601899 27124 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.549033 27270 consensus_queue.cc:237] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.607745 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:04.614583 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.615336 21910 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
W20260709 13:10:04.571333 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 103678us
I20260709 13:10:04.574549 27308 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:04.574993 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:04.604208 27115 raft_consensus.cc:359] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:04.623369 21805 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:04.578632 21912 raft_consensus.cc:2368] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13.
I20260709 13:10:04.580511 27203 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:04.616817 21662 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45746 (request call id 244) took 3025 ms. Trace:
I20260709 13:10:04.626936 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.627516 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.628518 21910 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:10:04.630579 21912 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:10:04.624727 27308 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:04.634146 27308 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:04.589257 27153 consensus_queue.cc:260] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.634706 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.636355 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:04.627985 21662 rpcz_store.cc:276] 0709 13:10:01.589107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.589311 (+   204us) service_pool.cc:224] Handling call
0709 13:10:04.614348 (+3025037us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:01.947287 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:01.949996 (+  2709us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:01.950033 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:10:01.950051 (+    18us) tablet.cc:662] Decoding operations
0709 13:10:01.950474 (+   423us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:01.950551 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:01.950577 (+    26us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:10:01.950868 (+   291us) tablet.cc:701] Row locks acquired
0709 13:10:01.950885 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:10:01.951029 (+   144us) write_op.cc:270] Start()
0709 13:10:01.951136 (+   107us) write_op.cc:276] Timestamp: P: 1783602601950986 usec, L: 0
0709 13:10:01.951155 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:10:01.951810 (+   655us) log.cc:844] Serialized 917 byte log entry
0709 13:10:02.160181 (+208371us) op_driver.cc:464] REPLICATION: finished
0709 13:10:02.237578 (+ 77397us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6ab24d0ac 00007fc6b40a7ab9 00007fc6ab26969b 00007fc6ab26793f 00007fc6ab269c02 00007fc6b1d8def0
0709 13:10:02.426443 (+188865us) write_op.cc:301] APPLY: starting
0709 13:10:02.448177 (+ 21734us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:02.457571 (+  9394us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:02.457604 (+    33us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:02.459111 (+  1507us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:02.459367 (+   256us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:10:02.459433 (+    66us) write_op.cc:312] APPLY: finished
0709 13:10:02.459686 (+   253us) log.cc:844] Serialized 33 byte log entry
0709 13:10:02.459902 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:02.460015 (+   113us) write_op.cc:454] Released schema lock
0709 13:10:02.460077 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:02.460567 (+   490us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:02.460610 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":899314,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":233928,"apply.run_cpu_time_us":5036,"apply.run_wall_time_us":45129,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12495,"num_ops":2,"prepare.queue_time_us":156742,"prepare.run_cpu_time_us":2735,"prepare.run_wall_time_us":35476,"replication_time_us":186662,"spinlock_wait_cycles":35409792,"thread_start_us":210600,"threads_started":2}]]}
I20260709 13:10:04.636987 21759 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 17.
I20260709 13:10:04.636371 21912 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 16.
I20260709 13:10:04.639348 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:04.638548 21912 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:10:04.640290 21756 raft_consensus.cc:1275] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:04.626206 27124 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:04.640899 21912 raft_consensus.cc:606] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:04.621133 27115 raft_consensus.cc:740] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:10:04.643154 21912 raft_consensus.cc:614] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:04.644179 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:04.617863 27111 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.646992 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.652899 21910 raft_consensus.cc:2368] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13.
I20260709 13:10:04.649765 21729 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:04.648211 21805 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:04.625762 27196 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:10:04.659435 21840 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:10:04.642620 27124 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.681057 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:04.688418 21910 raft_consensus.cc:1275] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:10:04.692040 27210 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:04.699118 27313 consensus_queue.cc:1048] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:10:04.701892 27111 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.701517 27115 consensus_queue.cc:260] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:04.703469 27161 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:04.703955 27161 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.704373 27161 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:04.704069 27148 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.662043 27305 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:04.705910 27305 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.706236 27305 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:04.708154 21763 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 16.
I20260709 13:10:04.651000 27150 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:04.703594 27115 ts_tablet_manager.cc:1434] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.191s	user 0.009s	sys 0.000s
I20260709 13:10:04.719504 21840 raft_consensus.cc:1275] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:04.722851 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.724750 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:04.686116 27124 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:04.730911 21840 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:04.733783 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:04.722684 27212 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:04.769281 21840 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 17.
I20260709 13:10:04.769726 27315 consensus_queue.cc:1048] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:10:04.770606 21728 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:04.771725 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:04.772364 21840 raft_consensus.cc:2393] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 16: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:04.773118 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:04.773572 21840 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.774504 27304 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.775763 21910 raft_consensus.cc:2393] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 17: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:04.776767 27304 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:04.779275 27203 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:04.779999 27148 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.782688 27148 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:04.783197 27148 raft_consensus.cc:697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 17 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:04.784088 27148 consensus_queue.cc:237] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.787269 21840 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:10:04.792410 27116 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.792922 27116 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:04.798019 21728 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:04.799000 27315 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:04.800796 27022 tablet_bootstrap.cc:492] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:10:04.767598 21774 tablet_copy_service.cc:342] P 3843e9b794a245dd8608e04ec7915239: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-5e295b8b73874adcb77878c1ca4897ea received from {username='slave'} at 127.0.0.1:44772
I20260709 13:10:04.806411 21774 tablet_copy_service.cc:434] P 3843e9b794a245dd8608e04ec7915239: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-5e295b8b73874adcb77878c1ca4897ea on tablet 5e295b8b73874adcb77878c1ca4897ea with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:04.807351 27313 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:04.807919 27313 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.749768 27212 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:04.810490 27317 log.cc:927] Time spent T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:10:04.811415 27212 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:04.799516 27315 raft_consensus.cc:697] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 12 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:04.820813 27022 tablet_bootstrap.cc:492] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:10:04.821681 27022 ts_tablet_manager.cc:1403] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 2.367s	user 0.035s	sys 0.044s
I20260709 13:10:04.814401 27079 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.830309 27311 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.830408 27296 raft_consensus.cc:3055] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:04.835194 21910 raft_consensus.cc:1275] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:04.842439 22448 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:04.844748 21728 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:04.853116 27203 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:04.853596 27203 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.853940 27203 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:04.854112 27311 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.856348 27311 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.856801 27223 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:04.858450 27313 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.851148 27296 raft_consensus.cc:740] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:04.859323 27154 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:04.859807 27154 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.860239 27154 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:04.824590 27308 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.861057 21835 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:10:04.862138 27308 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:04.859611 27296 consensus_queue.cc:260] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.863981 27296 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:04.865790 27315 consensus_queue.cc:237] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:04.866918 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.869361 21905 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:10:04.866339 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:10:04.872987 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:04.877029 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:04.887457 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:04.888447 21759 raft_consensus.cc:2368] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13.
I20260709 13:10:04.894800 27022 raft_consensus.cc:359] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.896076 27022 raft_consensus.cc:740] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:10:04.896692 27022 consensus_queue.cc:260] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:04.905756 21905 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
I20260709 13:10:04.869577 27197 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:04.920540 21908 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 16.
I20260709 13:10:04.886000 27229 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.923601 27022 ts_tablet_manager.cc:1434] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.001s
I20260709 13:10:04.922231 21729 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:04.886091 27171 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:04.903781 27192 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:04.931318 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:04.928139 27187 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:04.933617 27187 raft_consensus.cc:697] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 16 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:04.934785 27187 consensus_queue.cc:237] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.889191 27111 consensus_queue.cc:1048] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:10:04.946956 21850 tablet_copy_service.cc:342] P 6fadfd81c5a645f1806a284ddbb6bf0d: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-d28f4c429d54450dbbeb1ac9f6b7cd55 received from {username='slave'} at 127.0.0.1:56424
I20260709 13:10:04.947449 21850 tablet_copy_service.cc:434] P 6fadfd81c5a645f1806a284ddbb6bf0d: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-d28f4c429d54450dbbeb1ac9f6b7cd55 on tablet d28f4c429d54450dbbeb1ac9f6b7cd55 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:04.922757 27116 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.992971 27116 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:04.994215 27327 log.cc:927] Time spent T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:10:04.994447 27154 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:04.958103 27203 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.930117 27171 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:04.924855 27197 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:04.926962 27229 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:04.921195 27305 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:04.943161 27192 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:04.984455 27079 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:05.002136 21804 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:05.003925 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:05.017584 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:05.004930 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:05.007016 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:05.018164 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:05.018831 21833 raft_consensus.cc:2368] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 17. Current term is 18.
I20260709 13:10:05.018851 21912 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:05.011617 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:05.007059 21834 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:05.020735 21911 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:05.021951 21831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38352 (request call id 3739) took 1151 ms. Trace:
I20260709 13:10:05.022310 21831 rpcz_store.cc:276] 0709 13:10:03.864945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:03.865060 (+   115us) service_pool.cc:224] Handling call
0709 13:10:05.016203 (+1151143us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b5400403654. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:10:05.016345 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":698112896}
I20260709 13:10:05.024374 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:05.023196 21804 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:05.028513 21836 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:10:05.030885 21804 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:05.039479 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:05.041079 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:05.041916 21764 raft_consensus.cc:2368] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 11. Current term is 12.
I20260709 13:10:05.041762 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:05.042563 21756 raft_consensus.cc:2368] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 17. Current term is 18.
I20260709 13:10:05.044559 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:05.045622 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:05.023567 27116 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:05.052443 21877 leader_election.cc:400] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 17. Current term is 18.
I20260709 13:10:05.052770 21877 leader_election.cc:403] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:10:05.055689 21804 leader_election.cc:400] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13.
I20260709 13:10:05.056198 21804 leader_election.cc:403] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:05.014348 27187 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:05.060993 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:05.062678 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:05.063573 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:05.063949 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:05.049906 27305 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:05.065455 21764 raft_consensus.cc:2393] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 12: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:05.100955 21757 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 17. Current term is 18. Ops: [17.11-17.11]
W20260709 13:10:05.101747 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 63212.6us
I20260709 13:10:05.076144 21760 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 16: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:05.049597 27212 consensus_queue.cc:1048] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:05.103147 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:05.109743 21763 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:10:05.113854 27312 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:05.103693 27116 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:10:05.060736 27194 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.020610 27161 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:05.051896 27308 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.124257 27132 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:05.124826 21908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:10:05.125411 21908 raft_consensus.cc:606] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:05.134503 21804 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:05.140786 21804 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:05.142318 21804 leader_election.cc:400] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13.
I20260709 13:10:05.143049 21804 leader_election.cc:403] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:05.066380 27075 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:10:05.158401 21912 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:10:05.154589 21804 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:05.065894 27187 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:05.137894 27298 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
W20260709 13:10:05.167824 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.152118 27305 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:05.151250 27308 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:05.149649 27209 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13.
W20260709 13:10:05.178634 27331 log.cc:927] Time spent T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:10:05.169099 27079 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:10:05.160135 27271 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 13:10:05.166250 27313 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:05.182231 27313 raft_consensus.cc:697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:05.183327 27116 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13.
I20260709 13:10:05.183158 27313 consensus_queue.cc:237] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:05.169543 27111 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:05.184470 27111 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:05.168846 27305 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:05.185611 27305 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:05.186385 27332 log.cc:927] Time spent T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:10:05.177968 27298 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:05.193079 27298 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:05.193727 27308 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:05.194231 27308 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:05.198748 27079 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:05.198477 27305 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:05.199347 27079 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:05.204838 27111 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:05.206384 27338 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:05.206451 27305 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:05.207279 27338 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:05.209821 27154 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:05.210224 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:05.210474 27154 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:05.211048 27154 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:05.214708 27161 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:05.216171 27203 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:05.218706 27187 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:05.220717 27192 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:05.124854 27132 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:05.225771 27132 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:05.226984 27197 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:05.228292 27229 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:05.229002 27229 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:05.129626 27194 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:05.234520 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:05.251643 21905 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:10:05.251698 21913 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 16.
I20260709 13:10:05.258455 21729 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:05.229693 27229 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:05.279548 21805 leader_election.cc:400] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13.
I20260709 13:10:05.161866 27312 consensus_queue.cc:1048] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
W20260709 13:10:05.259087 27330 log.cc:927] Time spent T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
W20260709 13:10:05.281672 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 169775us
I20260709 13:10:05.284633 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:05.281308 27148 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:05.283934 21729 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:05.290663 21879 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:05.291344 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:05.300168 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:05.301565 21759 raft_consensus.cc:2410] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:10:05.303215 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:05.303973 21759 raft_consensus.cc:2368] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10.
I20260709 13:10:05.306782 21911 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 18.
I20260709 13:10:05.307823 21764 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:05.309352 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:05.310114 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:10:05.306008 27277 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.003s	sys 0.035s
I20260709 13:10:05.312291 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:05.332651 21879 leader_election.cc:400] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 11. Current term is 12.
I20260709 13:10:05.332583 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:05.333118 21879 leader_election.cc:403] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:05.335388 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:05.336560 21758 raft_consensus.cc:2393] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 18: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:05.338002 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:05.338606 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:05.338783 21905 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:05.295104 27203 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:05.339243 22482 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:10:05.339901 21763 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:05.340790 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:05.341055 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:05.341732 21834 raft_consensus.cc:2393] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 18: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:05.337986 21879 leader_election.cc:400] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 17. Current term is 18.
I20260709 13:10:05.297039 27148 raft_consensus.cc:697] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:05.371789 21905 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:10:05.373857 27148 consensus_queue.cc:237] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:05.342419 21879 leader_election.cc:403] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:05.344509 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:05.345355 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:05.347886 21805 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:05.348115 27211 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 11. Current term is 12.
I20260709 13:10:05.348191 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:05.348493 27229 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:05.348897 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:05.350157 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:05.351316 27338 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:05.351723 21759 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:05.394470 21837 raft_consensus.cc:2393] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 12: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:05.353729 27339 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:05.355383 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:05.286999 27296 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:10:05.344108 27203 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:05.360433 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:05.308944 27079 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:05.363253 27341 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:05.364415 27111 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:05.364890 27187 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:05.365629 27171 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:05.370779 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.370965 27194 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:05.371508 27186 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:05.371789 27154 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:05.372381 27209 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:05.399542 27203 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:05.426815 27209 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:05.339495 27124 consensus_meta.cc:287] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.604s	user 0.011s	sys 0.000s
I20260709 13:10:05.382580 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:05.311208 27143 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:05.332432 27226 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 17. Current term is 18.
W20260709 13:10:05.311152 27277 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.003s	sys 0.035s
I20260709 13:10:05.386257 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:10:05.386360 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 48534.9us
I20260709 13:10:05.386750 22449 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:05.430855 27187 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:05.388620 21805 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:05.393071 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:05.402213 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:05.432654 27209 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:05.394907 27125 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:05.433677 21832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38348 (request call id 2646) took 1055 ms. Trace:
I20260709 13:10:05.390671 27132 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 17. Current term is 18.
I20260709 13:10:05.402756 27339 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:05.434212 27197 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:05.436158 27339 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:05.410609 27079 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:05.410822 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:05.430070 27313 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:05.438452 27313 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:05.440958 27313 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:05.417119 27341 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:05.430413 22482 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:05.443264 27341 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:05.444027 21879 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:05.445271 21879 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:05.447158 27132 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:05.449209 22482 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
W20260709 13:10:05.452013 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 65346.5us
I20260709 13:10:05.453275 27339 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:05.454911 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:05.457767 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:05.457173 21659 catalog_manager.cc:5697] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:05.458942 21838 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38348 (request call id 2640) took 1123 ms. Trace:
I20260709 13:10:05.459254 27192 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:05.459311 21838 rpcz_store.cc:276] 0709 13:10:04.335163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.338857 (+  3694us) service_pool.cc:224] Handling call
0709 13:10:05.458791 (+1119934us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x7b540045c4d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:10:05.458892 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137634688}
I20260709 13:10:05.459882 27192 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:05.461093 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:05.461567 27161 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:05.461814 22479 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:10:05.462098 27161 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:05.432706 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 44209.7us
I20260709 13:10:05.464156 21805 leader_election.cc:400] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10.
I20260709 13:10:05.429903 27124 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:05.466639 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:05.467908 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:05.468050 27143 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:05.468721 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:05.429242 27308 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:05.470815 27096 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:05.471827 27308 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:05.472221 27187 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:05.436889 27079 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:05.475150 27079 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:05.469762 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:05.429811 27111 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:05.477622 27111 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:05.464183 27161 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:05.481606 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:05.481804 21839 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38352 (request call id 3749) took 1016 ms. Trace:
I20260709 13:10:05.466696 27124 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:05.482139 21839 rpcz_store.cc:276] 0709 13:10:04.465705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.645125 (+179420us) service_pool.cc:224] Handling call
0709 13:10:04.828888 (+183763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.829211 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.829238 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:04.829753 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 13:10:04.852602 (+ 22849us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:04.852658 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:04.852721 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:04.962332 (+109611us) raft_consensus.cc:1685] finished
0709 13:10:04.962350 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.481565 (+519215us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54002bff50. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae3568ad 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:10:05.481750 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5144,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":421663488,"thread_start_us":22451,"threads_started":1,"wal-append.queue_time_us":82053}
I20260709 13:10:05.483685 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:05.453804 27339 raft_consensus.cc:697] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:05.491117 21913 raft_consensus.cc:1275] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:05.481617 21663 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52326 (request call id 169) took 3658 ms. Trace:
I20260709 13:10:05.486150 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:05.493875 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:05.499485 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:05.501586 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:05.503235 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:05.505152 21804 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:05.508282 21729 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:05.511708 22450 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:05.434046 21832 rpcz_store.cc:276] 0709 13:10:04.378098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.438948 (+ 60850us) service_pool.cc:224] Handling call
0709 13:10:05.433522 (+994574us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54003c0ad4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:10:05.433622 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275107072}
I20260709 13:10:05.515491 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:10:05.515633 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 68942.5us
I20260709 13:10:05.516283 21914 raft_consensus.cc:2393] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 19: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:05.516352 21879 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:05.517598 21879 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:05.517678 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:05.537010 27335 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.542645 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:05.543963 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:05.544637 21914 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:05.546387 21913 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:10:05.550902 21879 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:05.556696 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 64295.3us
I20260709 13:10:05.542860 22450 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:05.559239 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:05.560890 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:10:05.561288 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 53119.2us
I20260709 13:10:05.562134 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:05.562846 21911 raft_consensus.cc:2368] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13.
I20260709 13:10:05.563601 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:05.565912 21879 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:05.566880 21914 raft_consensus.cc:2468] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 17.
W20260709 13:10:05.570147 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 65070.7us
I20260709 13:10:05.564095 21911 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:05.579701 22450 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:05.591787 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:05.593314 21914 raft_consensus.cc:1275] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:05.593708 21804 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:05.594332 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:05.594439 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:05.597700 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:05.598768 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:05.599066 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:05.599670 21762 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:05.600116 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:05.599723 21756 raft_consensus.cc:2393] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:05.601564 21764 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:10:05.602648 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:05.603278 21757 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:10:05.605062 21911 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
I20260709 13:10:05.562242 27142 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:05.492266 21663 rpcz_store.cc:276] 0709 13:10:01.823448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:01.823587 (+   139us) service_pool.cc:224] Handling call
0709 13:10:05.481547 (+3657960us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:02.030528 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:02.031131 (+   603us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:02.031165 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:10:02.031185 (+    20us) tablet.cc:662] Decoding operations
0709 13:10:02.031558 (+   373us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:02.031609 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:02.031641 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:10:02.031878 (+   237us) tablet.cc:701] Row locks acquired
0709 13:10:02.031900 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:10:02.032055 (+   155us) write_op.cc:270] Start()
0709 13:10:02.032168 (+   113us) write_op.cc:276] Timestamp: P: 1783602602031995 usec, L: 0
0709 13:10:02.032194 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:10:02.032865 (+   671us) log.cc:844] Serialized 530 byte log entry
0709 13:10:02.379445 (+346580us) op_driver.cc:464] REPLICATION: finished
0709 13:10:02.461042 (+ 81597us) write_op.cc:301] APPLY: starting
0709 13:10:02.461133 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:02.547336 (+ 86203us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:02.555214 (+  7878us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:02.595795 (+ 40581us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:02.595962 (+   167us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:10:02.596009 (+    47us) write_op.cc:312] APPLY: finished
0709 13:10:02.596192 (+   183us) log.cc:844] Serialized 25 byte log entry
0709 13:10:02.596373 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:02.596447 (+    74us) write_op.cc:454] Released schema lock
0709 13:10:02.596483 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:02.596821 (+   338us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:02.596848 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1149154,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":76843,"apply.run_cpu_time_us":3861,"apply.run_wall_time_us":135723,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4184,"num_ops":1,"prepare.queue_time_us":1036,"prepare.run_cpu_time_us":2591,"prepare.run_wall_time_us":2591,"replication_time_us":336511,"thread_start_us":109018,"threads_started":1}]]}
I20260709 13:10:05.569029 27079 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:05.564575 27143 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:05.609887 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:05.615491 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 2076) took 1123 ms. Trace:
I20260709 13:10:05.610224 22479 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:10:05.609059 21804 leader_election.cc:400] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13.
I20260709 13:10:05.586436 27211 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:05.577628 27229 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:05.620401 22450 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:05.590271 27271 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:05.616750 21804 leader_election.cc:403] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:10:05.585887 27154 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:05.624286 21762 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
I20260709 13:10:05.588917 27305 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:05.624979 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:05.556279 27282 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:10:05.626188 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:10:05.646529 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 189227us
I20260709 13:10:05.571077 27124 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:10:05.615875 21909 rpcz_store.cc:276] 0709 13:10:04.491581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.491693 (+   112us) service_pool.cc:224] Handling call
0709 13:10:04.491982 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:04.534063 (+ 42081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:04.534092 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:04.829029 (+294937us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b18003ddf20. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab2382a6 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6acc50a11 00007fc6acc60372 00007fc6ae392a01 00007fc6ae35743a
0709 13:10:05.229237 (+400208us) spinlock_profiling.cc:243] Waited 985 us on lock 0x7b2c00021ff8. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6acc50a11 00007fc6acc60372 00007fc6ae392a01 00007fc6ae35743a 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2
0709 13:10:05.229892 (+   655us) log.cc:844] Serialized 26 byte log entry
0709 13:10:05.467806 (+237914us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:05.467852 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:05.467919 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:05.615311 (+147392us) raft_consensus.cc:1685] finished
0709 13:10:05.615330 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:05.615439 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41885,"raft.queue_time_us":41305,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5282,"spinlock_wait_cycles":5040768,"thread_start_us":237511,"threads_started":1,"wal-append.queue_time_us":220578}
I20260709 13:10:05.632207 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:05.659322 22484 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 20.
I20260709 13:10:05.570887 27209 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:10:05.607393 27140 raft_consensus.cc:2764] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:10:05.652909 22449 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:05.761116 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 108339us
I20260709 13:10:05.613374 27313 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:05.588521 27151 consensus_queue.cc:1059] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:10:05.669179 21728 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:05.616573 27192 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:05.696022 27329 log.cc:927] Time spent T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:10:05.763945 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 116486us
I20260709 13:10:05.767163 21911 raft_consensus.cc:1240] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:05.771111 21905 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:05.633358 27079 raft_consensus.cc:697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 10 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:05.639534 27047 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:05.807916 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 138840us
I20260709 13:10:05.809315 21728 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:05.762343 22449 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:05.618355 27335 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:10:05.788134 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 179253us
I20260709 13:10:05.815465 21804 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:05.816885 21804 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:05.616729 27299 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.143s
I20260709 13:10:05.632921 27348 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:05.806972 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 161255us
I20260709 13:10:05.814065 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:05.761168 27197 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:05.820353 21731 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:05.770591 27194 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:05.763759 27271 raft_consensus.cc:697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:05.820612 27178 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:05.860567 21731 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:05.861742 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:05.863468 22480 raft_consensus.cc:1240] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:10:05.648274 27154 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:05.818238 27161 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:10:05.867149 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 50315.5us
I20260709 13:10:05.663195 27305 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:05.821161 27192 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:05.873168 21839 raft_consensus.cc:1275] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:05.873314 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:05.874440 22482 raft_consensus.cc:2368] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12.
I20260709 13:10:05.633074 27339 consensus_queue.cc:237] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:05.880254 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:05.878222 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:05.884821 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:05.867916 27116 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:05.866025 27313 raft_consensus.cc:2804] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:05.866714 27187 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:05.821766 27203 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:05.890316 21832 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 10.
I20260709 13:10:05.870296 27148 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:05.869839 27111 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:05.862556 27312 consensus_queue.cc:1048] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:10:05.861768 27134 consensus_queue.cc:1059] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:10:05.913905 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:05.913268 27148 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:05.918479 27354 log.cc:927] Time spent T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:10:05.920243 27148 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:05.899420 27187 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:05.921912 27187 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:05.931787 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:05.932633 21905 raft_consensus.cc:1240] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:05.822052 27335 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:05.933765 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:05.934432 21911 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 16.
I20260709 13:10:05.935722 27335 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:05.947746 27313 raft_consensus.cc:697] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:05.948931 27154 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:05.949786 21912 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:05.949033 27313 consensus_queue.cc:237] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:05.949550 27271 consensus_queue.cc:237] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:05.956327 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:05.954519 27362 consensus_queue.cc:1059] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:05.910424 27116 raft_consensus.cc:697] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:05.967229 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:05.969568 22482 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:10:05.969771 22483 raft_consensus.cc:2393] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 15: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
W20260709 13:10:05.974123 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:05.986435 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:05.987686 21880 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:05.990094 21880 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:05.992645 21806 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:05.993202 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:05.993553 27075 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:05.993847 22482 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 19.
I20260709 13:10:05.995139 21806 leader_election.cc:400] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12.
I20260709 13:10:05.995858 21806 leader_election.cc:403] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:05.996699 27075 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983) with higher term. Message: Invalid argument: T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12.
I20260709 13:10:05.971247 21729 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:06.001519 27315 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:06.003396 21729 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:06.004462 27315 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:06.010483 27249 raft_consensus.cc:3055] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:06.011044 27249 raft_consensus.cc:740] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:06.013870 22450 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:06.001312 27347 log.cc:927] Time spent T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:10:06.012046 27249 consensus_queue.cc:260] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:06.023276 27249 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:06.025322 21758 raft_consensus.cc:1240] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 16. Current term is 17. Ops: []
W20260709 13:10:06.034001 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 271795us
I20260709 13:10:05.968595 27353 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:06.038422 22449 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:06.039623 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 230393us
W20260709 13:10:06.040522 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 180165us
I20260709 13:10:06.045229 21761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:32926
I20260709 13:10:06.045889 21761 raft_consensus.cc:606] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:06.046162 21728 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
W20260709 13:10:06.049214 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 59191.8us
W20260709 13:10:06.051080 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 47780.4us
I20260709 13:10:05.911103 27079 consensus_queue.cc:237] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:05.964582 27364 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:10:06.032214 27109 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:06.031452 27151 consensus_queue.cc:1059] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:10:06.053944 27360 raft_consensus.cc:2764] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 13:10:06.066733 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 68442.7us
I20260709 13:10:06.057335 27226 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:06.059437 27264 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:06.088076 21836 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:06.048496 27353 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:06.080333 27226 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:10:06.113981 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 100204us
I20260709 13:10:06.073091 21806 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:06.116549 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:06.117654 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:06.118418 21762 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
W20260709 13:10:06.116905 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 43903.2us
W20260709 13:10:06.123787 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 85453.4us
I20260709 13:10:06.124642 22449 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:06.117246 21761 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
I20260709 13:10:06.126281 21806 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:06.133383 21759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:32926
I20260709 13:10:06.134174 21759 raft_consensus.cc:606] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:06.104592 27226 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:06.099313 27305 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:06.142096 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 79698.2us
I20260709 13:10:06.127053 27124 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:06.127200 27047 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:06.151865 22449 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:06.096834 27264 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:06.154608 21839 raft_consensus.cc:1240] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:06.085795 27116 consensus_queue.cc:237] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:06.164989 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:06.157060 21806 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:06.139003 27296 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.158919 27371 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:06.170157 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:06.170404 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:06.171171 21756 raft_consensus.cc:1240] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:06.133037 27075 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 13:10:06.174927 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:06.176093 21731 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:06.178385 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:10:06.159705 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 85315.3us
I20260709 13:10:06.182041 21728 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:06.147372 27187 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:06.159431 27203 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:06.157444 27367 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:06.207906 21806 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
W20260709 13:10:06.218261 27375 log.cc:927] Time spent T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:10:06.221591 27342 consensus_queue.cc:1048] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:10:06.224884 22484 raft_consensus.cc:1275] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:06.173451 27296 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:06.227995 27296 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:06.228592 27124 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:06.173707 27154 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:06.229395 27124 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:06.232179 27124 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:06.234536 27264 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:06.235836 27197 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13.
I20260709 13:10:06.140630 27368 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:10:06.240741 27221 raft_consensus.cc:3055] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:06.243022 27187 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:06.207088 27305 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:06.260625 21729 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:10:06.247506 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 48603.3us
I20260709 13:10:06.245904 22450 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
W20260709 13:10:06.250011 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 68041.6us
I20260709 13:10:06.262313 21728 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:06.263557 21879 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:06.264218 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:06.206622 27315 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:06.267089 22476 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:10:06.269503 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:06.270123 21913 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:10:06.270682 21913 raft_consensus.cc:606] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 15 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:06.271200 21911 raft_consensus.cc:1240] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:06.271812 27367 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:06.272248 27367 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:06.272643 27367 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.273599 27124 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:06.274143 27376 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:06.274183 27124 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:06.277702 27124 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:06.283217 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:06.285107 21910 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:10:06.288657 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 48391.6us
I20260709 13:10:06.289880 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:06.291229 27161 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:06.291703 27161 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:06.283784 27151 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:06.329916 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:06.297919 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:06.251479 27221 raft_consensus.cc:740] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:10:06.337257 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 76737us
I20260709 13:10:06.253834 27308 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:06.311911 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:06.334313 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:10:06.334594 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 47123.8us
I20260709 13:10:06.266852 27296 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:06.299767 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:06.296788 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:06.283923 27155 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.345391 21837 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 16.
W20260709 13:10:06.295040 27384 log.cc:927] Time spent T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:10:06.350656 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 86030.9us
W20260709 13:10:06.358572 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 60338.8us
I20260709 13:10:06.285923 27109 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:06.361956 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:06.364264 21729 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:06.292085 27161 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.374802 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:06.285346 27197 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
W20260709 13:10:06.357609 27096 consensus_meta.cc:287] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.886s	user 0.012s	sys 0.000s
I20260709 13:10:06.346176 27364 raft_consensus.cc:493] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:06.348129 27308 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:06.330045 27075 consensus_queue.cc:1059] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:10:06.376420 27385 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:06.335415 27124 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:10:06.343163 27212 consensus_queue.cc:1059] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:10:06.395025 21729 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:06.375058 27353 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:06.389501 27308 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:06.371414 27360 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:10:06.360524 27155 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:06.406440 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 45532.4us
I20260709 13:10:06.392514 27148 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.393239 27096 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:06.377687 27109 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:06.416990 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 46553.8us
I20260709 13:10:06.383663 27226 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:06.428231 27305 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:06.430697 21729 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.20.40.3:43881 timed out after 1.804s (SENT) [suppressed 98 similar messages]
I20260709 13:10:06.392012 27367 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:06.392949 27221 consensus_queue.cc:260] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:06.449636 21835 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:06.453814 27395 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:06.453608 27124 consensus_queue.cc:1059] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:06.454741 27124 raft_consensus.cc:3055] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:06.455106 27124 raft_consensus.cc:740] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:06.455977 27124 consensus_queue.cc:260] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:06.457211 27124 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:06.457899 27393 log.cc:927] Time spent T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:10:06.461757 27109 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:06.392701 27364 raft_consensus.cc:515] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:06.464213 27364 leader_election.cc:290] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:06.467216 27209 raft_consensus.cc:1064] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:10:06.467801 27367 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:06.443622 27385 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:06.468312 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:06.468586 27385 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.468935 27385 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:06.420794 27096 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:06.470546 27155 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:06.471871 27402 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:06.472257 27096 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:06.474236 27226 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 21 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:06.415220 27148 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:06.475592 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:06.476234 21837 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
W20260709 13:10:06.476403 27388 log.cc:927] Time spent T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:10:06.412645 27187 consensus_queue.cc:1059] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:10:06.472440 27402 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:06.494027 27394 log.cc:927] Time spent T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:10:06.498373 27313 raft_consensus.cc:3055] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:06.498912 27313 raft_consensus.cc:740] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:06.499782 27313 consensus_queue.cc:260] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:06.501103 27313 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:06.501766 27187 raft_consensus.cc:3055] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:06.502189 27187 raft_consensus.cc:740] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:10:06.501233 27355 log.cc:927] Time spent T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.619s	user 0.003s	sys 0.000s
I20260709 13:10:06.502996 27187 consensus_queue.cc:260] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:06.504132 27187 raft_consensus.cc:3060] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:06.511381 27192 raft_consensus.cc:993] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:10:06.512061 27192 raft_consensus.cc:1081] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:10:06.512456 27402 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:06.521931 27308 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:06.523656 21835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38348
I20260709 13:10:06.524248 21835 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:06.524712 21835 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:06.533396 27186 raft_consensus.cc:993] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:10:06.534148 27186 raft_consensus.cc:1081] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:10:06.536345 27144 raft_consensus.cc:993] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:10:06.536870 27144 raft_consensus.cc:1081] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
W20260709 13:10:06.539067 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.539285 27153 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:06.541893 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.542614 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:06.542778 27368 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:06.544099 27368 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:06.545846 21837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38348
I20260709 13:10:06.546500 21837 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:06.546918 21837 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.554523 21805 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:06.554975 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:06.556653 21833 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:06.557826 27313 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:06.560206 21758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 2074) took 1217 ms. Trace:
I20260709 13:10:06.560598 21758 rpcz_store.cc:276] 0709 13:10:05.343260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:05.343584 (+   324us) service_pool.cc:224] Handling call
0709 13:10:05.343833 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:06.025733 (+681900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.559955 (+534222us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b540028d554. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:10:06.560117 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1566876928}
I20260709 13:10:06.563367 27368 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:06.565645 27197 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:06.567493 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:06.577409 27221 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:06.596097 27148 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:06.602550 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:06.603262 21839 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 16.
I20260709 13:10:06.611811 27209 consensus_queue.cc:237] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:06.621649 21728 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:06.623469 27298 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:06.624534 27298 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:06.625474 27298 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:06.628057 27161 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:06.670230 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 252425us
I20260709 13:10:06.678076 21835 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:06.685629 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.679677 21837 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:06.686693 21728 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:06.704301 21728 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:06.707967 27385 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:06.711512 27385 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:06.721727 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:06.723795 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:06.724743 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:06.726879 21905 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 21 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:06.733014 21911 raft_consensus.cc:1275] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:10:06.735389 21834 raft_consensus.cc:2393] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 12: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:06.718977 22448 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:06.737461 27203 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:06.744009 27203 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:06.744614 27313 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:06.745462 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "667c64e212614c7ca822788e9d37fc29" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:06.746099 27203 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:06.746634 27365 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:06.747056 27365 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.747423 27365 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.747267 27403 consensus_queue.cc:1059] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:06.747985 27403 consensus_queue.cc:1243] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer 6fadfd81c5a645f1806a284ddbb6bf0d log is divergent from this leader: its last log entry 18.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:10:06.748479 27403 raft_consensus.cc:3055] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:06.748762 27403 raft_consensus.cc:740] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:06.749593 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:06.749989 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:06.750653 21833 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:10:06.751446 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:06.753409 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:06.742851 21905 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:10:06.739099 27140 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:06.755275 27140 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:06.758626 21728 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:06.761243 27403 consensus_queue.cc:260] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:06.763309 21835 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:06.764071 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 45184.8us
W20260709 13:10:06.765049 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:06.761861 27399 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:06.762292 27140 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:06.766640 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:06.767499 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:06.762641 27148 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:10:06.773613 27341 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:06.840256 27404 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:06.841542 21837 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:10:06.831211 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 58507.2us
W20260709 13:10:06.838406 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 66014.8us
I20260709 13:10:06.839221 27385 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:10:06.836333 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.895263 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 152018us
I20260709 13:10:06.873757 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:10:06.894937 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:06.854540 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 423838us
I20260709 13:10:06.911320 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:10:06.900646 27079 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.000s	sys 0.023s
I20260709 13:10:06.920626 27125 raft_consensus.cc:3055] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:06.922322 27125 raft_consensus.cc:740] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:06.839351 27311 consensus_queue.cc:1048] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:10:06.924360 27125 consensus_queue.cc:260] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:06.925412 27125 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:06.930578 21877 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:06.930614 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:06.932971 21804 leader_election.cc:304] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:06.934996 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:06.845093 27403 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:06.936005 21880 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.016s	sys 0.010s
W20260709 13:10:06.938223 21880 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.016s	sys 0.010s
I20260709 13:10:06.941371 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:06.941702 22482 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEARNER]: Advancing to term 15
I20260709 13:10:06.941989 22484 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:06.916353 27148 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:06.949791 21880 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:06.944388 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:06.950874 21905 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:06.843477 27399 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:06.945024 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:06.912788 27315 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:06.906610 27398 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:06.853768 27335 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
W20260709 13:10:06.927779 27079 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.000s	sys 0.024s
I20260709 13:10:06.886428 27197 consensus_queue.cc:1059] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 13:10:06.955775 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:06.955624 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:06.960006 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:06.960664 21911 raft_consensus.cc:2393] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 19: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:06.970002 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:06.971724 21911 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 17. Current term is 18. Ops: []
I20260709 13:10:06.963908 21912 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:06.964886 22482 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEARNER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:06.910910 27385 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:06.980703 22482 raft_consensus.cc:1240] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:06.966481 21763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:10:06.912935 27298 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:06.942708 27132 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:06.981779 21763 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:06.988027 21763 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:06.982228 21910 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:06.985052 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:06.986378 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:06.952917 27308 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 19 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:06.960975 27399 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:06.959729 27401 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:06.990244 27116 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:10:06.983822 27247 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:07.003551 27124 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:06.962080 27311 raft_consensus.cc:2749] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:07.006389 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:07.046175 27298 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:07.044371 21729 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:07.047926 27385 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:07.047992 21763 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:07.048599 27385 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:07.050300 21763 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:07.047788 21729 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:06.987336 27132 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.060037 27132 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:07.065078 21757 raft_consensus.cc:1240] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:10:07.066466 27368 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:07.005067 27079 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:07.067315 27079 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:07.068737 21763 raft_consensus.cc:1240] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:06.966845 27398 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:07.071424 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:07.072494 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:07.025399 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:10:07.011216 27366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.026s	sys 0.060s
W20260709 13:10:07.029233 27411 log.cc:927] Time spent T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:10:07.035737 22483 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 19.
I20260709 13:10:07.041559 27275 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:07.043268 27161 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:06.962728 27315 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:07.043931 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 55957.9us
I20260709 13:10:07.052399 27364 consensus_queue.cc:1059] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:07.193420 27364 raft_consensus.cc:3055] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:07.193853 27364 raft_consensus.cc:740] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:07.194739 27364 consensus_queue.cc:260] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:07.196007 27364 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:07.043963 27153 consensus_meta.cc:287] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.504s	user 0.004s	sys 0.007s
W20260709 13:10:07.055191 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 45123.2us
W20260709 13:10:07.055744 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 45159.6us
I20260709 13:10:07.024088 21905 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:10:07.074172 21764 raft_consensus.cc:1240] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 10 LEADER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:07.200377 27315 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:07.201211 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.083067 21833 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:10:07.201694 21833 pending_rounds.cc:85] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting all ops after (but not including) 6
I20260709 13:10:07.085807 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:07.086473 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:07.201930 21907 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:10:07.201969 21833 pending_rounds.cc:107] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:10:07.202914 21833 raft_consensus.cc:2889] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:07.016507 22484 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:10:07.143832 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:07.173184 21661 catalog_manager.cc:5697] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 11 to 12, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 12 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:07.078192 27366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.026s	sys 0.061s
I20260709 13:10:07.178740 21806 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:07.207141 21806 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:10:07.185002 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 87909.4us
I20260709 13:10:07.201125 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:07.210093 21764 raft_consensus.cc:3055] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:07.210489 21764 raft_consensus.cc:740] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:07.065246 21659 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45778 (request call id 299) took 4776 ms. Trace:
I20260709 13:10:07.087123 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:07.211658 22484 raft_consensus.cc:1240] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:07.212643 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:07.214593 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:07.215355 22483 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:07.044524 27143 consensus_queue.cc:1059] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.139s
I20260709 13:10:07.228858 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:07.169552 27079 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:07.229586 21761 raft_consensus.cc:3055] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:07.239511 21761 raft_consensus.cc:740] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:07.230985 21911 raft_consensus.cc:1240] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:10:07.232949 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:07.235003 22483 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:10:07.226606 21880 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:07.211365 21764 consensus_queue.cc:260] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:07.175541 27362 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:07.077095 27247 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:07.225894 27150 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:07.245599 27221 consensus_meta.cc:287] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.661s	user 0.005s	sys 0.008s
I20260709 13:10:07.228964 27311 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:07.261381 27311 raft_consensus.cc:697] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:07.261523 27151 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:10:07.261706 27150 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:07.262308 27311 consensus_queue.cc:237] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:07.262671 27161 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:07.212112 21659 rpcz_store.cc:276] 0709 13:10:02.289303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.289467 (+   164us) service_pool.cc:224] Handling call
0709 13:10:02.778657 (+489190us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54002ae254. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c1090 00007fc6ae35ff3a 00007fc6b41161cc 00007fc6b421437e 00007fc6b26d52a4 00007fc6b26d5232 00007fc6b26d5161 00007fc6b26d50dc 00007fc6b26d4392 00007fc6ac69248c 00007fc6ac6918c6
0709 13:10:07.065166 (+4286509us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:05.807210 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:05.943782 (+136572us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:05.943816 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:10:05.943832 (+    16us) tablet.cc:662] Decoding operations
0709 13:10:05.944179 (+   347us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:05.944259 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:05.944289 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:10:05.944471 (+   182us) tablet.cc:701] Row locks acquired
0709 13:10:05.944488 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:10:05.944641 (+   153us) write_op.cc:270] Start()
0709 13:10:05.944772 (+   131us) write_op.cc:276] Timestamp: P: 1783602605944594 usec, L: 0
0709 13:10:05.944794 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:10:05.945508 (+   714us) log.cc:844] Serialized 535 byte log entry
0709 13:10:06.376300 (+430792us) op_driver.cc:464] REPLICATION: finished
0709 13:10:06.984790 (+608490us) write_op.cc:301] APPLY: starting
0709 13:10:06.991984 (+  7194us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:07.028981 (+ 36997us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:07.029090 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:07.030034 (+   944us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:07.030214 (+   180us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:10:07.030258 (+    44us) write_op.cc:312] APPLY: finished
0709 13:10:07.030466 (+   208us) log.cc:844] Serialized 25 byte log entry
0709 13:10:07.030620 (+   154us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:07.030691 (+    71us) write_op.cc:454] Released schema lock
0709 13:10:07.030725 (+    34us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:07.031108 (+   383us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:07.031133 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1630419,"reported_tablets":5,"spinlock_wait_cycles":303092480,"child_traces":[["op",{"apply.queue_time_us":575603,"apply.run_cpu_time_us":3796,"apply.run_wall_time_us":63164,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8311,"num_ops":1,"prepare.queue_time_us":236599,"prepare.run_cpu_time_us":11158,"prepare.run_wall_time_us":282228,"raft.queue_time_us":151757,"raft.run_cpu_time_us":83436,"raft.run_wall_time_us":466708,"replication_time_us":431307,"thread_start_us":747563,"threads_started":4,"wal-append.queue_time_us":187630}]]}
I20260709 13:10:07.267642 21879 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:07.230001 27075 raft_consensus.cc:2804] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:07.276513 21804 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:07.269171 27402 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:07.259034 21761 consensus_queue.cc:260] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:07.291577 21761 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:07.295604 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:07.296490 21905 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:10:07.203706 27365 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:07.297641 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:07.292111 21731 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:07.299379 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:07.300220 21905 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 15.
I20260709 13:10:07.300817 21911 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:07.304049 21731 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:07.304637 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:07.308635 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:07.313508 21760 raft_consensus.cc:2368] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13.
I20260709 13:10:07.258297 27362 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:07.259200 27197 consensus_queue.cc:1059] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:10:07.316696 21879 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:07.317502 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:07.320640 21911 raft_consensus.cc:2393] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 17: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:07.304685 27203 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:07.331192 21911 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:10:07.309559 27305 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:07.313666 27079 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:07.338291 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:07.303051 27315 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:10:07.319741 27211 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:07.347474 27079 raft_consensus.cc:697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:07.345182 27305 raft_consensus.cc:697] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:10:07.375978 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.385269 21729 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:07.391314 27153 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.392174 27153 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:10:07.393008 27187 consensus_meta.cc:287] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.888s	user 0.010s	sys 0.000s
I20260709 13:10:07.393963 27079 consensus_queue.cc:237] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:07.396791 21907 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 2235) took 3099 ms (client timeout 1804 ms). Trace:
I20260709 13:10:07.358861 27398 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:07.398384 27365 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:07.402017 27408 log.cc:927] Time spent T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:10:07.407612 21758 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:07.408166 27398 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.408752 27398 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:07.409382 27421 log.cc:927] Time spent T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:07.409927 21763 raft_consensus.cc:1275] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:10:07.410382 21763 pending_rounds.cc:85] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 9
I20260709 13:10:07.410615 21763 pending_rounds.cc:107] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:10:07.410868 21763 raft_consensus.cc:2889] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:07.418618 27362 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:07.420805 21909 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45202 (request call id 1285) took 1174 ms. Trace:
I20260709 13:10:07.421293 21909 rpcz_store.cc:276] 0709 13:10:06.246737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:06.246844 (+   107us) service_pool.cc:224] Handling call
0709 13:10:06.247155 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:06.252670 (+  5515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:06.252714 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:06.287030 (+ 34316us) log.cc:844] Serialized 26 byte log entry
0709 13:10:06.669764 (+382734us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:06.723326 (+ 53562us) log.cc:844] Serialized 14 byte log entry
0709 13:10:06.723612 (+   286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:06.723708 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:06.762372 (+ 38664us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b180031aa40. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab26a3f3 00007fc6ab26c7c1 00007fc6ab26c779 00007fc6ab26c709 00007fc6ab26c6d1 00007fc6ab26b9cd 000000000038f354 000000000038f199 00007fc6ab24d83a
0709 13:10:07.420462 (+658090us) raft_consensus.cc:1685] finished
0709 13:10:07.420570 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:07.420725 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50916,"prepare.queue_time_us":48601,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":6750,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":20212,"spinlock_wait_cycles":87128320,"thread_start_us":298371,"threads_started":1,"wal-append.queue_time_us":895215}
I20260709 13:10:07.424127 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:07.391305 21759 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
I20260709 13:10:07.426916 21759 pending_rounds.cc:85] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 8
I20260709 13:10:07.427176 21759 pending_rounds.cc:107] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 17.9
I20260709 13:10:07.427444 21759 raft_consensus.cc:2889] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:07.409067 21758 raft_consensus.cc:1240] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:07.437296 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:10:07.429461 21907 rpcz_store.cc:269] 0709 13:10:04.300307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:04.300454 (+   147us) service_pool.cc:224] Handling call
0709 13:10:07.396542 (+3096088us) spinlock_profiling.cc:243] Waited 2.9 s on lock 0x7b540021aa54. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae35b2fa 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6 00007fc6ac69126f
0709 13:10:07.396697 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6670807936}
I20260709 13:10:07.441808 21761 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:10:07.449577 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:07.450434 21909 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:10:07.428501 27298 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:07.470732 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:07.471561 21909 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:10:07.471796 21837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.031s	sys 0.018s
W20260709 13:10:07.473568 21837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.032s	sys 0.018s
W20260709 13:10:07.481534 27422 log.cc:927] Time spent T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:10:07.475574 27247 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:07.468096 27305 consensus_queue.cc:237] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:07.507797 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 494756us
W20260709 13:10:07.534487 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 305341us
I20260709 13:10:07.547952 22450 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:07.549319 21729 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:07.553323 21729 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:07.545933 21805 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:07.550217 27203 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.563908 27365 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:07.568879 27341 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:07.558703 27209 consensus_queue.cc:1059] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:10:07.572211 27209 raft_consensus.cc:3055] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:07.572678 27209 raft_consensus.cc:740] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:07.574090 27366 raft_consensus.cc:3055] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:10:07.544400 27399 consensus_meta.cc:287] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.002s
I20260709 13:10:07.575176 27399 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:07.574635 27366 raft_consensus.cc:740] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:07.579380 27366 consensus_queue.cc:260] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:07.580986 27366 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:07.561061 27187 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:07.586074 27209 consensus_queue.cc:260] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:07.587141 27313 raft_consensus.cc:3055] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:07.587579 27313 raft_consensus.cc:740] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:07.589974 27399 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:07.598763 21729 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:07.601274 21729 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:07.588606 27313 consensus_queue.cc:260] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:07.613629 21729 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:07.601713 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 55890.3us
I20260709 13:10:07.620066 21909 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:10:07.623462 21805 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:07.562736 27203 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:07.625219 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.615427 27313 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:07.611261 27209 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:07.628463 27125 consensus_meta.cc:287] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.699s	user 0.011s	sys 0.000s
W20260709 13:10:07.769243 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 145878us
I20260709 13:10:07.602617 27376 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:07.793583 21836 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 17.
I20260709 13:10:07.793960 21805 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:10:07.774745 27364 consensus_meta.cc:287] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.578s	user 0.021s	sys 0.000s
I20260709 13:10:07.776464 27192 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:07.799077 27192 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:07.799265 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 170332us
I20260709 13:10:07.799494 27192 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:07.800024 21729 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:07.800798 27399 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:07.614548 27385 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:07.801321 27399 raft_consensus.cc:697] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:07.801697 27203 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:07.802310 27399 consensus_queue.cc:237] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:07.611909 27368 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:07.805936 27125 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:07.806818 27125 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:07.808629 27398 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:07.792851 21764 raft_consensus.cc:3060] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:07.813712 27197 consensus_queue.cc:1048] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:07.815282 27197 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:07.819584 27151 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.820197 27151 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:07.821563 27221 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.822171 27221 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:07.824155 27221 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:07.824981 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:07.825371 27151 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:07.604197 27187 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:10:07.830199 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:07.778808 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:07.779076 27410 raft_consensus.cc:3055] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:07.831647 27410 raft_consensus.cc:740] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:07.832619 27410 consensus_queue.cc:260] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:07.780339 22478 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 LEARNER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:07.779464 27075 raft_consensus.cc:697] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:07.782213 22485 raft_consensus.cc:1240] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:07.784166 27150 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:07.785918 21911 raft_consensus.cc:3055] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:07.835546 21911 raft_consensus.cc:740] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:07.835080 27075 consensus_queue.cc:237] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:07.836335 21911 consensus_queue.cc:260] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:07.837754 27150 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:07.838420 27150 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:07.840910 27150 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:07.786641 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:07.787364 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.788323 27153 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:07.788489 27161 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:07.847247 27211 raft_consensus.cc:993] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:10:07.847817 27211 raft_consensus.cc:1081] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 15 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:10:07.847568 27161 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:07.850142 27161 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:07.789312 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:07.850390 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:07.804744 21663 catalog_manager.cc:5697] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 7 to 8, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 8 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:10:07.735306 21757 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.033s	sys 0.053s
W20260709 13:10:07.851688 21757 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.033s	sys 0.053s
W20260709 13:10:07.777745 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.852105 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:10:07.779088 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.827868 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:07.852737 21760 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:10:07.825819 21913 raft_consensus.cc:2410] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:10:07.774817 27132 consensus_meta.cc:287] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.714s	user 0.015s	sys 0.006s
I20260709 13:10:07.853652 27132 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:07.856093 27132 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:07.828153 27416 consensus_queue.cc:1059] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:07.857323 27416 raft_consensus.cc:3055] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:07.857611 21910 raft_consensus.cc:1240] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 13. Current term is 14. Ops: []
I20260709 13:10:07.857228 21663 catalog_manager.cc:5697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 11 to 12, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 12 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:07.857872 27416 raft_consensus.cc:740] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:07.859054 27416 consensus_queue.cc:260] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:07.859316 21663 catalog_manager.cc:5697] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 7 to 8, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 8 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:07.851048 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:07.861169 27416 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:07.861099 21663 catalog_manager.cc:5697] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 15 to 16, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 16 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:07.853123 21905 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:10:07.828716 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:07.862895 21761 raft_consensus.cc:2368] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 16. Current term is 17.
I20260709 13:10:07.868040 21764 raft_consensus.cc:2468] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:10:07.829103 21879 leader_election.cc:400] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13.
I20260709 13:10:07.869305 21879 leader_election.cc:403] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:07.869464 27116 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:07.872874 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:10:07.872646 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 81934us
I20260709 13:10:07.840361 27192 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:07.877660 21837 raft_consensus.cc:2393] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 16: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
W20260709 13:10:07.875874 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:07.880820 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:10:07.882890 21804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.009s	sys 0.022s
W20260709 13:10:07.883322 21804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.009s	sys 0.022s
W20260709 13:10:07.883841 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 607415us
I20260709 13:10:07.891077 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:07.862895 21663 catalog_manager.cc:5697] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 13 to 14, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 14 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:07.895082 21759 raft_consensus.cc:2393] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 12: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:07.891781 21833 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:10:07.878682 27132 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13.
I20260709 13:10:07.905830 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:07.911217 21879 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:07.903685 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:07.915551 22480 raft_consensus.cc:1240] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:07.917582 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:07.923950 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:07.924870 22483 raft_consensus.cc:2410] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:10:07.929342 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:07.891611 27338 consensus_queue.cc:1059] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:10:07.931532 21663 catalog_manager.cc:5697] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 11 to 13, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 13 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:07.962306 21663 catalog_manager.cc:5697] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 15 to 16, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 16 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:07.967325 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:07.967839 21913 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 21 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 20. Current term is 21. Ops: []
I20260709 13:10:07.969398 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:07.970320 21836 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:10:07.971895 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:07.972209 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:07.973631 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:07.926848 27153 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:07.973718 21837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38352
I20260709 13:10:07.974562 21837 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:07.975051 21837 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:07.977288 21728 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:07.967777 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:07.951784 27426 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.983623 21909 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:07.947973 21905 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 17.
I20260709 13:10:08.001255 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:07.985579 27365 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:07.995748 21837 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:07.964594 27171 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.997327 27211 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.979622 27153 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:08.037747 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 484344us
I20260709 13:10:08.038727 21837 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:08.005964 27365 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:08.028280 27192 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:08.031939 27153 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:07.998528 27426 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.038156 27432 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.044827 27365 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:08.063633 27430 log.cc:927] Time spent T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:10:08.032676 27171 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.035049 27211 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:08.064649 27432 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:08.088330 27432 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:08.090821 27426 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:08.092052 27211 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:08.092919 27438 log.cc:927] Time spent T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:10:08.092257 27431 log.cc:927] Time spent T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:10:08.096740 27171 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:08.097739 27442 log.cc:927] Time spent T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 13:10:08.098978 27441 log.cc:927] Time spent T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
W20260709 13:10:08.104031 27434 log.cc:927] Time spent T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.191s	user 0.004s	sys 0.000s
I20260709 13:10:08.116042 22479 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36278 (request call id 923) took 1042 ms. Trace:
I20260709 13:10:08.116641 22479 rpcz_store.cc:276] 0709 13:10:07.073692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.074130 (+   438us) service_pool.cc:224] Handling call
0709 13:10:07.074494 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.074882 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.074921 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.075436 (+   515us) log.cc:844] Serialized 26 byte log entry
0709 13:10:07.600841 (+525405us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:07.600879 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.600941 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.103334 (+502393us) spinlock_profiling.cc:243] Waited 7.5 ms on lock 0x7b4400022b4c. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab190c85 00007fc6ab1916a2 00007fc6adf031db 00007fc6adefeaaf 00007fc6adef286e 00007fc6adef1bb6 00007fc6adef17d8 00007fc6adefb221 00007fc6adefb1d9 00007fc6adefb169
0709 13:10:08.115661 (+ 12327us) raft_consensus.cc:1685] finished
0709 13:10:08.115692 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.115959 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3350,"raft.run_cpu_time_us":5234,"raft.run_wall_time_us":95351,"spinlock_wait_cycles":17289984,"thread_start_us":350194,"threads_started":1,"wal-append.queue_time_us":752011}
I20260709 13:10:08.122470 27335 raft_consensus.cc:3055] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:08.122902 27335 raft_consensus.cc:740] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:08.123659 27335 consensus_queue.cc:260] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.124626 27335 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:08.136233 27444 log.cc:927] Time spent T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:10:08.142315 27132 consensus_queue.cc:1175] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8c6c2207af3d47b3acf352d81959f4dd" responder_term: 11 status { last_received { term: 10 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:07.977980 21663 catalog_manager.cc:5697] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index 9 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:08.212031 21757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 2099) took 1018 ms. Trace:
I20260709 13:10:08.212795 21757 rpcz_store.cc:276] 0709 13:10:07.193263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.193517 (+   254us) service_pool.cc:224] Handling call
0709 13:10:07.193898 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.198693 (+  4795us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.198726 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.199194 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:10:07.852084 (+652890us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:10:07.852391 (+   307us) log.cc:844] Serialized 14 byte log entry
0709 13:10:07.852596 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.852667 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.211413 (+358746us) raft_consensus.cc:1685] finished
0709 13:10:08.211460 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.211784 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4386,"prepare.queue_time_us":1791,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":12761,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":181,"thread_start_us":652506,"threads_started":1,"wal-append.queue_time_us":735611}
I20260709 13:10:08.218715 21765 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 2087) took 1154 ms. Trace:
I20260709 13:10:08.219264 21765 rpcz_store.cc:276] 0709 13:10:07.064203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.065086 (+   883us) service_pool.cc:224] Handling call
0709 13:10:07.065397 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.065697 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.065733 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.066264 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 13:10:07.500850 (+434586us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:07.500895 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:07.500969 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.218134 (+717165us) raft_consensus.cc:1685] finished
0709 13:10:08.218173 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.218472 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1655,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":60,"thread_start_us":434192,"threads_started":1,"wal-append.queue_time_us":862010}
I20260709 13:10:08.229233 21833 raft_consensus.cc:1240] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 11. Current term is 12. Ops: []
W20260709 13:10:08.229463 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 252137us
I20260709 13:10:08.232395 21834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56424 (request call id 943) took 1145 ms. Trace:
I20260709 13:10:08.232941 21834 rpcz_store.cc:276] 0709 13:10:07.086443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.087643 (+  1200us) service_pool.cc:224] Handling call
0709 13:10:07.088086 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:07.088491 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:07.088532 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:07.117776 (+ 29244us) log.cc:844] Serialized 26 byte log entry
0709 13:10:07.630858 (+513082us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b18000dbe20. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ab24ce07 00007fc6b40a7ab9 00007fc6ab26969b 00007fc6ab26793f 00007fc6ab269c02 00007fc6adef120b 00007fc6adef6d23 00007fc6adef70d1 00007fc6ae312a0f
0709 13:10:08.231318 (+600460us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:10:08.231417 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:08.231553 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:08.231642 (+    89us) raft_consensus.cc:1685] finished
0709 13:10:08.231660 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:08.232129 (+   469us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5742,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":18173,"spinlock_wait_cycles":50623872,"thread_start_us":445272,"threads_started":1,"wal-append.queue_time_us":918204}
I20260709 13:10:08.238092 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:08.239270 21840 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:08.239589 21877 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:08.243515 21905 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:10:08.243947 21879 leader_election.cc:400] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 16. Current term is 17.
I20260709 13:10:08.244388 21879 leader_election.cc:403] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:08.250141 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:08.222405 21663 catalog_manager.cc:5697] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.261844 27151 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:08.268687 27366 raft_consensus.cc:1064] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:10:08.269218 27047 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:08.275689 21914 raft_consensus.cc:2410] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:10:08.270222 27047 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.281626 22479 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:08.281661 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:08.286118 21663 catalog_manager.cc:5697] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.287817 21909 raft_consensus.cc:2410] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:10:08.290184 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:08.261052 27305 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.291059 21839 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:08.282792 27443 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.292955 27443 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.291651 27305 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:08.276893 27366 raft_consensus.cc:1068] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: Unable to promote non-voter 8c6c2207af3d47b3acf352d81959f4dd: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:10:08.286187 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:08.300680 27075 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:08.286216 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:08.302865 27143 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 16. Current term is 17.
I20260709 13:10:08.301821 27075 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.306573 21832 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 18.
I20260709 13:10:08.306946 27315 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:08.302320 21837 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:08.310531 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:08.311653 21832 raft_consensus.cc:2410] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:10:08.314584 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:10:08.316236 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 77119.2us
I20260709 13:10:08.306504 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:08.317102 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:08.264746 27311 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:10:08.329005 27075 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:10:08.329792 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 86296.8us
I20260709 13:10:08.337086 22483 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:10:08.341760 22479 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:08.342705 27443 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:08.346517 27305 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:10:08.354805 27446 log.cc:927] Time spent T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.256s	user 0.001s	sys 0.001s
I20260709 13:10:08.357571 21838 raft_consensus.cc:2410] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:10:08.366503 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:08.368606 21835 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 13. Current term is 14. Ops: []
W20260709 13:10:08.372957 21728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.373703 27047 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:08.372619 27452 log.cc:927] Time spent T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.418s	user 0.002s	sys 0.000s
W20260709 13:10:08.394603 27412 consensus_queue.cc:1175] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8c6c2207af3d47b3acf352d81959f4dd" responder_term: 13 status { last_received { term: 12 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:08.373510 27410 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:08.397163 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:08.397950 21832 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 18.
I20260709 13:10:08.399847 21840 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:10:08.399847 21911 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:08.372599 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 48996.2us
I20260709 13:10:08.380963 27364 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:10:08.392271 22451 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:08.387125 21731 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.413059 27315 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:08.421070 27315 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.427961 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:08.428908 22483 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:10:08.429586 21729 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:08.429877 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:08.430634 27403 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:08.429188 22485 raft_consensus.cc:1275] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:08.430688 22484 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
I20260709 13:10:08.425972 21877 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:08.437002 21839 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:10:08.440622 27187 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:08.441504 27187 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.444443 27203 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:08.431620 27403 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.445333 27203 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.445900 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:08.447130 27315 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:08.444500 27187 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:10:08.458847 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.444988 27079 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:08.466320 27385 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:08.465945 27153 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:08.471032 27111 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:08.471720 27298 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:08.473750 27161 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:08.479094 21837 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 17.
I20260709 13:10:08.468976 22479 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 16.
I20260709 13:10:08.509799 22480 raft_consensus.cc:1240] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:08.510450 21806 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:08.509910 27144 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:08.511230 27144 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:08.511337 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 78087.1us
I20260709 13:10:08.511649 27144 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:08.512480 21806 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:08.513736 27385 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.516444 27385 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:08.520545 27366 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:08.520999 27366 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.522711 27247 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:08.522984 27211 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:08.523602 27416 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.523528 27247 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:08.523908 27211 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:08.524364 27416 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.526331 27247 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:08.526755 27211 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:08.527156 21912 raft_consensus.cc:1240] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:10:08.526777 27153 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:08.526818 27416 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:10:08.522833 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.517629 27111 raft_consensus.cc:697] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 17 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
W20260709 13:10:08.530544 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.530939 27111 consensus_queue.cc:237] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:08.521206 27203 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:08.534639 27365 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:08.534767 27161 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:08.537115 27365 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:08.541759 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 136576us
I20260709 13:10:08.496603 22448 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:08.537766 27161 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:08.521390 27366 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:08.550527 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:08.552399 21877 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:08.555757 21806 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:08.562202 27116 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:08.562731 27116 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.563171 27116 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:08.563686 27079 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.543682 27311 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:10:08.575613 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:08.576783 27338 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:08.498250 27298 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.577390 27412 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:08.579954 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:08.579102 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:08.549676 27385 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:08.583897 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:10:08.583400 27399 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.010s	sys 0.016s
I20260709 13:10:08.569535 27079 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:10:08.592926 27399 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.010s	sys 0.017s
I20260709 13:10:08.600129 27305 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:08.600857 27305 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.603185 27305 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:08.604259 27410 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.618590 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:08.619211 27410 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:08.607787 27364 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:08.622324 27364 raft_consensus.cc:697] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:08.623634 27364 consensus_queue.cc:237] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.621469 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:10:08.625651 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 73349.6us
I20260709 13:10:08.626545 27410 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:08.627281 21877 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:08.628973 27247 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:08.629454 27247 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:08.629886 27247 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:08.611434 21661 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45762 (request call id 260) took 6089 ms. Trace:
W20260709 13:10:08.666162 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 122521us
I20260709 13:10:08.618273 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:08.669415 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:08.670109 21728 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:08.670260 22480 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:10:08.672600 27476 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:08.673043 27476 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.673269 21911 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:10:08.673380 27476 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:08.674135 21911 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49544 (request call id 2278) took 1336 ms (client timeout 1541 ms). Trace:
W20260709 13:10:08.674592 21911 rpcz_store.cc:269] 0709 13:10:07.337825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.337975 (+   150us) service_pool.cc:224] Handling call
0709 13:10:07.785777 (+447802us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b5400473720. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae2cedc0 00007fc6ae35ae18 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c 00007fc6ac8967c2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:10:08.381967 (+596190us) spinlock_profiling.cc:243] Waited 414 ms on lock 0x7b18002c48a0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae392646 00007fc6ae2cc58e 00007fc6ae34df9e 00007fc6ae34f7de 00007fc6ae35b27c 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c
0709 13:10:08.399055 (+ 17088us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b58008de3d0. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae2b30aa 00007fc6ae335447 00007fc6ae34dfe7 00007fc6ae34f7de 00007fc6ae35b27c 00007fc6b331cb17 00007fc6ac8976d4 00007fc6ac897662 00007fc6ac897591 00007fc6ac89750c
0709 13:10:08.674042 (+274987us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992700288}
I20260709 13:10:08.603441 27144 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:08.676446 21908 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:08.679405 21914 raft_consensus.cc:2393] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 12: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:08.612020 27399 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:08.681321 27399 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.685732 27275 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.686425 27275 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:08.687263 27410 consensus_queue.cc:1059] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:08.688525 27275 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:08.689093 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 192814us
I20260709 13:10:08.689636 27410 raft_consensus.cc:3055] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:08.690183 27410 raft_consensus.cc:740] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:08.690348 22448 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:08.691093 21806 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:08.616367 27403 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:08.615128 27298 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:08.695016 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:08.694700 27171 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:08.698731 27437 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:08.699034 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:08.699224 27338 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:08.699712 22479 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:10:08.699958 27338 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:08.701714 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 74559us
I20260709 13:10:08.699236 27437 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:08.702425 27437 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:08.702767 21877 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:08.704540 21877 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:08.705622 27161 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.705780 27211 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:08.706074 27398 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:08.706446 27161 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.706948 27474 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:08.707620 27474 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:08.708699 27161 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:08.712809 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:08.713809 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:08.684778 27385 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.714756 21804 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:08.681521 27144 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:08.716101 27385 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:08.684715 27416 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:08.717319 27443 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:08.718137 27311 raft_consensus.cc:1064] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:10:08.718401 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f23d2bb6e7e4e44b828b7f7ede73841" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:08.720137 27203 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:08.720781 27203 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:08.722280 27111 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:08.722651 27385 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:08.722924 27111 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.723446 27385 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:08.724040 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:08.696233 27399 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:08.680019 27366 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.727628 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:08.728670 27366 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:08.723188 27203 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:08.730675 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:08.731184 27311 consensus_queue.cc:237] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.732491 27144 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:08.733220 27144 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.655184 21661 rpcz_store.cc:276] 0709 13:10:02.522300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:02.522479 (+   179us) service_pool.cc:224] Handling call
0709 13:10:08.611137 (+6088658us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:07.906317 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:07.912785 (+  6468us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:07.912825 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:10:07.912843 (+    18us) tablet.cc:662] Decoding operations
0709 13:10:07.913199 (+   356us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:07.913268 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:07.913299 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:10:07.913519 (+   220us) tablet.cc:701] Row locks acquired
0709 13:10:07.913535 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:10:07.913693 (+   158us) write_op.cc:270] Start()
0709 13:10:07.913820 (+   127us) write_op.cc:276] Timestamp: P: 1783602607913634 usec, L: 0
0709 13:10:07.913842 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:10:07.957445 (+ 43603us) log.cc:844] Serialized 530 byte log entry
0709 13:10:08.069677 (+112232us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b54002ae254. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae352e28 00007fc6b1d8d581 00007fc6b1d8cd58 00007fc6b1d919f1 00007fc6b1d919a9 00007fc6b1d91939 00007fc6b1d91901 00007fc6b1d90b2d 000000000038f354 000000000038f199
0709 13:10:08.175010 (+105333us) op_driver.cc:464] REPLICATION: finished
0709 13:10:08.399074 (+224064us) write_op.cc:301] APPLY: starting
0709 13:10:08.399298 (+   224us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:08.475025 (+ 75727us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:08.475066 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:08.475970 (+   904us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:08.476308 (+   338us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:10:08.476375 (+    67us) write_op.cc:312] APPLY: finished
0709 13:10:08.533663 (+ 57288us) log.cc:844] Serialized 25 byte log entry
0709 13:10:08.533925 (+   262us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:08.573835 (+ 39910us) spinlock_profiling.cc:243] Waited 21.6 ms on lock 0x7b0c00052920. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b1cc1161 00007fc6b1e02b50 00007fc6b1e03420 00007fc6b1e0329e 00007fc6b1da4720 00007fc6b1da3928 00007fc6b1da332c 00007fc6b1d8f389 00007fc6b1d8eb53 00007fc6b1d92d61 00007fc6b1d92d19
0709 13:10:08.573955 (+   120us) write_op.cc:454] Released schema lock
0709 13:10:08.574023 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:08.574630 (+   607us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:08.574666 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":774416,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":187623,"apply.run_cpu_time_us":9669,"apply.run_wall_time_us":175609,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8311,"num_ops":1,"prepare.queue_time_us":636788,"prepare.run_cpu_time_us":6559,"prepare.run_wall_time_us":175611,"replication_time_us":260940,"spinlock_wait_cycles":69334528,"thread_start_us":407900,"threads_started":2}]]}
I20260709 13:10:08.735826 27398 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:08.736374 27398 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:08.717835 27416 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.737545 27474 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:08.738487 27416 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:08.741052 27144 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:08.742993 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:08.738502 27398 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:08.743587 22448 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:08.745059 27338 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:08.747139 27410 consensus_queue.cc:260] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.748833 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:08.749926 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:10:08.750782 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 46425.5us
I20260709 13:10:08.750705 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:08.773538 21728 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:08.753885 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:08.755599 21837 raft_consensus.cc:1275] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:10:08.757266 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:08.758893 27116 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.760218 22477 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEARNER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:08.778692 21914 raft_consensus.cc:2393] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 17: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:08.725112 27111 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:08.760352 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:08.761538 27385 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:08.762027 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:08.751641 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:08.780659 22476 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:08.781924 21911 raft_consensus.cc:2393] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 21: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:10:08.794481 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.791508 21839 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 21.
I20260709 13:10:08.796061 22448 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:08.785689 27484 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:08.801546 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:08.807039 21877 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:08.809458 22478 raft_consensus.cc:2393] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 13: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:10:08.809398 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:10:08.812868 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 114284us
I20260709 13:10:08.809023 21880 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:08.808456 27144 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:08.817162 27144 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:08.819622 27144 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:08.820222 27426 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:08.801741 27075 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:08.826380 27416 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:08.805141 27311 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:10:08.834533 21763 raft_consensus.cc:1240] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: []
W20260709 13:10:08.834333 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:08.824167 27247 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:08.837390 27432 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:08.838048 27432 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.838786 21914 raft_consensus.cc:1240] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:08.828871 27460 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:08.861167 21877 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:08.831449 27144 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:08.873404 27459 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:08.873926 27459 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.874267 27459 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:08.875372 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:08.889508 27410 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:08.892800 21728 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:08.896066 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:08.896270 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:08.896934 21756 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 17: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:08.897310 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:08.897513 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:08.897984 27432 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:08.898633 21757 raft_consensus.cc:2410] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:10:08.899920 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:08.901032 21758 raft_consensus.cc:2393] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 12: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:08.898099 21765 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:10:08.902570 27075 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:10:08.904980 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:08.905593 21837 raft_consensus.cc:1240] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:08.905752 21840 raft_consensus.cc:2393] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 16: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:08.907815 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:08.909773 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:08.910784 21832 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 17.
I20260709 13:10:08.911943 27116 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:08.859087 27460 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:08.915673 27460 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:08.915470 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:08.916581 21831 raft_consensus.cc:2393] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 12: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:08.919064 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:08.920307 21836 raft_consensus.cc:2410] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:10:08.921459 27476 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:08.922637 21761 raft_consensus.cc:2393] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 19: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:08.922487 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:08.923163 21763 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:10:08.924211 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:08.921739 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:08.925412 27476 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 19 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:08.927677 27247 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:08.932098 22476 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 16.
I20260709 13:10:08.869689 27144 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:08.936975 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:08.940089 21840 raft_consensus.cc:2368] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 13. Current term is 14.
W20260709 13:10:08.936678 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 65986.7us
I20260709 13:10:08.940565 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:08.957587 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:08.935635 27476 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:08.935910 27410 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:08.942308 27144 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:08.964485 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:08.944311 27398 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:08.969877 27398 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:08.967161 27437 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.980769 27484 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.983003 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:08.983618 21840 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 17.
I20260709 13:10:08.987380 21912 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 16.
I20260709 13:10:08.993929 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:08.994676 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:08.995148 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:08.977380 27410 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:08.988253 27385 consensus_queue.cc:1048] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:08.996438 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:08.998055 21761 raft_consensus.cc:2393] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 17: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:08.992723 21806 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:08.997611 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c77d056b72142dbaf44be22749d2024" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:09.001873 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:08.998003 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:09.003262 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:09.003978 22485 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:09.001912 27116 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:09.006636 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:09.008919 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:09.008033 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:09.018280 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:09.018596 21835 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:10:09.006664 27116 raft_consensus.cc:697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:09.020805 27116 consensus_queue.cc:237] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:08.981726 27484 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:09.026085 27484 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:09.030562 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:09.034471 27398 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:09.035270 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:09.037672 21728 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:09.038125 27410 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:09.038944 27385 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:09.040064 21728 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:09.041576 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:09.042379 27385 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:09.044910 21728 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:09.041101 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:09.047037 21838 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:09.058530 27385 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:09.060047 21728 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:09.060801 27385 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:09.062031 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:09.063686 27385 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:09.065220 21728 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:09.066020 27385 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:09.066418 27385 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.066769 27385 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:09.068120 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:09.068943 21761 raft_consensus.cc:2393] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 19: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:09.071189 21765 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:09.072507 21756 raft_consensus.cc:1275] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:08.991225 27476 raft_consensus.cc:697] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 12 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:09.085394 27476 consensus_queue.cc:237] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:09.085805 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:09.092288 21838 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 19.
I20260709 13:10:09.094059 21728 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:09.094278 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:09.096371 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:09.096521 27484 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:09.097059 21759 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 8.
I20260709 13:10:09.097095 27484 raft_consensus.cc:697] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 19 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:09.107672 21831 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 17.
I20260709 13:10:09.108609 21731 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:09.115597 21728 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:10:09.119421 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.132771 22485 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:10:09.135875 21806 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:10:09.138319 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.118598 27410 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.119199 27315 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:09.158631 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 53339.7us
I20260709 13:10:09.135849 27398 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.146067 27364 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:09.146553 27474 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:09.179876 27111 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:09.162781 27410 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:09.186203 27474 raft_consensus.cc:697] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 17 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:09.218097 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:09.166572 27459 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:09.176690 27398 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:09.275959 27459 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:09.276973 21912 raft_consensus.cc:2393] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 19: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:09.277254 21906 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:10:09.275976 27398 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:09.236426 27410 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:09.238276 27437 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:09.179113 27315 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:09.281112 27315 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:09.282279 21763 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 17.
I20260709 13:10:09.240499 27426 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.283128 27426 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:09.246623 22477 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:09.246842 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:09.250810 21659 catalog_manager.cc:5697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 8 to 10, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 10 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:09.254001 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:09.255424 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:09.287498 21914 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:10:09.257119 21760 raft_consensus.cc:1240] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:09.257939 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:09.258682 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:09.239578 27474 consensus_queue.cc:237] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:09.188211 27364 raft_consensus.cc:697] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:09.272658 27385 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:09.259616 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:09.304414 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:09.295969 21905 raft_consensus.cc:2393] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 14: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:09.195899 27484 consensus_queue.cc:237] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:09.303458 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:09.304955 21907 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 16.
I20260709 13:10:09.310686 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:09.311385 21831 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 17.
I20260709 13:10:09.323942 21909 raft_consensus.cc:1240] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:09.330057 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:09.330677 21907 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:10:09.336856 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:09.337710 21659 catalog_manager.cc:5697] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 13 to 14, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 14 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:09.343353 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:09.323037 27432 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:10:09.343950 21659 catalog_manager.cc:5697] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:09.302119 27426 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:09.345829 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:09.345373 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:09.334640 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:09.355260 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:09.355980 21840 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 21.
I20260709 13:10:09.345330 21659 catalog_manager.cc:5697] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 14 to 15, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 15 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:09.357862 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:09.358763 21840 raft_consensus.cc:2393] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 19: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:09.360901 21659 catalog_manager.cc:5697] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 15 to 17, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 17 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:09.382958 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:09.383479 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:09.387341 27144 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:09.388929 21910 raft_consensus.cc:2393] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 16: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:09.389554 27211 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.390216 27305 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:09.390180 27211 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:09.390969 27305 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:09.392426 27211 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:09.397020 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:09.400326 21911 raft_consensus.cc:2393] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 14: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:10:09.400409 27494 log.cc:927] Time spent T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.138s	user 0.005s	sys 0.000s
I20260709 13:10:09.398913 27311 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:09.401872 27311 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:09.402966 27492 log.cc:927] Time spent T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:10:09.404376 27311 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:09.399222 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:09.389304 21907 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:10:09.412104 21804 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:09.410892 21728 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:10:09.417083 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.418426 21912 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:09.423549 22485 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:10:09.424090 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:10:09.425007 21880 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:09.424393 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:09.420763 27116 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:09.426566 27116 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.426950 27116 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:09.331472 27460 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:09.430639 22477 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 21.
I20260709 13:10:09.438748 21659 catalog_manager.cc:5697] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 11 to 13, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 13 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:09.442408 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:09.440923 21659 catalog_manager.cc:5697] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:09.393405 27305 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:09.449642 21905 raft_consensus.cc:2393] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 19: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:09.446604 21659 catalog_manager.cc:5697] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:09.455473 21659 catalog_manager.cc:5697] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:09.452919 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:09.458590 22484 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:10:09.457388 21659 catalog_manager.cc:5697] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 11 to 13, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 13 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:09.432780 27365 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:09.460078 21659 catalog_manager.cc:5697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:09.448416 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:09.461380 27338 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:09.461627 21910 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 16.
I20260709 13:10:09.461941 27338 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:09.464120 27338 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:09.464488 21804 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:09.466697 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:09.467293 21910 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
I20260709 13:10:09.468128 27432 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:09.473006 21880 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:09.475862 21663 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45746 (request call id 245) took 2428 ms. Trace:
I20260709 13:10:09.460814 21805 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:09.471380 27365 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:09.503057 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 80526.6us
I20260709 13:10:09.503697 21805 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:09.459158 27398 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.455276 27437 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
W20260709 13:10:09.514048 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 57980.5us
I20260709 13:10:09.510931 27275 consensus_queue.cc:1059] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:09.515025 21877 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:09.469209 27305 consensus_queue.cc:1048] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:10:09.497864 27432 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:09.537920 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:09.504868 27144 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:09.505646 27365 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:09.540313 21877 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:09.541937 21765 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:09.547406 21840 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:10:09.476428 21663 rpcz_store.cc:276] 0709 13:10:07.029855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.031508 (+  1653us) service_pool.cc:224] Handling call
0709 13:10:09.458296 (+2426788us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:08.498833 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:08.499917 (+  1084us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:08.518137 (+ 18220us) write_op.cc:435] Acquired schema lock
0709 13:10:08.527056 (+  8919us) tablet.cc:662] Decoding operations
0709 13:10:08.528396 (+  1340us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:08.528491 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:08.528526 (+    35us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:10:08.559022 (+ 30496us) tablet.cc:701] Row locks acquired
0709 13:10:08.562469 (+  3447us) write_op.cc:260] PREPARE: finished
0709 13:10:08.562746 (+   277us) write_op.cc:270] Start()
0709 13:10:08.562911 (+   165us) write_op.cc:276] Timestamp: P: 1783602608562678 usec, L: 0
0709 13:10:08.562939 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:10:08.563807 (+   868us) log.cc:844] Serialized 4067 byte log entry
0709 13:10:08.566853 (+  3046us) op_driver.cc:464] REPLICATION: finished
0709 13:10:08.575088 (+  8235us) write_op.cc:301] APPLY: starting
0709 13:10:08.575172 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:08.824418 (+249246us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:08.826687 (+  2269us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:08.889164 (+ 62477us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:08.889364 (+   200us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:10:08.889420 (+    56us) write_op.cc:312] APPLY: finished
0709 13:10:08.978241 (+ 88821us) log.cc:844] Serialized 97 byte log entry
0709 13:10:08.990755 (+ 12514us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:09.011314 (+ 20559us) write_op.cc:454] Released schema lock
0709 13:10:09.074035 (+ 62721us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:09.109607 (+ 35572us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:09.112133 (+  2526us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":35315,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":7953,"apply.run_cpu_time_us":15993,"apply.run_wall_time_us":520552,"cfile_cache_hit":40,"cfile_cache_hit_bytes":41840,"num_ops":10,"prepare.queue_time_us":7813,"prepare.run_cpu_time_us":5533,"prepare.run_wall_time_us":68612,"replication_time_us":3764,"thread_start_us":88766,"threads_started":1}]]}
I20260709 13:10:09.556249 21877 leader_election.cc:400] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 13. Current term is 14.
I20260709 13:10:09.556921 21877 leader_election.cc:403] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:09.558056 21877 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:09.537006 27311 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:09.538604 27432 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:09.547997 27153 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:09.458520 27364 consensus_queue.cc:237] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:09.547746 27075 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:10:09.567201 27385 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:09.571645 27144 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:09.561976 27211 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:09.565982 27366 raft_consensus.cc:3055] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:09.544113 27398 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:09.572501 27247 raft_consensus.cc:2749] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 13. Current term is 14.
I20260709 13:10:09.572994 27153 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:09.581736 27144 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:10:09.588492 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 92903.8us
I20260709 13:10:09.572240 27432 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:09.585557 27366 raft_consensus.cc:740] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:09.590279 27460 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 21 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:09.601354 27153 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:09.623169 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 150240us
I20260709 13:10:09.602207 27144 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:09.603533 21879 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:09.624631 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 66662.7us
W20260709 13:10:09.659508 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 204797us
W20260709 13:10:09.661772 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 229248us
W20260709 13:10:09.664534 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 61345.3us
I20260709 13:10:09.663414 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:09.667796 21906 raft_consensus.cc:2393] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 21: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:09.624603 27221 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:09.672111 21879 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:09.705852 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 202221us
I20260709 13:10:09.710222 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:09.710891 21840 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:09.715411 21836 raft_consensus.cc:1275] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:09.703516 27221 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.738292 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:09.704766 27211 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:09.741658 22477 raft_consensus.cc:2393] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 16: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:09.745540 21834 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:09.751116 21840 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 14.
I20260709 13:10:09.718674 27075 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:10:09.755334 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 210853us
W20260709 13:10:09.762866 27500 log.cc:927] Time spent T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
W20260709 13:10:09.775132 27504 log.cc:927] Time spent T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:10:09.794581 27398 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:09.806979 21806 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:09.752913 27075 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:09.740921 27221 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:09.816782 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:09.817391 22483 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:10:09.818508 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 158046us
W20260709 13:10:09.814867 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 150329us
W20260709 13:10:09.824954 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 166454us
I20260709 13:10:09.811796 27412 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:09.825730 21880 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:09.861253 22477 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:09.719020 27366 consensus_queue.cc:260] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:09.880088 22449 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:09.864001 27311 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:09.866122 27247 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:10:09.882063 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 214336us
W20260709 13:10:09.882544 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 126234us
W20260709 13:10:09.899705 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 227694us
I20260709 13:10:09.900794 21879 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:09.924700 21879 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:09.888013 27247 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:09.928479 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 58715.7us
I20260709 13:10:09.930217 27075 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:09.921959 27516 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:09.943720 27529 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:09.957831 27526 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:09.891884 27311 raft_consensus.cc:697] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:09.962946 22483 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 14.
I20260709 13:10:09.963128 27524 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:09.963678 27524 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:09.964056 27524 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:09.868870 27116 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:09.970717 21729 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:10:09.975608 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 74885.9us
I20260709 13:10:09.953852 27247 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:09.979100 21729 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:09.979552 21879 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:09.961668 27526 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:10:09.974906 27474 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.011s	sys 0.014s
I20260709 13:10:09.994740 27311 consensus_queue.cc:237] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:09.998934 21729 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:09.970772 27365 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:09.966450 27529 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.000538 27527 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:09.997495 27526 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.027132 27523 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:10.028774 27116 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:10.029625 27522 log.cc:927] Time spent T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:10:10.033557 27144 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.035583 27529 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:10.062487 27144 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:10.037981 27153 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.025501 27111 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:10.064576 27153 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:10.039556 27513 log.cc:927] Time spent T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:10.041668 27203 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:10.046962 27365 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:10.048519 27221 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:10.071681 27221 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:10.055606 27535 consensus_queue.cc:1059] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:10:10.057572 27505 log.cc:927] Time spent T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.437s	user 0.002s	sys 0.000s
I20260709 13:10:10.072926 27338 raft_consensus.cc:3055] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:10.073345 27338 raft_consensus.cc:740] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:10.074317 27338 consensus_queue.cc:260] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:10.075013 27432 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:10.075830 27338 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:10.077243 27432 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:10:10.081569 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.091216 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:10.059703 27247 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:10.059731 22448 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:10:10.116238 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 56604.8us
W20260709 13:10:10.116942 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 170960us
W20260709 13:10:10.058521 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 227139us
I20260709 13:10:10.119712 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:10:10.121290 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 122444us
I20260709 13:10:10.119828 21731 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:10.118880 21877 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:10.175258 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 54040.8us
I20260709 13:10:10.176580 21729 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:10.176964 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 58142.8us
W20260709 13:10:10.186409 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 76760.2us
I20260709 13:10:10.187988 21834 raft_consensus.cc:1240] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:10.190570 21729 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:10.191654 27537 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:10.192714 27529 consensus_queue.cc:1059] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:10.193140 21729 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:10.197727 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:10.198438 21838 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:10:10.198767 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:10.172788 27047 raft_consensus.cc:2764] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:10:10.203370 21729 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:10.188532 27315 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:10.202656 27365 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:10.208761 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:10.209563 21729 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:10.211813 27510 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:10:10.212654 21840 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 21.
I20260709 13:10:10.213205 27490 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:10:10.213763 27542 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:10.215255 21729 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:10.215595 27525 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:10.216204 27525 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.217782 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:10.218297 27525 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:10.218415 21910 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:10:10.218835 27542 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:10.221832 21905 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:10:10.213820 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:10.221813 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:10.224779 21839 raft_consensus.cc:2368] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 17. Current term is 18.
I20260709 13:10:10.229116 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:10.229507 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:10.230476 27534 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.118s
I20260709 13:10:10.234650 27542 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:10.235270 27542 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.235671 21836 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 17.
I20260709 13:10:10.238529 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:10.238837 27247 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 22 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:10.243983 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:10.244267 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:10.244751 21757 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:10:10.244920 21905 raft_consensus.cc:3060] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:10.252312 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:10.255507 27539 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.256117 27539 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.257961 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:10.258678 21758 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 10.
I20260709 13:10:10.258877 27539 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:10.277827 21877 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:10.280324 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:10.283605 21905 raft_consensus.cc:2468] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 18.
I20260709 13:10:10.284356 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:10.260947 27523 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:10.283797 21761 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:10:10.293301 21879 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:10.296450 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:10.287595 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:10.297161 21837 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:10.297209 27410 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:10.299548 21879 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:10.300261 27410 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:10.301582 21879 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:10.302282 27410 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:10.304374 27543 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:10.304930 27543 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.305047 27531 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:10.305372 27543 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:10.309813 22448 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:10.310043 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:10.310650 21764 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:10:10.313760 27540 consensus_queue.cc:1059] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:10.315251 27540 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:10.315438 27171 raft_consensus.cc:3055] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:10.315917 27171 raft_consensus.cc:740] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:10.316558 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:10.317498 21760 raft_consensus.cc:2368] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 17. Current term is 18.
I20260709 13:10:10.317030 27171 consensus_queue.cc:260] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:10.318607 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:10.318898 27171 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:10.320691 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:10.304896 21879 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:10.307492 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.306774 27533 raft_consensus.cc:2955] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 10 to 12, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:10.329752 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:10:10.318827 27530 log.cc:927] Time spent T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.300s	user 0.004s	sys 0.000s
I20260709 13:10:10.332414 21763 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 17: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:10.296525 21877 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:10.333743 27275 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:10.334362 21804 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:10:10.347502 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 51058.6us
I20260709 13:10:10.305394 27517 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:10:10.339072 27524 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:10.315825 27540 raft_consensus.cc:697] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 21 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:10.343393 27410 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:10.361832 27410 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.364905 27410 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:10.351967 27247 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:10.366758 27519 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:10.367355 27519 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:10.367846 27519 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:10.372712 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:10.355728 27539 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:10.360564 27540 consensus_queue.cc:237] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:10.390080 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
W20260709 13:10:10.399451 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 46815.9us
I20260709 13:10:10.400712 21877 leader_election.cc:400] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 17. Current term is 18.
I20260709 13:10:10.401187 21877 leader_election.cc:403] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:10:10.343123 27531 raft_consensus.cc:697] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 14 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:10.405350 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:10.405990 22477 raft_consensus.cc:2393] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 12: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:10:10.403501 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:10.406474 21840 raft_consensus.cc:2393] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 18: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:10.385010 27542 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:10.408912 21804 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:10.404146 21877 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:10.415509 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:10.417022 21837 raft_consensus.cc:2468] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 22.
I20260709 13:10:10.421260 21764 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:10:10.409869 27247 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 17. Current term is 18.
I20260709 13:10:10.412966 27075 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:10.430986 27075 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:10.431805 21909 raft_consensus.cc:1275] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:10.437688 27526 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:10.438874 27508 log.cc:927] Time spent T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.441s	user 0.001s	sys 0.001s
I20260709 13:10:10.440371 27526 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:10.418022 27542 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:10:10.417879 27416 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:10.416685 27398 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:10.447477 21804 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:10.463008 21909 raft_consensus.cc:1275] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:10:10.464596 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:10.466369 22478 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:10.467475 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:10.467926 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:10.468894 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:10.482499 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:10.470256 21906 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:10:10.486143 27305 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:10.452556 27221 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.491225 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:10.498427 21906 raft_consensus.cc:2393] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 18: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:10.474576 21877 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:10:10.495841 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 67533.9us
I20260709 13:10:10.425407 27543 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.511185 21905 raft_consensus.cc:2393] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 12: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:10.429054 27484 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:10:10.506806 27144 raft_consensus.cc:2804] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:10:10.469666 27416 raft_consensus.cc:697] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 17 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:10.466378 27275 raft_consensus.cc:2804] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:10.458204 27398 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.514966 21909 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:10.469542 27516 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:10:10.570919 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 68078.1us
I20260709 13:10:10.581125 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:10.585407 21804 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:10.509722 27221 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.573791 27432 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:10.610138 27515 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:10.581126 27116 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:10.483053 27531 consensus_queue.cc:237] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:10.593211 27144 raft_consensus.cc:697] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 22 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:10.611577 27533 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:10.632721 27533 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:10.634960 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:10.582712 27516 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.643393 21879 leader_election.cc:400] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 17. Current term is 18.
I20260709 13:10:10.606760 27547 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:10.612273 21913 raft_consensus.cc:2955] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 10 to 12, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:10.651304 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:10.612891 27275 raft_consensus.cc:697] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
W20260709 13:10:10.652946 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 58523.1us
I20260709 13:10:10.655056 21762 raft_consensus.cc:2393] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:10.637588 27533 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:10.629977 27524 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:10.615229 27432 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.628609 27116 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.666348 21729 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:10.690208 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:10:10.692915 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 63485us
W20260709 13:10:10.696705 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 50655us
I20260709 13:10:10.700564 27523 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:10.701498 27523 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:10.707036 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:10.707903 21909 raft_consensus.cc:2393] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 12: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:10.714990 27366 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:10.719697 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 61120.5us
I20260709 13:10:10.691721 27474 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:10.735101 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:10.737941 21762 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:10:10.654140 27543 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:10.660372 27550 log.cc:927] Time spent T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: Append to log took a long time: real 0.183s	user 0.000s	sys 0.002s
I20260709 13:10:10.657763 27161 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:10.742409 21879 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:10.745791 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:10.750133 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:10.750152 21764 raft_consensus.cc:2393] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 18: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:10.614845 27416 consensus_queue.cc:237] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.691900 27551 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:10.660053 27315 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:10:10.689642 27542 consensus_queue.cc:1048] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:10:10.759251 21879 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
W20260709 13:10:10.759256 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 93018.7us
I20260709 13:10:10.768328 21729 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:10.654454 27547 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:10.760243 27398 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:10.761830 27568 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:10.753619 27534 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:10:10.751869 27161 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.702150 27523 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:10.751991 27474 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.788460 27111 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:10.793004 27552 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:10:10.793493 27553 log.cc:927] Time spent T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:10:10.803879 27516 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:10.786942 27543 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:10.813540 27568 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.813870 27543 raft_consensus.cc:697] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:10.815793 27568 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:10.815255 27543 consensus_queue.cc:237] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:10.804492 27221 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:10.819501 27474 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:10.786067 27517 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:10.809762 27552 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.810484 27560 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:10.812567 27161 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:10.765202 27275 consensus_queue.cc:237] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.835346 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:10.755762 27144 consensus_queue.cc:237] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:10.825552 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:10.825901 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:10.759099 27551 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:10.810091 27554 log.cc:927] Time spent T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:10.823704 27432 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:10.851348 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 63430.1us
I20260709 13:10:10.857524 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:10.859572 21905 raft_consensus.cc:1240] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:10.864187 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:10.866441 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:10.866807 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:10.867157 21914 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 18.
I20260709 13:10:10.869832 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:10.852034 27529 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:10.874253 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:10.874305 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:10.875058 21907 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:10.878784 21729 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:10.882797 27547 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:10:10.885001 27519 consensus_meta.cc:287] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.517s	user 0.010s	sys 0.001s
I20260709 13:10:10.868062 27542 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:10.885515 27315 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:10.886000 27315 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:10.885860 27542 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:10.886459 27552 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:10.886706 27315 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:10.888312 27542 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:10.831403 27517 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:10.890255 27551 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:10.894255 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:10.897202 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:10.897405 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cde61de02cf40daa7e584ca0a574c26" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:10.897032 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:10.898885 21838 raft_consensus.cc:2410] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:10:10.873929 27161 consensus_queue.cc:1059] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:10:10.891094 27116 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:10.905607 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:10.906895 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:10.907575 21907 raft_consensus.cc:2393] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 13: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:10.869947 21911 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:10:10.908599 21911 raft_consensus.cc:606] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
W20260709 13:10:10.910362 27559 log.cc:927] Time spent T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:10:10.913093 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:10.944291 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:10.945482 21913 raft_consensus.cc:2393] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 16: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:10.914443 27547 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:10:10.945811 27542 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:10.880079 27529 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:10.913170 27517 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:10.914389 27533 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.945104 27543 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:10.974515 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:10.978529 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:10.948264 27564 raft_consensus.cc:493] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:10.985864 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:10.986662 21765 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:10.896510 27519 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.944911 27315 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.957581 22484 raft_consensus.cc:2955] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 10 to 12, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:10.982802 27542 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:10.989362 27476 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:11.086478 21831 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 11.
I20260709 13:10:11.088037 21908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:10:11.088454 27579 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:11.088774 21908 raft_consensus.cc:606] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:11.089082 27579 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:11.091457 27579 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:11.092005 27579 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:11.092540 27579 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:11.096626 21805 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:11.103916 27075 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:11.108711 27542 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:11.006851 27543 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:11.120069 27315 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 19 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:11.120846 27515 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:11.121117 27543 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:11.121457 27515 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:11.126127 27517 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:11.127560 21908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:10:11.153378 21908 raft_consensus.cc:606] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:11.127810 21805 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:11.128028 27366 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:11.129487 27529 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:11.129729 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
W20260709 13:10:11.130582 27581 log.cc:927] Time spent T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:10:11.130836 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:10:11.131470 27578 log.cc:927] Time spent T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:10:11.133117 27519 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:11.135079 27580 log.cc:927] Time spent T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:10:11.136425 27521 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:11.155071 21805 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:11.155901 21914 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:11.065351 27437 raft_consensus.cc:476] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Not starting pre-election -- already a leader
I20260709 13:10:11.160465 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:11.162647 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:11.163308 27557 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:10:11.163465 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:11.159895 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:11.166926 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:11.167029 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:11.167297 22485 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:11.168012 21833 raft_consensus.cc:1240] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:11.177049 21838 raft_consensus.cc:2410] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:10:11.133211 27410 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:11.173934 27366 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:11.189942 27410 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:11.171661 27537 raft_consensus.cc:3055] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:11.192127 27366 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:11.192248 27537 raft_consensus.cc:740] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:11.181093 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:11.176275 27519 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:11.193950 27519 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:11.194362 27519 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:11.194649 21840 raft_consensus.cc:2393] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 9: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:11.196384 27523 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:11.182020 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:11.197901 21763 raft_consensus.cc:2393] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 12: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:11.192054 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:11.171151 27521 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:11.152127 27476 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:11.182432 21761 raft_consensus.cc:2955] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 10 to 12, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:11.203118 22480 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 17.
I20260709 13:10:11.231436 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:11.233839 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:11.234606 21913 raft_consensus.cc:2393] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:11.237562 21806 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:11.241294 21907 raft_consensus.cc:1240] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:11.192098 27410 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:11.074201 27564 raft_consensus.cc:515] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:11.236454 27535 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.258072 27521 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:11.258261 27533 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:11.258935 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:11.259408 27075 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:10:11.264259 27585 log.cc:927] Time spent T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:10:11.222522 27534 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.266219 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:11.280031 21913 raft_consensus.cc:2368] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12.
I20260709 13:10:11.281113 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:11.267988 21804 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:11.254204 27579 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:11.274214 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:11.306335 21765 raft_consensus.cc:2468] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:10:11.241271 27557 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:10:11.278775 27075 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:11.295539 27579 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:11.342710 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 50860.4us
I20260709 13:10:11.274948 27535 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:11.349936 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:11.355646 21879 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:11.360998 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:11.360852 21877 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:11.365305 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:11.342900 27075 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:11.370817 21909 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:10:11.371299 21909 pending_rounds.cc:85] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 10
I20260709 13:10:11.426604 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:11.431565 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:11.432598 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:11.326223 27432 consensus_queue.cc:1059] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:10:11.368306 21879 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:11.348330 27365 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:11.286098 27534 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:11.370427 22450 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:11.371582 21909 pending_rounds.cc:107] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:10:11.432979 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:11.453027 21909 raft_consensus.cc:2889] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:11.450083 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 81863.3us
I20260709 13:10:11.351754 27338 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:11.448217 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:11.345844 27437 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 13:10:11.459409 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:11.460021 22480 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:10:11.456437 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:11.457088 21879 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:11.446381 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:10:11.464143 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 327605us
I20260709 13:10:11.374145 27516 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:11.426168 27566 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:11.469277 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:11.471066 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:11.374940 27568 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:11.467486 21756 raft_consensus.cc:2368] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12.
I20260709 13:10:11.476662 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:10:11.456236 27583 log.cc:927] Time spent T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:10:11.468183 21728 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:11.483381 21763 raft_consensus.cc:2393] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 17: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:11.453889 27476 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:11.493904 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:11.495363 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:11.470067 27365 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:11.509595 27542 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:11.509738 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:11.509984 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:11.510936 27524 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:10:11.511490 21762 raft_consensus.cc:1275] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:10:11.514084 27534 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:10:11.514599 27548 log.cc:927] Time spent T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:11.448776 27490 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:11.457701 27247 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:11.491693 21728 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:11.522161 21805 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:11.530761 27116 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:11.488112 27568 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:11.534929 27568 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:11.462951 27338 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:11.538704 27338 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:11.544297 27519 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:11.547489 27561 log.cc:927] Time spent T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.749s	user 0.004s	sys 0.000s
I20260709 13:10:11.551065 21765 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:10:11.552515 21758 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 18. Current term is 19. Ops: []
I20260709 13:10:11.554700 21805 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:10:11.558112 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 66515.4us
I20260709 13:10:11.572789 21728 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:11.560046 27564 leader_election.cc:290] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:11.520332 27144 raft_consensus.cc:2804] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:11.571381 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:11.577143 21758 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
I20260709 13:10:11.580027 21728 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:11.581828 21728 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:11.582789 27568 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:11.583014 27531 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:11.583146 27144 raft_consensus.cc:697] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:11.584134 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:11.584764 27144 consensus_queue.cc:237] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:11.566810 27542 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:11.587266 22483 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:11.590276 21731 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:11.591264 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:11.613404 21731 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:11.551201 27490 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:11.618553 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:11.576043 27534 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:11.586895 27385 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:11.638322 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 268006us
W20260709 13:10:11.629221 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 53729.5us
I20260709 13:10:11.618458 27203 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:10:11.653789 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 284166us
W20260709 13:10:11.648953 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 191898us
I20260709 13:10:11.666072 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:11.676234 21879 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:11.679416 21761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59108 (request call id 2137) took 1037 ms. Trace:
I20260709 13:10:11.653906 27203 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:11.641306 27564 consensus_queue.cc:1048] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:10:11.680114 21761 rpcz_store.cc:276] 0709 13:10:10.642114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.181851 (+539737us) service_pool.cc:224] Handling call
0709 13:10:11.182138 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:11.182324 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:10:11.537833 (+355509us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.678923 (+141090us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:11.678994 (+    71us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:11.679051 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.679195 (+   144us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.679346 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1472,"spinlock_wait_cycles":25856,"thread_start_us":138953,"threads_started":1}
I20260709 13:10:11.685082 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:11.687692 21906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:10:11.688555 21906 raft_consensus.cc:606] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:11.687826 22478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36278 (request call id 967) took 1177 ms. Trace:
I20260709 13:10:11.696792 21761 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:11.700129 21728 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:11.687633 27203 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:11.677371 27535 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:11.687678 27577 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.683547 27510 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:11.698076 27515 consensus_meta.cc:287] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb: Time spent flushing consensus metadata: real 0.526s	user 0.006s	sys 0.006s
I20260709 13:10:11.689751 22478 rpcz_store.cc:276] 0709 13:10:10.502711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:10.502895 (+   184us) service_pool.cc:224] Handling call
0709 13:10:10.503230 (+   335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:10.921865 (+418635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:10.921913 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:10.948173 (+ 26260us) log.cc:844] Serialized 52 byte log entry
0709 13:10:11.310201 (+362028us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:10:11.458471 (+148270us) log.cc:844] Serialized 14 byte log entry
0709 13:10:11.679809 (+221338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:11.679887 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:11.679933 (+    46us) raft_consensus.cc:1685] finished
0709 13:10:11.679944 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:11.680079 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":410586,"prepare.queue_time_us":329421,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":490927,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":5451,"thread_start_us":678499,"threads_started":3,"wal-append.queue_time_us":384365}
I20260709 13:10:11.712083 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:10:11.688025 27410 raft_consensus.cc:493] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:11.727315 27410 raft_consensus.cc:515] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:11.729950 27410 leader_election.cc:290] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:11.732800 27211 raft_consensus.cc:993] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:10:11.733477 27211 raft_consensus.cc:1081] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:10:11.733659 27519 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:11.738284 27490 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:11.741900 27543 raft_consensus.cc:993] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:10:11.742362 27543 raft_consensus.cc:1081] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:10:11.722327 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:11.747745 21728 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:11.710810 27525 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:11.722704 27476 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:11.761456 21879 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:11.725956 27515 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:11.757608 27610 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:10:11.763607 27593 log.cc:927] Time spent T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:10:11.763368 27610 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:11.764389 21911 raft_consensus.cc:1240] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 14. Current term is 15. Ops: []
W20260709 13:10:11.764804 27600 log.cc:927] Time spent T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:10:11.765185 27602 log.cc:927] Time spent T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:10:11.757398 27528 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.766868 27528 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:11.771158 27528 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:11.774296 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:11.755260 27565 consensus_queue.cc:1059] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:10:11.777535 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:11.757722 27547 raft_consensus.cc:2764] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:10:11.781776 21879 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:11.783684 22449 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:11.787602 27529 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.788136 27529 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:11.790226 27529 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:11.785526 27247 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:11.787179 27565 raft_consensus.cc:3055] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:11.794145 27565 raft_consensus.cc:740] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:11.794989 27565 consensus_queue.cc:260] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:11.796226 27565 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:11.800348 27568 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:11.802383 27607 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:11.802824 21764 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 16.
I20260709 13:10:11.807701 27594 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:11.801841 27560 raft_consensus.cc:993] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:10:11.814966 27203 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:11.807695 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:11.816399 22484 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 17.
I20260709 13:10:11.816699 27560 raft_consensus.cc:1081] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:10:11.744004 27577 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:11.805877 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:11.812325 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:11.802326 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:11.831607 21729 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:11.834131 27365 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:11.807899 27075 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:11.837921 27525 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.838681 27525 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:11.839548 27075 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:11.805572 27531 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:11.834600 27577 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:11.837116 21758 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:11.843006 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:11.843304 21729 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:11.843737 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:11.824040 21762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:10:11.851958 21762 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:11.852406 21762 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:11.866364 27203 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:11.841566 27525 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:11.869809 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:11.852303 27531 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:11.809762 27537 consensus_queue.cc:260] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:11.863202 27568 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:10:11.873629 21765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:10:11.874266 21765 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:11.864486 27577 raft_consensus.cc:493] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:11.874652 21765 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:11.875021 27577 raft_consensus.cc:515] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:11.861676 27365 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:10:11.878243 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:11.881796 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:11.883708 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:11.877233 27577 leader_election.cc:290] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:11.887706 21731 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:11.892761 21909 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 22 LEADER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:11.894034 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:11.894770 21913 raft_consensus.cc:2393] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 16: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:11.895000 27315 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:11.895366 27315 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.895540 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:11.896164 21912 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 14.
I20260709 13:10:11.897662 27598 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:11.895706 27315 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:11.932658 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:11.954725 22449 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:11.909055 21762 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:11.972323 21765 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:11.973274 21761 raft_consensus.cc:1240] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:11.973455 22484 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:10:11.975838 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:11.977701 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:11.977983 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:11.906126 27437 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.978510 21831 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 17.
I20260709 13:10:11.978314 21833 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:10:11.989720 21762 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:12.000226 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:11.975145 27514 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:11.988919 27533 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:12.026276 21765 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:12.027720 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:11.987691 27528 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:12.001994 27221 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.012679 27075 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:12.046294 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b32fdbf1d5847cb8bb918426813576d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:12.014176 27514 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.988919 27460 consensus_queue.cc:1059] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.048s
I20260709 13:10:12.061641 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:12.062700 21840 raft_consensus.cc:2393] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 9: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:12.062934 27460 consensus_queue.cc:1243] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer 6d698a5544b946939790e7a3972db9fb log is divergent from this leader: its last log entry 22.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:10:12.063155 21765 raft_consensus.cc:1240] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:12.063565 27460 raft_consensus.cc:3055] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:10:12.063927 27460 raft_consensus.cc:740] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:12.064708 27460 consensus_queue.cc:260] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.059068 27075 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.098062 27460 raft_consensus.cc:3060] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:10:12.099732 27075 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:12.102939 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:12.103888 21831 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:12.046777 27221 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:12.106226 27221 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:12.066008 27619 log.cc:927] Time spent T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:10:12.047123 27528 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.108438 27528 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:12.059602 27533 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:12.113122 27533 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:12.073211 27577 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:12.083964 22479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:12.129794 27577 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.130242 22479 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:12.131848 21834 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38352
I20260709 13:10:12.132380 21834 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:12.132550 27577 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:12.086103 27144 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:12.088449 21731 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:10:12.133350 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 44987.5us
I20260709 13:10:12.133205 27144 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:12.134824 27275 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.134883 27551 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:12.135425 27275 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:12.135764 27551 raft_consensus.cc:697] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:12.137959 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:12.139058 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:12.139163 27515 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:12.084856 27410 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:12.144629 27410 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.146396 27539 raft_consensus.cc:3055] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:12.146847 27539 raft_consensus.cc:740] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:11.991976 27437 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.147557 27410 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:12.149358 27437 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:12.055332 27514 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:12.149787 27542 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.150341 27542 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.150780 27515 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:12.152494 27542 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:12.121152 21905 raft_consensus.cc:1240] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 10. Current term is 11. Ops: []
I20260709 13:10:12.154178 27610 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:12.154510 21839 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:12.156380 27537 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:12.122555 27116 consensus_queue.cc:1059] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:12.123200 27540 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:12.161147 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9d0d92d0fde44e8b0697570a1c2024e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:12.161779 27540 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.162499 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0e492aa4394405bb48ed3b957dd8f23" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:12.126298 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:12.163365 22477 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
I20260709 13:10:12.103065 21804 leader_election.cc:400] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12.
I20260709 13:10:12.132702 21834 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:12.164011 27540 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:12.164217 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:12.164433 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:12.127378 22480 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:12.163578 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:12.089766 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:12.166574 22484 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:12.167799 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:12.169942 27539 consensus_queue.cc:260] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:12.171140 27539 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:12.173031 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:12.135285 27144 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:12.173592 22476 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:12.173843 27116 raft_consensus.cc:3055] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:12.174363 27116 raft_consensus.cc:740] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:12.174947 21832 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 22 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:10:12.175226 27116 consensus_queue.cc:260] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:12.176481 27116 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:12.164062 21804 leader_election.cc:403] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
W20260709 13:10:12.178031 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 75105.7us
I20260709 13:10:12.178741 21804 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:12.179996 27534 raft_consensus.cc:3060] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:12.180586 27275 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:12.181172 27275 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:12.137068 27551 consensus_queue.cc:237] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.180001 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:12.090472 21877 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:12.186146 21805 leader_election.cc:400] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12.
W20260709 13:10:12.186393 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 96001.2us
I20260709 13:10:12.189827 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:12.190439 22485 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:10:12.191030 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:12.191628 21905 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 16.
I20260709 13:10:12.193179 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "701ea15eb74f4429a9b47522314b79a7" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:10:12.194692 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 72440.4us
I20260709 13:10:12.195829 27410 raft_consensus.cc:2749] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:12.199903 21834 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:12.254223 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:12.210901 21662 catalog_manager.cc:5697] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 10 to 12, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 12 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:12.214100 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:12.174101 21835 raft_consensus.cc:2410] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:10:12.218521 22479 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:10:12.220364 21760 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:10:12.220927 22480 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 17.
I20260709 13:10:12.223497 27515 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:12.225922 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:12.226758 21731 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:10:12.261303 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.262346 21833 raft_consensus.cc:1240] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 13. Current term is 15. Ops: []
I20260709 13:10:12.229902 27315 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.231796 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:12.239045 21804 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:12.242297 27514 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.244328 22484 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:10:12.246150 21879 leader_election.cc:304] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:12.248582 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:12.279798 21834 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:12.258462 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:12.258647 21877 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:12.227041 21831 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:10:12.265784 22481 raft_consensus.cc:1240] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:12.267081 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:12.268302 27620 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:12.293745 27620 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.294183 27620 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:12.260703 21805 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:12.299698 27534 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12.
W20260709 13:10:12.299923 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 114037us
I20260709 13:10:12.276392 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:12.280936 21757 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 17.
I20260709 13:10:12.281824 21832 raft_consensus.cc:1240] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:12.285341 21731 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:12.286340 27247 raft_consensus.cc:2749] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:12.286262 21879 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:12.287600 27221 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:12.288170 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:12.288575 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:12.289768 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:12.328542 21911 raft_consensus.cc:3055] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:10:12.289793 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:12.328809 21906 raft_consensus.cc:3055] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:12.328949 21911 raft_consensus.cc:740] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:12.329237 21906 raft_consensus.cc:740] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:12.291399 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:12.291785 22483 raft_consensus.cc:1275] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 22 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 17. (term mismatch)
I20260709 13:10:12.330258 22483 pending_rounds.cc:85] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: Aborting all ops after (but not including) 16
I20260709 13:10:12.302098 21804 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:12.302681 27075 consensus_queue.cc:1059] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:12.303495 22477 raft_consensus.cc:1240] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:10:12.305016 27539 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:12.306842 21762 raft_consensus.cc:2368] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 17. Current term is 18.
I20260709 13:10:12.307436 27315 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:12.300432 27534 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:12.319306 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:12.327989 21805 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:12.290674 27560 raft_consensus.cc:993] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:10:12.335433 27560 raft_consensus.cc:1081] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:10:12.301165 22482 raft_consensus.cc:1240] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 8. Current term is 9. Ops: []
I20260709 13:10:12.335620 21906 consensus_queue.cc:260] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.336848 21906 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:12.330514 22483 pending_rounds.cc:107] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: Aborting uncommitted NO_OP operation due to leader change: 21.17
W20260709 13:10:12.331735 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 45558us
I20260709 13:10:12.338406 22483 raft_consensus.cc:2889] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:12.338853 21879 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:10:12.331656 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 46410.6us
W20260709 13:10:12.315222 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.336740 21804 leader_election.cc:304] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:12.343516 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:12.344398 22483 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:12.353338 21879 leader_election.cc:304] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:12.347759 21911 consensus_queue.cc:260] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.372864 21911 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:12.373368 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.377028 27514 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:12.340919 27410 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:12.342671 27537 raft_consensus.cc:2804] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:12.333930 27539 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:12.352447 27519 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:12.403077 22483 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 18.
I20260709 13:10:12.403775 27519 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:12.404384 27519 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:12.347229 27557 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.407120 27557 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.351557 27247 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:12.367498 27560 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:10:12.411777 27579 raft_consensus.cc:3055] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:12.412387 27579 raft_consensus.cc:740] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:12.370260 27366 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:12.370720 27416 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.043s
I20260709 13:10:12.414072 27366 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:12.414515 27366 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:12.374486 27534 raft_consensus.cc:2749] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:12.370999 27609 raft_consensus.cc:2749] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:12.422765 27537 raft_consensus.cc:697] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:12.423092 27606 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:12.423839 27606 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.423977 27537 consensus_queue.cc:237] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.425585 27539 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:12.393319 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:10:12.402451 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 89670.2us
W20260709 13:10:12.430486 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:12.431980 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 48428.4us
I20260709 13:10:12.435627 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:12.436407 21762 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:12.432559 21731 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:12.441659 21879 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:10:12.443153 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.443830 21805 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:12.447494 21757 raft_consensus.cc:1275] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:12.455113 21906 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:10:12.458559 21911 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 9.
I20260709 13:10:12.468940 21805 leader_election.cc:400] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 17. Current term is 18.
I20260709 13:10:12.469404 21805 leader_election.cc:403] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:10:12.470372 27116 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:12.470809 27116 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:12.471179 27116 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:12.471575 21806 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:12.479308 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:12.480070 27116 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:12.480320 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:12.421283 27620 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.481002 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:12.481353 21761 raft_consensus.cc:1240] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:10:12.482486 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:12.482429 21662 catalog_manager.cc:5697] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.487040 21877 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:12.456761 27315 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:12.510762 21831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38352
W20260709 13:10:12.514709 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.518482 21834 raft_consensus.cc:1240] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:10:12.522716 21831 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:12.523105 21831 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:12.460002 27609 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:12.526394 27116 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:12.526496 27221 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:12.526926 21877 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:12.534068 21833 raft_consensus.cc:1275] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:12.541113 21662 catalog_manager.cc:5697] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 19 to 20, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 20 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:12.484731 27275 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:12.467895 27509 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:12.488765 27611 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:12.548377 21877 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:12.413347 27579 consensus_queue.cc:260] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:12.631307 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 83021.4us
I20260709 13:10:12.632411 21877 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:12.538930 27221 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:12.635718 27609 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:12.538395 27315 raft_consensus.cc:697] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 18 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:12.636243 21762 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
I20260709 13:10:12.512770 27247 consensus_queue.cc:1048] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.037s
I20260709 13:10:12.648178 21760 raft_consensus.cc:1240] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 13. Current term is 15. Ops: []
I20260709 13:10:12.525281 27560 consensus_queue.cc:1048] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:10:12.631724 21831 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:12.644919 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 287870us
I20260709 13:10:12.640005 21659 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45778 (request call id 300) took 4036 ms. Trace:
I20260709 13:10:12.652004 21804 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:12.644940 27610 consensus_queue.cc:1059] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:10:12.654459 27315 consensus_queue.cc:237] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.649873 21659 rpcz_store.cc:276] 0709 13:10:08.604095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:08.604456 (+   361us) service_pool.cc:224] Handling call
0709 13:10:08.727083 (+122627us) spinlock_profiling.cc:243] Waited 52.2 ms on lock 0x7b54002ae254. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c1090 00007fc6ae35ff3a 00007fc6b41161cc 00007fc6b421437e 00007fc6b26d52a4 00007fc6b26d5232 00007fc6b26d5161 00007fc6b26d50dc 00007fc6b26d4392 00007fc6ac69248c 00007fc6ac6918c6
0709 13:10:08.747323 (+ 20240us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b5400002210. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ab0f2db1 00007fc6ab233640 00007fc6b410ab76 00007fc6b4214c3e 00007fc6b26d52a4 00007fc6b26d5232 00007fc6b26d5161 00007fc6b26d50dc 00007fc6b26d4392 00007fc6ac69248c 00007fc6ac6918c6
0709 13:10:12.639926 (+3892603us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:09.962236 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:10.041733 (+ 79497us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:10.041769 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:10:10.041791 (+    22us) tablet.cc:662] Decoding operations
0709 13:10:10.188123 (+146332us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:10.195986 (+  7863us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:10.199828 (+  3842us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:10:10.346019 (+146191us) tablet.cc:701] Row locks acquired
0709 13:10:10.346036 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:10:10.346192 (+   156us) write_op.cc:270] Start()
0709 13:10:10.346319 (+   127us) write_op.cc:276] Timestamp: P: 1783602610346144 usec, L: 0
0709 13:10:10.346336 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 13:10:10.349707 (+  3371us) log.cc:844] Serialized 4346 byte log entry
0709 13:10:11.171308 (+821601us) op_driver.cc:464] REPLICATION: finished
0709 13:10:11.647626 (+476318us) write_op.cc:301] APPLY: starting
0709 13:10:11.653340 (+  5714us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:11.814527 (+161187us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:11.814634 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:11.900842 (+ 86208us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:11.903195 (+  2353us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:10:11.903244 (+    49us) write_op.cc:312] APPLY: finished
0709 13:10:11.903578 (+   334us) log.cc:844] Serialized 105 byte log entry
0709 13:10:11.903743 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:11.903880 (+   137us) write_op.cc:454] Released schema lock
0709 13:10:11.903932 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:11.945379 (+ 41447us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:11.969347 (+ 23968us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":168817,"reported_tablets":29,"spinlock_wait_cycles":155956352,"child_traces":[["op",{"apply.queue_time_us":443735,"apply.run_cpu_time_us":17068,"apply.run_wall_time_us":281315,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50151,"num_ops":11,"prepare.queue_time_us":430905,"prepare.run_cpu_time_us":17045,"prepare.run_wall_time_us":527388,"raft.queue_time_us":385765,"raft.run_cpu_time_us":25265,"raft.run_wall_time_us":275361,"replication_time_us":824794,"thread_start_us":723518,"threads_started":4,"wal-append.queue_time_us":127052}]]}
I20260709 13:10:12.656916 27610 raft_consensus.cc:3055] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:12.657308 27610 raft_consensus.cc:740] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:12.658107 27610 consensus_queue.cc:260] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.659231 27610 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:12.662138 21879 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.541635 27571 consensus_queue.cc:1059] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.108s
I20260709 13:10:12.680956 21831 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:12.549261 27144 consensus_queue.cc:1059] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.130s
I20260709 13:10:12.680040 27247 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:12.681137 27564 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:12.710248 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:12.711071 21909 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 14.
W20260709 13:10:12.711514 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 59596.7us
I20260709 13:10:12.712710 21729 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:12.716776 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:12.695987 27551 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:12.721777 21834 raft_consensus.cc:1240] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 22 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 21. Current term is 22. Ops: []
I20260709 13:10:12.769218 27116 raft_consensus.cc:3055] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:12.769791 27116 raft_consensus.cc:740] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:12.770640 27116 consensus_queue.cc:260] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.771171 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:12.772445 22483 raft_consensus.cc:1275] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:12.705268 27416 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:12.773355 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:12.771776 27116 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:12.704015 27606 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:12.774039 21762 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:12.779093 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:12.720429 27541 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:12.704782 27247 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:12.753216 27534 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:10:12.770231 27171 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:10:12.807994 22449 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.708158 27564 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:12.813457 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:12.821825 21762 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
I20260709 13:10:12.823081 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:12.752566 27551 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:12.835019 27564 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:12.780587 27416 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:12.807621 27541 raft_consensus.cc:697] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:12.775226 27519 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.842577 27541 consensus_queue.cc:237] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:12.843413 27629 log.cc:927] Time spent T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:10:12.845898 27630 log.cc:927] Time spent T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:10:12.846539 21835 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 14.
I20260709 13:10:12.847170 21910 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49554 (request call id 2192) took 1693 ms. Trace:
W20260709 13:10:12.847268 27632 log.cc:927] Time spent T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
W20260709 13:10:12.847985 27628 log.cc:927] Time spent T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:10:12.719427 27509 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.847594 21910 rpcz_store.cc:276] 0709 13:10:11.153490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:11.153943 (+   453us) service_pool.cc:224] Handling call
0709 13:10:11.154343 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:11.154745 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:11.154782 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:12.044181 (+889399us) spinlock_profiling.cc:243] Waited 6.2 ms on lock 0x7b2c00021ff8. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6acc50a11 00007fc6acc60372 00007fc6ae392a01 00007fc6ae35743a 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2
0709 13:10:12.058729 (+ 14548us) log.cc:844] Serialized 26 byte log entry
0709 13:10:12.461114 (+402385us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:10:12.461150 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:12.468285 (+  7135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:12.846862 (+378577us) raft_consensus.cc:1685] finished
0709 13:10:12.846884 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:12.847093 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11,"raft.queue_time_us":3558,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":12039,"spinlock_wait_cycles":14254464,"thread_start_us":367294,"threads_started":1,"wal-append.queue_time_us":537635}
I20260709 13:10:12.851364 27509 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:12.852296 27557 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:12.854446 21834 raft_consensus.cc:2368] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 16. Current term is 17.
I20260709 13:10:12.856045 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:12.856582 27519 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:12.857342 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:12.860276 27525 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:12.865548 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:12.880949 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:12.881647 21728 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:12.902853 21914 raft_consensus.cc:2410] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:10:12.916294 21833 raft_consensus.cc:2410] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
W20260709 13:10:12.917279 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 280408us
I20260709 13:10:12.918182 21877 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:12.918269 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:12.923285 22449 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:12.924422 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:12.821394 27620 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:12.841176 27366 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:12.922252 27275 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 17. Current term is 18.
I20260709 13:10:12.955844 27509 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:12.956363 27509 raft_consensus.cc:493] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:12.956710 27509 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:12.820101 27171 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:12.922953 27565 raft_consensus.cc:2749] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:12.960973 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:12.962523 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:10:12.964886 21803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:12.944084 27560 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:12.944970 27410 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:12.922899 27525 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:12.954298 27635 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:12.982180 27633 log.cc:927] Time spent T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:10:12.980013 27410 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:12.980132 27560 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:13.067971 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:10:13.069132 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 148814us
I20260709 13:10:13.077028 21728 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:13.080090 27620 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:13.052436 21838 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 18.
I20260709 13:10:13.080504 27620 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:13.080962 27620 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:13.067265 27607 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:13.053043 27247 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:13.096778 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 132764us
I20260709 13:10:13.060075 27221 raft_consensus.cc:3055] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:13.100916 21805 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:13.096331 22448 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:13.107466 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:13.108295 22478 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:10:13.111006 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:13.117309 22448 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:13.122598 27642 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:13.123188 27642 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:13.123575 27551 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:13.124125 27564 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.124665 27564 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:13.125677 27509 raft_consensus.cc:515] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:13.126456 22448 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:13.126845 27564 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:13.127566 27509 leader_election.cc:290] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:13.128125 27509 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:13.128684 27534 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:13.129240 27534 raft_consensus.cc:697] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:13.130088 27534 consensus_queue.cc:237] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:13.132872 22482 raft_consensus.cc:1240] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:13.134506 27410 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:13.134914 21805 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:13.137706 27533 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:13.138041 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:10:13.138473 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.138684 22484 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 9.
W20260709 13:10:13.139024 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.128717 27509 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:13.143596 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:13.146854 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:13.104434 27221 raft_consensus.cc:740] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:13.127562 22448 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:13.148396 27221 consensus_queue.cc:260] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:13.151846 27540 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:13.152827 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:13.153421 21905 raft_consensus.cc:2468] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 16.
I20260709 13:10:13.154639 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:13.148408 27551 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:10:13.155450 21914 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:13.158941 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:13.159713 21908 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 16.
I20260709 13:10:13.096721 27366 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:13.138195 27533 raft_consensus.cc:697] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:13.164156 21914 raft_consensus.cc:2468] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 15.
I20260709 13:10:13.165628 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0e72cc3f09a4d549ebd824be85955a3" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:13.165443 21806 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:13.166930 22478 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 17.
I20260709 13:10:13.102538 27416 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:13.167532 22448 leader_election.cc:400] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 16 pre-election: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 16. Current term is 17.
I20260709 13:10:13.173985 22448 leader_election.cc:403] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:13.174640 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:13.149729 27221 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:10:13.162140 27525 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:13.104053 27247 consensus_queue.cc:1048] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
W20260709 13:10:13.170935 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.151132 27171 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:13.175249 22449 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:13.172837 27564 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:13.123584 27642 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:13.104990 27577 consensus_queue.cc:1059] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:10:13.189297 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:13.191479 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:13.194527 21905 raft_consensus.cc:1240] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:13.202636 27577 raft_consensus.cc:3055] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:13.203104 27577 raft_consensus.cc:740] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:13.203976 27577 consensus_queue.cc:260] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:13.205107 27577 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:13.182228 27528 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) with higher term. Message: Invalid argument: T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 16. Current term is 17.
I20260709 13:10:13.213882 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:13.195631 22449 leader_election.cc:304] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:13.226195 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:13.233999 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:13.186467 27564 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.245091 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:13.245785 21761 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:13.237448 21910 raft_consensus.cc:1240] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:13.194298 27540 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:13.247145 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:13.210546 21912 raft_consensus.cc:1275] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:10:13.254551 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:13.257304 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:13.249142 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:13.261665 27514 raft_consensus.cc:2804] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:13.262410 27514 raft_consensus.cc:697] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:13.263391 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:10:13.270138 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 76418.9us
I20260709 13:10:13.272864 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:13.273511 21914 raft_consensus.cc:3055] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:13.273849 21914 raft_consensus.cc:740] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:13.196696 27647 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:10:13.251763 27560 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:13.252041 27540 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:13.274582 21914 consensus_queue.cc:260] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:13.253027 27564 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:13.185141 27533 consensus_queue.cc:237] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:13.285375 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:13.288349 21906 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:10:13.290325 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 164764us
I20260709 13:10:13.292507 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:13.295571 21761 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 17.
I20260709 13:10:13.295758 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:13.291096 21728 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:13.299351 21906 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 17.
I20260709 13:10:13.303951 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:10:13.305758 27644 log.cc:927] Time spent T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:10:13.307029 27648 log.cc:927] Time spent T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:10:13.308189 27514 consensus_queue.cc:237] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:13.312493 27564 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:13.314888 27564 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:13.305145 21760 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 11.
I20260709 13:10:13.318104 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:13.318753 22478 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:13.284497 27540 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:13.330507 21912 raft_consensus.cc:2393] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:10:13.331280 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 147681us
I20260709 13:10:13.331511 22478 raft_consensus.cc:2468] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 10.
I20260709 13:10:13.333359 21806 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:13.334758 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee8c1089f60b4e52ae7e434904d4d178" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:13.342016 27519 raft_consensus.cc:2804] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:13.342695 27519 raft_consensus.cc:697] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:13.343580 27519 consensus_queue.cc:237] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:13.344321 27579 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:13.342206 27539 consensus_meta.cc:287] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Time spent flushing consensus metadata: real 0.916s	user 0.013s	sys 0.000s
I20260709 13:10:13.346211 27539 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:13.348359 27539 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:13.349030 21835 raft_consensus.cc:1240] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:13.299194 27474 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:13.354387 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:13.358526 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:13.358819 21804 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:13.359642 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:13.360250 21804 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:13.363219 21729 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:13.321256 27642 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:13.365530 21831 raft_consensus.cc:2393] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 13: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:13.374404 27366 consensus_queue.cc:1048] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:13.377848 21832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:13.332633 27534 consensus_queue.cc:1059] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:10:13.378530 21832 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 19.
I20260709 13:10:13.378997 27534 raft_consensus.cc:3055] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:13.379374 27534 raft_consensus.cc:740] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:13.380256 27534 consensus_queue.cc:260] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:13.381471 27474 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:13.354084 27541 raft_consensus.cc:493] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:13.396863 21804 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:13.398648 27116 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:13.369150 27576 raft_consensus.cc:2749] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:13.369544 27539 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:13.406690 27652 log.cc:927] Time spent T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 13:10:13.407985 27654 log.cc:927] Time spent T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:13.397876 27437 consensus_queue.cc:1059] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 13:10:13.411808 21804 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:13.414400 21877 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:10:13.415776 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 44270.4us
I20260709 13:10:13.418696 27116 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:13.409543 27653 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.437795 27653 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:13.440007 27653 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:13.441208 21729 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:13.435372 21905 raft_consensus.cc:2410] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:10:13.420138 27116 raft_consensus.cc:697] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:13.442749 22477 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:13.443655 22478 raft_consensus.cc:1240] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:13.445101 21909 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
I20260709 13:10:13.450479 22482 raft_consensus.cc:1240] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:10:13.442683 27116 consensus_queue.cc:237] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:13.459200 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:13.459935 21834 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:13.419461 27642 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:13.455444 27610 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:13.410699 27541 raft_consensus.cc:515] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:13.452606 27539 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:13.488152 21834 raft_consensus.cc:2468] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 15.
I20260709 13:10:13.489182 21833 raft_consensus.cc:1240] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:10:13.489562 22448 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:13.490624 27642 raft_consensus.cc:2804] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:13.491251 27642 raft_consensus.cc:697] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:13.492390 27642 consensus_queue.cc:237] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:13.480890 27620 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:13.497843 21648 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 773a4e5c42d942629a59d30efb0870f6 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6d698a5544b946939790e7a3972db9fb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:13.498946 27620 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:13.471153 27533 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:13.465888 27643 consensus_queue.cc:1059] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:10:13.507073 27643 raft_consensus.cc:3055] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:13.507423 27643 raft_consensus.cc:740] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:13.508308 27643 consensus_queue.cc:260] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:13.511085 27541 leader_election.cc:290] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:13.512683 27385 raft_consensus.cc:493] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:13.515378 21914 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:13.515142 27540 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:13.516155 27611 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:13.516640 27611 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:13.513353 27385 raft_consensus.cc:515] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:13.501840 27620 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:13.543082 27385 leader_election.cc:290] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:13.487741 27610 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:13.522621 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:13.496357 27539 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:13.505757 27551 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:13.525692 21914 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
I20260709 13:10:13.546788 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:10:13.570739 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:13.582880 22450 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.587301 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:13.599740 22448 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:13.602157 21804 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:13.550853 27643 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:13.567394 27610 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:13.549799 27275 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:13.550627 27540 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:13.612692 21837 raft_consensus.cc:1240] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: []
I20260709 13:10:13.565416 27611 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:13.628891 21834 raft_consensus.cc:1240] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:13.532096 27533 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:13.605003 27576 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:10:13.632355 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 189209us
I20260709 13:10:13.610529 27640 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.649788 21760 raft_consensus.cc:1240] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Rejecting Update request from peer 8c6c2207af3d47b3acf352d81959f4dd for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:13.611002 27437 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:10:13.639854 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 176748us
I20260709 13:10:13.610808 27645 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:10:13.652454 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:13.650323 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:13.653321 21833 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:10:13.610369 27564 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:13.645222 27611 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:13.684660 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:13.690582 27539 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:13.628641 27275 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:13.703410 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:10:13.710191 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 58868.8us
W20260709 13:10:13.711848 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 57856.2us
I20260709 13:10:13.712366 27649 consensus_queue.cc:1059] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:13.890487 27541 consensus_queue.cc:1059] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:10:13.763566 21877 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:13.766945 21728 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:13.771255 27534 raft_consensus.cc:3060] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:13.773336 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:13.780400 21879 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:13.786746 27533 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:13.788616 27275 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:13.649870 27576 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:13.677771 27564 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:13.906067 27576 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:13.907389 27564 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:13.656338 27640 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:13.718015 27611 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:13.798799 21805 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:10:13.911468 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 112791us
I20260709 13:10:13.805406 21908 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:13.806049 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:13.912662 21905 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:10:13.808249 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:13.808995 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:13.812702 22477 raft_consensus.cc:1240] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 16. Current term is 17. Ops: []
I20260709 13:10:13.719302 21839 raft_consensus.cc:2393] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 13: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:13.829196 27610 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:13.856067 22476 raft_consensus.cc:1275] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:10:13.857121 27668 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.864487 27542 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:13.865084 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a218be1e72294b138c21b46dfa317d11" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:13.896368 27620 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.878239 22450 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:13.879702 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:13.880818 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:13.909410 27607 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:13.883773 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:13.884665 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:13.885496 27315 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:13.886263 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:10:13.899451 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 132577us
W20260709 13:10:13.900617 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 120318us
I20260709 13:10:13.904174 27665 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:13.908905 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:13.803781 21910 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:10:13.877583 27642 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:13.910918 27144 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:13.923435 21760 raft_consensus.cc:2393] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 13: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:13.881161 21763 raft_consensus.cc:1275] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:10:13.926250 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 48086.8us
I20260709 13:10:13.925081 21805 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:13.929638 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d6d123916f54285a4a4b037399f46ec" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:13.918823 27678 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:13.942488 21805 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:13.947430 27642 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:13.950439 27611 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:13.950995 27474 consensus_queue.cc:1059] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:13.935760 27665 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.951783 27474 consensus_queue.cc:1243] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer 6fadfd81c5a645f1806a284ddbb6bf0d log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:10:13.951849 27665 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:13.952381 27474 raft_consensus.cc:3055] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:10:13.952788 27474 raft_consensus.cc:740] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:13.954641 27610 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:13.947471 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:13.959656 27144 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:13.947520 27315 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:13.922855 27668 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:13.923038 27551 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:10:13.922977 27542 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:13.969548 27640 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:13.935031 27643 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:10:13.971840 21756 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:10:13.980300 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:13.983047 27642 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:13.971428 27564 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:10:13.983526 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 50826.7us
I20260709 13:10:14.015468 21879 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:14.017635 27410 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:13.925355 27620 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:13.996759 27366 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:13.986246 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 43845.3us
I20260709 13:10:14.026695 21805 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:13.937032 27645 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:14.028854 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 110598us
W20260709 13:10:14.028872 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 309318us
I20260709 13:10:14.031725 21761 raft_consensus.cc:2393] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 19: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:14.032378 21805 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:14.033672 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:14.034646 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:14.040792 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:14.046329 21756 raft_consensus.cc:2393] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 13: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:14.050413 21905 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:14.041481 21835 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:10:14.053020 21877 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:14.055054 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:14.055929 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:14.058665 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:14.060402 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:14.061928 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:14.055923 21835 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:10:14.067135 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:14.069039 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:14.070664 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd623bab71d4824b1463c6a5d774292" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:14.072867 22483 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:14.074942 21756 raft_consensus.cc:1275] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:14.061928 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:14.067962 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9911866d06f94adfb20f8f0e0890dcd9" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:14.078048 21877 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:14.083554 21762 raft_consensus.cc:1240] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:13.995425 27474 consensus_queue.cc:260] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:14.087373 27474 raft_consensus.cc:3060] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:14.078059 27460 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.089919 27460 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:14.092795 27460 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:14.093531 27647 consensus_queue.cc:1175] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8c6c2207af3d47b3acf352d81959f4dd" responder_term: 10 status { last_received { term: 8 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 9. Current term is 10. Ops: [9.10-9.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:14.096050 27686 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:14.096659 27686 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.097105 27686 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:14.102710 22476 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:10:14.049973 27607 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.105938 27607 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:14.119163 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:14.125458 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:14.126052 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:14.126926 21762 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:10:14.127532 21731 leader_election.cc:304] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:14.128048 21762 raft_consensus.cc:3055] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:14.128434 21762 raft_consensus.cc:740] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:14.032378 27620 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:14.056053 27533 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:14.062952 27557 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:14.036576 27564 raft_consensus.cc:697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:14.135319 21839 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 19.
I20260709 13:10:14.078121 27640 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:14.136451 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:14.136642 22482 raft_consensus.cc:1275] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:10:14.140410 21731 leader_election.cc:304] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:14.138059 21905 raft_consensus.cc:1275] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:10:14.146649 21731 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:14.148029 27365 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:14.148583 27365 raft_consensus.cc:697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:14.149536 27365 consensus_queue.cc:237] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:14.129588 27385 raft_consensus.cc:2749] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:14.143793 27311 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:14.153730 21729 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.148105 27564 consensus_queue.cc:237] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:14.156296 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:14.160693 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:14.143646 27640 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:14.165568 27640 raft_consensus.cc:3060] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:14.153888 27649 raft_consensus.cc:2749] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:14.176204 21908 raft_consensus.cc:1275] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:10:14.136198 21762 consensus_queue.cc:260] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:14.152674 27311 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:14.063118 27275 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:10:14.180717 21762 raft_consensus.cc:3060] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:14.189317 27681 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:14.191049 27681 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:14.175329 27687 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.137176 27665 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:14.143298 27674 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:10:14.200659 27687 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:14.203326 27665 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:14.207687 27311 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:14.203451 27686 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:14.208350 27640 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:14.205973 21831 raft_consensus.cc:1275] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:10:14.245164 27640 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:14.216461 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:14.252070 27643 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.267648 27643 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:14.257102 21730 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.270823 27643 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:14.193390 27681 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:14.217832 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:14.277987 21908 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:10:14.217361 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:14.278976 21909 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:10:14.202242 21764 raft_consensus.cc:2393] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 14: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:14.217391 27695 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:14.219624 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 63178.1us
W20260709 13:10:14.274611 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 126828us
I20260709 13:10:14.274488 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:14.215207 21761 raft_consensus.cc:1275] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:10:14.283352 21761 pending_rounds.cc:85] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239: Aborting all ops after (but not including) 9
I20260709 13:10:14.283617 21761 pending_rounds.cc:107] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:10:14.283843 21761 raft_consensus.cc:2889] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:14.266851 21756 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:10:14.260331 21762 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:14.286468 27695 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:14.289925 27542 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:14.290688 27695 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:14.295307 22449 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:14.301165 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:14.301712 21756 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:14.307838 27542 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:14.304553 27460 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:14.309051 27687 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:14.309603 27460 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:14.310057 27460 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:14.333724 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:14.335215 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:14.335839 21908 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:10:14.335857 21879 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:14.344087 27668 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:14.343958 27611 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:14.345062 27607 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:14.347958 21879 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:14.348804 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:14.356776 22477 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:14.356791 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:14.359266 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:14.356966 21909 raft_consensus.cc:2393] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 15: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:14.359421 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:14.351665 21805 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:14.367301 27116 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:14.369797 27116 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.370106 27116 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:14.370728 21806 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:14.372843 21879 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:14.373325 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:14.374058 21760 raft_consensus.cc:2393] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 14: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:14.375263 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:14.375869 21764 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:10:14.372615 27247 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:14.378057 27247 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:14.378481 27247 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:14.378750 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:14.379333 21763 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:10:14.384621 21806 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:14.387017 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:14.388619 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:14.388692 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:14.389387 21905 raft_consensus.cc:2393] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 14: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:14.389367 21909 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 18.
I20260709 13:10:14.393522 27437 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:14.394356 21879 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:14.361759 27687 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:14.397945 21879 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:14.397756 21877 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:14.431516 27116 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:14.432700 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 72350.4us
I20260709 13:10:14.433171 21839 raft_consensus.cc:2393] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 16: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:14.435009 27116 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:14.423871 27640 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:14.435985 27640 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.436486 27640 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:14.436931 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 52378us
I20260709 13:10:14.437947 27116 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:14.434927 22450 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:10:14.441630 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 46461.2us
W20260709 13:10:14.443043 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 45555.5us
I20260709 13:10:14.445271 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:14.445854 21760 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:10:14.378019 27645 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:10:14.447588 27221 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:14.456887 27221 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.378000 27576 consensus_queue.cc:1059] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
I20260709 13:10:14.458145 27576 raft_consensus.cc:3055] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:14.458508 27576 raft_consensus.cc:740] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:14.459313 27576 consensus_queue.cc:260] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:14.447726 27641 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:14.467402 27641 raft_consensus.cc:697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 19 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:14.395351 27694 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:10:14.470423 27694 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.470918 27694 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:14.372952 27311 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:10:14.365515 27366 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:10:14.385143 27460 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:14.477931 27460 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:14.483924 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:14.468568 27641 consensus_queue.cc:237] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:14.457283 27221 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:14.521052 27611 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:14.525905 27611 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:14.529866 22482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:14.567556 21760 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 16.
I20260709 13:10:14.511647 27540 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:14.581647 21835 raft_consensus.cc:2468] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:10:14.591759 27221 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:14.594023 27221 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:14.592059 27686 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:14.564196 27611 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:10:14.575639 27676 log.cc:927] Time spent T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:10:14.508031 27557 consensus_queue.cc:1048] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.122s
I20260709 13:10:14.674803 27640 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:14.710243 21908 raft_consensus.cc:2368] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 13. Current term is 14.
I20260709 13:10:14.714762 27640 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:14.675853 22483 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 13:10:14.718115 21804 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.008s	sys 0.063s
W20260709 13:10:14.718477 21804 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.008s	sys 0.063s
W20260709 13:10:14.718736 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 538008us
I20260709 13:10:14.719969 21804 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:14.720274 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:14.721179 21804 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:14.722471 27311 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:14.724906 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:14.726567 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:14.728541 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:14.692065 27315 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:14.721239 22477 raft_consensus.cc:2393] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 15: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:10:14.402431 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:14.737079 21729 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:14.744606 27116 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:14.729399 22481 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:10:14.762235 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:14.763088 22476 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:14.765568 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 321225us
I20260709 13:10:14.693385 27694 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:14.698288 27144 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:10:14.704146 27703 log.cc:927] Time spent T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.107s	user 0.003s	sys 0.000s
I20260709 13:10:14.507833 27678 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.137s
I20260709 13:10:14.782407 21804 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:14.767561 27665 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:14.792986 21729 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:10:14.789713 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 54904.7us
I20260709 13:10:14.801787 27116 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:14.801939 21805 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:14.798133 21834 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:14.803313 27116 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:14.799619 22449 leader_election.cc:400] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 13. Current term is 14.
I20260709 13:10:14.803937 27116 raft_consensus.cc:697] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:14.804031 22449 leader_election.cc:403] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:10:14.808769 21662 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52326 (request call id 170) took 7550 ms. Trace:
I20260709 13:10:14.800736 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:14.634446 27247 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:14.731057 27315 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
W20260709 13:10:14.817480 21806 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.805099 27116 consensus_queue.cc:237] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:14.819929 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:14.821973 21835 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 19.
I20260709 13:10:14.832783 27576 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:14.813410 27698 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:10:14.836161 27247 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:14.801033 27366 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:10:14.838321 27694 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:14.810986 27534 raft_consensus.cc:2749] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:14.807704 27551 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:14.808211 27665 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:14.844633 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 88545us
I20260709 13:10:14.844760 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:14.845293 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
W20260709 13:10:14.845225 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 77836.6us
I20260709 13:10:14.846393 21831 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:14.846495 21834 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 18: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:14.846798 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:14.846504 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:14.848242 21837 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 13.
I20260709 13:10:14.853209 22448 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:14.861488 22476 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:10:14.809305 21662 rpcz_store.cc:276] 0709 13:10:07.247448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:07.249543 (+  2095us) service_pool.cc:224] Handling call
0709 13:10:14.797644 (+7548101us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:13.103000 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:13.145979 (+ 42979us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:13.146014 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:10:13.146031 (+    17us) tablet.cc:662] Decoding operations
0709 13:10:13.146567 (+   536us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:13.146643 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:13.146669 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:10:13.146991 (+   322us) tablet.cc:701] Row locks acquired
0709 13:10:13.147011 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:10:13.147142 (+   131us) write_op.cc:270] Start()
0709 13:10:13.147253 (+   111us) write_op.cc:276] Timestamp: P: 1783602613147095 usec, L: 0
0709 13:10:13.147276 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:10:13.147933 (+   657us) log.cc:844] Serialized 1284 byte log entry
0709 13:10:13.640015 (+492082us) op_driver.cc:464] REPLICATION: finished
0709 13:10:13.887847 (+247832us) write_op.cc:301] APPLY: starting
0709 13:10:13.887947 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:13.961582 (+ 73635us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b180025ac80. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6b4132de1 00007fc6b413f5b1 00007fc6ae0960ec 00007fc6ae098af7 00007fc6ae099fb0 00007fc6b1dae1bb 00007fc6b1dae532 00007fc6b1df5b93 00007fc6b1ca2de3 00007fc6b1ca26ab 00007fc6b1ca3e77
0709 13:10:13.963146 (+  1564us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:13.963166 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:13.964958 (+  1792us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:13.965147 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:10:13.965191 (+    44us) write_op.cc:312] APPLY: finished
0709 13:10:13.965412 (+   221us) log.cc:844] Serialized 41 byte log entry
0709 13:10:13.965942 (+   530us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:13.966032 (+    90us) write_op.cc:454] Released schema lock
0709 13:10:13.966071 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:14.070670 (+104599us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:14.079177 (+  8507us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":195339,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":247539,"apply.run_cpu_time_us":8849,"apply.run_wall_time_us":93577,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16679,"num_ops":3,"prepare.queue_time_us":342066,"prepare.run_cpu_time_us":28173,"prepare.run_wall_time_us":191266,"raft.queue_time_us":273518,"raft.run_cpu_time_us":70046,"raft.run_wall_time_us":251875,"replication_time_us":492586,"spinlock_wait_cycles":26098432,"thread_start_us":832883,"threads_started":4,"wal-append.queue_time_us":185684}]]}
I20260709 13:10:14.849308 27665 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:14.850898 27509 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.858019 27514 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:14.863446 27701 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) with higher term. Message: Invalid argument: T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for earlier term 13. Current term is 14.
I20260709 13:10:14.861611 27689 consensus_queue.cc:1048] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
W20260709 13:10:14.924576 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 70683.4us
I20260709 13:10:14.925984 21877 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:14.931106 21831 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 14.
I20260709 13:10:14.941587 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:14.942736 21835 raft_consensus.cc:2393] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 13: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:14.945051 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:14.953593 21880 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:14.900964 27509 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:14.969087 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:14.971611 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:14.972748 21839 raft_consensus.cc:2393] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 14: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:14.974664 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:14.975414 21908 raft_consensus.cc:2393] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 16: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:14.976603 21914 raft_consensus.cc:1240] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:14.983474 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:14.988865 21910 raft_consensus.cc:2393] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 16: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
W20260709 13:10:14.990645 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 201064us
I20260709 13:10:14.954459 27706 raft_consensus.cc:2804] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:14.968974 27694 raft_consensus.cc:2804] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:10:14.997325 21648 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 773a4e5c42d942629a59d30efb0870f6 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6d698a5544b946939790e7a3972db9fb is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:14.980834 27687 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:15.016896 27694 raft_consensus.cc:697] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:10:15.034550 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 225408us
W20260709 13:10:15.036901 27714 log.cc:927] Time spent T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:10:15.046227 27710 log.cc:927] Time spent T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:10:15.047696 27668 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:15.050388 27514 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.060385 27509 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:15.061412 27687 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:15.070734 21728 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:15.076392 21835 raft_consensus.cc:1275] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:15.077651 21729 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:15.014755 27706 raft_consensus.cc:697] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 15 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
W20260709 13:10:15.101383 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 145372us
I20260709 13:10:15.107023 27706 consensus_queue.cc:237] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:15.109543 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:15.110206 21908 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 17.
I20260709 13:10:15.117791 27116 consensus_queue.cc:1059] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:15.087196 27514 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:15.125640 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:10:15.124647 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 54030.6us
I20260709 13:10:15.132691 21757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:15.132826 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:15.133561 21762 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:15.133919 21759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:15.134727 21759 raft_consensus.cc:2393] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 16: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:15.137686 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:15.125309 27116 raft_consensus.cc:3055] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:15.139966 27116 raft_consensus.cc:740] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:15.148857 21760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:15.152455 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:15.153448 21756 raft_consensus.cc:2393] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 13: Already voted for candidate 3843e9b794a245dd8608e04ec7915239 in this term.
I20260709 13:10:15.140914 27116 consensus_queue.cc:260] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:15.165222 27116 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:10:15.166239 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 363101us
I20260709 13:10:15.113013 27460 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:15.112946 27689 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:15.172744 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:15.176383 21763 raft_consensus.cc:3060] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:15.176800 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:15.177163 21762 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 12.
I20260709 13:10:15.178530 21835 raft_consensus.cc:2410] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:10:15.179435 21764 raft_consensus.cc:1240] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 11. Current term is 12. Ops: []
I20260709 13:10:15.130826 27565 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:10:15.120054 27721 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:10:15.193259 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 60725us
I20260709 13:10:15.209682 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:15.210669 22448 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:15.190364 27565 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.194795 21728 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:15.191536 27437 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.192680 27721 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:15.227331 27721 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:15.182250 27460 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:15.182368 27689 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:15.218137 27565 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:15.233302 22448 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:15.207701 27514 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:15.127624 27694 consensus_queue.cc:237] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:15.242519 27736 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:15.222280 27437 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:15.230718 27727 consensus_queue.cc:1048] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:10:15.245899 27726 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:15.275377 27540 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:15.303515 21879 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:15.310142 21877 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:15.313313 27221 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:10:15.346793 27687 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:15.349011 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:15.354377 27689 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:15.358664 27437 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:15.359965 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:15.365374 21905 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:10:15.367887 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 59271.6us
I20260709 13:10:15.368685 21763 raft_consensus.cc:2468] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
W20260709 13:10:15.365702 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 55649.6us
W20260709 13:10:15.374790 27732 log.cc:927] Time spent T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:10:15.374886 27722 log.cc:927] Time spent T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
W20260709 13:10:15.374855 27731 log.cc:927] Time spent T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:10:15.376574 27720 log.cc:927] Time spent T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 13:10:15.378002 27725 log.cc:927] Time spent T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:10:15.379127 27460 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:15.367588 27577 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:10:15.380820 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:15.382727 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:15.383246 21805 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:15.385048 27697 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:15.384932 27665 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:15.387180 27665 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:15.392151 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 46117.2us
I20260709 13:10:15.393355 21757 raft_consensus.cc:2368] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 13. Current term is 14.
I20260709 13:10:15.396148 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:15.398464 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:15.399056 21908 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:15.410123 21765 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:15.430846 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:10:15.576216 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 358697us
W20260709 13:10:15.576814 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 182388us
W20260709 13:10:15.576086 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 182952us
I20260709 13:10:15.577049 21728 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
W20260709 13:10:15.604207 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 195562us
I20260709 13:10:15.608080 21840 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 13:10:15.613521 21877 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:15.646260 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:15.649466 21879 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:15.608631 27686 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:15.617079 27687 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:15.645293 27144 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:15.670233 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 93200.2us
W20260709 13:10:15.693750 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 81921.6us
I20260709 13:10:15.665725 27610 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:15.672643 27674 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:15.670044 27687 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:15.662772 27686 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:15.738121 27746 log.cc:927] Time spent T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:10:15.764959 21908 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 14.
I20260709 13:10:15.766746 22476 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:10:15.726428 27610 raft_consensus.cc:697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:15.775192 21729 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:15.791877 27755 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:15.792711 27755 raft_consensus.cc:697] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 14 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:15.793635 27755 consensus_queue.cc:237] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:15.689093 27721 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:15.744649 27685 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:10:15.723057 27565 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:15.804939 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 154422us
I20260709 13:10:15.810393 27687 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:15.813050 27686 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:15.790117 27577 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:10:15.822737 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:15.823500 22483 raft_consensus.cc:2393] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 17: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:10:15.825598 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:15.827865 27565 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 20 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:15.832914 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 183588us
I20260709 13:10:15.837322 22448 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:15.838394 21914 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:10:15.840709 21840 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:10:15.842425 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:15.846211 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:15.841794 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:15.848948 21839 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:15.844514 27674 raft_consensus.cc:697] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 14 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:15.852276 27610 consensus_queue.cc:237] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:15.857635 27715 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:15.854592 27730 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.884172 27366 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.886595 27515 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:15.887086 27144 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:15.904577 21839 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 14.
I20260709 13:10:15.888767 27221 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:10:15.932287 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 77991us
I20260709 13:10:15.914072 27762 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:15.901753 27730 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:15.901418 27366 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:15.942493 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:15.928576 27577 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:15.943668 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:15.903827 27144 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:15.958047 27144 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:15.947455 27674 consensus_queue.cc:237] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:15.949028 21837 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:15.904114 27515 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:15.967585 27515 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:15.928402 27221 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:15.969753 27221 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:15.954895 27756 log.cc:927] Time spent T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:10:15.972229 22481 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36278 (request call id 1023) took 1057 ms. Trace:
I20260709 13:10:15.977036 27366 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:15.938448 27721 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:15.977566 21837 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 20.
I20260709 13:10:15.979354 27730 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:15.980141 21831 raft_consensus.cc:2393] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 in current term 18: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:15.940661 27687 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:15.981935 27687 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:15.984143 27687 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:15.943778 27762 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:15.987494 27762 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:15.988093 27577 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:15.990442 27577 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:15.995309 27744 log.cc:927] Time spent T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.342s	user 0.004s	sys 0.000s
W20260709 13:10:15.996959 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 58620.6us
I20260709 13:10:16.006408 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:16.007053 21831 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 17.
W20260709 13:10:16.011890 21805 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:16.013411 21879 leader_election.cc:400] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 13. Current term is 14.
I20260709 13:10:16.013761 21879 leader_election.cc:403] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:10:16.014669 22448 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:15.972756 22481 rpcz_store.cc:276] 0709 13:10:14.914908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.916857 (+  1949us) service_pool.cc:224] Handling call
0709 13:10:14.917172 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:15.084348 (+167176us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:10:15.086586 (+  2238us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:15.104836 (+ 18250us) log.cc:844] Serialized 26 byte log entry
0709 13:10:15.209074 (+104238us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:10:15.209125 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:15.965384 (+756259us) spinlock_profiling.cc:243] Waited 73.3 ms on lock 0x7b54009e89d4. stack: 00007fc6ab238343 00007fc6ab238240 00007fc6aabc71d4 00007fc6b4905304 00007fc6b4905299 00007fc6ae2c0571 00007fc6ae357e01 00007fc6ae35683e 00007fc6b331b419 00007fc6ac892bd4 00007fc6ac892b62 00007fc6ac892a91 00007fc6ac892a0c 00007fc6ac891cc2 00007fc6ac69248c 00007fc6ac6918c6
0709 13:10:15.971860 (+  6476us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:15.971911 (+    51us) raft_consensus.cc:1685] finished
0709 13:10:15.971926 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:15.972157 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":62806,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":113,"spinlock_wait_cycles":168610688,"thread_start_us":177137,"threads_started":2,"wal-append.queue_time_us":196374}
I20260709 13:10:16.020074 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:16.020905 21913 raft_consensus.cc:2410] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:10:16.022874 21805 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:16.025888 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:16.030316 27437 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:16.032698 27697 raft_consensus.cc:2955] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 LEADER]: Committing config change with OpId 15.10: config changed from index 8 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:16.036525 22481 raft_consensus.cc:2955] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 8 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:16.010249 27366 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:16.041774 27366 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:16.043853 27366 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:16.005614 27551 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:10:16.015482 27751 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.015636 27577 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb for earlier term 13. Current term is 14.
I20260709 13:10:16.046067 27751 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:16.047024 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:16.048529 27751 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:16.024726 27642 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:16.049357 27642 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.049754 27642 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:16.025147 27758 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.000574 27681 raft_consensus.cc:493] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:16.054752 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:16.055320 27681 raft_consensus.cc:515] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:16.056943 21728 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:16.055899 21913 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 16.
I20260709 13:10:16.058609 27717 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:16.059178 27717 raft_consensus.cc:697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 20 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:16.059999 27717 consensus_queue.cc:237] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:16.060878 27681 leader_election.cc:290] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:16.054456 27758 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:16.066654 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:16.068730 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:16.069042 21910 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 18.
I20260709 13:10:16.074645 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:16.088572 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:16.093253 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:16.118350 21764 raft_consensus.cc:2410] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:10:16.125345 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "915629d8ce0e4452b6308425161f143a" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:16.083462 27537 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:16.120973 27678 raft_consensus.cc:2749] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:16.144435 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:16.137669 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:16.150833 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:16.136026 27537 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:16.159528 27537 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:16.165033 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:16.170500 27758 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:16.174217 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:10:16.176697 21647 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 291227c6f9914476b4363d40f7cfebb8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 6fadfd81c5a645f1806a284ddbb6bf0d from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 10 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:16.177877 27689 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:16.178406 27689 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:16.180357 27611 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:16.181759 27689 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:16.189857 21804 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:16.190783 27611 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:16.193918 27611 raft_consensus.cc:493] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.194272 27611 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:16.156840 27642 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:16.200048 22484 raft_consensus.cc:2393] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 18: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:10:16.137663 27752 raft_consensus.cc:493] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:16.206300 27689 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:16.207050 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:16.206876 27689 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:16.207484 27752 raft_consensus.cc:515] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:16.209131 27689 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:16.209583 27752 leader_election.cc:290] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:16.212113 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:16.216934 21729 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:16.217710 27541 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:16.218206 27541 raft_consensus.cc:697] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 18 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:16.219043 27541 consensus_queue.cc:237] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:16.225834 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:16.227392 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:16.222916 21729 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:16.235757 21906 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:16.237787 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:16.238411 21909 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 16.
I20260709 13:10:16.241415 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:16.241926 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c5cb2b121749798f01933921c01ed6" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:16.242574 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:16.243173 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:16.225778 21905 raft_consensus.cc:2955] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 8 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:16.253532 21761 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 20 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:16.252033 27736 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:16.266712 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:16.267917 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:16.263424 27642 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 18 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:16.270782 21729 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:16.258124 27730 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:16.300164 27116 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:16.300730 27116 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:16.312642 27116 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:16.318111 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:16.324368 21805 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:16.287602 27761 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:16.337721 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:16.340535 21835 raft_consensus.cc:1240] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 19. Current term is 20. Ops: [19.10-19.10]
I20260709 13:10:16.288345 27730 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:16.288959 27611 raft_consensus.cc:515] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:16.347568 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b87224fb843940c68eca74d28db8e73c" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
W20260709 13:10:16.345010 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 58033us
I20260709 13:10:16.350456 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
W20260709 13:10:16.344281 27780 log.cc:927] Time spent T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:10:16.346393 27519 raft_consensus.cc:2749] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:16.359295 21839 raft_consensus.cc:2393] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 18: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:16.360349 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:16.371099 21837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:16.371611 21659 catalog_manager.cc:5697] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.373764 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:16.373734 21659 catalog_manager.cc:5697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 12 to 13, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 13 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.375401 21659 catalog_manager.cc:5697] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 8 to 9, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 9 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.377822 21834 raft_consensus.cc:1275] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:10:16.381072 21659 catalog_manager.cc:5697] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 16 to 18, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 18 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.384279 21659 catalog_manager.cc:5697] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 13 to 17, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 17 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.386313 21756 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:16.392653 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:16.392133 21659 catalog_manager.cc:5697] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 12 to 14, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 14 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.394994 21659 catalog_manager.cc:5697] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:16.401036 21659 catalog_manager.cc:5697] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.403025 21659 catalog_manager.cc:5697] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index 10 to 12, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:16.358296 21805 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:16.405130 21659 catalog_manager.cc:5697] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.408280 21659 catalog_manager.cc:5697] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 13 to 14, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 14 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
W20260709 13:10:16.412806 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 161517us
I20260709 13:10:16.415377 22450 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:16.414045 21659 catalog_manager.cc:5697] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 16 to 17, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 17 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:16.394584 27753 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:16.416524 21659 catalog_manager.cc:5697] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 11 to 12, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 12 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:10:16.420848 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 62653.7us
I20260709 13:10:16.422140 21805 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:16.426642 22450 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:16.428444 22450 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:16.431639 22477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:16.431942 22484 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b18a570f5764b538a612ae89ef0327c" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:16.435437 21805 leader_election.cc:304] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:16.435017 21659 catalog_manager.cc:5697] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 8 to 9, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 9 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.438598 27116 raft_consensus.cc:2749] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:16.406041 27687 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:10:16.435017 21731 leader_election.cc:304] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:16.438534 21659 catalog_manager.cc:5697] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 12 to 13, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 13 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.424510 27752 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:16.445190 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:16.445859 21659 catalog_manager.cc:5697] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:16.428732 27766 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:16.429563 27642 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:16.418416 27753 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:16.440120 27742 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:16.440795 27715 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:16.493382 27730 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:16.447037 27761 raft_consensus.cc:2749] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:16.503026 27753 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:16.504755 21877 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:10:16.508055 27777 log.cc:927] Time spent T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 13:10:16.511216 27782 log.cc:927] Time spent T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239: Append to log took a long time: real 0.129s	user 0.003s	sys 0.000s
I20260709 13:10:16.527371 21877 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:16.532454 27515 raft_consensus.cc:2749] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:16.551115 27790 log.cc:927] Time spent T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:16.554534 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:16.575887 21877 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:16.561550 27247 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:16.572994 27515 consensus_queue.cc:1059] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:10:16.661490 27515 raft_consensus.cc:3055] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:16.661927 27515 raft_consensus.cc:740] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:16.662693 27515 consensus_queue.cc:260] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:16.666452 27515 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:16.669294 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:16.671314 27611 leader_election.cc:290] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:16.675241 27736 raft_consensus.cc:493] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:16.675700 27678 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.675824 27736 raft_consensus.cc:515] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:16.676257 27678 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:16.680986 27678 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:16.685755 21840 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:16.686364 21840 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 12.
I20260709 13:10:16.688832 21834 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:16.694972 21836 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:16.697489 27247 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:16.698191 21908 raft_consensus.cc:3060] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:16.698932 27736 leader_election.cc:290] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:16.705634 21908 raft_consensus.cc:2468] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 18.
I20260709 13:10:16.709407 27694 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:16.711021 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 135215us
I20260709 13:10:16.712373 22448 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:16.713045 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:16.713618 27767 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:16.714023 27767 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:16.714368 27767 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:16.723062 21911 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:16.728026 21913 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:16.733762 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "772d060b63de449b996b0ddc91936bcd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:16.750677 21911 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:10:16.751911 21910 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:10:16.752326 21910 pending_rounds.cc:85] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 9
I20260709 13:10:16.752562 21910 pending_rounds.cc:107] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:10:16.752808 21910 raft_consensus.cc:2889] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:16.754290 21763 raft_consensus.cc:2955] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 8 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:16.761009 27755 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:16.761871 27678 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.762483 27678 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:16.763989 27758 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.765313 21839 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:10:16.765831 22449 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:16.764487 27758 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:16.766381 21836 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:10:16.767081 27783 raft_consensus.cc:2804] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:16.767874 27783 raft_consensus.cc:697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:16.768772 27758 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:16.770000 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:16.773247 27678 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:16.775440 27767 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:16.768744 27783 consensus_queue.cc:237] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:16.783582 21877 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:16.784657 21877 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:16.785465 27515 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:16.785864 21877 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:16.786177 27515 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:16.786609 27754 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:16.787503 27754 consensus_queue.cc:1048] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:16.791328 27755 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:16.797272 27794 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:16.797848 27794 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:16.804433 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:16.811194 21728 leader_election.cc:304] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:16.812887 27537 raft_consensus.cc:2749] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:16.815133 27736 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:16.830296 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:16.832407 27537 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:16.834295 22485 raft_consensus.cc:1275] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:16.842515 27755 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.843051 27755 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:16.845319 27755 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:16.846441 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:16.787525 21877 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:16.851802 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 64339.9us
I20260709 13:10:16.852324 27686 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:16.857980 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:16.861917 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:16.865283 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:16.866381 21911 raft_consensus.cc:2393] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 18: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:10:16.866498 21838 raft_consensus.cc:2410] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3843e9b794a245dd8608e04ec7915239 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:10:16.881685 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:16.881822 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:16.882644 21758 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:10:16.884684 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:16.886855 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b27c43ce1954bb1ad1f8a4e30f76005" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:16.892452 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:16.897723 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:16.877879 27767 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:16.867224 27794 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:16.901221 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ec128cbd4ca4f3daa63f2db9749837f" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:16.923662 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:16.925264 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdda4b9a4f14b5c90c55134ebfd6303" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:16.926887 21806 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:16.928494 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:16.930757 21911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:16.931536 21911 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:10:16.943693 21804 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:16.939352 21805 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:16.961025 27519 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:16.961555 27519 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.961959 27519 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:10:16.964377 27806 log.cc:927] Time spent T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.085s	user 0.004s	sys 0.000s
I20260709 13:10:16.967645 27761 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:10:16.950017 27739 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:16.973132 27537 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:10:16.971840 27758 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:17.007797 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 64192.2us
I20260709 13:10:16.975610 27247 consensus_queue.cc:1048] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:10:17.012743 27665 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:17.016177 21804 leader_election.cc:304] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:17.017616 27812 raft_consensus.cc:2749] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:17.021574 21804 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:17.022541 21910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:10:17.023214 21910 raft_consensus.cc:606] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:17.027060 21729 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:17.044659 22450 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:17.046782 22450 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:17.035701 27678 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:17.021407 27762 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:10:17.031805 27741 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:17.073305 21804 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:17.076704 27716 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:17.077178 27716 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:17.077587 27716 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:17.078328 21840 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b50256b3ab294021ae20aa34053b59e1"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:10:17.079030 21840 raft_consensus.cc:606] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 22 FOLLOWER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:17.079385 21840 raft_consensus.cc:614] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:17.086445 21908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:10:17.087100 21908 raft_consensus.cc:606] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:17.087478 21908 raft_consensus.cc:614] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:17.053063 27689 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:10:17.107167 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:17.108942 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:17.061975 27795 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:17.127568 21756 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:10:17.143545 27807 log.cc:927] Time spent T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:10:17.145572 27727 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:17.146098 27727 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:17.146873 27810 log.cc:927] Time spent T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:10:17.148236 27727 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:17.154050 21914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
W20260709 13:10:17.173892 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 127201us
I20260709 13:10:17.166491 27247 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:10:17.189589 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f2b8ba156604362aecf8501bef61de4" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:17.201890 22450 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:17.205993 27519 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:17.208534 27519 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:17.208946 21835 raft_consensus.cc:1240] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:17.225485 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:17.243840 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0564e1a5f9d940fa9d28c8d27271a4c5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:17.244436 21761 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:17.258549 27716 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:17.259750 21839 raft_consensus.cc:1240] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 14. Current term is 15. Ops: []
I20260709 13:10:17.261893 27716 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:17.276247 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:17.280032 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:17.282989 22478 raft_consensus.cc:1240] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 12. Current term is 13. Ops: []
I20260709 13:10:17.286000 21761 raft_consensus.cc:2468] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:10:17.286801 21756 raft_consensus.cc:1240] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:10:17.300422 21805 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:17.339967 27755 consensus_queue.cc:1059] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:17.341070 27736 raft_consensus.cc:3055] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:17.329990 27752 raft_consensus.cc:2804] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:17.303589 27694 consensus_queue.cc:1059] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:10:17.355052 21911 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:17.355189 21804 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:17.350042 27736 raft_consensus.cc:740] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:17.360843 27694 consensus_queue.cc:1243] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer 6fadfd81c5a645f1806a284ddbb6bf0d log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:10:17.364934 27812 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:10:17.366874 27577 consensus_queue.cc:1059] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:17.364948 27727 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:10:17.358350 27752 raft_consensus.cc:697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:17.390892 27701 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:17.387584 27668 consensus_queue.cc:1059] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:10:17.397876 27737 raft_consensus.cc:3055] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:10:17.398334 27737 raft_consensus.cc:740] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:17.399267 27737 consensus_queue.cc:260] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:17.400892 27737 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:17.401974 27752 consensus_queue.cc:237] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:17.405272 27736 consensus_queue.cc:260] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:17.406492 27665 consensus_queue.cc:1175] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" responder_term: 12 status { last_received { term: 12 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 12 index: 11 } }
I20260709 13:10:17.406679 27736 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:17.426038 21835 raft_consensus.cc:1275] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:17.431511 27783 consensus_queue.cc:1048] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:17.440150 27696 raft_consensus.cc:3055] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:10:17.442480 27696 raft_consensus.cc:740] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:17.443323 27696 consensus_queue.cc:260] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:17.444669 27696 raft_consensus.cc:3060] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:17.476274 27247 raft_consensus.cc:993] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:10:17.476809 27247 raft_consensus.cc:1081] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
W20260709 13:10:17.479115 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 58185.2us
I20260709 13:10:17.491564 21839 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38352
I20260709 13:10:17.492128 21839 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.492473 21839 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:17.501972 21839 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:17.503350 21662 catalog_manager.cc:5697] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 9 to 10, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 10 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:17.504354 21839 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Requested vote from peers 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:17.505059 21662 catalog_manager.cc:5697] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:17.506557 21662 catalog_manager.cc:5697] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 14 to 15, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 15 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.507994 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:17.508592 22478 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:17.509858 21662 catalog_manager.cc:5697] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 13 to 17, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2), now has a pending config: VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1), VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2), VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3), VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 17 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } } pending_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:17.512095 21662 catalog_manager.cc:5697] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 12 to 15, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 15 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.526257 21662 catalog_manager.cc:5697] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 15 to 16, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 16 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:17.515223 21659 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45746 (request call id 246) took 3174 ms. Trace:
I20260709 13:10:17.520828 22478 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:10:17.524781 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:17.533936 21909 raft_consensus.cc:3055] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:17.534353 21909 raft_consensus.cc:740] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:17.535324 21909 consensus_queue.cc:260] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:17.536948 21909 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:17.542208 21806 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:17.543139 27519 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:17.543650 27519 raft_consensus.cc:697] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:17.544382 27519 consensus_queue.cc:237] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:17.546909 21909 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:10:17.527997 21662 catalog_manager.cc:5697] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 20 to 22, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 22 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:17.548854 21662 catalog_manager.cc:5697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 12 to 13, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 13 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:17.529078 21659 rpcz_store.cc:276] 0709 13:10:14.341149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.343535 (+  2386us) service_pool.cc:224] Handling call
0709 13:10:17.515143 (+3171608us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:16.657777 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:16.660852 (+  3075us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:16.660890 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:10:16.660910 (+    20us) tablet.cc:662] Decoding operations
0709 13:10:16.662421 (+  1511us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:16.662518 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:16.662558 (+    40us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:10:16.667324 (+  4766us) tablet.cc:701] Row locks acquired
0709 13:10:16.667344 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:10:16.667499 (+   155us) write_op.cc:270] Start()
0709 13:10:16.667613 (+   114us) write_op.cc:276] Timestamp: P: 1783602616667450 usec, L: 0
0709 13:10:16.667632 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:10:16.668327 (+   695us) log.cc:844] Serialized 6348 byte log entry
0709 13:10:16.838002 (+169675us) op_driver.cc:464] REPLICATION: finished
0709 13:10:17.008959 (+170957us) write_op.cc:301] APPLY: starting
0709 13:10:17.009405 (+   446us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:17.370488 (+361083us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:17.370611 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:17.463917 (+ 93306us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:17.464246 (+   329us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:10:17.464300 (+    54us) write_op.cc:312] APPLY: finished
0709 13:10:17.464686 (+   386us) log.cc:844] Serialized 148 byte log entry
0709 13:10:17.464879 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:17.465055 (+   176us) write_op.cc:454] Released schema lock
0709 13:10:17.465113 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:17.467026 (+  1913us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:17.467061 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":325715,"reported_tablets":32,"spinlock_wait_cycles":1280,"child_traces":[["op",{"apply.queue_time_us":160763,"apply.run_cpu_time_us":22958,"apply.run_wall_time_us":465170,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71071,"num_ops":16,"prepare.queue_time_us":143798,"prepare.run_cpu_time_us":55450,"prepare.run_wall_time_us":146602,"raft.queue_time_us":19602,"raft.run_cpu_time_us":13878,"raft.run_wall_time_us":91781,"replication_time_us":170200,"thread_start_us":394374,"threads_started":4,"wal-append.queue_time_us":124403}]]}
I20260709 13:10:17.695330 21663 catalog_manager.cc:5697] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 13 to 14, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 14 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:17.700316 21663 catalog_manager.cc:5697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 13 to 16, leader changed from 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 16 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:17.702518 21662 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52326 (request call id 171) took 1443 ms. Trace:
I20260709 13:10:17.702754 21663 catalog_manager.cc:5697] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 10 to 12, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 12 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:17.707046 21836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38332
I20260709 13:10:17.707633 21836 raft_consensus.cc:606] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 LEADER]: Received request to transfer leadership
I20260709 13:10:17.719182 21839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38332
I20260709 13:10:17.719857 21839 raft_consensus.cc:606] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 LEADER]: Received request to transfer leadership
W20260709 13:10:17.721405 21647 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 5e295b8b73874adcb77878c1ca4897ea already in progress
I20260709 13:10:17.702988 21662 rpcz_store.cc:276] 0709 13:10:16.258729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:16.263451 (+  4722us) service_pool.cc:224] Handling call
0709 13:10:17.701875 (+1438424us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:17.602035 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:17.602571 (+   536us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:17.602602 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:10:17.602619 (+    17us) tablet.cc:662] Decoding operations
0709 13:10:17.603436 (+   817us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:17.603505 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:17.603537 (+    32us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:10:17.604159 (+   622us) tablet.cc:701] Row locks acquired
0709 13:10:17.604177 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:10:17.604304 (+   127us) write_op.cc:270] Start()
0709 13:10:17.604532 (+   228us) write_op.cc:276] Timestamp: P: 1783602617604264 usec, L: 0
0709 13:10:17.604555 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:10:17.605539 (+   984us) log.cc:844] Serialized 3470 byte log entry
0709 13:10:17.655906 (+ 50367us) op_driver.cc:464] REPLICATION: finished
0709 13:10:17.656322 (+   416us) write_op.cc:301] APPLY: starting
0709 13:10:17.656400 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:17.660590 (+  4190us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:17.660684 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:17.665227 (+  4543us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:17.665478 (+   251us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:10:17.665532 (+    54us) write_op.cc:312] APPLY: finished
0709 13:10:17.665809 (+   277us) log.cc:844] Serialized 81 byte log entry
0709 13:10:17.677593 (+ 11784us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:17.677729 (+   136us) write_op.cc:454] Released schema lock
0709 13:10:17.677778 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:17.686969 (+  9191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:17.687007 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15072,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":152,"apply.run_cpu_time_us":10278,"apply.run_wall_time_us":30568,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33472,"num_ops":8,"prepare.queue_time_us":34216,"prepare.run_cpu_time_us":3473,"prepare.run_wall_time_us":5613,"replication_time_us":51199,"thread_start_us":28013,"threads_started":1}]]}
I20260709 13:10:17.768522 21659 catalog_manager.cc:5697] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index 8 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1), VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2), VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3), VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 17 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:17.771281 21659 catalog_manager.cc:5697] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:17.775388 27519 raft_consensus.cc:993] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:10:17.780067 27519 raft_consensus.cc:1081] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:10:17.781983 21763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59108
I20260709 13:10:17.782552 21763 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.782907 21763 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:10:17.785311 21647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 63930.1us
I20260709 13:10:17.787487 21839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38332
I20260709 13:10:17.788262 21839 raft_consensus.cc:606] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 LEADER]: Received request to transfer leadership
I20260709 13:10:17.798732 21659 catalog_manager.cc:5697] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 14 to 15, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 15 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
W20260709 13:10:17.800381 21711 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:10:17.800814 21711 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 5e295b8b73874adcb77878c1ca4897ea already in progress
W20260709 13:10:17.801136 21711 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 5e295b8b73874adcb77878c1ca4897ea already in progress
I20260709 13:10:17.800617 21659 catalog_manager.cc:5697] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:17.803015 21659 catalog_manager.cc:5697] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 13 to 15, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 15 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:17.812368 21763 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:17.818692 21659 catalog_manager.cc:5697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 18 to 20, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 20 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.825160 21659 catalog_manager.cc:5697] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.829831 21663 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45778 (request call id 301) took 3436 ms. Trace:
I20260709 13:10:17.831506 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:17.834762 21839 raft_consensus.cc:3055] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:10:17.835083 21839 raft_consensus.cc:740] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:17.835816 21839 consensus_queue.cc:260] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:17.837182 21839 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:17.839294 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:17.839900 22485 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:17.845371 21908 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:17.847462 22485 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 18.
I20260709 13:10:17.847558 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:17.848191 21909 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:17.849157 27742 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:17.849819 27742 consensus_queue.cc:1243] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Peer 6d698a5544b946939790e7a3972db9fb log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:17.854575 21911 raft_consensus.cc:1217] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Deduplicated request from leader. Original: 8.6->[10.7-13.9]   Dedup: 10.7->[11.8-13.9]
I20260709 13:10:17.855046 21911 pending_rounds.cc:85] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 7
I20260709 13:10:17.855274 21911 pending_rounds.cc:107] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:10:17.855499 21911 raft_consensus.cc:2889] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:17.855648 21763 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:17.863696 21909 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 18.
I20260709 13:10:17.864537 21839 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 18.
I20260709 13:10:17.866118 21729 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:17.832414 21659 catalog_manager.cc:5697] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 17 to 18, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 18 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.888103 27737 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:17.888962 27737 raft_consensus.cc:697] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 18 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:17.890313 27737 consensus_queue.cc:237] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:17.844761 21663 rpcz_store.cc:276] 0709 13:10:14.393887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.423866 (+ 29979us) service_pool.cc:224] Handling call
0709 13:10:17.829775 (+3405909us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:17.707008 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:17.707621 (+   613us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:17.707663 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:10:17.707683 (+    20us) tablet.cc:662] Decoding operations
0709 13:10:17.708358 (+   675us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:17.708422 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:17.708454 (+    32us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:10:17.708831 (+   377us) tablet.cc:701] Row locks acquired
0709 13:10:17.708853 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:10:17.709000 (+   147us) write_op.cc:270] Start()
0709 13:10:17.709123 (+   123us) write_op.cc:276] Timestamp: P: 1783602617708954 usec, L: 0
0709 13:10:17.709148 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:10:17.709853 (+   705us) log.cc:844] Serialized 1289 byte log entry
0709 13:10:17.711774 (+  1921us) op_driver.cc:464] REPLICATION: finished
0709 13:10:17.712252 (+   478us) write_op.cc:301] APPLY: starting
0709 13:10:17.712329 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:17.714332 (+  2003us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:17.714441 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:17.716505 (+  2064us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:17.716698 (+   193us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:10:17.716763 (+    65us) write_op.cc:312] APPLY: finished
0709 13:10:17.716995 (+   232us) log.cc:844] Serialized 41 byte log entry
0709 13:10:17.722670 (+  5675us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:17.722822 (+   152us) write_op.cc:454] Released schema lock
0709 13:10:17.722869 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:17.738419 (+ 15550us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:17.738455 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":291726,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":267,"apply.run_cpu_time_us":5495,"apply.run_wall_time_us":10957,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12552,"num_ops":3,"prepare.queue_time_us":114,"prepare.run_cpu_time_us":3147,"prepare.run_wall_time_us":3148,"replication_time_us":2509}]]}
I20260709 13:10:17.919865 21763 consensus_queue.cc:237] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:17.941313 21756 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:17.951331 22485 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:17.954612 27519 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 13:10:18.024732 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 71470.9us
I20260709 13:10:18.025329 27647 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:10:18.046258 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 75651us
I20260709 13:10:18.060079 21908 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:18.086277 27737 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:10:18.110082 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:18.117252 22485 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:10:18.117880 21662 catalog_manager.cc:5697] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 16 to 18, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 18 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:18.119037 27758 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:18.119804 21662 catalog_manager.cc:5697] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 14 to 15, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 15 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:18.190591 27737 raft_consensus.cc:2955] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 10 to 12, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:18.198655 22478 raft_consensus.cc:2955] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 10 to 12, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:10:18.232641 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 84402.6us
I20260709 13:10:18.240121 21661 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45762 (request call id 261) took 3382 ms. Trace:
I20260709 13:10:18.254103 21661 rpcz_store.cc:276] 0709 13:10:14.857673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:14.858138 (+   465us) service_pool.cc:224] Handling call
0709 13:10:18.240030 (+3381892us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1900,"reported_tablets":35}
W20260709 13:10:18.267119 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 111810us
I20260709 13:10:18.277361 21649 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 773a4e5c42d942629a59d30efb0870f6 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
I20260709 13:10:18.305272 21911 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:10:18.310307 21835 consensus_queue.cc:237] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:18.311215 27835 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:18.337270 21839 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:10:18.337497 21908 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:10:18.338572 21659 catalog_manager.cc:5697] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 17 to 18, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 18 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.340502 21659 catalog_manager.cc:5697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 10 to 13, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 13 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:18.342136 27758 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:18.347559 27750 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:18.349956 21908 raft_consensus.cc:2955] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 10 to 12, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:18.352734 21662 catalog_manager.cc:5697] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 10 to 12, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New cstate: current_term: 13 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:18.378041 21662 catalog_manager.cc:5697] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 13 to 14, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 14 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:18.414907 21761 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:18.416913 27758 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:18.420955 22485 raft_consensus.cc:1275] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:10:18.439741 27752 consensus_queue.cc:1048] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:10:18.650339 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 61252.4us
I20260709 13:10:18.660589 27845 raft_consensus.cc:2955] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:18.673803 21826 tablet_service.cc:1558] Processing DeleteTablet for tablet 773a4e5c42d942629a59d30efb0870f6 with delete_type TABLET_DATA_TOMBSTONED (TS 6fadfd81c5a645f1806a284ddbb6bf0d not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:38332
I20260709 13:10:18.674264 22478 raft_consensus.cc:2955] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:18.694609 27247 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:18.695690 27247 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:18.746258 21663 catalog_manager.cc:5697] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 12 to 14, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 14 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:18.753072 22485 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:10:18.759472 27647 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:18.766455 27247 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:18.769483 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:18.770646 21836 raft_consensus.cc:2393] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 15: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:18.781180 27864 tablet_replica.cc:333] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:18.785650 27860 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:18.786343 27860 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:18.790903 27860 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:18.801949 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:18.837178 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:18.837860 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:18.838066 21756 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:10:18.838711 21762 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:10:18.844900 21647 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c6406f8b01c041c58abe3add218f6b41 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:18.864655 27519 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:18.865578 27519 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:18.875484 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:18.876405 22481 raft_consensus.cc:2393] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 13: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:10:18.880059 27519 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:18.887871 21879 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:18.889724 27760 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:18.890208 27760 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:18.890632 27760 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:18.901996 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:18.902806 21762 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:10:18.904508 21758 raft_consensus.cc:2955] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:18.918051 21805 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:18.919507 27742 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:18.947665 27742 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:18.948058 27742 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:18.927090 22450 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:18.952296 27689 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:18.952754 27689 raft_consensus.cc:493] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:18.953100 27689 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:18.941365 27864 raft_consensus.cc:2243] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.954950 27864 raft_consensus.cc:2272] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.966018 27864 ts_tablet_manager.cc:1916] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:18.971158 27689 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:18.974388 27689 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:18.976218 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:18.977658 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:18.978295 21756 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:18.988072 21756 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 14.
I20260709 13:10:18.992726 22450 leader_election.cc:304] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:18.993780 27863 raft_consensus.cc:2804] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:18.994372 27863 raft_consensus.cc:697] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:18.995376 27863 consensus_queue.cc:237] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:18.919278 27760 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:18.999661 27742 raft_consensus.cc:515] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:19.000746 21836 raft_consensus.cc:3060] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:19.009011 21836 raft_consensus.cc:2468] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 14.
I20260709 13:10:19.012627 27760 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:19.016996 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:19.017899 21835 raft_consensus.cc:2393] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 15: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:19.020406 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:19.021199 21761 raft_consensus.cc:2368] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 13. Current term is 14.
I20260709 13:10:19.023062 21805 leader_election.cc:400] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 13. Current term is 14.
I20260709 13:10:19.023373 21805 leader_election.cc:403] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:10:19.024415 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:19.023976 27519 raft_consensus.cc:2749] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645) with higher term. Message: Invalid argument: T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 13. Current term is 14.
I20260709 13:10:19.131582 27742 leader_election.cc:290] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:19.148520 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e7bb11958aa45b0a1f77b20c2e9a6e5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:19.179725 21756 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:10:19.189450 21879 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:19.191704 27838 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:19.192198 27838 raft_consensus.cc:697] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 15 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:19.193137 27838 consensus_queue.cc:237] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:19.276597 27864 ts_tablet_manager.cc:1929] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 13:10:19.277300 27864 log.cc:1199] T 773a4e5c42d942629a59d30efb0870f6 P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-1-root/wals/773a4e5c42d942629a59d30efb0870f6
I20260709 13:10:19.287062 21659 catalog_manager.cc:5697] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 12 to 13, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New cstate: current_term: 16 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:19.288674 21659 catalog_manager.cc:5697] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 12 to 14, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 14 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:19.290304 21647 catalog_manager.cc:5028] TS 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): tablet 773a4e5c42d942629a59d30efb0870f6 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:10:19.317258 21660 catalog_manager.cc:5697] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 14 to 15, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 15 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:19.326421 21897 tablet_service.cc:1558] Processing DeleteTablet for tablet c6406f8b01c041c58abe3add218f6b41 with delete_type TABLET_DATA_TOMBSTONED (TS 6d698a5544b946939790e7a3972db9fb not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:36378
I20260709 13:10:19.327795 27519 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.327893 21826 tablet_service.cc:1558] Processing DeleteTablet for tablet 773a4e5c42d942629a59d30efb0870f6 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 10 (current committed config index is 12)) from {username='slave'} at 127.0.0.1:38332
I20260709 13:10:19.328471 27519 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:19.330704 27519 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:19.330814 21647 catalog_manager.cc:5028] TS 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): tablet 773a4e5c42d942629a59d30efb0870f6 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:10:19.331833 21762 consensus_queue.cc:237] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:19.338578 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:19.342211 22478 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:19.344128 27736 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:19.352082 27736 raft_consensus.cc:2955] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 10 to 13, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:19.354856 22478 raft_consensus.cc:2955] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 10 to 13, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:19.361150 21907 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:19.365978 27844 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:19.366711 27844 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:19.380537 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:19.385262 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239" is_pre_election: true
I20260709 13:10:19.387470 21763 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 15.
I20260709 13:10:19.392320 21805 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:19.397135 21661 catalog_manager.cc:5697] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 10 to 13, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New cstate: current_term: 18 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:19.399542 27519 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:19.401155 27519 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.401525 27519 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:19.399554 27856 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:10:19.407909 27868 tablet_replica.cc:333] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:19.409122 27868 raft_consensus.cc:2243] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.410171 27868 raft_consensus.cc:2272] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.413331 21907 raft_consensus.cc:2955] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 10 to 13, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:19.422395 21649 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5e295b8b73874adcb77878c1ca4897ea with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:19.426329 22481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:19.427850 21880 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:10:19.428504 21880 raft_consensus.cc:2686] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:10:19.428437 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6406f8b01c041c58abe3add218f6b41" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:19.433497 27844 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:19.437357 27868 ts_tablet_manager.cc:1916] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:19.439903 27519 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:19.453635 21826 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e295b8b73874adcb77878c1ca4897ea with delete_type TABLET_DATA_TOMBSTONED (TS 6fadfd81c5a645f1806a284ddbb6bf0d not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:38332
I20260709 13:10:19.462355 27864 tablet_replica.cc:333] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:19.463425 27864 raft_consensus.cc:2243] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:19.464052 27864 raft_consensus.cc:2272] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:19.468624 27864 ts_tablet_manager.cc:1916] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:19.475205 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:19.494549 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:19.495147 21763 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:19.496703 27519 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:19.509299 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:19.510972 21763 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 16.
I20260709 13:10:19.519454 27864 ts_tablet_manager.cc:1929] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.12
I20260709 13:10:19.520268 27864 log.cc:1199] T 5e295b8b73874adcb77878c1ca4897ea P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-1-root/wals/5e295b8b73874adcb77878c1ca4897ea
I20260709 13:10:19.524314 21647 catalog_manager.cc:5028] TS 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): tablet 5e295b8b73874adcb77878c1ca4897ea (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:10:19.533908 21805 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:19.534876 27861 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:19.535400 27861 raft_consensus.cc:697] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:19.536294 27861 consensus_queue.cc:237] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:19.542219 21839 raft_consensus.cc:1275] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:19.543795 27727 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:19.561619 27868 ts_tablet_manager.cc:1929] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.12
I20260709 13:10:19.562129 27868 log.cc:1199] T c6406f8b01c041c58abe3add218f6b41 P 6d698a5544b946939790e7a3972db9fb: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-2-root/wals/c6406f8b01c041c58abe3add218f6b41
I20260709 13:10:19.564149 21648 catalog_manager.cc:5028] TS 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): tablet c6406f8b01c041c58abe3add218f6b41 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:10:19.580552 21660 catalog_manager.cc:5697] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 15 to 16, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 16 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:19.592375 21756 raft_consensus.cc:1275] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:19.610391 27862 consensus_queue.cc:1048] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:19.645473 21762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:32926
I20260709 13:10:19.646251 21762 raft_consensus.cc:606] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:19.660445 21762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:32926
I20260709 13:10:19.661329 21762 raft_consensus.cc:606] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:19.664152 21762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:32926
I20260709 13:10:19.664775 21762 raft_consensus.cc:606] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 18 LEADER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:19.674336 27665 raft_consensus.cc:993] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239: : Instructing follower 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:10:19.674980 27665 raft_consensus.cc:1081] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Signalling peer 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:10:19.675055 21839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71a084e9c0014661925a846711e7a18f"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:10:19.675844 21839 raft_consensus.cc:606] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 LEADER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:19.680831 21910 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:49544
I20260709 13:10:19.683221 21910 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.683660 21910 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:19.704936 21910 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:19.710613 21762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a860581d33304a09b6bd77ea24698076"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:32926
I20260709 13:10:19.711313 21762 raft_consensus.cc:606] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 10 LEADER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:19.716843 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:19.718744 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:19.724241 27835 raft_consensus.cc:993] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239: : Instructing follower 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:10:19.724826 27835 raft_consensus.cc:1081] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 10 LEADER]: Signalling peer 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:10:19.730513 21907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a860581d33304a09b6bd77ea24698076"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:49544
I20260709 13:10:19.731176 21907 raft_consensus.cc:493] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.731593 21907 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:19.755880 21762 raft_consensus.cc:1240] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:19.758368 27838 consensus_queue.cc:1059] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:19.759528 27760 raft_consensus.cc:3055] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:19.759923 27760 raft_consensus.cc:740] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:19.760759 27760 consensus_queue.cc:260] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:19.762144 27760 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:19.763166 21910 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:19.764382 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:19.765085 21839 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:19.770500 21836 raft_consensus.cc:1240] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Rejecting Update request from peer 6d698a5544b946939790e7a3972db9fb for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:19.783835 21907 raft_consensus.cc:515] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:19.796219 21907 leader_election.cc:290] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:19.797571 21836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:19.798353 21836 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:19.805886 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b5c7b1a9d544cacaea74aa99eefa301" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:19.806744 21762 raft_consensus.cc:3055] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:19.807163 21762 raft_consensus.cc:740] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:19.808081 21762 consensus_queue.cc:260] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:19.809610 21762 raft_consensus.cc:3060] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:19.807865 21839 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:10:19.807899 21836 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:10:19.819383 21877 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:19.819664 21758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a860581d33304a09b6bd77ea24698076" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:19.820348 21758 raft_consensus.cc:3055] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:10:19.820714 21758 raft_consensus.cc:740] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:19.820467 21877 leader_election.cc:304] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:19.820909 27842 raft_consensus.cc:2804] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:19.821964 27838 raft_consensus.cc:2804] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:19.822577 27838 raft_consensus.cc:697] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:19.822947 27842 raft_consensus.cc:697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:19.823690 27838 consensus_queue.cc:237] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:19.821583 21758 consensus_queue.cc:260] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:19.826817 21758 raft_consensus.cc:3060] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:10:19.824062 27842 consensus_queue.cc:237] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:19.834391 21758 raft_consensus.cc:2468] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 11.
I20260709 13:10:19.873867 21762 raft_consensus.cc:2468] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:10:19.911599 27665 raft_consensus.cc:993] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239: : Instructing follower 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:10:19.912177 27665 raft_consensus.cc:1081] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 18 LEADER]: Signalling peer 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:10:19.914350 21912 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:49544
I20260709 13:10:19.915112 21912 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.915560 21912 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:19.921164 21660 catalog_manager.cc:5697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 13 to 14, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 14 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:19.938834 21910 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:10:19.939230 21910 pending_rounds.cc:85] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb: Aborting all ops after (but not including) 9
I20260709 13:10:19.939456 21910 pending_rounds.cc:107] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:10:19.939746 21910 raft_consensus.cc:2889] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:19.941838 27519 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:19.947346 27858 raft_consensus.cc:993] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239: : Instructing follower 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:10:19.947964 27858 raft_consensus.cc:1081] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Signalling peer 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:10:19.949996 21910 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:49544
I20260709 13:10:19.950805 21910 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.951308 21910 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:19.956152 27843 raft_consensus.cc:993] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d: : Instructing follower 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:10:19.956719 27861 raft_consensus.cc:1081] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 LEADER]: Signalling peer 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:10:19.957299 21912 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:19.959980 21905 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71a084e9c0014661925a846711e7a18f"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:49554
I20260709 13:10:19.967154 21905 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.967545 21905 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:19.966210 21761 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:10:19.972880 27843 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:19.980473 21910 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:19.985219 21762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:19.985940 21762 raft_consensus.cc:3055] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:19.986251 21762 raft_consensus.cc:740] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:19.990305 21762 consensus_queue.cc:260] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:19.992045 21762 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:20.002969 21912 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:20.003077 21762 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:10:20.004309 21879 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:20.006469 27838 raft_consensus.cc:2804] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:20.007009 27838 raft_consensus.cc:697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:20.009510 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:20.009256 27838 consensus_queue.cc:237] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:20.010144 22485 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:20.013787 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e295b8b73874adcb77878c1ca4897ea" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:20.014408 21756 raft_consensus.cc:3055] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:20.014707 21756 raft_consensus.cc:740] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:20.015895 21910 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:20.017689 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f7cb5d9283d4cf7969db82011d35ed9" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:20.023672 22478 raft_consensus.cc:3060] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:20.018522 22485 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 19.
I20260709 13:10:20.018327 21905 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:20.007625 21662 catalog_manager.cc:5697] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 10 to 11, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 11 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:20.032063 22478 raft_consensus.cc:2468] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:10:20.032632 21880 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:20.033763 21905 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 20 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:20.034420 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:20.034514 27842 raft_consensus.cc:2804] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:20.035006 21835 raft_consensus.cc:3055] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:20.035375 21835 raft_consensus.cc:740] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:20.036298 21835 consensus_queue.cc:260] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:20.039599 21835 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:20.035375 27842 raft_consensus.cc:697] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 19 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:20.020198 21756 consensus_queue.cc:260] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:20.065938 21756 raft_consensus.cc:3060] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:20.066814 27842 consensus_queue.cc:237] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:20.101711 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:20.102514 22478 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:20.111464 21835 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 20.
I20260709 13:10:20.112965 21877 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:20.114739 27842 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:20.116135 21756 raft_consensus.cc:2468] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 19.
I20260709 13:10:20.116817 27842 raft_consensus.cc:697] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 20 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:20.118265 27842 consensus_queue.cc:237] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:20.125871 22478 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 20.
I20260709 13:10:20.129307 21662 catalog_manager.cc:5697] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 13 to 14, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 14 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.135061 21662 catalog_manager.cc:5697] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 18 to 19, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 19 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.193285 21662 catalog_manager.cc:5697] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 19 to 20, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 20 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.340968 21836 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:20.347249 27842 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:20.363886 21762 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:20.365586 27842 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:20.523157 21835 raft_consensus.cc:1275] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:20.535009 21758 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:20.551625 21763 raft_consensus.cc:1275] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:10:20.541265 27838 consensus_queue.cc:1048] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:10:20.606666 21910 consensus_queue.cc:237] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:10:20.646679 27882 log.cc:927] Time spent T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:10:20.668524 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 80204.3us
I20260709 13:10:20.665462 27896 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:10:20.674175 27892 consensus_queue.cc:1048] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:20.683702 22478 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:20.686668 22485 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:10:20.699172 27894 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:10:20.700198 27886 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:10:20.744247 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 72093.1us
W20260709 13:10:20.756075 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 45967.3us
I20260709 13:10:20.769471 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:20.923385 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 163889us
I20260709 13:10:20.936365 21839 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:10:20.938235 21839 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:20.954757 22481 raft_consensus.cc:1275] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:20.965504 27894 consensus_queue.cc:1048] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:10:20.968452 21880 consensus_peers.cc:597] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6c77d056b72142dbaf44be22749d2024. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:20.971616 27895 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:10:20.978183 27895 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:10:20.988737 21761 raft_consensus.cc:1275] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:21.061335 21762 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:10:21.118887 27906 raft_consensus.cc:2955] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:21.136384 21831 raft_consensus.cc:2955] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:21.139092 27896 consensus_queue.cc:1048] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:21.148343 27894 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:21.165846 21757 consensus_queue.cc:237] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:10:21.184167 21731 consensus_peers.cc:597] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c096033d73b64750a7e09d89d0a70c7b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.187335 21660 catalog_manager.cc:5697] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index -1 to 9, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 14 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.188370 21835 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:10:21.197568 21909 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:10:21.211931 27835 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:21.221760 27736 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:21.237087 27835 raft_consensus.cc:2955] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:21.240288 21764 raft_consensus.cc:2955] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Committing config change with OpId 14.9: config changed from index -1 to 9, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:21.239152 21835 raft_consensus.cc:2955] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:21.306133 21910 raft_consensus.cc:2955] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:21.305895 21909 consensus_queue.cc:237] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:21.339494 21757 raft_consensus.cc:1275] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:21.341501 21831 raft_consensus.cc:1275] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:10:21.342468 27906 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:10:21.344810 21880 consensus_peers.cc:597] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 915629d8ce0e4452b6308425161f143a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.345533 27842 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:21.349936 21659 catalog_manager.cc:5697] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index -1 to 12, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 19 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.375288 27894 raft_consensus.cc:2955] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:21.383249 21757 raft_consensus.cc:2955] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:21.427512 21757 consensus_queue.cc:237] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:21.425031 21659 catalog_manager.cc:5697] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index -1 to 9, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 11 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:21.465080 27938 ts_tablet_manager.cc:933] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:21.479707 21731 consensus_peers.cc:597] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1dcda663ffc2447db5619b817e1c5078. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.487996 27938 tablet_copy_client.cc:323] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:10:21.491051 21839 raft_consensus.cc:2955] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:21.496793 21923 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet 6c77d056b72142dbaf44be22749d2024 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:10:21.497519 21923 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet 6c77d056b72142dbaf44be22749d2024 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-6c77d056b72142dbaf44be22749d2024
I20260709 13:10:21.498147 21910 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:21.499333 21835 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:21.500664 27885 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:21.512969 27858 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:21.522544 21923 tablet_copy_source_session.cc:215] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:21.529619 27938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c77d056b72142dbaf44be22749d2024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:21.550602 27835 raft_consensus.cc:2955] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:21.563313 27938 tablet_copy_client.cc:806] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:21.556937 21910 raft_consensus.cc:2955] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:21.563607 21831 raft_consensus.cc:2955] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:21.572772 27938 tablet_copy_client.cc:670] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:21.591547 21659 catalog_manager.cc:5697] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index -1 to 10, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 13 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.595359 27938 tablet_copy_client.cc:538] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:21.624174 27938 tablet_bootstrap.cc:492] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:10:21.700433 27942 ts_tablet_manager.cc:933] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645)
I20260709 13:10:21.737998 27942 tablet_copy_client.cc:323] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.1:46645
I20260709 13:10:21.741827 21774 tablet_copy_service.cc:140] P 3843e9b794a245dd8608e04ec7915239: Received BeginTabletCopySession request for tablet c096033d73b64750a7e09d89d0a70c7b from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:44772)
I20260709 13:10:21.742748 21774 tablet_copy_service.cc:161] P 3843e9b794a245dd8608e04ec7915239: Beginning new tablet copy session on tablet c096033d73b64750a7e09d89d0a70c7b from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:44772: session id = 8c6c2207af3d47b3acf352d81959f4dd-c096033d73b64750a7e09d89d0a70c7b
I20260709 13:10:21.788803 21774 tablet_copy_source_session.cc:215] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:21.817226 27942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c096033d73b64750a7e09d89d0a70c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:21.826682 27945 ts_tablet_manager.cc:933] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:21.862293 27945 tablet_copy_client.cc:323] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:10:21.863998 21923 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet 915629d8ce0e4452b6308425161f143a from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:10:21.864605 21923 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet 915629d8ce0e4452b6308425161f143a from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-915629d8ce0e4452b6308425161f143a
I20260709 13:10:21.877444 21923 tablet_copy_source_session.cc:215] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:21.883911 27945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 915629d8ce0e4452b6308425161f143a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:21.888411 27938 tablet_bootstrap.cc:492] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=2 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:21.904946 27938 tablet_bootstrap.cc:492] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:10:21.909811 27938 ts_tablet_manager.cc:1403] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.286s	user 0.042s	sys 0.028s
I20260709 13:10:21.918970 27938 raft_consensus.cc:359] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:21.920089 27938 raft_consensus.cc:740] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:10:21.920853 27938 consensus_queue.cc:260] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:21.922921 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:21.941743 27942 tablet_copy_client.cc:806] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:21.942349 27942 tablet_copy_client.cc:670] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:21.948019 27938 ts_tablet_manager.cc:1434] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.001s
I20260709 13:10:21.948287 27942 tablet_copy_client.cc:538] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:21.959950 21923 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-6c77d056b72142dbaf44be22749d2024 received from {username='slave'} at 127.0.0.1:45202
I20260709 13:10:21.960467 21923 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-6c77d056b72142dbaf44be22749d2024 on tablet 6c77d056b72142dbaf44be22749d2024 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:21.969007 22478 raft_consensus.cc:1217] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 LEARNER]: Deduplicated request from leader. Original: 14.8->[14.9-14.9]   Dedup: 14.9->[]
I20260709 13:10:22.021317 27938 ts_tablet_manager.cc:933] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645)
I20260709 13:10:22.021792 27945 tablet_copy_client.cc:806] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:22.022487 27945 tablet_copy_client.cc:670] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:22.051224 27945 tablet_copy_client.cc:538] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:22.053404 27942 tablet_bootstrap.cc:492] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:10:22.082278 21910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:10:22.083402 21910 raft_consensus.cc:606] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:22.088331 27938 tablet_copy_client.cc:323] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.1:46645
I20260709 13:10:22.090234 21774 tablet_copy_service.cc:140] P 3843e9b794a245dd8608e04ec7915239: Received BeginTabletCopySession request for tablet 1dcda663ffc2447db5619b817e1c5078 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:44772)
I20260709 13:10:22.092906 21774 tablet_copy_service.cc:161] P 3843e9b794a245dd8608e04ec7915239: Beginning new tablet copy session on tablet 1dcda663ffc2447db5619b817e1c5078 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:44772: session id = 8c6c2207af3d47b3acf352d81959f4dd-1dcda663ffc2447db5619b817e1c5078
I20260709 13:10:22.103176 21834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:10:22.103746 21834 raft_consensus.cc:606] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:22.114524 21834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a740500460ba465faaeb007be4b83108"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:10:22.115104 21834 raft_consensus.cc:606] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 LEADER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:22.116572 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:22.118412 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:22.121331 27945 tablet_bootstrap.cc:492] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:10:22.126041 21774 tablet_copy_source_session.cc:215] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:22.134578 27938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcda663ffc2447db5619b817e1c5078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.197753 27938 tablet_copy_client.cc:806] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:22.205542 27938 tablet_copy_client.cc:670] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:22.220820 27938 tablet_copy_client.cc:538] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:22.271142 27938 tablet_bootstrap.cc:492] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:10:22.288028 27945 tablet_bootstrap.cc:492] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:22.289080 27945 tablet_bootstrap.cc:492] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:10:22.289857 27945 ts_tablet_manager.cc:1403] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.169s	user 0.036s	sys 0.004s
I20260709 13:10:22.324156 27945 raft_consensus.cc:359] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:22.328009 27945 raft_consensus.cc:740] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:10:22.329818 27861 raft_consensus.cc:993] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d: : Instructing follower 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:10:22.330291 27861 raft_consensus.cc:1081] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 LEADER]: Signalling peer 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:10:22.332053 21909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a740500460ba465faaeb007be4b83108"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:49554
I20260709 13:10:22.332574 21909 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:22.332894 21909 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:22.336500 27945 consensus_queue.cc:260] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:22.344416 27945 ts_tablet_manager.cc:1434] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.001s
I20260709 13:10:22.349351 21909 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:22.354404 27895 raft_consensus.cc:993] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:10:22.354941 27842 raft_consensus.cc:1081] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:10:22.360882 21757 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59102
I20260709 13:10:22.361389 21757 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:22.361764 21757 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:22.362008 21923 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-915629d8ce0e4452b6308425161f143a received from {username='slave'} at 127.0.0.1:45202
I20260709 13:10:22.362459 21923 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-915629d8ce0e4452b6308425161f143a on tablet 915629d8ce0e4452b6308425161f143a with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:22.362733 27942 tablet_bootstrap.cc:492] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:22.363744 27942 tablet_bootstrap.cc:492] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:10:22.364482 27942 ts_tablet_manager.cc:1403] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.321s	user 0.049s	sys 0.026s
I20260709 13:10:22.373093 21909 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:22.374123 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:22.374724 21834 raft_consensus.cc:3055] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:22.374986 21834 raft_consensus.cc:740] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:22.380025 21757 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:22.382714 21764 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:22.383364 21764 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:22.377370 21834 consensus_queue.cc:260] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:22.388465 21834 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:22.397480 21764 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 19.
I20260709 13:10:22.402853 21879 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:22.403401 21757 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:22.405357 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:22.406014 21909 raft_consensus.cc:3055] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:10:22.405982 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:22.406638 21909 raft_consensus.cc:740] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:22.407626 27906 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:22.406855 21831 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:22.408202 27906 raft_consensus.cc:697] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 19 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:22.409162 27906 consensus_queue.cc:237] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:22.416613 21831 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
I20260709 13:10:22.425248 21834 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 19.
I20260709 13:10:22.426245 21728 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:22.427908 27858 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:10:22.428465 27858 raft_consensus.cc:697] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 12 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:22.429464 27858 consensus_queue.cc:237] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:22.417829 21909 consensus_queue.cc:260] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:22.442492 21909 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:10:22.437096 27942 raft_consensus.cc:359] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:22.463101 27942 raft_consensus.cc:740] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:10:22.463969 27942 consensus_queue.cc:260] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:22.488467 21909 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 12.
W20260709 13:10:22.570268 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 98464.1us
W20260709 13:10:22.588722 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 48426.2us
I20260709 13:10:22.578243 21660 catalog_manager.cc:5697] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 18 to 19, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 19 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:22.609623 27842 raft_consensus.cc:1064] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:10:22.638684 21659 catalog_manager.cc:5697] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 11 to 12, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 12 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:22.641768 27942 ts_tablet_manager.cc:1434] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.277s	user 0.011s	sys 0.014s
I20260709 13:10:22.644462 21774 tablet_copy_service.cc:342] P 3843e9b794a245dd8608e04ec7915239: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-c096033d73b64750a7e09d89d0a70c7b received from {username='slave'} at 127.0.0.1:44772
I20260709 13:10:22.644933 21774 tablet_copy_service.cc:434] P 3843e9b794a245dd8608e04ec7915239: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-c096033d73b64750a7e09d89d0a70c7b on tablet c096033d73b64750a7e09d89d0a70c7b with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:22.627364 27842 consensus_queue.cc:237] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 7, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:22.723405 27898 raft_consensus.cc:993] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:10:22.723901 27898 raft_consensus.cc:1081] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:10:22.810329 21833 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:22.812294 27959 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:22.813400 22478 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:22.815055 27959 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:22.861133 27938 tablet_bootstrap.cc:492] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:10:22.866288 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 151450us
I20260709 13:10:22.867225 27938 tablet_bootstrap.cc:492] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:10:22.867981 27938 ts_tablet_manager.cc:1403] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.603s	user 0.045s	sys 0.024s
W20260709 13:10:22.869629 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 151790us
I20260709 13:10:22.893630 22478 raft_consensus.cc:1217] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [term 19 LEARNER]: Deduplicated request from leader. Original: 19.11->[19.12-19.12]   Dedup: 19.12->[]
I20260709 13:10:22.896741 21764 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:22.897266 21756 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59108
I20260709 13:10:22.897817 21756 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:22.898144 21756 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:22.921095 27967 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:22.927037 21909 raft_consensus.cc:1275] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:22.929654 21756 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:22.931519 21756 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:22.932969 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:22.933522 21909 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:22.933569 27858 consensus_queue.cc:1048] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:22.938686 21831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:22.939244 21831 raft_consensus.cc:3055] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:22.939517 21831 raft_consensus.cc:740] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:22.946499 21909 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 17.
I20260709 13:10:22.957687 21838 raft_consensus.cc:1275] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:10:22.962363 21729 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:22.965606 27858 consensus_queue.cc:1048] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:22.966966 27858 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:22.967427 27858 raft_consensus.cc:697] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 17 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:22.968271 27858 consensus_queue.cc:237] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:22.969682 21831 consensus_queue.cc:260] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:22.977372 27938 raft_consensus.cc:359] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:22.989188 27938 raft_consensus.cc:740] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:10:22.989984 27938 consensus_queue.cc:260] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:22.999341 21838 raft_consensus.cc:2955] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:23.002068 21757 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:10:23.008859 27906 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:23.012543 21831 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:22.951761 27962 raft_consensus.cc:2955] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:23.060693 27938 ts_tablet_manager.cc:1434] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.192s	user 0.011s	sys 0.010s
I20260709 13:10:23.066474 21774 tablet_copy_service.cc:342] P 3843e9b794a245dd8608e04ec7915239: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-1dcda663ffc2447db5619b817e1c5078 received from {username='slave'} at 127.0.0.1:44772
I20260709 13:10:23.067095 21774 tablet_copy_service.cc:434] P 3843e9b794a245dd8608e04ec7915239: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-1dcda663ffc2447db5619b817e1c5078 on tablet 1dcda663ffc2447db5619b817e1c5078 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:23.074005 21831 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 17.
W20260709 13:10:23.199540 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 109541us
W20260709 13:10:23.202708 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 110813us
I20260709 13:10:23.209223 21756 raft_consensus.cc:2955] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:23.222218 21838 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:10:23.246215 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:23.252688 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 54728.8us
I20260709 13:10:23.280602 22485 raft_consensus.cc:1217] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 13:10:23.270691 22478 raft_consensus.cc:2955] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 9 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:23.298913 27980 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:10:23.312021 22485 raft_consensus.cc:1217] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 13:10:23.337183 21659 catalog_manager.cc:5697] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 9 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:23.354126 27858 raft_consensus.cc:1064] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:10:23.358469 27858 consensus_queue.cc:237] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:23.367702 21660 catalog_manager.cc:5697] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 16 to 17, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 17 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.389706 22485 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [term 19 LEARNER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:23.391525 27972 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:10:23.394956 21909 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:23.399624 21838 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:23.401929 27974 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:23.403641 27972 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:23.443064 21909 consensus_queue.cc:237] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:23.458274 21834 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:10:23.464385 27972 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:10:23.501812 22478 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:23.511701 27982 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:10:23.513726 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 50830.2us
I20260709 13:10:23.520772 21839 raft_consensus.cc:1275] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:23.539990 27982 consensus_queue.cc:1048] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:23.548828 27842 raft_consensus.cc:2955] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:23.556866 27972 raft_consensus.cc:2955] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:23.558840 22485 raft_consensus.cc:2955] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:23.570433 21912 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:10:23.580206 22478 raft_consensus.cc:2955] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:23.580389 21909 raft_consensus.cc:2955] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:23.588986 27858 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:23.591531 21839 raft_consensus.cc:2955] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:23.609215 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6c77d056b72142dbaf44be22749d2024 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:23.610520 21840 raft_consensus.cc:2955] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:23.612704 21661 catalog_manager.cc:5697] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 12 to 13, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:23.659150 21756 consensus_queue.cc:237] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:23.661341 21659 catalog_manager.cc:5697] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 10 to 11, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New cstate: current_term: 14 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:23.697502 21749 tablet_service.cc:1558] Processing DeleteTablet for tablet 6c77d056b72142dbaf44be22749d2024 with delete_type TABLET_DATA_TOMBSTONED (TS 3843e9b794a245dd8608e04ec7915239 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:48338
I20260709 13:10:23.700138 22485 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:23.706286 27858 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:23.716395 27736 raft_consensus.cc:2955] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:23.717222 27986 raft_consensus.cc:1064] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:10:23.729359 27986 consensus_queue.cc:237] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:23.733022 21839 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:23.735667 21649 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c096033d73b64750a7e09d89d0a70c7b with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:23.744115 27952 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:23.750487 21839 raft_consensus.cc:2955] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:23.748253 21660 catalog_manager.cc:5697] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index 13 to 14, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New cstate: current_term: 19 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:23.748222 22485 raft_consensus.cc:2955] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:23.854720 22485 raft_consensus.cc:1275] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:23.883056 27981 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:10:23.922063 28000 tablet_replica.cc:333] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
W20260709 13:10:23.924446 28001 log.cc:927] Time spent T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:10:23.924957 27858 raft_consensus.cc:1064] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
W20260709 13:10:23.938316 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 101674us
W20260709 13:10:23.927121 27969 log.cc:927] Time spent T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:10:23.952369 21897 tablet_service.cc:1558] Processing DeleteTablet for tablet c096033d73b64750a7e09d89d0a70c7b with delete_type TABLET_DATA_TOMBSTONED (TS 6d698a5544b946939790e7a3972db9fb not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:36378
I20260709 13:10:23.966951 27858 consensus_queue.cc:237] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:23.983589 21839 raft_consensus.cc:1275] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:24.017395 27986 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:24.052109 21761 raft_consensus.cc:1275] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:10:24.094522 27985 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:24.117985 28017 tablet_replica.cc:333] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:24.148587 28017 raft_consensus.cc:2243] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.154170 28017 raft_consensus.cc:2272] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.160063 28017 ts_tablet_manager.cc:1916] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:24.172778 28018 raft_consensus.cc:2955] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:24.198804 28000 raft_consensus.cc:2243] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.199918 28000 raft_consensus.cc:2272] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.221709 21839 raft_consensus.cc:2955] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:24.231988 22485 raft_consensus.cc:2955] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:24.238583 21761 raft_consensus.cc:2955] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:24.244853 28000 ts_tablet_manager.cc:1916] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:24.250416 22478 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEARNER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:24.254721 27736 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:24.259048 21907 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:24.255362 21662 catalog_manager.cc:5697] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 9 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.285733 21838 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:24.288836 28006 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:24.298256 28006 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:24.464725 28017 ts_tablet_manager.cc:1929] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.13
I20260709 13:10:24.529928 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:24.465399 28017 log.cc:1199] T c096033d73b64750a7e09d89d0a70c7b P 6d698a5544b946939790e7a3972db9fb: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-2-root/wals/c096033d73b64750a7e09d89d0a70c7b
I20260709 13:10:24.554005 21907 raft_consensus.cc:2955] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:24.554307 27736 raft_consensus.cc:2955] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:24.557838 21648 catalog_manager.cc:5028] TS 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): tablet c096033d73b64750a7e09d89d0a70c7b (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:10:24.596357 22478 raft_consensus.cc:2955] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:24.627768 28000 ts_tablet_manager.cc:1929] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 13:10:24.629366 28000 log.cc:1199] T 6c77d056b72142dbaf44be22749d2024 P 3843e9b794a245dd8608e04ec7915239: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-0-root/wals/6c77d056b72142dbaf44be22749d2024
W20260709 13:10:24.644213 28028 log.cc:927] Time spent T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
I20260709 13:10:24.655180 21838 raft_consensus.cc:2955] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:24.657765 21649 catalog_manager.cc:5028] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): tablet 6c77d056b72142dbaf44be22749d2024 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:10:24.742527 21663 catalog_manager.cc:5697] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index 10 to 11, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:24.784327 21763 consensus_queue.cc:237] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:24.798182 21838 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:24.801046 28005 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:24.798205 22478 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:24.805341 21907 consensus_queue.cc:237] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:24.808180 28005 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:24.818603 21839 raft_consensus.cc:2955] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:24.820093 21838 raft_consensus.cc:1275] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:24.823017 27894 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:24.812995 27974 raft_consensus.cc:2955] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:24.818624 22478 raft_consensus.cc:1275] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:10:24.837342 27984 raft_consensus.cc:2955] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:24.839165 28010 consensus_queue.cc:1048] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:24.857806 22485 raft_consensus.cc:2955] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:24.852638 21834 raft_consensus.cc:2955] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:24.914258 22478 raft_consensus.cc:2955] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:24.920097 21662 catalog_manager.cc:5697] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index 11 to 12, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New cstate: current_term: 13 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:24.951963 21897 tablet_service.cc:1558] Processing DeleteTablet for tablet 1dcda663ffc2447db5619b817e1c5078 with delete_type TABLET_DATA_TOMBSTONED (TS 6d698a5544b946939790e7a3972db9fb not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:36378
I20260709 13:10:24.953183 21649 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1dcda663ffc2447db5619b817e1c5078 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:24.954550 28017 tablet_replica.cc:333] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:24.955577 28017 raft_consensus.cc:2243] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:24.956391 28017 raft_consensus.cc:2272] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:24.965898 28017 ts_tablet_manager.cc:1916] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:24.976097 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 915629d8ce0e4452b6308425161f143a with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:24.971716 21662 catalog_manager.cc:5697] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index 10 to 11, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New cstate: current_term: 11 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:25.017277 21749 tablet_service.cc:1558] Processing DeleteTablet for tablet 915629d8ce0e4452b6308425161f143a with delete_type TABLET_DATA_TOMBSTONED (TS 3843e9b794a245dd8608e04ec7915239 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:48338
I20260709 13:10:25.018249 28000 tablet_replica.cc:333] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:25.026808 28017 ts_tablet_manager.cc:1929] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 13:10:25.027292 28017 log.cc:1199] T 1dcda663ffc2447db5619b817e1c5078 P 6d698a5544b946939790e7a3972db9fb: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-2-root/wals/1dcda663ffc2447db5619b817e1c5078
I20260709 13:10:25.028826 21648 catalog_manager.cc:5028] TS 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): tablet 1dcda663ffc2447db5619b817e1c5078 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:10:25.038565 21763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:32926
I20260709 13:10:25.039139 21763 raft_consensus.cc:606] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:25.041623 28000 raft_consensus.cc:2243] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.042770 28000 raft_consensus.cc:2272] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.047875 28000 ts_tablet_manager.cc:1916] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:25.055272 21763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
new_leader_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:32926
I20260709 13:10:25.056030 21763 raft_consensus.cc:606] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 18 LEADER]: Received request to transfer leadership to TS 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:25.063189 21907 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:10:25.063791 21907 raft_consensus.cc:606] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 16 LEADER]: Received request to transfer leadership to TS 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:25.066244 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:25.068100 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:25.092903 28000 ts_tablet_manager.cc:1929] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 13:10:25.103250 28000 log.cc:1199] T 915629d8ce0e4452b6308425161f143a P 3843e9b794a245dd8608e04ec7915239: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-0-root/wals/915629d8ce0e4452b6308425161f143a
I20260709 13:10:25.105419 21649 catalog_manager.cc:5028] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): tablet 915629d8ce0e4452b6308425161f143a (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:10:25.154932 27974 raft_consensus.cc:993] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239: : Instructing follower 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:10:25.155690 28005 raft_consensus.cc:1081] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 18 LEADER]: Signalling peer 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:10:25.159519 21907 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:49544
I20260709 13:10:25.160109 21907 raft_consensus.cc:493] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:25.160465 21907 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:25.179389 21907 raft_consensus.cc:515] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:25.216231 21763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:25.216874 21763 raft_consensus.cc:3055] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:10:25.217159 21763 raft_consensus.cc:740] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:25.217819 21763 consensus_queue.cc:260] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:25.219012 21763 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:25.228883 21763 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 19.
W20260709 13:10:25.241858 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 71660us
I20260709 13:10:25.230361 21907 leader_election.cc:290] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:25.273200 21879 leader_election.cc:304] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:25.274451 27984 raft_consensus.cc:2804] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:25.275004 27984 raft_consensus.cc:697] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 19 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:25.275871 27984 consensus_queue.cc:237] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:25.301704 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31c81db970e24298b014b6d17fb12a0e" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:25.302359 21834 raft_consensus.cc:3060] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:25.327168 21834 raft_consensus.cc:2468] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 19.
I20260709 13:10:25.366401 21660 catalog_manager.cc:5697] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 18 to 19, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 19 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.438052 27974 raft_consensus.cc:993] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:10:25.438609 27665 raft_consensus.cc:1081] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:10:25.440467 21835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38348
I20260709 13:10:25.441089 21835 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:25.441509 21835 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.450863 21835 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:25.463048 21835 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:25.465097 21756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:25.471422 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcda663ffc2447db5619b817e1c5078" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:25.471943 21756 raft_consensus.cc:3055] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:10:25.472108 22478 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.472396 21756 raft_consensus.cc:740] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:25.473371 21756 consensus_queue.cc:260] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:25.474982 21756 raft_consensus.cc:3060] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:25.477839 27984 raft_consensus.cc:993] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:10:25.478324 27984 raft_consensus.cc:1081] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 16 LEADER]: Signalling peer 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:10:25.479888 22485 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:36290
I20260709 13:10:25.480374 22485 raft_consensus.cc:493] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:25.480698 22485 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:25.484723 21756 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:10:25.487131 22485 raft_consensus.cc:515] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:25.495677 22478 raft_consensus.cc:2468] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:10:25.502149 21806 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:25.502163 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:25.503046 21835 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:25.504381 28032 raft_consensus.cc:2804] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:25.504956 28032 raft_consensus.cc:697] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:25.512068 22485 leader_election.cc:290] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:25.513833 21835 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 17.
I20260709 13:10:25.525403 22448 leader_election.cc:304] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:25.526476 27954 raft_consensus.cc:2804] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:25.527108 27954 raft_consensus.cc:697] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 17 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:25.528095 27954 consensus_queue.cc:237] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:25.552503 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af88ee4a85a24987b0c1513dd7ce39ed" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:25.553231 21907 raft_consensus.cc:3055] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:25.554291 21907 raft_consensus.cc:740] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:25.555078 21907 consensus_queue.cc:260] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:25.505846 28032 consensus_queue.cc:237] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:25.592622 21907 raft_consensus.cc:3060] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:25.610199 21907 raft_consensus.cc:2468] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 17.
I20260709 13:10:25.612043 21660 catalog_manager.cc:5697] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 16 to 17, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 17 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.604808 21662 catalog_manager.cc:5697] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 13 to 14, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 14 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:25.680658 21835 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:25.684440 27894 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:25.886641 21765 raft_consensus.cc:1275] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:25.896901 27894 consensus_queue.cc:1048] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:25.942945 21840 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:25.945746 28023 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:25.996300 21907 raft_consensus.cc:1275] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:26.002197 28023 consensus_queue.cc:1048] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:26.069653 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:26.175102 21761 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:26.177026 28032 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:26.191377 22485 raft_consensus.cc:1275] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:26.198918 28032 consensus_queue.cc:1048] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:26.288581 21912 consensus_queue.cc:237] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:10:26.410288 21880 consensus_peers.cc:597] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b5c7b1a9d544cacaea74aa99eefa301. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:26.410348 21834 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:26.411974 21765 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:26.419642 28010 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:26.422629 27894 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:26.631875 21761 raft_consensus.cc:2955] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:26.629411 28010 raft_consensus.cc:2955] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:26.703723 21834 raft_consensus.cc:2955] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index -1 to 11, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:26.734678 21661 catalog_manager.cc:5697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index -1 to 11, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 14 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:26.796898 21840 consensus_queue.cc:237] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:26.849411 21913 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:10:26.851190 21806 consensus_peers.cc:597] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0564e1a5f9d940fa9d28c8d27271a4c5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:26.853461 21756 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:10:26.861644 28070 ts_tablet_manager.cc:933] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:26.867817 28045 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:26.870155 28059 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:26.896776 28070 tablet_copy_client.cc:323] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:10:26.898639 21923 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet 2b5c7b1a9d544cacaea74aa99eefa301 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:10:26.899232 21923 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet 2b5c7b1a9d544cacaea74aa99eefa301 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-2b5c7b1a9d544cacaea74aa99eefa301
I20260709 13:10:26.908134 28045 raft_consensus.cc:2955] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:26.919670 21763 raft_consensus.cc:2955] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:26.935901 21913 raft_consensus.cc:2955] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:26.948062 21912 consensus_queue.cc:237] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:10:26.980561 21880 consensus_peers.cc:597] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a740500460ba465faaeb007be4b83108. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:26.983489 21840 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:10:26.985132 28063 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:26.985369 21763 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:10:26.988669 28063 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:26.968628 21923 tablet_copy_source_session.cc:215] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:27.030817 28070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b5c7b1a9d544cacaea74aa99eefa301. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.054136 28066 raft_consensus.cc:2955] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:27.054273 21840 raft_consensus.cc:2955] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:27.058976 21765 raft_consensus.cc:2955] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:27.058877 21661 catalog_manager.cc:5697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index -1 to 10, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 13 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:27.087785 28070 tablet_copy_client.cc:806] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:27.088651 28070 tablet_copy_client.cc:670] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:27.091964 21661 catalog_manager.cc:5697] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index -1 to 12, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 19 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:27.097875 28070 tablet_copy_client.cc:538] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:27.107656 21765 consensus_queue.cc:237] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:27.152117 28070 tablet_bootstrap.cc:492] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:10:27.179000 21839 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:10:27.183071 28058 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:27.184335 21912 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:10:27.191179 21731 consensus_peers.cc:597] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 59340daad1394837bb0d56471ed8ce5a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:27.203907 28058 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:10:27.251755 28067 raft_consensus.cc:2955] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:27.259620 21839 raft_consensus.cc:2955] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:27.268705 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:27.301856 21661 catalog_manager.cc:5697] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index -1 to 10, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 14 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:27.329249 21913 raft_consensus.cc:2955] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:27.442790 28070 tablet_bootstrap.cc:492] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:27.443904 28070 tablet_bootstrap.cc:492] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:10:27.444722 28070 ts_tablet_manager.cc:1403] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.293s	user 0.054s	sys 0.009s
I20260709 13:10:27.454736 21909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71a084e9c0014661925a846711e7a18f"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:10:27.455449 21909 raft_consensus.cc:606] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 20 LEADER]: Received request to transfer leadership to TS 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:27.466593 28084 ts_tablet_manager.cc:933] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:27.469319 21839 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:10:27.471567 21839 raft_consensus.cc:606] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:27.477625 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:27.479943 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:27.486245 28070 raft_consensus.cc:359] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:27.493619 28070 raft_consensus.cc:740] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:10:27.501108 28070 consensus_queue.cc:260] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:27.513087 28070 ts_tablet_manager.cc:1434] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.068s	user 0.010s	sys 0.000s
I20260709 13:10:27.528601 28084 tablet_copy_client.cc:323] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.2:34765
I20260709 13:10:27.535831 28010 raft_consensus.cc:993] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:10:27.536465 28010 raft_consensus.cc:1081] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 20 LEADER]: Signalling peer 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:10:27.539072 28086 ts_tablet_manager.cc:933] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:27.542321 22478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71a084e9c0014661925a846711e7a18f"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:36290
I20260709 13:10:27.542959 22478 raft_consensus.cc:493] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:27.543390 22478 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:27.546161 21923 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-2b5c7b1a9d544cacaea74aa99eefa301 received from {username='slave'} at 127.0.0.1:45202
I20260709 13:10:27.546675 21923 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-2b5c7b1a9d544cacaea74aa99eefa301 on tablet 2b5c7b1a9d544cacaea74aa99eefa301 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:27.550601 22478 raft_consensus.cc:515] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:27.554908 21850 tablet_copy_service.cc:140] P 6fadfd81c5a645f1806a284ddbb6bf0d: Received BeginTabletCopySession request for tablet 0564e1a5f9d940fa9d28c8d27271a4c5 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:56424)
I20260709 13:10:27.558300 28086 tablet_copy_client.cc:323] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:10:27.558583 21850 tablet_copy_service.cc:161] P 6fadfd81c5a645f1806a284ddbb6bf0d: Beginning new tablet copy session on tablet 0564e1a5f9d940fa9d28c8d27271a4c5 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:56424: session id = 8c6c2207af3d47b3acf352d81959f4dd-0564e1a5f9d940fa9d28c8d27271a4c5
I20260709 13:10:27.559762 22478 leader_election.cc:290] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 21 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:27.561699 21923 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet a740500460ba465faaeb007be4b83108 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:10:27.562299 21923 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet a740500460ba465faaeb007be4b83108 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-a740500460ba465faaeb007be4b83108
I20260709 13:10:27.565757 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:27.566485 21909 raft_consensus.cc:3055] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:10:27.566819 21909 raft_consensus.cc:740] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:27.567067 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71a084e9c0014661925a846711e7a18f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:27.567641 21909 consensus_queue.cc:260] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:27.567641 21839 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:27.573557 21909 raft_consensus.cc:3060] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:27.584054 21923 tablet_copy_source_session.cc:215] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:27.587368 21850 tablet_copy_source_session.cc:215] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:27.602468 28088 ts_tablet_manager.cc:933] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645)
I20260709 13:10:27.604059 21839 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 21.
I20260709 13:10:27.605767 22448 leader_election.cc:304] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:27.606828 28065 raft_consensus.cc:2804] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:27.607424 28065 raft_consensus.cc:697] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 21 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:27.608390 28065 consensus_queue.cc:237] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:27.612638 28088 tablet_copy_client.cc:323] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.1:46645
I20260709 13:10:27.615381 28086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a740500460ba465faaeb007be4b83108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.625038 21774 tablet_copy_service.cc:140] P 3843e9b794a245dd8608e04ec7915239: Received BeginTabletCopySession request for tablet 59340daad1394837bb0d56471ed8ce5a from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:44772)
I20260709 13:10:27.625939 21774 tablet_copy_service.cc:161] P 3843e9b794a245dd8608e04ec7915239: Beginning new tablet copy session on tablet 59340daad1394837bb0d56471ed8ce5a from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:44772: session id = 8c6c2207af3d47b3acf352d81959f4dd-59340daad1394837bb0d56471ed8ce5a
I20260709 13:10:27.654928 22478 raft_consensus.cc:1217] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 LEARNER]: Deduplicated request from leader. Original: 14.10->[14.11-14.11]   Dedup: 14.11->[]
I20260709 13:10:27.666399 21909 raft_consensus.cc:2468] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 21.
I20260709 13:10:27.669140 28086 tablet_copy_client.cc:806] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:27.670146 28086 tablet_copy_client.cc:670] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:27.687510 28015 raft_consensus.cc:993] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:10:27.688243 28015 raft_consensus.cc:1081] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:10:27.690111 21756 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59108
I20260709 13:10:27.690687 21756 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:27.691037 21756 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:27.706785 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 47305.3us
W20260709 13:10:27.707934 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 47194.6us
I20260709 13:10:27.733412 21756 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:27.736414 28084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0564e1a5f9d940fa9d28c8d27271a4c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.739099 21774 tablet_copy_source_session.cc:215] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:10:27.744740 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 122512us
I20260709 13:10:27.746971 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:27.747676 21839 raft_consensus.cc:3055] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:10:27.749619 21839 raft_consensus.cc:740] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:27.759755 21756 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:27.761324 21913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:27.762109 21913 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:10:27.762624 21839 consensus_queue.cc:260] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:27.776567 28088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59340daad1394837bb0d56471ed8ce5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.793226 21913 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 16.
I20260709 13:10:27.797523 21907 raft_consensus.cc:1240] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Rejecting Update request from peer 6fadfd81c5a645f1806a284ddbb6bf0d for earlier term 15. Current term is 16. Ops: []
I20260709 13:10:27.801211 21729 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:27.821884 21839 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:27.846722 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 45602.9us
I20260709 13:10:27.855587 21839 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 16.
I20260709 13:10:27.846416 28086 tablet_copy_client.cc:538] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:27.854275 28067 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:10:27.882635 28067 raft_consensus.cc:697] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 16 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:27.883590 28067 consensus_queue.cc:237] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:27.904845 21661 catalog_manager.cc:5697] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 20 to 21, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 21 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:27.910470 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 44120.1us
I20260709 13:10:27.944316 28086 tablet_bootstrap.cc:492] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:10:27.947893 28084 tablet_copy_client.cc:806] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:27.957856 28084 tablet_copy_client.cc:670] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:27.962716 21662 catalog_manager.cc:5697] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 15 to 16, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 16 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.963887 28084 tablet_copy_client.cc:538] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:27.992146 28084 tablet_bootstrap.cc:492] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:10:27.996405 28088 tablet_copy_client.cc:806] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:28.008358 28088 tablet_copy_client.cc:670] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:28.045521 28088 tablet_copy_client.cc:538] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:28.108987 21909 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 21 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:10:28.112496 28065 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:10:28.116385 28061 raft_consensus.cc:1064] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:10:28.116925 28088 tablet_bootstrap.cc:492] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:10:28.120206 28061 consensus_queue.cc:237] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:28.181797 22481 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:28.210004 21834 raft_consensus.cc:1275] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 21 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:10:28.212384 28092 consensus_queue.cc:1048] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:10:28.216179 28063 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
W20260709 13:10:28.324961 28086 log.cc:927] Time spent T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:10:28.345731 21835 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:28.352917 21761 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:28.362287 21840 raft_consensus.cc:1275] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:28.371809 28067 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:28.369215 28010 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:10:28.387853 28066 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:28.390183 28086 tablet_bootstrap.cc:492] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:28.392057 28086 tablet_bootstrap.cc:492] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:10:28.398042 28086 ts_tablet_manager.cc:1403] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.454s	user 0.051s	sys 0.019s
I20260709 13:10:28.405138 28084 tablet_bootstrap.cc:492] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:28.443099 21913 raft_consensus.cc:1275] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:28.444717 28084 tablet_bootstrap.cc:492] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:10:28.445701 28084 ts_tablet_manager.cc:1403] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.454s	user 0.040s	sys 0.018s
I20260709 13:10:28.454248 28084 raft_consensus.cc:359] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:28.487180 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:28.477380 28084 raft_consensus.cc:740] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:10:28.504508 28086 raft_consensus.cc:359] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:28.505512 28086 raft_consensus.cc:740] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:10:28.504855 28084 consensus_queue.cc:260] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:28.506307 28086 consensus_queue.cc:260] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:28.523744 28084 ts_tablet_manager.cc:1434] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.078s	user 0.004s	sys 0.003s
W20260709 13:10:28.534978 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 62695.2us
I20260709 13:10:28.540421 28058 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:10:28.593014 21850 tablet_copy_service.cc:342] P 6fadfd81c5a645f1806a284ddbb6bf0d: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-0564e1a5f9d940fa9d28c8d27271a4c5 received from {username='slave'} at 127.0.0.1:56424
I20260709 13:10:28.596688 21850 tablet_copy_service.cc:434] P 6fadfd81c5a645f1806a284ddbb6bf0d: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-0564e1a5f9d940fa9d28c8d27271a4c5 on tablet 0564e1a5f9d940fa9d28c8d27271a4c5 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:28.616626 28086 ts_tablet_manager.cc:1434] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.208s	user 0.008s	sys 0.001s
I20260709 13:10:28.629393 21923 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-a740500460ba465faaeb007be4b83108 received from {username='slave'} at 127.0.0.1:45202
I20260709 13:10:28.634459 21923 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-a740500460ba465faaeb007be4b83108 on tablet a740500460ba465faaeb007be4b83108 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:28.633891 28088 tablet_bootstrap.cc:492] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:28.649638 28111 raft_consensus.cc:2955] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:28.658205 22485 raft_consensus.cc:2955] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:28.691228 22481 raft_consensus.cc:1217] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 LEARNER]: Deduplicated request from leader. Original: 19.11->[19.12-19.12]   Dedup: 19.12->[]
I20260709 13:10:28.715776 28088 tablet_bootstrap.cc:492] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:10:28.716770 28088 ts_tablet_manager.cc:1403] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.600s	user 0.047s	sys 0.001s
I20260709 13:10:28.758613 28088 raft_consensus.cc:359] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:28.760578 28088 raft_consensus.cc:740] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:10:28.761396 28088 consensus_queue.cc:260] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:28.765564 28088 ts_tablet_manager.cc:1434] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 13:10:28.770726 21835 raft_consensus.cc:2955] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:10:28.788920 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 209700us
I20260709 13:10:28.829308 21661 catalog_manager.cc:5697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index 11 to 12, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:29.008049 22478 raft_consensus.cc:1217] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 13:10:29.075603 21756 raft_consensus.cc:2955] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:29.123395 22485 raft_consensus.cc:1217] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 13:10:29.136509 21774 tablet_copy_service.cc:342] P 3843e9b794a245dd8608e04ec7915239: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-59340daad1394837bb0d56471ed8ce5a received from {username='slave'} at 127.0.0.1:44772
I20260709 13:10:29.137336 21774 tablet_copy_service.cc:434] P 3843e9b794a245dd8608e04ec7915239: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-59340daad1394837bb0d56471ed8ce5a on tablet 59340daad1394837bb0d56471ed8ce5a with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:29.200947 28110 raft_consensus.cc:1064] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:10:29.225056 21909 consensus_queue.cc:237] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:29.204495 28110 consensus_queue.cc:237] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:29.256803 22485 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:29.279867 21757 raft_consensus.cc:1275] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:29.287536 28124 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:29.289886 28124 consensus_queue.cc:1048] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:29.301196 28111 raft_consensus.cc:2955] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:29.312908 22485 raft_consensus.cc:2955] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:29.317750 21757 raft_consensus.cc:2955] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Committing config change with OpId 14.13: config changed from index 12 to 13, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:29.336783 22478 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:29.338088 21840 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:29.338572 28063 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:29.339927 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2b5c7b1a9d544cacaea74aa99eefa301 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:29.345856 28124 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:29.349063 21757 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:10:29.364014 28108 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:29.372684 21661 catalog_manager.cc:5697] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 12 to 13, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New cstate: current_term: 14 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:29.384330 28136 raft_consensus.cc:1064] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:10:29.387305 28136 consensus_queue.cc:237] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:29.403146 21835 raft_consensus.cc:2955] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:29.407861 21826 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b5c7b1a9d544cacaea74aa99eefa301 with delete_type TABLET_DATA_TOMBSTONED (TS 6fadfd81c5a645f1806a284ddbb6bf0d not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:38332
I20260709 13:10:29.409194 28108 raft_consensus.cc:2955] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:29.464612 28142 tablet_replica.cc:333] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:29.466177 28142 raft_consensus.cc:2243] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:29.486461 21661 catalog_manager.cc:5697] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index 12 to 13, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:29.491580 28142 raft_consensus.cc:2272] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:29.503885 21757 raft_consensus.cc:2955] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:29.512970 28142 ts_tablet_manager.cc:1916] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:29.523015 22478 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEARNER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:29.528280 21912 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:29.528990 28136 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:29.545553 28015 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:29.555353 21756 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:10:29.557185 28123 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:29.580822 22481 raft_consensus.cc:2955] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:29.586237 21909 consensus_queue.cc:237] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:29.593158 28125 raft_consensus.cc:1064] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:10:29.596216 28125 consensus_queue.cc:237] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:29.607149 21840 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:29.616679 28135 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:29.635685 21834 raft_consensus.cc:2955] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:29.646878 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:29.683889 22483 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [term 14 LEARNER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:29.689069 21840 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:29.691546 28128 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:10:29.695317 21909 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:10:29.700673 28128 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:29.733044 28136 raft_consensus.cc:2955] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:29.735821 21662 catalog_manager.cc:5697] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index 13 to 14, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New cstate: current_term: 19 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:29.759485 22485 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:29.764736 22483 raft_consensus.cc:2955] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:29.674883 28108 raft_consensus.cc:2955] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:29.795054 28142 ts_tablet_manager.cc:1929] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.12
I20260709 13:10:29.796747 28142 log.cc:1199] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-1-root/wals/2b5c7b1a9d544cacaea74aa99eefa301
I20260709 13:10:29.802286 28063 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:10:29.806771 28128 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:29.825070 22485 raft_consensus.cc:2955] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:29.847261 21909 raft_consensus.cc:2955] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:29.891184 28146 raft_consensus.cc:2955] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:10:29.897564 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 105575us
I20260709 13:10:29.901757 21647 catalog_manager.cc:5028] TS 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): tablet 2b5c7b1a9d544cacaea74aa99eefa301 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:10:29.926051 21749 tablet_service.cc:1558] Processing DeleteTablet for tablet a740500460ba465faaeb007be4b83108 with delete_type TABLET_DATA_TOMBSTONED (TS 3843e9b794a245dd8608e04ec7915239 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:48338
I20260709 13:10:29.899071 21662 catalog_manager.cc:5697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index 10 to 11, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.933101 22483 raft_consensus.cc:2955] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:10:29.937207 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 151021us
I20260709 13:10:29.965833 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a740500460ba465faaeb007be4b83108 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:30.001077 21756 raft_consensus.cc:2955] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:30.049592 21907 raft_consensus.cc:2955] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:30.058051 21835 raft_consensus.cc:2955] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:30.065850 21840 consensus_queue.cc:237] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:30.033752 21662 catalog_manager.cc:5697] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 10 to 11, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:30.108867 22483 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:30.123720 21761 raft_consensus.cc:1275] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:10:30.124560 28015 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:30.135028 28156 tablet_replica.cc:333] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:30.135129 28015 raft_consensus.cc:2955] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:30.136634 28156 raft_consensus.cc:2243] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:30.137719 28156 raft_consensus.cc:2272] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.142247 22483 raft_consensus.cc:2955] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:30.159580 28154 consensus_queue.cc:1048] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:30.163045 21647 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0564e1a5f9d940fa9d28c8d27271a4c5 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:30.176084 21661 catalog_manager.cc:5697] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index 11 to 12, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New cstate: current_term: 13 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:30.193276 21761 raft_consensus.cc:2955] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:30.195544 21897 tablet_service.cc:1558] Processing DeleteTablet for tablet 0564e1a5f9d940fa9d28c8d27271a4c5 with delete_type TABLET_DATA_TOMBSTONED (TS 6d698a5544b946939790e7a3972db9fb not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:36378
I20260709 13:10:30.205132 28156 ts_tablet_manager.cc:1916] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:30.230890 28158 tablet_replica.cc:333] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:30.238525 21763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
new_leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:32926
I20260709 13:10:30.239713 21763 raft_consensus.cc:606] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 19 LEADER]: Received request to transfer leadership to TS 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:30.245888 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:10:30.247637 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:30.248936 28158 raft_consensus.cc:2243] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:30.251449 28158 raft_consensus.cc:2272] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.257323 28158 ts_tablet_manager.cc:1916] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:30.259168 28156 ts_tablet_manager.cc:1929] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.13
I20260709 13:10:30.269037 28156 log.cc:1199] T a740500460ba465faaeb007be4b83108 P 3843e9b794a245dd8608e04ec7915239: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-0-root/wals/a740500460ba465faaeb007be4b83108
I20260709 13:10:30.271377 21649 catalog_manager.cc:5028] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): tablet a740500460ba465faaeb007be4b83108 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:10:30.336481 28158 ts_tablet_manager.cc:1929] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 13:10:30.348259 28158 log.cc:1199] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6d698a5544b946939790e7a3972db9fb: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-2-root/wals/0564e1a5f9d940fa9d28c8d27271a4c5
I20260709 13:10:30.350313 21648 catalog_manager.cc:5028] TS 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): tablet 0564e1a5f9d940fa9d28c8d27271a4c5 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:10:30.557907 21761 consensus_queue.cc:237] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:30.626024 22485 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:10:30.630509 28152 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:10:30.663846 28152 raft_consensus.cc:2955] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:30.678310 22485 raft_consensus.cc:2955] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:30.698271 21649 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 59340daad1394837bb0d56471ed8ce5a with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:30.731746 21909 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:10:30.733548 21728 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 91280.7us
I20260709 13:10:30.741094 21663 catalog_manager.cc:5697] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index 11 to 12, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New cstate: current_term: 14 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:30.753775 28153 raft_consensus.cc:993] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239: : Instructing follower 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:10:30.754891 28146 raft_consensus.cc:1081] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 19 LEADER]: Signalling peer 6fadfd81c5a645f1806a284ddbb6bf0d to start an election
I20260709 13:10:30.764319 21838 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
 from {username='slave'} at 127.0.0.1:38348
I20260709 13:10:30.765120 21838 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:30.765529 21838 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:30.780609 21838 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:30.784456 21838 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 20 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:30.784641 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:30.785383 22483 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:30.792773 22483 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 20.
I20260709 13:10:30.794443 21806 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:30.795472 28123 raft_consensus.cc:2804] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:30.796113 28123 raft_consensus.cc:697] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:30.797834 28123 consensus_queue.cc:237] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:30.809552 28152 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:30.830669 21662 catalog_manager.cc:5697] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 19 to 20, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 20 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.837925 21826 tablet_service.cc:1558] Processing DeleteTablet for tablet 59340daad1394837bb0d56471ed8ce5a with delete_type TABLET_DATA_TOMBSTONED (TS 6fadfd81c5a645f1806a284ddbb6bf0d not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:38332
I20260709 13:10:30.856529 21909 raft_consensus.cc:2955] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:30.874815 22483 raft_consensus.cc:1240] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Rejecting Update request from peer 3843e9b794a245dd8608e04ec7915239 for earlier term 19. Current term is 20. Ops: []
I20260709 13:10:30.878300 28159 consensus_queue.cc:1059] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:30.880125 28159 raft_consensus.cc:3055] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:30.880483 28159 raft_consensus.cc:740] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:30.881364 28159 consensus_queue.cc:260] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:30.889065 28159 raft_consensus.cc:3060] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:30.900959 21761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:30.902144 28168 tablet_replica.cc:333] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:30.903110 28168 raft_consensus.cc:2243] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:30.904060 28168 raft_consensus.cc:2272] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:30.953125 28168 ts_tablet_manager.cc:1916] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:30.957762 21761 raft_consensus.cc:2468] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 20.
I20260709 13:10:31.135722 28168 ts_tablet_manager.cc:1929] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 13:10:31.136248 28168 log.cc:1199] T 59340daad1394837bb0d56471ed8ce5a P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-1-root/wals/59340daad1394837bb0d56471ed8ce5a
I20260709 13:10:31.173992 21647 catalog_manager.cc:5028] TS 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): tablet 59340daad1394837bb0d56471ed8ce5a (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:10:31.208751 21765 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 20 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:10:31.210318 28162 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:31.252863 22485 raft_consensus.cc:1275] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:10:31.254643 28015 consensus_queue.cc:1048] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:31.251365 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:32.110661 21765 consensus_queue.cc:237] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
W20260709 13:10:32.149971 21731 consensus_peers.cc:597] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4e45c5ba8a1f4b0c958677540c41b258. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:32.154261 21907 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:32.155637 21838 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:10:32.158586 28152 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:32.161906 28159 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:32.231786 28152 raft_consensus.cc:2955] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:32.236979 21909 raft_consensus.cc:2955] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:32.268500 21835 consensus_queue.cc:237] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:32.283610 21662 catalog_manager.cc:5697] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index -1 to 11, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 17 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:32.287251 21838 raft_consensus.cc:2955] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
W20260709 13:10:32.323925 21806 consensus_peers.cc:597] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1969778971854d32a111e62af7be53fd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:32.325065 21909 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:32.325981 21765 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:10:32.330925 28162 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:32.334069 28123 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:32.358369 28123 raft_consensus.cc:2955] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:32.367395 21765 raft_consensus.cc:2955] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:32.382616 21909 raft_consensus.cc:2955] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:32.426924 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:32.434374 21835 consensus_queue.cc:237] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:32.486133 21909 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:10:32.488834 21806 consensus_peers.cc:597] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3cde61de02cf40daa7e584ca0a574c26. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:32.490640 28015 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:32.493760 21765 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:10:32.495316 28015 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:32.524647 28123 raft_consensus.cc:2955] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:32.532399 21765 raft_consensus.cc:2955] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:32.536973 21909 raft_consensus.cc:2955] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:32.553684 21835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1969778971854d32a111e62af7be53fd"
dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
mode: GRACEFUL
new_leader_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:44058
I20260709 13:10:32.554324 21835 raft_consensus.cc:606] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Received request to transfer leadership to TS 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:32.556172 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:10:32.559026 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:32.584401 21663 catalog_manager.cc:5697] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index -1 to 11, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 16 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:32.598827 21663 catalog_manager.cc:5697] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index -1 to 9, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 12 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:32.596329 21765 consensus_queue.cc:237] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:32.605832 28190 ts_tablet_manager.cc:933] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645)
I20260709 13:10:32.619858 28190 tablet_copy_client.cc:323] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.1:46645
I20260709 13:10:32.621785 21774 tablet_copy_service.cc:140] P 3843e9b794a245dd8608e04ec7915239: Received BeginTabletCopySession request for tablet 4e45c5ba8a1f4b0c958677540c41b258 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:44772)
I20260709 13:10:32.622406 21774 tablet_copy_service.cc:161] P 3843e9b794a245dd8608e04ec7915239: Beginning new tablet copy session on tablet 4e45c5ba8a1f4b0c958677540c41b258 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:44772: session id = 8c6c2207af3d47b3acf352d81959f4dd-4e45c5ba8a1f4b0c958677540c41b258
I20260709 13:10:32.631315 21774 tablet_copy_source_session.cc:215] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:10:32.639684 21731 consensus_peers.cc:597] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dee4ace3bc71491c9c9b19b0f5a8a667. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:32.640695 21909 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:10:32.642879 28179 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:32.648272 28190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e45c5ba8a1f4b0c958677540c41b258. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:32.649730 21835 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:10:32.651051 28179 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:32.682303 28152 raft_consensus.cc:2955] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 20 LEADER]: Committing config change with OpId 20.11: config changed from index -1 to 11, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:32.689008 21909 raft_consensus.cc:2955] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Committing config change with OpId 20.11: config changed from index -1 to 11, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:32.698812 21662 catalog_manager.cc:5697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index -1 to 11, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 20 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:32.702651 21835 raft_consensus.cc:2955] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Committing config change with OpId 20.11: config changed from index -1 to 11, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:32.776762 28190 tablet_copy_client.cc:806] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:32.778702 28190 tablet_copy_client.cc:670] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:32.797240 28190 tablet_copy_client.cc:538] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:32.817363 28188 raft_consensus.cc:993] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d: : Instructing follower 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:10:32.817950 28188 raft_consensus.cc:1081] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Signalling peer 3843e9b794a245dd8608e04ec7915239 to start an election
I20260709 13:10:32.821266 21765 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1969778971854d32a111e62af7be53fd"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
 from {username='slave'} at 127.0.0.1:59108
I20260709 13:10:32.825234 21765 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:32.825737 21765 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:32.846071 21765 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:32.848837 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:32.849512 21835 raft_consensus.cc:3055] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:10:32.849859 21835 raft_consensus.cc:740] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:32.850708 21835 consensus_queue.cc:260] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:32.852347 21835 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:32.855206 21765 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:32.864158 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:32.864800 21909 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:32.876729 21909 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 17.
I20260709 13:10:32.888485 21729 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb; no voters: 
I20260709 13:10:32.895038 28152 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:32.895591 28152 raft_consensus.cc:697] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 17 LEADER]: Becoming Leader. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:32.896658 28152 consensus_queue.cc:237] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:32.893054 21835 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3843e9b794a245dd8608e04ec7915239 in term 17.
I20260709 13:10:32.905880 28190 tablet_bootstrap.cc:492] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:10:32.917532 21663 catalog_manager.cc:5697] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 reported cstate change: term changed from 16 to 17, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 3843e9b794a245dd8608e04ec7915239 (127.20.40.1). New cstate: current_term: 17 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:32.969352 28195 ts_tablet_manager.cc:933] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:32.981519 28195 tablet_copy_client.cc:323] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.2:34765
I20260709 13:10:32.983702 21850 tablet_copy_service.cc:140] P 6fadfd81c5a645f1806a284ddbb6bf0d: Received BeginTabletCopySession request for tablet 3cde61de02cf40daa7e584ca0a574c26 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:56424)
I20260709 13:10:32.984436 21850 tablet_copy_service.cc:161] P 6fadfd81c5a645f1806a284ddbb6bf0d: Beginning new tablet copy session on tablet 3cde61de02cf40daa7e584ca0a574c26 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:56424: session id = 8c6c2207af3d47b3acf352d81959f4dd-3cde61de02cf40daa7e584ca0a574c26
I20260709 13:10:33.015823 21761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1969778971854d32a111e62af7be53fd"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48338
I20260709 13:10:33.016507 21761 raft_consensus.cc:606] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 17 LEADER]: Received request to transfer leadership
I20260709 13:10:33.017253 21850 tablet_copy_source_session.cc:215] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:33.021267 21761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1969778971854d32a111e62af7be53fd"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48338
I20260709 13:10:33.021898 21761 raft_consensus.cc:606] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 17 LEADER]: Received request to transfer leadership
W20260709 13:10:33.025005 21649 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 1969778971854d32a111e62af7be53fd already in progress
I20260709 13:10:33.032325 28195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cde61de02cf40daa7e584ca0a574c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:33.070425 21761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1969778971854d32a111e62af7be53fd"
dest_uuid: "3843e9b794a245dd8608e04ec7915239"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:48338
I20260709 13:10:33.071064 21761 raft_consensus.cc:606] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 17 LEADER]: Received request to transfer leadership
W20260709 13:10:33.077983 21711 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:10:33.078420 21711 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 1969778971854d32a111e62af7be53fd already in progress
W20260709 13:10:33.078696 21711 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 1969778971854d32a111e62af7be53fd already in progress
I20260709 13:10:33.078773 28195 tablet_copy_client.cc:806] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:33.086771 28195 tablet_copy_client.cc:670] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:33.099541 28195 tablet_copy_client.cc:538] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:33.112396 28190 tablet_bootstrap.cc:492] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:33.116488 28190 tablet_bootstrap.cc:492] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:10:33.141645 28190 ts_tablet_manager.cc:1403] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.243s	user 0.047s	sys 0.008s
I20260709 13:10:33.145488 28190 raft_consensus.cc:359] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:33.146592 28190 raft_consensus.cc:740] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:10:33.157935 28190 consensus_queue.cc:260] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:33.165298 28195 tablet_bootstrap.cc:492] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:10:33.167279 28190 ts_tablet_manager.cc:1434] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:10:33.175014 28199 ts_tablet_manager.cc:933] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645)
I20260709 13:10:33.174997 21774 tablet_copy_service.cc:342] P 3843e9b794a245dd8608e04ec7915239: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-4e45c5ba8a1f4b0c958677540c41b258 received from {username='slave'} at 127.0.0.1:44772
I20260709 13:10:33.175905 21774 tablet_copy_service.cc:434] P 3843e9b794a245dd8608e04ec7915239: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-4e45c5ba8a1f4b0c958677540c41b258 on tablet 4e45c5ba8a1f4b0c958677540c41b258 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:33.202919 28199 tablet_copy_client.cc:323] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.1:46645
I20260709 13:10:33.205883 21774 tablet_copy_service.cc:140] P 3843e9b794a245dd8608e04ec7915239: Received BeginTabletCopySession request for tablet dee4ace3bc71491c9c9b19b0f5a8a667 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:44772)
I20260709 13:10:33.206502 21774 tablet_copy_service.cc:161] P 3843e9b794a245dd8608e04ec7915239: Beginning new tablet copy session on tablet dee4ace3bc71491c9c9b19b0f5a8a667 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:44772: session id = 8c6c2207af3d47b3acf352d81959f4dd-dee4ace3bc71491c9c9b19b0f5a8a667
I20260709 13:10:33.249455 21774 tablet_copy_source_session.cc:215] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:33.283386 21909 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:33.286691 28199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dee4ace3bc71491c9c9b19b0f5a8a667. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:10:33.288451 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 67967.1us
I20260709 13:10:33.288889 28152 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:10:33.320600 28195 tablet_bootstrap.cc:492] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:33.321664 28195 tablet_bootstrap.cc:492] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:10:33.325187 28195 ts_tablet_manager.cc:1403] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.160s	user 0.048s	sys 0.010s
I20260709 13:10:33.326109 28153 raft_consensus.cc:993] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239: : Instructing follower 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:10:33.326579 28153 raft_consensus.cc:1081] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 17 LEADER]: Signalling peer 6d698a5544b946939790e7a3972db9fb to start an election
I20260709 13:10:33.338140 21913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1969778971854d32a111e62af7be53fd"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
 from {username='slave'} at 127.0.0.1:49544
I20260709 13:10:33.350919 28195 raft_consensus.cc:359] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:33.353633 28199 tablet_copy_client.cc:806] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:33.360870 28199 tablet_copy_client.cc:670] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:33.358249 21913 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:33.361559 21913 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:33.360464 28195 raft_consensus.cc:740] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:10:33.363880 21835 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:33.364516 28195 consensus_queue.cc:260] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:33.365456 28179 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:10:33.367278 28195 ts_tablet_manager.cc:1434] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:10:33.373513 21850 tablet_copy_service.cc:342] P 6fadfd81c5a645f1806a284ddbb6bf0d: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-3cde61de02cf40daa7e584ca0a574c26 received from {username='slave'} at 127.0.0.1:56424
I20260709 13:10:33.374040 21850 tablet_copy_service.cc:434] P 6fadfd81c5a645f1806a284ddbb6bf0d: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-3cde61de02cf40daa7e584ca0a574c26 on tablet 3cde61de02cf40daa7e584ca0a574c26 with peer 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:10:33.380999 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 52374.8us
I20260709 13:10:33.386339 28199 tablet_copy_client.cc:538] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:10:33.389374 21731 consensus_peers.cc:597] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1969778971854d32a111e62af7be53fd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:33.369325 21913 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:33.424590 21765 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "3843e9b794a245dd8608e04ec7915239"
I20260709 13:10:33.425208 21765 raft_consensus.cc:3055] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:10:33.424741 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 100960us
I20260709 13:10:33.425575 21765 raft_consensus.cc:740] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 3843e9b794a245dd8608e04ec7915239, State: Running, Role: LEADER
I20260709 13:10:33.426348 21765 consensus_queue.cc:260] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:33.427690 21765 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:33.429071 28199 tablet_bootstrap.cc:492] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:10:33.439534 21913 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:33.444041 21765 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 18.
I20260709 13:10:33.444274 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1969778971854d32a111e62af7be53fd" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:33.448911 21835 raft_consensus.cc:3060] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:33.470340 21835 raft_consensus.cc:2468] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 18.
I20260709 13:10:33.473475 21877 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:33.474434 28203 raft_consensus.cc:2804] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:33.474927 28203 raft_consensus.cc:697] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 18 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:33.475805 28203 consensus_queue.cc:237] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:33.489813 21662 catalog_manager.cc:5697] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 17 to 18, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 18 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:33.543921 28199 tablet_bootstrap.cc:492] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=3 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:33.545094 28199 tablet_bootstrap.cc:492] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:10:33.545910 28199 ts_tablet_manager.cc:1403] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.122s	user 0.045s	sys 0.001s
I20260709 13:10:33.548702 22485 raft_consensus.cc:1217] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 13:10:33.549139 28199 raft_consensus.cc:359] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:33.550143 28199 raft_consensus.cc:740] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:10:33.550869 28199 consensus_queue.cc:260] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:33.553799 28199 ts_tablet_manager.cc:1434] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:33.560000 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:33.581064 21774 tablet_copy_service.cc:342] P 3843e9b794a245dd8608e04ec7915239: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-dee4ace3bc71491c9c9b19b0f5a8a667 received from {username='slave'} at 127.0.0.1:44772
I20260709 13:10:33.581640 21774 tablet_copy_service.cc:434] P 3843e9b794a245dd8608e04ec7915239: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-dee4ace3bc71491c9c9b19b0f5a8a667 on tablet dee4ace3bc71491c9c9b19b0f5a8a667 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:33.635483 22485 raft_consensus.cc:1217] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 LEARNER]: Deduplicated request from leader. Original: 20.10->[20.11-20.11]   Dedup: 20.11->[]
I20260709 13:10:33.676152 22483 raft_consensus.cc:1217] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
W20260709 13:10:33.924712 21880 consensus_peers.cc:597] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1969778971854d32a111e62af7be53fd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:33.949694 21835 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:33.954036 28155 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:33.957103 28015 raft_consensus.cc:1064] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:10:33.960280 28015 consensus_queue.cc:237] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:33.979260 21765 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:10:33.997152 28155 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:34.098208 22483 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 LEARNER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:34.101480 28188 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:34.128142 21763 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:34.128764 21913 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:10:34.130724 28217 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:10:34.135125 28217 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:10:34.155169 28216 log.cc:927] Time spent T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:10:34.182106 28152 raft_consensus.cc:1064] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:10:34.191749 28152 consensus_queue.cc:237] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 9, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:34.206903 28015 raft_consensus.cc:2955] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:34.257462 22485 raft_consensus.cc:2955] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:34.267657 21909 raft_consensus.cc:2955] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:34.255867 21763 raft_consensus.cc:2955] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:34.300006 28223 raft_consensus.cc:1064] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:10:34.302477 28223 consensus_queue.cc:237] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:34.310420 21661 catalog_manager.cc:5697] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index 9 to 10, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.459106 21913 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:10:34.459996 22485 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 LEARNER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:10:34.474725 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 57036.4us
I20260709 13:10:34.476967 21835 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:10:34.462865 28222 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:10:34.482856 28227 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:34.504753 28225 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:10:34.538102 21840 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:34.551676 21909 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:10:34.555471 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 47067.6us
I20260709 13:10:34.560086 22483 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 LEARNER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:34.557070 28222 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:10:34.591871 28226 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:34.595451 28153 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:34.637655 28233 ts_tablet_manager.cc:933] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:34.698395 21835 consensus_queue.cc:237] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:34.705747 22485 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:34.707942 28123 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:34.725867 28123 raft_consensus.cc:2955] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:10:34.732085 21729 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 59477.6us
I20260709 13:10:34.753183 22476 raft_consensus.cc:2955] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:34.764964 28152 raft_consensus.cc:2955] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:34.766160 28226 raft_consensus.cc:2955] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 20 LEADER]: Committing config change with OpId 20.12: config changed from index 11 to 12, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:34.774380 21763 raft_consensus.cc:1275] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:10:34.774545 21838 raft_consensus.cc:2955] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:34.778096 21647 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3cde61de02cf40daa7e584ca0a574c26 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:34.786469 22485 raft_consensus.cc:2955] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:34.786078 22478 raft_consensus.cc:2955] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Committing config change with OpId 20.12: config changed from index 11 to 12, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:34.794466 28015 consensus_queue.cc:1048] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:10:34.797204 21909 raft_consensus.cc:2955] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Committing config change with OpId 20.12: config changed from index 11 to 12, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:34.809546 21660 catalog_manager.cc:5697] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 10 to 11, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New cstate: current_term: 12 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:34.811391 28233 tablet_copy_client.cc:323] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.3:43881
I20260709 13:10:34.817771 21663 catalog_manager.cc:5697] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index 11 to 12, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:34.819972 21923 tablet_copy_service.cc:140] P 6d698a5544b946939790e7a3972db9fb: Received BeginTabletCopySession request for tablet 1969778971854d32a111e62af7be53fd from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:45202)
I20260709 13:10:34.827560 21923 tablet_copy_service.cc:161] P 6d698a5544b946939790e7a3972db9fb: Beginning new tablet copy session on tablet 1969778971854d32a111e62af7be53fd from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:45202: session id = 8c6c2207af3d47b3acf352d81959f4dd-1969778971854d32a111e62af7be53fd
I20260709 13:10:34.840186 21897 tablet_service.cc:1558] Processing DeleteTablet for tablet 3cde61de02cf40daa7e584ca0a574c26 with delete_type TABLET_DATA_TOMBSTONED (TS 6d698a5544b946939790e7a3972db9fb not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:36378
I20260709 13:10:34.861862 21763 raft_consensus.cc:2955] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 6d698a5544b946939790e7a3972db9fb (127.20.40.3) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:34.884143 21923 tablet_copy_source_session.cc:215] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:34.905519 21838 raft_consensus.cc:2955] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Committing config change with OpId 20.12: config changed from index 11 to 12, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:34.913676 21662 catalog_manager.cc:5697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 11 to 12, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:34.931121 28233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1969778971854d32a111e62af7be53fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:34.943490 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:34.945333 28248 tablet_replica.cc:333] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:34.948784 28248 raft_consensus.cc:2243] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.949770 28248 raft_consensus.cc:2272] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.966570 21761 consensus_queue.cc:237] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:34.967598 21909 raft_consensus.cc:2955] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:34.972453 22478 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:10:34.974381 28245 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:34.984835 28248 ts_tablet_manager.cc:1916] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:34.985460 28245 raft_consensus.cc:2955] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index 12 to 13, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:34.990041 22476 raft_consensus.cc:2955] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:34.999482 21909 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:10:35.011235 21763 consensus_queue.cc:237] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:35.013307 28226 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:35.025303 21910 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:35.025557 22478 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Refusing update from remote peer 3843e9b794a245dd8608e04ec7915239: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:10:35.026605 21909 raft_consensus.cc:2955] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:35.028950 28226 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:35.037715 28229 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:35.051712 28229 raft_consensus.cc:2955] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:35.063567 21661 catalog_manager.cc:5697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 12 to 13, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New cstate: current_term: 20 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:35.067400 21910 raft_consensus.cc:2955] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:35.077667 21649 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dee4ace3bc71491c9c9b19b0f5a8a667 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:35.091727 28233 tablet_copy_client.cc:806] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:35.092352 28233 tablet_copy_client.cc:670] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:35.082508 21649 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4e45c5ba8a1f4b0c958677540c41b258 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:35.119524 21826 tablet_service.cc:1558] Processing DeleteTablet for tablet dee4ace3bc71491c9c9b19b0f5a8a667 with delete_type TABLET_DATA_TOMBSTONED (TS 6fadfd81c5a645f1806a284ddbb6bf0d not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:38332
I20260709 13:10:35.152987 22478 raft_consensus.cc:2955] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:35.163980 21909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a740500460ba465faaeb007be4b83108"
dest_uuid: "6d698a5544b946939790e7a3972db9fb"
mode: GRACEFUL
new_leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:39728
I20260709 13:10:35.164619 21909 raft_consensus.cc:606] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 19 LEADER]: Received request to transfer leadership to TS 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:35.180517 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:10:35.187671 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:35.189093 28249 tablet_replica.cc:333] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:35.197768 28233 tablet_copy_client.cc:538] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:35.197409 21662 catalog_manager.cc:5697] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 reported cstate change: config changed from index 12 to 13, VOTER 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) evicted. New cstate: current_term: 17 leader_uuid: "3843e9b794a245dd8608e04ec7915239" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:35.213879 28233 tablet_bootstrap.cc:492] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:10:35.218639 21826 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e45c5ba8a1f4b0c958677540c41b258 with delete_type TABLET_DATA_TOMBSTONED (TS 6fadfd81c5a645f1806a284ddbb6bf0d not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:38332
I20260709 13:10:35.221542 28248 ts_tablet_manager.cc:1929] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 13:10:35.222026 28248 log.cc:1199] T 3cde61de02cf40daa7e584ca0a574c26 P 6d698a5544b946939790e7a3972db9fb: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-2-root/wals/3cde61de02cf40daa7e584ca0a574c26
I20260709 13:10:35.223732 21648 catalog_manager.cc:5028] TS 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): tablet 3cde61de02cf40daa7e584ca0a574c26 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:10:35.244130 28249 raft_consensus.cc:2243] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.245076 28249 raft_consensus.cc:2272] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.251863 28249 ts_tablet_manager.cc:1916] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:35.283517 28249 ts_tablet_manager.cc:1929] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.12
I20260709 13:10:35.284021 28249 log.cc:1199] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-1-root/wals/dee4ace3bc71491c9c9b19b0f5a8a667
I20260709 13:10:35.288305 21647 catalog_manager.cc:5028] TS 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): tablet dee4ace3bc71491c9c9b19b0f5a8a667 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:10:35.301179 28249 tablet_replica.cc:333] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:35.302340 28249 raft_consensus.cc:2243] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:35.308741 28249 raft_consensus.cc:2272] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:35.320700 28249 ts_tablet_manager.cc:1916] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:35.362540 28249 ts_tablet_manager.cc:1929] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.12
I20260709 13:10:35.363231 28249 log.cc:1199] T 4e45c5ba8a1f4b0c958677540c41b258 P 6fadfd81c5a645f1806a284ddbb6bf0d: Deleting WAL directory at /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602420111825-20640-0/minicluster-data/ts-1-root/wals/4e45c5ba8a1f4b0c958677540c41b258
I20260709 13:10:35.364866 21647 catalog_manager.cc:5028] TS 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): tablet 4e45c5ba8a1f4b0c958677540c41b258 (table test-workload [id=aaafd53c3f48453ab36385f5b86f077f]) successfully deleted
I20260709 13:10:35.386386 28233 tablet_bootstrap.cc:492] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:35.387454 28233 tablet_bootstrap.cc:492] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:10:35.388177 28233 ts_tablet_manager.cc:1403] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.175s	user 0.043s	sys 0.019s
I20260709 13:10:35.394972 28233 raft_consensus.cc:359] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:35.395956 28233 raft_consensus.cc:740] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:10:35.396728 28233 consensus_queue.cc:260] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:35.399537 28233 ts_tablet_manager.cc:1434] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.003s
I20260709 13:10:35.407398 21923 tablet_copy_service.cc:342] P 6d698a5544b946939790e7a3972db9fb: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-1969778971854d32a111e62af7be53fd received from {username='slave'} at 127.0.0.1:45202
I20260709 13:10:35.407912 21923 tablet_copy_service.cc:434] P 6d698a5544b946939790e7a3972db9fb: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-1969778971854d32a111e62af7be53fd on tablet 1969778971854d32a111e62af7be53fd with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:35.522434 22478 raft_consensus.cc:1217] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd [term 18 LEARNER]: Deduplicated request from leader. Original: 17.12->[18.13-18.13]   Dedup: 18.13->[]
I20260709 13:10:35.551360 28155 raft_consensus.cc:993] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb: : Instructing follower 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:10:35.554075 28215 raft_consensus.cc:1081] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 19 LEADER]: Signalling peer 8c6c2207af3d47b3acf352d81959f4dd to start an election
I20260709 13:10:35.556078 22478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a740500460ba465faaeb007be4b83108"
dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
 from {username='slave'} at 127.0.0.1:36290
I20260709 13:10:35.556650 22478 raft_consensus.cc:493] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:35.556989 22478 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:35.589850 22478 raft_consensus.cc:515] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:35.621726 22478 leader_election.cc:290] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 20 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:35.639796 21838 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:35.640621 21838 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:35.645983 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a740500460ba465faaeb007be4b83108" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:35.646854 21910 raft_consensus.cc:3055] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:10:35.647204 21910 raft_consensus.cc:740] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:35.647892 21910 consensus_queue.cc:260] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:35.649907 21910 raft_consensus.cc:3060] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:10:35.663918 21838 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 20.
I20260709 13:10:35.665171 22448 leader_election.cc:304] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:35.665369 21910 raft_consensus.cc:2468] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 20.
I20260709 13:10:35.666114 28236 raft_consensus.cc:2804] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:10:35.666667 28236 raft_consensus.cc:697] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:35.667608 28236 consensus_queue.cc:237] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:35.701206 21662 catalog_manager.cc:5697] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 19 to 20, leader changed from 6d698a5544b946939790e7a3972db9fb (127.20.40.3) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 20 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:36.110507 28252 raft_consensus.cc:1064] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:10:36.113871 28252 consensus_queue.cc:237] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:36.176419 21909 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:10:36.178125 28236 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:36.188611 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:36.264901 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 111985us
I20260709 13:10:36.301401 21838 raft_consensus.cc:1275] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:10:36.303546 28236 consensus_queue.cc:1048] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:36.360633 22476 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd [term 18 LEARNER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:36.361861 21838 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:36.368741 21765 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:36.363389 28260 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:36.374481 28251 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:10:36.388296 20640 tablet_server.cc:179] TabletServer@127.20.40.1:0 shutting down...
W20260709 13:10:36.479791 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 60191.9us
W20260709 13:10:36.481530 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 47954.3us
I20260709 13:10:36.500581 28155 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:10:36.506894 22450 consensus_peers.cc:597] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.538900 22450 consensus_peers.cc:597] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.544238 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 79970.3us
W20260709 13:10:36.544406 22450 consensus_peers.cc:597] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.550948 21840 consensus_queue.cc:237] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:36.572618 21838 raft_consensus.cc:2955] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 11 to 14, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:36.569502 28269 raft_consensus.cc:2955] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 11 to 14, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:10:36.591394 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 84942.3us
W20260709 13:10:36.591707 21805 consensus_peers.cc:597] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.592721 21805 consensus_peers.cc:597] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.593330 21805 consensus_peers.cc:597] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.594015 21879 consensus_peers.cc:597] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.604451 21879 consensus_peers.cc:597] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.635275 21806 consensus_peers.cc:597] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983): Couldn't send request to peer 8c6c2207af3d47b3acf352d81959f4dd. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e76639c6d03a4a9697beddbec2ef6411. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.644258 21879 consensus_peers.cc:597] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.651990 21879 consensus_peers.cc:597] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.677052 22476 raft_consensus.cc:2955] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 11 to 14, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:36.689111 21662 catalog_manager.cc:5697] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb reported cstate change: config changed from index 11 to 14, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:36.673739 21805 consensus_peers.cc:597] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.705557 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 92614.8us
I20260709 13:10:36.713099 21908 raft_consensus.cc:1275] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:10:36.730067 21879 consensus_peers.cc:597] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.738189 21879 consensus_peers.cc:597] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.738991 21879 consensus_peers.cc:597] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.743223 21805 consensus_peers.cc:597] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.744022 28277 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:10:36.755611 21805 consensus_peers.cc:597] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.768672 21805 consensus_peers.cc:597] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.770498 21805 consensus_peers.cc:597] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.775087 21805 consensus_peers.cc:597] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.807070 21805 consensus_peers.cc:597] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.846781 21879 consensus_peers.cc:597] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.847857 21879 consensus_peers.cc:597] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.856464 21879 consensus_peers.cc:597] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.863515 28278 raft_consensus.cc:2955] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
I20260709 13:10:36.865860 21909 raft_consensus.cc:2955] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index -1 to 10, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } }
W20260709 13:10:36.878374 21805 consensus_peers.cc:597] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.880861 22450 consensus_peers.cc:597] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.881570 22450 consensus_peers.cc:597] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.891803 22450 consensus_peers.cc:597] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.892797 22450 consensus_peers.cc:597] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:36.894697 22450 consensus_peers.cc:597] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.926433 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:10:36.932870 21805 consensus_peers.cc:597] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.938813 20640 tablet_replica.cc:333] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:36.939867 20640 raft_consensus.cc:2243] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.950307 20640 raft_consensus.cc:2272] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.960712 20640 tablet_replica.cc:333] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:36.961675 20640 raft_consensus.cc:2243] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:36.964468 21805 consensus_peers.cc:597] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:36.965571 20640 raft_consensus.cc:2272] T c6406f8b01c041c58abe3add218f6b41 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.973784 20640 tablet_replica.cc:333] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:36.982661 20640 raft_consensus.cc:2243] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:36.983675 20640 raft_consensus.cc:2272] T 2b5c7b1a9d544cacaea74aa99eefa301 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.988765 20640 tablet_replica.cc:333] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:36.989769 20640 raft_consensus.cc:2243] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:36.990875 20640 raft_consensus.cc:2272] T 59340daad1394837bb0d56471ed8ce5a P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:36.993924 20640 tablet_replica.cc:333] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.006134 20640 raft_consensus.cc:2243] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.006771 20640 raft_consensus.cc:2272] T 3f7cb5d9283d4cf7969db82011d35ed9 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.009305 20640 tablet_replica.cc:333] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.010123 20640 raft_consensus.cc:2243] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.010690 20640 raft_consensus.cc:2272] T 5e295b8b73874adcb77878c1ca4897ea P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.013337 20640 tablet_replica.cc:333] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.014204 20640 raft_consensus.cc:2243] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.015269 20640 raft_consensus.cc:2272] T 46dafcc946c640c6a029dd71c387264e P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.025218 20640 tablet_replica.cc:333] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.025170 21909 consensus_queue.cc:237] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:37.019569 28285 ts_tablet_manager.cc:933] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd: Initiating tablet copy from peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:37.026468 20640 raft_consensus.cc:2243] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.029965 20640 raft_consensus.cc:2272] T f5bb431cadec4a5d9440b6c8743b7b47 P 3843e9b794a245dd8608e04ec7915239 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.032528 20640 tablet_replica.cc:333] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.033471 20640 raft_consensus.cc:2243] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.034524 20640 raft_consensus.cc:2272] T c7fc47e7b4534569b3d46ad6ddc619d5 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.046819 22476 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:37.047963 20640 tablet_replica.cc:333] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.048940 28252 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:37.049306 20640 raft_consensus.cc:2243] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.049995 20640 raft_consensus.cc:2272] T bfdda4b9a4f14b5c90c55134ebfd6303 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.052759 20640 tablet_replica.cc:333] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.053591 20640 raft_consensus.cc:2243] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.054270 20640 raft_consensus.cc:2272] T 1969778971854d32a111e62af7be53fd P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.054987 21835 raft_consensus.cc:1275] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:10:37.055967 21662 catalog_manager.cc:5697] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: config changed from index -1 to 10, NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) added. New cstate: current_term: 15 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:37.063199 28252 consensus_queue.cc:1048] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:10:37.056968 20640 tablet_replica.cc:333] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.068421 28252 raft_consensus.cc:2955] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 18 LEADER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:37.070194 20640 raft_consensus.cc:2243] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.071995 20640 raft_consensus.cc:2272] T dee4ace3bc71491c9c9b19b0f5a8a667 P 3843e9b794a245dd8608e04ec7915239 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.074673 20640 tablet_replica.cc:333] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.075553 20640 raft_consensus.cc:2243] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.076614 20640 raft_consensus.cc:2272] T 45781e9b2110456fb03406d2393eff1d P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.079516 20640 tablet_replica.cc:333] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.080372 20640 raft_consensus.cc:2243] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.071611 22478 raft_consensus.cc:2955] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:37.091478 21834 raft_consensus.cc:2955] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:37.094470 20640 raft_consensus.cc:2272] T ab7de8b45d37410487e1759ba66727e1 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.097275 20640 tablet_replica.cc:333] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.098081 20640 raft_consensus.cc:2243] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.098613 20640 raft_consensus.cc:2272] T c2c5cb2b121749798f01933921c01ed6 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.101292 20640 tablet_replica.cc:333] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.101930 28285 tablet_copy_client.cc:323] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Beginning tablet copy session from remote peer at address 127.20.40.2:34765
I20260709 13:10:37.102030 20640 raft_consensus.cc:2243] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.102948 20640 raft_consensus.cc:2272] T a218be1e72294b138c21b46dfa317d11 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.103832 21850 tablet_copy_service.cc:140] P 6fadfd81c5a645f1806a284ddbb6bf0d: Received BeginTabletCopySession request for tablet e76639c6d03a4a9697beddbec2ef6411 from peer 8c6c2207af3d47b3acf352d81959f4dd ({username='slave'} at 127.0.0.1:56424)
I20260709 13:10:37.104409 21850 tablet_copy_service.cc:161] P 6fadfd81c5a645f1806a284ddbb6bf0d: Beginning new tablet copy session on tablet e76639c6d03a4a9697beddbec2ef6411 from peer 8c6c2207af3d47b3acf352d81959f4dd at {username='slave'} at 127.0.0.1:56424: session id = 8c6c2207af3d47b3acf352d81959f4dd-e76639c6d03a4a9697beddbec2ef6411
I20260709 13:10:37.107667 21648 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1969778971854d32a111e62af7be53fd with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:37.111768 21850 tablet_copy_source_session.cc:215] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:37.116722 20640 tablet_replica.cc:333] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.117656 20640 raft_consensus.cc:2243] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.118414 20640 raft_consensus.cc:2272] T 3b18a570f5764b538a612ae89ef0327c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.116544 21661 catalog_manager.cc:5697] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 14 to 15, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New cstate: current_term: 18 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:37.148389 28285 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e76639c6d03a4a9697beddbec2ef6411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:37.152138 20640 tablet_replica.cc:333] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.153096 20640 raft_consensus.cc:2243] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.159929 20640 raft_consensus.cc:2272] T 773a4e5c42d942629a59d30efb0870f6 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.189383 20640 tablet_replica.cc:333] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.190325 20640 raft_consensus.cc:2243] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.191217 20640 raft_consensus.cc:2272] T 291227c6f9914476b4363d40f7cfebb8 P 3843e9b794a245dd8608e04ec7915239 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.193744 20640 tablet_replica.cc:333] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.194540 20640 raft_consensus.cc:2243] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.195164 20640 raft_consensus.cc:2272] T ee8c1089f60b4e52ae7e434904d4d178 P 3843e9b794a245dd8608e04ec7915239 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.197819 20640 tablet_replica.cc:333] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.198619 20640 raft_consensus.cc:2243] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:37.199322 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 53342.8us
I20260709 13:10:37.256913 20640 raft_consensus.cc:2272] T 9d6d123916f54285a4a4b037399f46ec P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.259824 20640 tablet_replica.cc:333] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
W20260709 13:10:37.269955 21649 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 107755us
W20260709 13:10:37.315539 21649 catalog_manager.cc:4755] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1969778971854d32a111e62af7be53fd: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:10:37.316913 20640 raft_consensus.cc:2243] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.324564 28285 tablet_copy_client.cc:806] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:37.325398 28245 raft_consensus.cc:493] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8c6c2207af3d47b3acf352d81959f4dd)
I20260709 13:10:37.347393 28245 raft_consensus.cc:515] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:37.349452 28245 leader_election.cc:290] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:37.328261 28226 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:37.330474 20640 raft_consensus.cc:2272] T 3cde61de02cf40daa7e584ca0a574c26 P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.350941 28226 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:37.352950 28226 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:37.353812 20640 tablet_replica.cc:333] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.354768 20640 raft_consensus.cc:2243] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.355955 28285 tablet_copy_client.cc:670] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:37.355999 20640 raft_consensus.cc:2272] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:37.275357 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 59379.2us
I20260709 13:10:37.367560 28285 tablet_copy_client.cc:538] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:37.370692 20640 tablet_replica.cc:333] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.375113 20640 raft_consensus.cc:2243] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.385882 20640 raft_consensus.cc:2272] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:37.387621 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 73139.5us
W20260709 13:10:37.392975 21731 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 45981.1us
I20260709 13:10:37.394435 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:37.396567 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:37.401820 20640 tablet_replica.cc:333] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.404217 20640 raft_consensus.cc:2243] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.405055 20640 raft_consensus.cc:2272] T 7f2b8ba156604362aecf8501bef61de4 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.409072 20640 tablet_replica.cc:333] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.419414 20640 raft_consensus.cc:2243] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.420414 20640 raft_consensus.cc:2272] T 26b137560d844f9bb07a8939c623b0f5 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.420914 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2da934436fc940e6abc7519a767e11a7" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:37.423214 20640 tablet_replica.cc:333] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.423810 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c096033d73b64750a7e09d89d0a70c7b" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:37.425595 21728 leader_election.cc:304] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:10:37.440207 21728 raft_consensus.cc:2686] T 2da934436fc940e6abc7519a767e11a7 P 3843e9b794a245dd8608e04ec7915239: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:10:37.441155 21728 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:10:37.445748 21728 raft_consensus.cc:2686] T c096033d73b64750a7e09d89d0a70c7b P 3843e9b794a245dd8608e04ec7915239: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:10:37.441457 20640 raft_consensus.cc:2243] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.447067 20640 raft_consensus.cc:2272] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.453720 20640 tablet_replica.cc:333] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.455817 20640 raft_consensus.cc:2243] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.456538 20640 raft_consensus.cc:2272] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.461068 28285 tablet_bootstrap.cc:492] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap starting.
I20260709 13:10:37.465700 20640 tablet_replica.cc:333] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.472172 20640 raft_consensus.cc:2243] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.473692 20640 raft_consensus.cc:2272] T afc4a5871719461787d91a97d59582af P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.476760 20640 tablet_replica.cc:333] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.479288 20640 raft_consensus.cc:2243] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.479893 20640 raft_consensus.cc:2272] T 6dd623bab71d4824b1463c6a5d774292 P 3843e9b794a245dd8608e04ec7915239 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.486696 20640 tablet_replica.cc:333] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.487941 20640 raft_consensus.cc:2243] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.488564 20640 raft_consensus.cc:2272] T 9911866d06f94adfb20f8f0e0890dcd9 P 3843e9b794a245dd8608e04ec7915239 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.491330 20640 tablet_replica.cc:333] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.492173 20640 raft_consensus.cc:2243] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.492772 20640 raft_consensus.cc:2272] T b9d0d92d0fde44e8b0697570a1c2024e P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.500718 20640 tablet_replica.cc:333] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.501617 20640 raft_consensus.cc:2243] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.506179 20640 raft_consensus.cc:2272] T a0e492aa4394405bb48ed3b957dd8f23 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.510938 20640 tablet_replica.cc:333] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.534044 20640 raft_consensus.cc:2243] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.535094 20640 raft_consensus.cc:2272] T 772d060b63de449b996b0ddc91936bcd P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.543169 20640 tablet_replica.cc:333] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.544134 20640 raft_consensus.cc:2243] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.544842 20640 raft_consensus.cc:2272] T 701ea15eb74f4429a9b47522314b79a7 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.549680 20640 tablet_replica.cc:333] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.550513 20640 raft_consensus.cc:2243] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.553807 20640 raft_consensus.cc:2272] T d90ebc4155df4717946aa00672ba6697 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.556811 20640 tablet_replica.cc:333] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.557801 20640 raft_consensus.cc:2243] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.558487 20640 raft_consensus.cc:2272] T 1dcda663ffc2447db5619b817e1c5078 P 3843e9b794a245dd8608e04ec7915239 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.561384 20640 tablet_replica.cc:333] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.566565 20640 raft_consensus.cc:2243] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.567200 20640 raft_consensus.cc:2272] T 31c81db970e24298b014b6d17fb12a0e P 3843e9b794a245dd8608e04ec7915239 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.570070 20640 tablet_replica.cc:333] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.570900 20640 raft_consensus.cc:2243] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.571695 20640 raft_consensus.cc:2272] T 7b32fdbf1d5847cb8bb918426813576d P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.574496 20640 tablet_replica.cc:333] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.577662 20640 raft_consensus.cc:2243] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.578364 20640 raft_consensus.cc:2272] T e76639c6d03a4a9697beddbec2ef6411 P 3843e9b794a245dd8608e04ec7915239 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.580837 20640 tablet_replica.cc:333] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.581620 20640 raft_consensus.cc:2243] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.582854 20640 raft_consensus.cc:2272] T 5871b64f4d9b45f99140a286177ff44f P 3843e9b794a245dd8608e04ec7915239 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.585251 20640 tablet_replica.cc:333] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.585989 20640 raft_consensus.cc:2243] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.586967 20640 raft_consensus.cc:2272] T 4e45c5ba8a1f4b0c958677540c41b258 P 3843e9b794a245dd8608e04ec7915239 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.590772 20640 tablet_replica.cc:333] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.593252 20640 raft_consensus.cc:2243] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.595314 20640 raft_consensus.cc:2272] T b87224fb843940c68eca74d28db8e73c P 3843e9b794a245dd8608e04ec7915239 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.597748 20640 tablet_replica.cc:333] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.598464 20640 raft_consensus.cc:2243] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:37.599565 28296 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:37.600075 28296 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:37.602443 28296 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:37.604715 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:37.607498 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0a14b69a1b542de81c41c50c191d109" candidate_uuid: "3843e9b794a245dd8608e04ec7915239" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:37.615770 21729 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3843e9b794a245dd8608e04ec7915239; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:37.616750 28226 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:37.619729 20640 raft_consensus.cc:2272] T 2141d5426fcc4d348541c5ff6e33b6e1 P 3843e9b794a245dd8608e04ec7915239 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.622690 20640 tablet_replica.cc:333] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.623515 20640 raft_consensus.cc:2243] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.624147 20640 raft_consensus.cc:2272] T a0a14b69a1b542de81c41c50c191d109 P 3843e9b794a245dd8608e04ec7915239 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.626794 20640 tablet_replica.cc:333] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239: stopping tablet replica
I20260709 13:10:37.627465 20640 raft_consensus.cc:2243] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:37.628057 20640 raft_consensus.cc:2272] T a860581d33304a09b6bd77ea24698076 P 3843e9b794a245dd8608e04ec7915239 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:37.745030 28285 tablet_bootstrap.cc:492] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:37.746145 28285 tablet_bootstrap.cc:492] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd: Bootstrap complete.
I20260709 13:10:37.746893 28285 ts_tablet_manager.cc:1403] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent bootstrapping tablet: real 0.286s	user 0.037s	sys 0.006s
I20260709 13:10:37.766012 28285 raft_consensus.cc:359] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:37.777818 28285 raft_consensus.cc:740] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Initialized, Role: LEARNER
I20260709 13:10:37.778636 28285 consensus_queue.cc:260] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } }
I20260709 13:10:37.781031 28285 ts_tablet_manager.cc:1434] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 13:10:37.789685 21850 tablet_copy_service.cc:342] P 6fadfd81c5a645f1806a284ddbb6bf0d: Request end of tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-e76639c6d03a4a9697beddbec2ef6411 received from {username='slave'} at 127.0.0.1:56424
I20260709 13:10:37.790113 21850 tablet_copy_service.cc:434] P 6fadfd81c5a645f1806a284ddbb6bf0d: ending tablet copy session 8c6c2207af3d47b3acf352d81959f4dd-e76639c6d03a4a9697beddbec2ef6411 on tablet e76639c6d03a4a9697beddbec2ef6411 with peer 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:38.060560 28290 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.061168 28290 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.063205 28290 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:10:38.065675 22450 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111) [suppressed 98 similar messages]
I20260709 13:10:38.068017 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:38.076583 28287 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.077143 28287 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.080209 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:38.084241 22476 raft_consensus.cc:1217] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEARNER]: Deduplicated request from leader. Original: 15.9->[15.10-15.10]   Dedup: 15.10->[]
W20260709 13:10:38.091670 21805 leader_election.cc:336] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.092259 21805 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:38.097149 28015 raft_consensus.cc:2749] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:10:38.109678 28287 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:38.116266 28280 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.116890 28280 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.119031 28280 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:38.120813 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:38.121459 21909 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 20.
W20260709 13:10:38.121991 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 55549.6us
I20260709 13:10:38.123145 22449 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:38.125006 28280 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:10:38.125420 28280 raft_consensus.cc:493] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.125829 28280 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:38.147640 28292 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.148313 28292 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:38.151347 22450 leader_election.cc:336] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:38.158581 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 93312us
I20260709 13:10:38.152309 28292 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:38.154305 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:38.155894 28280 raft_consensus.cc:515] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.174705 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee4ace3bc71491c9c9b19b0f5a8a667" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:38.175360 21909 raft_consensus.cc:3060] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:10:38.182507 21909 raft_consensus.cc:2468] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 21.
W20260709 13:10:38.191542 21879 leader_election.cc:336] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.192246 21879 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:38.192485 22449 leader_election.cc:304] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:38.184302 28280 leader_election.cc:290] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 21 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:38.193271 28255 raft_consensus.cc:2804] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:10:38.193848 28255 raft_consensus.cc:697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [term 21 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
W20260709 13:10:38.194842 22450 leader_election.cc:336] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.194761 28255 consensus_queue.cc:237] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.199361 28292 raft_consensus.cc:2749] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:10:38.209192 21879 leader_election.cc:336] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.210587 28303 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.212723 28303 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:38.215108 28303 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:38.211275 28287 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.216055 28287 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:38.218103 28287 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:38.221088 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:38.221820 21909 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:10:38.223454 28305 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.223981 28305 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:38.226227 28305 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:38.228049 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:38.230285 21804 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:38.234086 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:38.251053 28280 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.252542 28280 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.254601 28303 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:38.254622 28280 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:38.255111 28303 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.255556 28303 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.274935 28292 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.275614 28292 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:38.283002 22450 leader_election.cc:336] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.286293 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:38.288333 28292 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:38.307001 21879 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:38.309453 28277 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:10:38.310250 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 101095us
I20260709 13:10:38.310143 28277 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.312400 28277 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:38.309569 28305 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:38.315433 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 61366.2us
I20260709 13:10:38.324654 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:38.325527 22476 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 18.
I20260709 13:10:38.328158 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:38.328754 21834 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 18.
I20260709 13:10:38.320724 28290 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.341519 28290 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:38.342499 28303 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:38.343566 28290 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:38.344476 22448 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:38.326519 28304 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.348481 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:38.352902 21909 raft_consensus.cc:3060] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:38.345587 28307 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:38.354791 28304 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.357057 28304 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:38.355238 28307 raft_consensus.cc:493] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.344483 28303 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:38.357687 28307 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:38.372529 21879 leader_election.cc:336] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.373111 21879 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:38.374055 21879 leader_election.cc:336] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.374641 28305 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:38.395726 21879 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:38.380187 28290 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.396414 28290 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.398522 28290 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:38.399439 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:38.400560 28290 raft_consensus.cc:2749] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:38.390621 28307 raft_consensus.cc:515] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.394155 28303 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.402693 28303 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:38.405807 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:38.406438 21908 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 12.
I20260709 13:10:38.407684 21804 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:38.408620 28304 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:10:38.409008 28304 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.409379 28304 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:38.419407 28304 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:38.379195 21661 catalog_manager.cc:5697] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 20 to 21, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 21 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.420135 28303 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:38.395216 21909 raft_consensus.cc:2468] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
I20260709 13:10:38.426405 28255 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.427019 28255 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.429059 28255 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:38.432124 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:38.432802 21834 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:10:38.434302 21804 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:38.435384 22448 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
W20260709 13:10:38.440635 22450 leader_election.cc:336] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.440667 28303 raft_consensus.cc:2804] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:38.441887 28255 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:10:38.442464 28255 raft_consensus.cc:493] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.445130 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab7de8b45d37410487e1759ba66727e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:38.447569 21834 raft_consensus.cc:3060] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:38.447150 28255 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:38.452970 22450 leader_election.cc:336] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.456050 28280 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.456573 28280 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.458655 28280 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:38.460150 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:38.460978 21839 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 8.
I20260709 13:10:38.462008 22448 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:38.464031 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:38.465991 21834 raft_consensus.cc:2468] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 19.
I20260709 13:10:38.474048 22448 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
W20260709 13:10:38.475848 21879 leader_election.cc:336] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.465734 21806 leader_election.cc:304] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:38.480762 28015 raft_consensus.cc:2764] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:10:38.444204 28307 leader_election.cc:290] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 19 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:38.487262 28253 raft_consensus.cc:2804] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:10:38.488639 22450 leader_election.cc:336] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.489167 28309 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.489749 28309 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.492097 28309 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:38.493394 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:38.493991 21910 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 14.
I20260709 13:10:38.495770 28280 raft_consensus.cc:2804] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:10:38.496163 28280 raft_consensus.cc:493] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.496512 28255 raft_consensus.cc:515] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.484004 21839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:38.500829 21839 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 16.
I20260709 13:10:38.501251 22476 raft_consensus.cc:2393] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 11: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:10:38.498173 22449 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:38.502928 21877 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
W20260709 13:10:38.483503 21879 leader_election.cc:336] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.517854 21879 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:38.519376 28305 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:38.502369 28308 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:38.521908 28305 raft_consensus.cc:493] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.522177 28308 raft_consensus.cc:493] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.522425 28305 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:38.522634 28308 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:38.525174 22450 leader_election.cc:336] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:38.527140 21805 leader_election.cc:336] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.446527 28303 raft_consensus.cc:697] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:38.526530 28301 raft_consensus.cc:2749] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:38.496515 28280 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:10:38.534343 21805 leader_election.cc:336] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.538195 21805 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:38.547133 28287 raft_consensus.cc:2749] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:38.547542 28255 leader_election.cc:290] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:38.549243 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7fc47e7b4534569b3d46ad6ddc619d5" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:38.550014 21834 raft_consensus.cc:3060] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:10:38.550712 22450 leader_election.cc:336] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.557421 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45781e9b2110456fb03406d2393eff1d" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:38.557940 21834 raft_consensus.cc:2468] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 11.
I20260709 13:10:38.558097 21909 raft_consensus.cc:3060] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:10:38.559015 22448 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:38.561695 28255 raft_consensus.cc:2804] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:10:38.562227 28255 raft_consensus.cc:697] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:38.563040 28255 consensus_queue.cc:237] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.563951 28307 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.557824 28304 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:38.564486 28307 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.568320 21909 raft_consensus.cc:2468] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
I20260709 13:10:38.540031 28253 raft_consensus.cc:697] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:38.569523 21804 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:38.573766 28304 raft_consensus.cc:2804] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:10:38.574286 28304 raft_consensus.cc:697] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:38.575142 28304 consensus_queue.cc:237] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:38.575966 28308 raft_consensus.cc:515] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.584825 28015 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.585343 28015 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:38.587212 28015 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:38.588140 22450 leader_election.cc:336] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.588629 28307 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:38.595870 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:38.599517 28308 leader_election.cc:290] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:38.602509 28253 consensus_queue.cc:237] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:38.603693 22450 leader_election.cc:336] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:38.609730 21805 leader_election.cc:336] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.569042 28305 raft_consensus.cc:515] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:38.621570 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:38.622469 21909 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 13.
I20260709 13:10:38.622778 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59340daad1394837bb0d56471ed8ce5a" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:38.623435 21908 raft_consensus.cc:3060] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:38.594830 28303 consensus_queue.cc:237] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:38.631228 21908 raft_consensus.cc:2468] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 15.
I20260709 13:10:38.632539 22449 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:38.633221 28310 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.634464 28309 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:38.634889 28309 raft_consensus.cc:493] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.634811 28310 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:38.610623 28280 raft_consensus.cc:515] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.635399 28309 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:38.634159 21805 leader_election.cc:336] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.637127 22449 leader_election.cc:304] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:38.638186 28310 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:38.639533 21805 leader_election.cc:304] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:38.640609 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:38.646589 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5bb431cadec4a5d9440b6c8743b7b47" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:38.647258 21834 raft_consensus.cc:3060] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:38.647920 28309 raft_consensus.cc:515] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.656085 28309 leader_election.cc:290] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:38.656774 21649 catalog_manager.cc:4755] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1969778971854d32a111e62af7be53fd: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.657048 21834 raft_consensus.cc:2468] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 17.
I20260709 13:10:38.663399 21877 leader_election.cc:304] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:10:38.665848 22450 leader_election.cc:336] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.668416 28292 raft_consensus.cc:2804] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:38.669324 28292 raft_consensus.cc:697] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 17 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:38.670670 28292 consensus_queue.cc:237] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:38.657526 28305 leader_election.cc:290] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:38.672777 21660 catalog_manager.cc:5697] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 13 to 14, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 14 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:38.674670 28301 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.675247 28301 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.658253 28255 raft_consensus.cc:2804] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:38.676494 28255 raft_consensus.cc:697] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:38.677594 28310 raft_consensus.cc:2749] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:38.661979 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "773a4e5c42d942629a59d30efb0870f6" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
W20260709 13:10:38.674328 21805 leader_election.cc:336] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.682229 21908 raft_consensus.cc:3060] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:38.683161 21805 leader_election.cc:336] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.698952 21908 raft_consensus.cc:2468] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 14.
I20260709 13:10:38.691488 28277 raft_consensus.cc:1064] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d: attempting to promote NON_VOTER 8c6c2207af3d47b3acf352d81959f4dd to VOTER
I20260709 13:10:38.707897 28280 leader_election.cc:290] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:38.709501 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dafcc946c640c6a029dd71c387264e" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:38.710143 21834 raft_consensus.cc:3060] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:10:38.709882 28277 consensus_queue.cc:237] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.719391 28305 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.720984 28305 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:38.677583 28255 consensus_queue.cc:237] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.722694 22449 leader_election.cc:304] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:38.723731 21908 raft_consensus.cc:1275] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 21 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:10:38.728910 28308 raft_consensus.cc:2804] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:38.722643 28301 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:38.729415 28308 raft_consensus.cc:697] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:38.733827 21834 raft_consensus.cc:2468] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:10:38.738704 22448 leader_election.cc:304] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:38.704768 28253 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:10:38.744879 21879 leader_election.cc:336] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.744781 28308 consensus_queue.cc:237] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:38.746618 22450 leader_election.cc:336] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:38.747905 21879 leader_election.cc:336] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.740139 28309 consensus_queue.cc:1048] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 13:10:38.748505 28253 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.751612 28316 raft_consensus.cc:2804] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:10:38.752168 28316 raft_consensus.cc:697] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 9 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:38.752763 28253 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:38.760474 22450 consensus_peers.cc:597] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:38.762804 22450 leader_election.cc:336] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:38.749573 21805 leader_election.cc:336] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.767721 21805 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
W20260709 13:10:38.771039 21805 leader_election.cc:336] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.769268 28304 raft_consensus.cc:2749] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:38.773886 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:38.773900 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:38.774766 22478 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 17.
I20260709 13:10:38.774834 21908 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 17.
I20260709 13:10:38.777966 21880 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:38.780755 28301 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:38.753106 28316 consensus_queue.cc:237] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:38.782599 21805 leader_election.cc:336] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.783143 21805 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:38.785378 22449 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:38.781185 28301 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.783939 28304 raft_consensus.cc:2749] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:38.794683 28309 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:10:38.798254 21879 leader_election.cc:336] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:38.793803 28301 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:38.803192 28309 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.809793 21663 catalog_manager.cc:5697] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 16 to 17, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 17 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.816403 22476 raft_consensus.cc:1275] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEARNER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:38.828996 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:38.830008 21834 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 13.
I20260709 13:10:38.837110 21877 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:38.837137 28015 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:10:38.825820 28309 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:38.831671 28305 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:38.847066 28290 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:38.849402 28253 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.857895 28290 raft_consensus.cc:493] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.894626 28290 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:38.896196 21879 consensus_peers.cc:597] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:38.898609 21661 catalog_manager.cc:5697] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 18 to 19, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 19 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:38.903893 21804 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 90960.7us
I20260709 13:10:38.904241 21661 catalog_manager.cc:5697] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 14 to 15, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 15 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.905892 21661 catalog_manager.cc:5697] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 10 to 11, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 11 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.907137 21908 raft_consensus.cc:1275] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:10:38.907168 21661 catalog_manager.cc:5697] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 13 to 14, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 14 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.911716 21661 catalog_manager.cc:5697] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 8 to 9, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 9 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:38.916086 28303 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.916672 28303 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:38.919729 22450 consensus_peers.cc:597] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:38.920109 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:38.886509 28253 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.900180 28255 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
W20260709 13:10:38.943322 21805 consensus_peers.cc:597] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:38.924412 28331 log.cc:927] Time spent T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:10:38.923151 28303 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:38.950858 28255 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:38.990310 28292 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:38.991081 28292 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
W20260709 13:10:38.994942 20640 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 21786)
I20260709 13:10:38.997356 22478 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 13.
W20260709 13:10:38.999738 22450 consensus_peers.cc:597] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:39.000594 21806 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:38.983503 28324 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:39.004190 28324 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:39.006537 28324 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:39.006875 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:39.007524 21835 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 17.
I20260709 13:10:38.993278 28292 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:39.011201 21907 raft_consensus.cc:1275] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:10:39.011152 28290 raft_consensus.cc:515] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:39.014082 28290 leader_election.cc:290] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:39.017764 21877 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:39.018033 28335 consensus_queue.cc:1048] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:10:39.018815 28344 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:39.019140 28253 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:39.019219 28344 raft_consensus.cc:493] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:39.020004 28344 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:39.021054 21835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afc4a5871719461787d91a97d59582af" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:39.021629 21835 raft_consensus.cc:3060] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:39.023038 28301 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:39.013204 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:39.058071 21834 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 17.
W20260709 13:10:39.024519 28330 log.cc:927] Time spent T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:10:39.026078 21907 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:39.029091 21835 raft_consensus.cc:2468] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 14.
I20260709 13:10:38.947979 28277 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:10:39.045715 28305 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:39.087280 28305 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:39.050697 21805 consensus_peers.cc:597] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:39.090070 21805 leader_election.cc:336] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:39.092368 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 43916.7us
W20260709 13:10:39.054143 21879 leader_election.cc:336] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:39.093695 28304 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:39.094235 28304 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:39.096319 28304 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:39.006556 28015 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:10:39.097990 28015 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:39.098374 28015 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:10:39.101925 21805 consensus_peers.cc:597] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:39.102465 21805 consensus_peers.cc:597] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:39.102982 21907 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 9.
I20260709 13:10:39.067852 21877 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:39.071175 28255 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:39.106179 21877 leader_election.cc:304] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
W20260709 13:10:39.114797 21879 leader_election.cc:336] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:39.114468 28015 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:39.121662 22449 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:39.125728 28015 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:10:39.124316 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 179258us
I20260709 13:10:39.123229 21912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:39.118963 28324 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:10:39.118889 28300 raft_consensus.cc:2804] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:39.077283 28309 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:39.131961 28316 raft_consensus.cc:2804] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:10:39.134881 28316 raft_consensus.cc:493] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:39.138233 28316 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:39.138402 28301 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:39.141762 28300 raft_consensus.cc:697] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:39.143078 28300 consensus_queue.cc:237] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:39.130990 28324 raft_consensus.cc:493] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 3843e9b794a245dd8608e04ec7915239)
I20260709 13:10:39.145733 28324 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:39.146132 28316 raft_consensus.cc:515] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:39.147317 28309 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 18 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:39.147763 28316 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:39.150991 28305 leader_election.cc:290] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:39.154073 28344 raft_consensus.cc:515] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:39.155122 28324 raft_consensus.cc:515] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:39.156638 28344 leader_election.cc:290] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:39.157531 28324 leader_election.cc:290] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:39.210712 21912 raft_consensus.cc:2393] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6fadfd81c5a645f1806a284ddbb6bf0d in current term 18: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:39.220204 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" is_pre_election: true
I20260709 13:10:39.222316 21834 raft_consensus.cc:2393] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 14: Already voted for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in this term.
I20260709 13:10:39.239347 22478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:39.240831 22478 raft_consensus.cc:2393] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 18: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
I20260709 13:10:39.242089 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:39.243166 22483 raft_consensus.cc:2393] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d698a5544b946939790e7a3972db9fb in current term 10: Already voted for candidate 8c6c2207af3d47b3acf352d81959f4dd in this term.
W20260709 13:10:39.253291 22450 leader_election.cc:336] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:39.268435 21879 leader_election.cc:336] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:39.274251 21909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5871b64f4d9b45f99140a286177ff44f" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:39.275274 21909 raft_consensus.cc:3060] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:10:39.276429 21834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26b137560d844f9bb07a8939c623b0f5" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:39.277458 21834 raft_consensus.cc:3060] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:39.278863 21833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d90ebc4155df4717946aa00672ba6697" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d"
I20260709 13:10:39.279608 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:39.279903 21833 raft_consensus.cc:3060] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:10:39.280808 21910 raft_consensus.cc:2393] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8c6c2207af3d47b3acf352d81959f4dd in current term 18: Already voted for candidate 6d698a5544b946939790e7a3972db9fb in this term.
I20260709 13:10:39.282877 21839 raft_consensus.cc:1275] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 13:10:39.281196 21879 consensus_peers.cc:597] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:39.295442 21831 raft_consensus.cc:1275] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:10:39.297102 21912 raft_consensus.cc:1275] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:10:39.297574 21879 consensus_peers.cc:597] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:39.298198 21879 consensus_peers.cc:597] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:39.320068 22483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2141d5426fcc4d348541c5ff6e33b6e1" candidate_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:39.321238 22483 raft_consensus.cc:3060] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:10:39.324535 28253 consensus_queue.cc:1048] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:39.325081 28309 consensus_queue.cc:1048] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:10:39.341403 22450 consensus_peers.cc:597] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:39.363757 21805 consensus_peers.cc:597] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:39.364466 21805 leader_election.cc:336] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:39.364589 21910 raft_consensus.cc:1275] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:10:39.364950 21805 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:39.366142 28311 consensus_queue.cc:1048] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:10:39.365762 21661 catalog_manager.cc:5697] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 12 to 13, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 13 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } }
I20260709 13:10:39.375806 21834 raft_consensus.cc:2468] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 18.
I20260709 13:10:39.373173 21833 raft_consensus.cc:2468] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 18.
W20260709 13:10:39.376407 22450 leader_election.cc:336] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:39.378573 22450 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:39.384756 28347 raft_consensus.cc:2749] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:39.386212 28325 consensus_queue.cc:1048] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:10:39.394378 21909 raft_consensus.cc:2468] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
I20260709 13:10:39.398372 21661 catalog_manager.cc:5697] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 13 to 14, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 14 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:39.396039 21879 leader_election.cc:336] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:39.407303 21879 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:39.413396 22449 leader_election.cc:304] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:39.416492 28253 raft_consensus.cc:2804] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:10:39.420754 28253 raft_consensus.cc:697] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:39.426479 21833 raft_consensus.cc:1275] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:10:39.427867 28342 raft_consensus.cc:2749] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:10:39.431154 28347 raft_consensus.cc:2955] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:39.427932 22483 raft_consensus.cc:2468] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6fadfd81c5a645f1806a284ddbb6bf0d in term 14.
W20260709 13:10:39.433048 21805 consensus_peers.cc:597] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:39.433796 21805 leader_election.cc:336] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:39.435889 21834 raft_consensus.cc:1275] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:10:39.426543 28253 consensus_queue.cc:237] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:39.448848 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 52858.7us
W20260709 13:10:39.449680 21879 leader_election.cc:336] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:39.450142 21879 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
W20260709 13:10:39.456254 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 101551us
I20260709 13:10:39.457722 28300 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:10:39.458822 21877 leader_election.cc:304] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 
I20260709 13:10:39.459887 28316 consensus_queue.cc:1048] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:10:39.461946 21879 leader_election.cc:336] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:39.462745 21879 leader_election.cc:336] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:39.462379 21912 raft_consensus.cc:2955] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:39.465601 28309 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:39.457186 22450 consensus_peers.cc:597] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:39.472005 22450 leader_election.cc:336] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:39.472555 22450 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:39.475776 28292 raft_consensus.cc:2804] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:39.477487 28292 raft_consensus.cc:697] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 18 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:39.478650 28292 consensus_queue.cc:237] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:39.499557 21806 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:39.500833 28015 raft_consensus.cc:2804] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:10:39.501672 22483 raft_consensus.cc:2955] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:39.503279 28015 raft_consensus.cc:697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Becoming Leader. State: Replica: 6fadfd81c5a645f1806a284ddbb6bf0d, State: Running, Role: LEADER
I20260709 13:10:39.504616 28015 consensus_queue.cc:237] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:39.508107 22450 leader_election.cc:336] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:39.509166 22450 consensus_peers.cc:597] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:39.511104 28316 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:10:39.495504 21879 consensus_peers.cc:597] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:39.521523 21879 consensus_peers.cc:597] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:39.522351 21877 leader_election.cc:304] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d; no voters: 3843e9b794a245dd8608e04ec7915239
W20260709 13:10:39.527318 21805 consensus_peers.cc:597] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:39.533187 28324 raft_consensus.cc:2804] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:10:39.533883 28324 raft_consensus.cc:697] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 18 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:39.535015 28324 consensus_queue.cc:237] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:39.536139 21908 raft_consensus.cc:1275] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:10:39.538686 28309 consensus_queue.cc:1048] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:10:39.528810 21805 consensus_peers.cc:597] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:39.542559 21805 consensus_peers.cc:597] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:39.548996 28344 consensus_queue.cc:1048] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:10:39.565991 22450 consensus_peers.cc:597] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:39.568449 22450 consensus_peers.cc:597] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:39.569062 22450 consensus_peers.cc:597] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:39.548005 21805 consensus_peers.cc:597] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:39.573360 22450 consensus_peers.cc:597] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:39.577734 22450 consensus_peers.cc:597] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:39.574101 21805 consensus_peers.cc:597] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:39.579993 21663 catalog_manager.cc:5697] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 9 to 10, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 10 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:39.589986 22450 consensus_peers.cc:597] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:39.590592 22450 consensus_peers.cc:597] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:39.613933 22450 consensus_peers.cc:597] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:39.592243 21805 consensus_peers.cc:597] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:39.621747 21805 consensus_peers.cc:597] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:39.635458 21805 consensus_peers.cc:597] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:39.639024 21879 consensus_peers.cc:597] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:39.640311 21879 consensus_peers.cc:597] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:39.654778 21805 consensus_peers.cc:597] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:39.654240 21663 catalog_manager.cc:5697] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 10 to 11, 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:10:39.686825 21879 consensus_peers.cc:597] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:39.718045 21879 consensus_peers.cc:597] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:39.721886 21660 catalog_manager.cc:5697] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 17 to 18, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 18 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.724159 21660 catalog_manager.cc:5697] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 17 to 18, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 18 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.776705 21834 raft_consensus.cc:1275] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:10:39.781603 21879 consensus_peers.cc:597] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:39.785054 21663 catalog_manager.cc:5697] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d reported cstate change: term changed from 13 to 14, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2). New cstate: current_term: 14 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.786214 28342 consensus_queue.cc:1048] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:39.866587 21834 consensus_queue.cc:237] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:39.868218 21910 raft_consensus.cc:1275] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:10:39.886608 21910 raft_consensus.cc:1275] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:39.889727 28335 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:39.890961 22476 raft_consensus.cc:1275] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:10:39.893606 28335 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:10:39.900103 28309 consensus_queue.cc:1048] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:10:39.901407 22450 consensus_peers.cc:597] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:39.907395 28277 raft_consensus.cc:2955] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:39.921702 21912 raft_consensus.cc:2955] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
I20260709 13:10:39.927037 22476 raft_consensus.cc:2955] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:10:39.948626 21879 consensus_peers.cc:597] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:39.974332 21649 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 191046us
I20260709 13:10:39.982729 21660 catalog_manager.cc:5697] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: config changed from index 11 to 12, VOTER 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) evicted. New cstate: current_term: 15 leader_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } } }
W20260709 13:10:39.996613 20640 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 21786)
I20260709 13:10:40.005776 21647 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e76639c6d03a4a9697beddbec2ef6411 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:10:39.986217 21649 catalog_manager.cc:4755] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1969778971854d32a111e62af7be53fd: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:40.022710 21879 consensus_peers.cc:597] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:40.031476 22476 raft_consensus.cc:1275] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Refusing update from remote peer 6fadfd81c5a645f1806a284ddbb6bf0d: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:10:40.033672 28015 consensus_queue.cc:1048] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:10:40.043985 21838 raft_consensus.cc:1275] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:10:40.087905 21835 raft_consensus.cc:1275] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:10:40.088960 21805 consensus_peers.cc:597] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:40.091893 28300 consensus_queue.cc:1048] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:10:40.069754 28342 consensus_queue.cc:1048] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
W20260709 13:10:40.178800 21805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 59907.1us
I20260709 13:10:40.960831 28370 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.961506 28370 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:40.971378 28370 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:10:40.972363 21879 leader_election.cc:336] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:40.973598 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:40.975435 22485 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 18.
I20260709 13:10:40.976873 21880 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:40.978053 28370 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:10:40.978461 28370 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.983565 28370 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:10:41.026976 28370 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:41.030536 22485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e45c5ba8a1f4b0c958677540c41b258" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:41.031131 22485 raft_consensus.cc:3060] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:10:41.052656 21879 leader_election.cc:336] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:41.054605 22485 raft_consensus.cc:2468] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 19.
I20260709 13:10:41.056016 21880 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239
I20260709 13:10:41.057021 28290 raft_consensus.cc:2804] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:10:41.058465 28290 raft_consensus.cc:697] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 19 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:41.059921 28290 consensus_queue.cc:237] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:41.073010 28370 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 election: Requested vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:41.136656 21660 catalog_manager.cc:5697] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 17 to 19, leader changed from 3843e9b794a245dd8608e04ec7915239 (127.20.40.1) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 19 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:41.274940 22450 consensus_peers.cc:597] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:41.319801 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 45483.2us
W20260709 13:10:41.340400 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 52268.8us
W20260709 13:10:41.357443 21649 catalog_manager.cc:4755] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e76639c6d03a4a9697beddbec2ef6411: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:41.410218 22450 consensus_peers.cc:597] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.449400 21879 consensus_peers.cc:597] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.450420 21805 consensus_peers.cc:597] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.454814 21805 consensus_peers.cc:597] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.472326 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 82817.6us
W20260709 13:10:41.485334 21879 consensus_peers.cc:597] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.508126 22450 consensus_peers.cc:597] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.514192 22450 consensus_peers.cc:597] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.538616 21879 consensus_peers.cc:597] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:41.540122 22450 consensus_peers.cc:597] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.551790 21879 consensus_peers.cc:597] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:41.555135 22450 consensus_peers.cc:597] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:41.592888 21879 consensus_peers.cc:597] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.610728 22450 consensus_peers.cc:597] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.642628 21805 consensus_peers.cc:597] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.649887 22450 consensus_peers.cc:597] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:41.670682 22450 consensus_peers.cc:597] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:41.685703 22485 raft_consensus.cc:1275] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:10:41.687264 28392 consensus_queue.cc:1048] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:10:41.690889 21805 consensus_peers.cc:597] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.704624 22450 consensus_peers.cc:597] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.713275 22450 consensus_peers.cc:597] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.769922 21805 consensus_peers.cc:597] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.777626 21805 consensus_peers.cc:597] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.789619 21805 consensus_peers.cc:597] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.793974 21879 consensus_peers.cc:597] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.815711 21879 consensus_peers.cc:597] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.872293 21805 consensus_peers.cc:597] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.883127 21805 consensus_peers.cc:597] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:41.891757 21805 consensus_peers.cc:597] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.925166 21879 consensus_peers.cc:597] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:41.929842 21805 consensus_peers.cc:597] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:42.013084 21805 consensus_peers.cc:597] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:42.044399 21805 consensus_peers.cc:597] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:42.072108 21879 consensus_peers.cc:597] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:42.129987 21805 consensus_peers.cc:597] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:42.155941 22450 consensus_peers.cc:597] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:42.240767 22450 consensus_peers.cc:597] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:42.261015 21879 consensus_peers.cc:597] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:42.295397 21879 consensus_peers.cc:597] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:42.312686 21879 consensus_peers.cc:597] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:42.416675 22450 consensus_peers.cc:597] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:42.436086 21649 catalog_manager.cc:4755] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e76639c6d03a4a9697beddbec2ef6411: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:42.459867 22450 consensus_peers.cc:597] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:42.462128 21879 consensus_peers.cc:597] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:42.545590 21805 consensus_peers.cc:597] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:42.669643 21879 consensus_peers.cc:597] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:43.074936 21805 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111) [suppressed 465 similar messages]
W20260709 13:10:43.456298 21806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 50594.2us
W20260709 13:10:43.647809 22450 consensus_peers.cc:597] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:43.650552 21879 consensus_peers.cc:597] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:43.765937 22450 consensus_peers.cc:597] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:43.769771 21879 consensus_peers.cc:597] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:43.902069 21805 consensus_peers.cc:597] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:43.903661 22450 consensus_peers.cc:597] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:43.907249 21879 consensus_peers.cc:597] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:43.922659 21879 consensus_peers.cc:597] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:43.971021 22450 consensus_peers.cc:597] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:43.971796 22450 consensus_peers.cc:597] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:43.993235 21879 consensus_peers.cc:597] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:44.014678 21805 consensus_peers.cc:597] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:44.128855 22450 consensus_peers.cc:597] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:44.132475 20640 tablet_server.cc:196] TabletServer@127.20.40.1:0 shutdown complete.
W20260709 13:10:44.148512 21805 consensus_peers.cc:597] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:44.157228 22450 consensus_peers.cc:597] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:44.162900 22450 consensus_peers.cc:597] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:44.200559 21879 consensus_peers.cc:597] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:44.241901 21805 consensus_peers.cc:597] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:44.310930 21805 consensus_peers.cc:597] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:44.319597 21879 consensus_peers.cc:597] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:44.327651 21805 consensus_peers.cc:597] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:44.333775 21805 consensus_peers.cc:597] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:44.346377 21805 consensus_peers.cc:597] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:44.368384 21879 consensus_peers.cc:597] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:44.408838 21805 consensus_peers.cc:597] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:44.411887 20640 tablet_server.cc:179] TabletServer@127.20.40.2:0 shutting down...
W20260709 13:10:44.414789 22450 consensus_peers.cc:597] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:44.416256 22450 consensus_peers.cc:597] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:44.441249 21805 consensus_peers.cc:597] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:44.459991 21805 consensus_peers.cc:597] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:44.461028 22450 consensus_peers.cc:597] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:44.492360 22448 consensus_peers.cc:597] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.510195 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:10:44.510620 21877 consensus_peers.cc:597] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.512971 21805 consensus_peers.cc:597] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:44.513114 20640 tablet_replica.cc:333] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.514302 20640 raft_consensus.cc:2243] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:44.515470 20640 raft_consensus.cc:2272] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.518317 20640 tablet_replica.cc:333] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.519095 20640 raft_consensus.cc:2243] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.519701 20640 raft_consensus.cc:2272] T b50256b3ab294021ae20aa34053b59e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.522481 20640 tablet_replica.cc:333] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.523294 20640 raft_consensus.cc:2243] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.524036 20640 raft_consensus.cc:2272] T 46dafcc946c640c6a029dd71c387264e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.526485 20640 tablet_replica.cc:333] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.527354 20640 raft_consensus.cc:2243] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.527900 20640 raft_consensus.cc:2272] T a740500460ba465faaeb007be4b83108 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.530505 20640 tablet_replica.cc:333] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.531250 20640 raft_consensus.cc:2243] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.531805 20640 raft_consensus.cc:2272] T f5bb431cadec4a5d9440b6c8743b7b47 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.534413 20640 tablet_replica.cc:333] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.535243 20640 raft_consensus.cc:2243] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:10:44.536054 22448 consensus_peers.cc:597] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.536281 20640 raft_consensus.cc:2272] T 0b8098340ee849cfae4a080cc2544e82 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.539106 20640 tablet_replica.cc:333] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.539914 20640 raft_consensus.cc:2243] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:44.540959 20640 raft_consensus.cc:2272] T 45781e9b2110456fb03406d2393eff1d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.543824 20640 tablet_replica.cc:333] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.544613 20640 raft_consensus.cc:2243] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.545140 20640 raft_consensus.cc:2272] T 71a084e9c0014661925a846711e7a18f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.547741 20640 tablet_replica.cc:333] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.548548 20640 raft_consensus.cc:2243] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.549081 20640 raft_consensus.cc:2272] T c7fc47e7b4534569b3d46ad6ddc619d5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.551652 20640 tablet_replica.cc:333] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.552419 20640 raft_consensus.cc:2243] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.553092 20640 raft_consensus.cc:2272] T ab7de8b45d37410487e1759ba66727e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.555850 20640 tablet_replica.cc:333] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.556663 20640 raft_consensus.cc:2243] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:44.557749 20640 raft_consensus.cc:2272] T c2c5cb2b121749798f01933921c01ed6 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.560498 20640 tablet_replica.cc:333] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.561153 20640 raft_consensus.cc:2243] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:44.562202 20640 raft_consensus.cc:2272] T c6406f8b01c041c58abe3add218f6b41 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:44.562575 21649 catalog_manager.cc:4755] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e76639c6d03a4a9697beddbec2ef6411: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:44.564815 20640 tablet_replica.cc:333] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
W20260709 13:10:44.574827 21805 consensus_peers.cc:597] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:44.575240 21877 consensus_peers.cc:597] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.577872 20640 raft_consensus.cc:2243] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.578536 20640 raft_consensus.cc:2272] T 2da934436fc940e6abc7519a767e11a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.586628 20640 tablet_replica.cc:333] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.594681 20640 raft_consensus.cc:2243] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:44.595827 20640 raft_consensus.cc:2272] T c096033d73b64750a7e09d89d0a70c7b P 6fadfd81c5a645f1806a284ddbb6bf0d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.598646 20640 tablet_replica.cc:333] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.599475 20640 raft_consensus.cc:2243] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.600451 20640 raft_consensus.cc:2272] T 1969778971854d32a111e62af7be53fd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:44.603914 21877 consensus_peers.cc:597] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.608014 20640 tablet_replica.cc:333] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.609328 20640 raft_consensus.cc:2243] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.610289 20640 raft_consensus.cc:2272] T 915629d8ce0e4452b6308425161f143a P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.617255 20640 tablet_replica.cc:333] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.618122 20640 raft_consensus.cc:2243] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:44.619230 20640 raft_consensus.cc:2272] T d76fbf464db84dbeb90facb1538a9ca1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:44.621567 21877 consensus_peers.cc:597] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.621873 20640 tablet_replica.cc:333] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.623119 20640 raft_consensus.cc:2243] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:44.624295 20640 raft_consensus.cc:2272] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.627207 20640 tablet_replica.cc:333] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.628026 20640 raft_consensus.cc:2243] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.628751 20640 raft_consensus.cc:2272] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.631580 20640 tablet_replica.cc:333] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.632447 20640 raft_consensus.cc:2243] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.633059 20640 raft_consensus.cc:2272] T b0e72cc3f09a4d549ebd824be85955a3 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.636562 20640 tablet_replica.cc:333] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.637396 20640 raft_consensus.cc:2243] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.638016 20640 raft_consensus.cc:2272] T af88ee4a85a24987b0c1513dd7ce39ed P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:44.638864 22448 consensus_peers.cc:597] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.640842 20640 tablet_replica.cc:333] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
W20260709 13:10:44.641149 21879 consensus_peers.cc:597] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:44.641736 20640 raft_consensus.cc:2243] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.642591 20640 raft_consensus.cc:2272] T afc4a5871719461787d91a97d59582af P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.645361 20640 tablet_replica.cc:333] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.646559 20640 raft_consensus.cc:2243] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:10:44.651048 22450 consensus_peers.cc:597] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:44.651125 20640 raft_consensus.cc:2272] T 9d6d123916f54285a4a4b037399f46ec P 6fadfd81c5a645f1806a284ddbb6bf0d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.655373 20640 tablet_replica.cc:333] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.656311 20640 raft_consensus.cc:2243] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.656904 20640 raft_consensus.cc:2272] T 667c64e212614c7ca822788e9d37fc29 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:44.657809 21877 consensus_peers.cc:597] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.659690 20640 tablet_replica.cc:333] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.660723 20640 raft_consensus.cc:2243] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:10:44.661895 20640 raft_consensus.cc:2272] T 3cde61de02cf40daa7e584ca0a574c26 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.664577 20640 tablet_replica.cc:333] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.665382 20640 raft_consensus.cc:2243] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.666237 20640 raft_consensus.cc:2272] T 26b137560d844f9bb07a8939c623b0f5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.669462 20640 tablet_replica.cc:333] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.670289 20640 raft_consensus.cc:2243] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:10:44.671677 20640 raft_consensus.cc:2272] T 291227c6f9914476b4363d40f7cfebb8 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.674333 20640 tablet_replica.cc:333] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.675122 20640 raft_consensus.cc:2243] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.675752 20640 raft_consensus.cc:2272] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:44.677037 22448 consensus_peers.cc:597] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.679167 20640 tablet_replica.cc:333] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.680035 20640 raft_consensus.cc:2243] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:10:44.681118 20640 raft_consensus.cc:2272] T a218be1e72294b138c21b46dfa317d11 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:44.683224 21877 consensus_peers.cc:597] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.683943 20640 tablet_replica.cc:333] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.684787 20640 raft_consensus.cc:2243] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:10:44.696251 21879 consensus_peers.cc:597] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:44.697835 20640 raft_consensus.cc:2272] T 1dcda663ffc2447db5619b817e1c5078 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:44.702385 22450 consensus_peers.cc:597] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:44.704799 20640 tablet_replica.cc:333] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.709623 20640 raft_consensus.cc:2243] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.710354 20640 raft_consensus.cc:2272] T 772d060b63de449b996b0ddc91936bcd P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.715540 20640 tablet_replica.cc:333] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.716439 20640 raft_consensus.cc:2243] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.717199 20640 raft_consensus.cc:2272] T 701ea15eb74f4429a9b47522314b79a7 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.719879 20640 tablet_replica.cc:333] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.720764 20640 raft_consensus.cc:2243] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.721500 20640 raft_consensus.cc:2272] T d90ebc4155df4717946aa00672ba6697 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.724295 20640 tablet_replica.cc:333] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.725124 20640 raft_consensus.cc:2243] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.725857 20640 raft_consensus.cc:2272] T 0ec128cbd4ca4f3daa63f2db9749837f P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.728358 20640 tablet_replica.cc:333] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.729240 20640 raft_consensus.cc:2243] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.730088 20640 raft_consensus.cc:2272] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:44.730737 21877 consensus_peers.cc:597] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.732883 20640 tablet_replica.cc:333] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.733851 20640 raft_consensus.cc:2243] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:44.734985 20640 raft_consensus.cc:2272] T ee8c1089f60b4e52ae7e434904d4d178 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.737599 20640 tablet_replica.cc:333] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.738389 20640 raft_consensus.cc:2243] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.741920 20640 raft_consensus.cc:2272] T 6c77d056b72142dbaf44be22749d2024 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.744653 20640 tablet_replica.cc:333] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.745460 20640 raft_consensus.cc:2243] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:10:44.746613 20640 raft_consensus.cc:2272] T a0a14b69a1b542de81c41c50c191d109 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.749404 20640 tablet_replica.cc:333] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.750167 20640 raft_consensus.cc:2243] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.751614 20640 raft_consensus.cc:2272] T 31c81db970e24298b014b6d17fb12a0e P 6fadfd81c5a645f1806a284ddbb6bf0d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.754324 20640 tablet_replica.cc:333] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.755036 20640 raft_consensus.cc:2243] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:44.756078 20640 raft_consensus.cc:2272] T e76639c6d03a4a9697beddbec2ef6411 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:44.758177 21877 consensus_peers.cc:597] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.758786 20640 tablet_replica.cc:333] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.759563 20640 raft_consensus.cc:2243] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:10:44.760756 20640 raft_consensus.cc:2272] T 7b32fdbf1d5847cb8bb918426813576d P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:44.763568 20640 tablet_replica.cc:333] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.764303 20640 raft_consensus.cc:2243] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.764894 20640 raft_consensus.cc:2272] T a860581d33304a09b6bd77ea24698076 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:44.766332 21879 consensus_peers.cc:597] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:44.767691 20640 tablet_replica.cc:333] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.769033 20640 raft_consensus.cc:2243] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:44.769698 20640 raft_consensus.cc:2272] T b87224fb843940c68eca74d28db8e73c P 6fadfd81c5a645f1806a284ddbb6bf0d [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:44.770059 22448 consensus_peers.cc:597] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:44.772316 20640 tablet_replica.cc:333] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d: stopping tablet replica
I20260709 13:10:44.773020 20640 raft_consensus.cc:2243] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:44.774283 20640 raft_consensus.cc:2272] T 2141d5426fcc4d348541c5ff6e33b6e1 P 6fadfd81c5a645f1806a284ddbb6bf0d [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:44.785671 21877 consensus_peers.cc:597] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.795056 21877 consensus_peers.cc:597] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.799618 21877 consensus_peers.cc:597] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.859313 21877 consensus_peers.cc:597] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.862439 22448 consensus_peers.cc:597] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.880460 22448 consensus_peers.cc:597] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.889250 22448 consensus_peers.cc:597] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.906044 22448 consensus_peers.cc:597] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.930531 21877 connection.cc:573] client connection to 127.20.40.2:34765 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:10:44.931022 21877 consensus_peers.cc:597] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.933521 22448 consensus_peers.cc:597] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.934873 21879 consensus_peers.cc:597] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:44.987818 22448 consensus_peers.cc:597] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:44.990724 22450 consensus_peers.cc:597] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:45.014797 21877 consensus_peers.cc:597] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:45.051388 22448 consensus_peers.cc:597] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:45.102892 22450 consensus_peers.cc:597] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:45.269965 21879 consensus_peers.cc:597] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:45.273201 21879 consensus_peers.cc:597] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:10:45.567236 28407 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:45.567766 28407 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:45.578676 28407 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:45.580021 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
W20260709 13:10:45.587697 21877 leader_election.cc:336] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:45.588487 21877 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:45.589818 28407 raft_consensus.cc:2749] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:45.657668 28290 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:45.658327 28290 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:45.660441 28290 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:45.668720 28379 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:45.669330 28379 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:45.671639 28379 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:45.676875 22448 leader_election.cc:336] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
W20260709 13:10:45.681238 22450 leader_election.cc:336] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:45.681975 22450 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:45.684124 28405 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:45.697134 21879 leader_election.cc:336] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:45.758023 28387 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:45.758632 28387 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:45.760803 28387 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:45.762665 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:45.780850 28387 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:45.781546 28387 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:45.785936 22448 leader_election.cc:336] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:45.786445 22448 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:45.788376 28379 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:10:45.789037 28387 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:45.792971 22450 leader_election.cc:336] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:45.794196 22448 leader_election.cc:336] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:45.794683 22448 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:45.796965 28290 raft_consensus.cc:493] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:45.797667 28290 raft_consensus.cc:515] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:45.799996 28290 leader_election.cc:290] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:45.795469 28387 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:45.803902 21877 leader_election.cc:336] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:45.805446 21877 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:45.807935 28407 raft_consensus.cc:2749] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:45.826176 28290 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:45.826857 28290 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:45.832492 28290 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:45.840795 21879 leader_election.cc:336] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:45.856884 28387 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:45.857856 28387 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:45.864998 22450 leader_election.cc:336] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:45.866153 28387 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:45.871212 22448 leader_election.cc:336] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:45.871672 22448 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:45.872833 28387 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:45.868942 21877 leader_election.cc:336] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:45.874436 21877 leader_election.cc:304] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:45.880203 28387 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:45.881795 28387 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:45.879616 21879 leader_election.cc:336] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:45.896615 28392 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:45.920286 28392 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:45.924641 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:45.926728 28392 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:45.893594 28290 raft_consensus.cc:2749] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:45.928172 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 59258us
W20260709 13:10:45.935633 22450 leader_election.cc:336] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:45.951598 22450 consensus_peers.cc:597] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:45.959553 28387 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:45.961772 22448 leader_election.cc:336] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:45.963598 22448 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:45.964929 28387 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:45.981513 28405 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:45.982035 28405 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:45.984071 28405 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:45.993502 22448 leader_election.cc:336] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:45.995046 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:46.005825 21910 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 14.
I20260709 13:10:46.007541 22449 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:46.008482 28387 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:10:46.008888 28387 raft_consensus.cc:493] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:46.009307 28387 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:10:46.002162 21877 leader_election.cc:336] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:46.021813 21877 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:46.028307 28405 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:46.031592 28405 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:46.033795 28405 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:46.044538 28392 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:46.045270 28392 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:46.048225 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:46.048803 22476 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 16.
I20260709 13:10:46.049979 21880 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:46.050823 28407 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:10:46.051229 28407 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:46.051894 28407 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:46.053717 28392 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:46.054361 28290 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:10:46.055428 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 53308.4us
W20260709 13:10:46.072508 21879 leader_election.cc:336] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:46.073323 28405 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:46.084331 28405 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:46.074843 28379 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:46.088146 28379 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:46.092118 28405 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:46.094545 28379 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:46.102313 21879 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 8c6c2207af3d47b3acf352d81959f4dd
I20260709 13:10:46.108304 28392 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:46.112706 21877 leader_election.cc:336] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:46.113255 28392 raft_consensus.cc:493] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:46.144258 28392 raft_consensus.cc:515] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:46.146749 28392 leader_election.cc:290] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:46.118842 22448 leader_election.cc:336] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:46.159654 28411 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:46.160298 28411 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:46.166594 22450 leader_election.cc:336] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:46.168998 22450 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:46.170837 28410 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:46.182642 21879 consensus_peers.cc:597] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:46.122675 28387 raft_consensus.cc:515] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:46.186581 21910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b8098340ee849cfae4a080cc2544e82" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb"
I20260709 13:10:46.187223 21910 raft_consensus.cc:3060] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:10:46.195618 21910 raft_consensus.cc:2468] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 15.
I20260709 13:10:46.197153 22449 leader_election.cc:304] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:46.198215 28410 raft_consensus.cc:2804] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:10:46.199126 28410 raft_consensus.cc:697] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEADER]: Becoming Leader. State: Replica: 8c6c2207af3d47b3acf352d81959f4dd, State: Running, Role: LEADER
I20260709 13:10:46.200147 28410 consensus_queue.cc:237] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:46.204164 28392 raft_consensus.cc:493] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:46.204768 28392 raft_consensus.cc:515] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:46.207126 28392 leader_election.cc:290] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:46.208250 22448 leader_election.cc:336] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
W20260709 13:10:46.208933 22448 leader_election.cc:336] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:46.220259 28411 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:46.223703 21908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "291227c6f9914476b4363d40f7cfebb8" candidate_uuid: "8c6c2207af3d47b3acf352d81959f4dd" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6d698a5544b946939790e7a3972db9fb" is_pre_election: true
I20260709 13:10:46.224498 21908 raft_consensus.cc:2468] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c6c2207af3d47b3acf352d81959f4dd in term 10.
W20260709 13:10:46.227905 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 103457us
I20260709 13:10:46.153610 28407 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:46.238396 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d76fbf464db84dbeb90facb1538a9ca1" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:46.239022 22476 raft_consensus.cc:3060] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:10:46.241847 28290 raft_consensus.cc:493] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:46.242444 28290 raft_consensus.cc:515] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:46.244405 28290 leader_election.cc:290] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:46.250037 22476 raft_consensus.cc:2468] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 17.
I20260709 13:10:46.265015 21880 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:46.266183 28290 raft_consensus.cc:2804] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:10:46.267445 28290 raft_consensus.cc:697] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 17 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:46.268350 28290 consensus_queue.cc:237] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:46.272550 28387 leader_election.cc:290] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:46.275707 28379 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:46.276363 28379 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:46.283489 28407 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
W20260709 13:10:46.285830 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 102468us
I20260709 13:10:46.290517 28324 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:46.291116 28324 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:46.293851 28324 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:46.303043 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd" is_pre_election: true
I20260709 13:10:46.303790 22476 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 15.
I20260709 13:10:46.304919 21880 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:46.306079 28324 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:10:46.306600 28324 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:46.307065 28324 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:46.307874 21649 catalog_manager.cc:4755] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1969778971854d32a111e62af7be53fd: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:46.315449 28379 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:46.316438 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 103814us
W20260709 13:10:46.318547 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 57532.2us
W20260709 13:10:46.325842 21877 leader_election.cc:336] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
W20260709 13:10:46.377950 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 52140.2us
I20260709 13:10:46.340548 21661 catalog_manager.cc:5697] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd reported cstate change: term changed from 14 to 15, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4). New cstate: current_term: 15 leader_uuid: "8c6c2207af3d47b3acf352d81959f4dd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:46.351483 22448 leader_election.cc:336] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:46.388818 21660 catalog_manager.cc:5697] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 16 to 17, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 17 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:46.332470 21879 leader_election.cc:336] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:46.391737 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 59303.3us
W20260709 13:10:46.404680 22448 leader_election.cc:336] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
W20260709 13:10:46.405459 22448 leader_election.cc:336] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:46.408648 28324 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:46.411058 28324 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Requested vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 8c6c2207af3d47b3acf352d81959f4dd (127.20.40.4:37983)
I20260709 13:10:46.414397 22476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e76639c6d03a4a9697beddbec2ef6411" candidate_uuid: "6d698a5544b946939790e7a3972db9fb" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8c6c2207af3d47b3acf352d81959f4dd"
I20260709 13:10:46.426069 22476 raft_consensus.cc:3060] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:10:46.387163 22450 leader_election.cc:336] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:46.433072 22450 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:46.435670 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 48542.3us
W20260709 13:10:46.442997 21877 leader_election.cc:336] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:46.443528 21877 leader_election.cc:304] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:46.444777 28324 raft_consensus.cc:2749] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:46.436252 28379 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:46.407544 21879 leader_election.cc:336] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:46.446079 21877 leader_election.cc:336] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:46.447180 21877 leader_election.cc:304] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:46.448362 21877 leader_election.cc:336] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:46.448818 28324 raft_consensus.cc:2749] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:10:46.433212 22476 raft_consensus.cc:2468] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d698a5544b946939790e7a3972db9fb in term 16.
I20260709 13:10:46.451581 21880 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 
I20260709 13:10:46.452389 28324 raft_consensus.cc:2804] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:10:46.442238 22450 leader_election.cc:336] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:46.452943 28324 raft_consensus.cc:697] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 16 LEADER]: Becoming Leader. State: Replica: 6d698a5544b946939790e7a3972db9fb, State: Running, Role: LEADER
I20260709 13:10:46.453409 22450 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:46.457522 22450 leader_election.cc:336] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:46.454058 28324 consensus_queue.cc:237] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:46.459441 22450 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb, 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:46.461012 28410 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:46.457978 28379 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:46.446149 21879 leader_election.cc:336] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:46.468331 21877 leader_election.cc:336] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:46.469079 21877 leader_election.cc:304] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:46.471769 28290 raft_consensus.cc:2749] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:10:46.473101 21877 leader_election.cc:336] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
W20260709 13:10:46.478102 21877 leader_election.cc:336] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
W20260709 13:10:46.485304 21879 consensus_peers.cc:597] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:46.527274 21879 consensus_peers.cc:597] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:46.529595 22450 consensus_peers.cc:597] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:46.530483 22450 leader_election.cc:336] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:46.532120 22450 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:46.535029 28410 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:46.545814 21879 consensus_peers.cc:597] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:46.560660 22450 consensus_peers.cc:597] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:46.573918 22450 consensus_peers.cc:597] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:46.579934 22450 consensus_peers.cc:597] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:46.715528 21879 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 121964us
W20260709 13:10:46.716333 21877 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 72642.3us
W20260709 13:10:46.749151 21877 consensus_peers.cc:597] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:46.803366 22485 raft_consensus.cc:1275] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:10:46.849408 28392 consensus_queue.cc:1048] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:10:46.942516 21879 consensus_peers.cc:597] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:46.953519 22450 consensus_peers.cc:597] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:46.954062 22450 consensus_peers.cc:597] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:46.955973 21880 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:37983, user_credentials={real_user=slave}} blocked reactor thread for 45989.8us
I20260709 13:10:46.957893 22478 raft_consensus.cc:1275] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Refusing update from remote peer 6d698a5544b946939790e7a3972db9fb: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:10:46.958151 21879 consensus_peers.cc:597] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:46.942513 22448 consensus_peers.cc:597] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:46.961578 21879 consensus_peers.cc:597] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:46.962831 21910 raft_consensus.cc:1275] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Refusing update from remote peer 8c6c2207af3d47b3acf352d81959f4dd: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:10:46.970599 28407 consensus_queue.cc:1048] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:10:46.981711 21661 catalog_manager.cc:5697] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb reported cstate change: term changed from 15 to 16, leader changed from 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2) to 6d698a5544b946939790e7a3972db9fb (127.20.40.3). New cstate: current_term: 16 leader_uuid: "6d698a5544b946939790e7a3972db9fb" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:46.984025 21877 consensus_peers.cc:597] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:47.000286 28425 consensus_queue.cc:1048] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:10:47.004668 22450 consensus_peers.cc:597] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:47.005354 22450 consensus_peers.cc:597] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:47.009161 22450 consensus_peers.cc:597] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:47.018155 22450 consensus_peers.cc:597] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:47.014115 21877 consensus_peers.cc:597] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.024125 21877 consensus_peers.cc:597] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:47.031044 21879 consensus_peers.cc:597] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:47.045584 22449 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:43881, user_credentials={real_user=slave}} blocked reactor thread for 46041.5us
W20260709 13:10:47.078776 22450 consensus_peers.cc:597] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:47.108611 21877 consensus_peers.cc:597] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.153604 21877 consensus_peers.cc:597] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.164670 21877 consensus_peers.cc:597] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.175482 21877 consensus_peers.cc:597] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.180730 21879 consensus_peers.cc:597] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:47.219081 22448 consensus_peers.cc:597] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.220135 21877 consensus_peers.cc:597] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.300638 21879 consensus_peers.cc:597] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:47.315711 20640 tablet_server.cc:196] TabletServer@127.20.40.2:0 shutdown complete.
W20260709 13:10:47.319635 21879 consensus_peers.cc:597] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:47.321682 22448 consensus_peers.cc:597] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.347518 22448 consensus_peers.cc:597] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.370237 22450 consensus_peers.cc:597] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:10:47.405329 21877 consensus_peers.cc:597] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.430322 22448 consensus_peers.cc:597] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.457616 21877 consensus_peers.cc:597] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.458655 22448 consensus_peers.cc:597] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.464938 21877 consensus_peers.cc:597] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.478737 22448 consensus_peers.cc:597] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.506549 21877 consensus_peers.cc:597] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:47.514423 20640 tablet_server.cc:179] TabletServer@127.20.40.3:0 shutting down...
W20260709 13:10:47.519912 21877 consensus_peers.cc:597] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.509999 22448 consensus_peers.cc:597] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.526934 22448 consensus_peers.cc:597] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.527452 22448 consensus_peers.cc:597] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.527938 22448 consensus_peers.cc:597] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.533916 22449 consensus_peers.cc:597] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:47.535492 22449 consensus_peers.cc:597] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:47.563875 22449 consensus_peers.cc:597] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:47.567443 21877 consensus_peers.cc:597] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:47.571734 22449 consensus_peers.cc:597] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:47.585641 28410 raft_consensus.cc:493] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:47.589320 28410 raft_consensus.cc:515] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:47.589993 22449 consensus_peers.cc:597] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:47.591423 28410 leader_election.cc:290] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:47.598997 22450 leader_election.cc:336] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:47.599638 22448 leader_election.cc:336] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:47.600099 22448 leader_election.cc:304] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:47.600943 28410 raft_consensus.cc:2749] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:10:47.621902 28410 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:47.622520 28410 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:47.625031 28410 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:47.630805 22450 leader_election.cc:336] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:47.634140 22448 leader_election.cc:336] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:47.634665 22448 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:47.635532 28410 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:47.637368 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:47.638466 20640 tablet_replica.cc:333] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.639120 20640 raft_consensus.cc:2243] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.640125 20640 raft_consensus.cc:2272] T b50256b3ab294021ae20aa34053b59e1 P 6d698a5544b946939790e7a3972db9fb [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.642990 20640 tablet_replica.cc:333] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.643890 20640 raft_consensus.cc:2243] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.644968 20640 raft_consensus.cc:2272] T 3f7cb5d9283d4cf7969db82011d35ed9 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:47.648813 21877 consensus_peers.cc:597] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:47.650120 20640 tablet_replica.cc:333] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.650738 20640 raft_consensus.cc:2243] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.651201 20640 raft_consensus.cc:2272] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.653105 20640 tablet_replica.cc:333] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.653743 20640 raft_consensus.cc:2243] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.654412 20640 raft_consensus.cc:2272] T dee4ace3bc71491c9c9b19b0f5a8a667 P 6d698a5544b946939790e7a3972db9fb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.656431 20640 tablet_replica.cc:333] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.656994 20640 raft_consensus.cc:2243] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.657799 20640 raft_consensus.cc:2272] T f5bb431cadec4a5d9440b6c8743b7b47 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.659991 20640 tablet_replica.cc:333] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.660826 20640 raft_consensus.cc:2243] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.661353 20640 raft_consensus.cc:2272] T 71a084e9c0014661925a846711e7a18f P 6d698a5544b946939790e7a3972db9fb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.663674 20640 tablet_replica.cc:333] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.664280 20640 raft_consensus.cc:2243] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.665154 20640 raft_consensus.cc:2272] T 5e295b8b73874adcb77878c1ca4897ea P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.667192 20640 tablet_replica.cc:333] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.667747 20640 raft_consensus.cc:2243] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.668323 20640 raft_consensus.cc:2272] T 59340daad1394837bb0d56471ed8ce5a P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.670069 20640 tablet_replica.cc:333] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.670593 20640 raft_consensus.cc:2243] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.671007 20640 raft_consensus.cc:2272] T 0b8098340ee849cfae4a080cc2544e82 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.673619 20640 tablet_replica.cc:333] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.674458 20640 raft_consensus.cc:2243] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.675444 20640 raft_consensus.cc:2272] T 2b5c7b1a9d544cacaea74aa99eefa301 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.678166 20640 tablet_replica.cc:333] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.679041 20640 raft_consensus.cc:2243] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.679665 20640 raft_consensus.cc:2272] T a740500460ba465faaeb007be4b83108 P 6d698a5544b946939790e7a3972db9fb [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.682231 20640 tablet_replica.cc:333] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.683060 20640 raft_consensus.cc:2243] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.683692 20640 raft_consensus.cc:2272] T b0e72cc3f09a4d549ebd824be85955a3 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.684914 28428 raft_consensus.cc:493] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
W20260709 13:10:47.687309 21879 consensus_peers.cc:597] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:47.686180 20640 tablet_replica.cc:333] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.687435 28428 raft_consensus.cc:515] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:47.688584 20640 raft_consensus.cc:2243] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.689214 20640 raft_consensus.cc:2272] T af88ee4a85a24987b0c1513dd7ce39ed P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.691789 20640 tablet_replica.cc:333] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.692600 20640 raft_consensus.cc:2243] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.693127 20640 raft_consensus.cc:2272] T 45781e9b2110456fb03406d2393eff1d P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.695688 20640 tablet_replica.cc:333] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.696106 28411 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:47.696609 20640 raft_consensus.cc:2243] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.696633 28411 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:47.697705 20640 raft_consensus.cc:2272] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.699045 28411 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:47.703997 22448 leader_election.cc:336] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
W20260709 13:10:47.706665 22450 leader_election.cc:336] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:47.707710 22448 consensus_peers.cc:597] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:47.708144 28428 leader_election.cc:290] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:47.708742 22450 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:47.710100 21877 leader_election.cc:336] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:47.711174 20640 tablet_replica.cc:333] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.712057 20640 raft_consensus.cc:2243] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.712172 28411 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:10:47.713291 20640 raft_consensus.cc:2272] T 1969778971854d32a111e62af7be53fd P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.716575 20640 tablet_replica.cc:333] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.717631 20640 raft_consensus.cc:2243] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Raft consensus shutting down.
W20260709 13:10:47.716487 21879 leader_election.cc:336] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:47.718669 20640 raft_consensus.cc:2272] T 915629d8ce0e4452b6308425161f143a P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.718775 21879 leader_election.cc:304] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:47.719449 21879 raft_consensus.cc:2686] T c2c5cb2b121749798f01933921c01ed6 P 6d698a5544b946939790e7a3972db9fb: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:10:47.721566 20640 tablet_replica.cc:333] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.722390 20640 raft_consensus.cc:2243] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.723178 20640 raft_consensus.cc:2272] T d76fbf464db84dbeb90facb1538a9ca1 P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.725814 20640 tablet_replica.cc:333] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.726603 20640 raft_consensus.cc:2243] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.727706 20640 raft_consensus.cc:2272] T bfdda4b9a4f14b5c90c55134ebfd6303 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.732699 28437 raft_consensus.cc:493] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:47.732692 20640 tablet_replica.cc:333] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.733403 28437 raft_consensus.cc:515] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } }
I20260709 13:10:47.733971 20640 raft_consensus.cc:2243] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.734730 20640 raft_consensus.cc:2272] T ee8c1089f60b4e52ae7e434904d4d178 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.736645 28437 leader_election.cc:290] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:47.737568 20640 tablet_replica.cc:333] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.738471 20640 raft_consensus.cc:2243] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.739508 20640 raft_consensus.cc:2272] T 6c77d056b72142dbaf44be22749d2024 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.742302 20640 tablet_replica.cc:333] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
W20260709 13:10:47.742470 21877 leader_election.cc:336] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:47.743150 20640 raft_consensus.cc:2243] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.744227 20640 raft_consensus.cc:2272] T 26b137560d844f9bb07a8939c623b0f5 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:47.746356 21879 leader_election.cc:336] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:47.746821 21879 leader_election.cc:304] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d698a5544b946939790e7a3972db9fb; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:47.747928 28437 raft_consensus.cc:2749] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:47.749082 20640 tablet_replica.cc:333] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.749994 20640 raft_consensus.cc:2243] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.751094 20640 raft_consensus.cc:2272] T 7f2b8ba156604362aecf8501bef61de4 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:47.751260 22449 consensus_peers.cc:597] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:47.751998 22506 debug-util.cc:398] Leaking SignalData structure 0x7b0800213920 after lost signal to thread 20643
W20260709 13:10:47.753187 22506 debug-util.cc:398] Leaking SignalData structure 0x7b08003a8fc0 after lost signal to thread 21697
I20260709 13:10:47.753247 20640 tablet_replica.cc:333] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.754238 20640 raft_consensus.cc:2243] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Raft consensus shutting down.
W20260709 13:10:47.754619 22506 debug-util.cc:398] Leaking SignalData structure 0x7b08002e3460 after lost signal to thread 21938
I20260709 13:10:47.755267 20640 raft_consensus.cc:2272] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:47.755873 22506 debug-util.cc:398] Leaking SignalData structure 0x7b0800328780 after lost signal to thread 22509
I20260709 13:10:47.758038 20640 tablet_replica.cc:333] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.758968 20640 raft_consensus.cc:2243] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.760670 20640 raft_consensus.cc:2272] T afc4a5871719461787d91a97d59582af P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:47.767181 22449 consensus_peers.cc:597] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:47.768086 20640 tablet_replica.cc:333] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.769027 20640 raft_consensus.cc:2243] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.769816 20640 raft_consensus.cc:2272] T 6dd623bab71d4824b1463c6a5d774292 P 6d698a5544b946939790e7a3972db9fb [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:47.777532 22449 consensus_peers.cc:597] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:47.779961 20640 tablet_replica.cc:333] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.780895 20640 raft_consensus.cc:2243] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:47.781199 22448 consensus_peers.cc:597] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:47.781587 20640 raft_consensus.cc:2272] T 9d6d123916f54285a4a4b037399f46ec P 6d698a5544b946939790e7a3972db9fb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.784541 20640 tablet_replica.cc:333] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.785652 20640 raft_consensus.cc:2243] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.786249 20640 raft_consensus.cc:2272] T 667c64e212614c7ca822788e9d37fc29 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.789750 20640 tablet_replica.cc:333] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.799845 20640 raft_consensus.cc:2243] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.800472 20640 raft_consensus.cc:2272] T 3b18a570f5764b538a612ae89ef0327c P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.803191 20640 tablet_replica.cc:333] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.804066 20640 raft_consensus.cc:2243] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.805482 20640 raft_consensus.cc:2272] T 773a4e5c42d942629a59d30efb0870f6 P 6d698a5544b946939790e7a3972db9fb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.808230 20640 tablet_replica.cc:333] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
W20260709 13:10:47.818658 22449 consensus_peers.cc:597] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:47.821102 22450 consensus_peers.cc:597] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:47.809136 20640 raft_consensus.cc:2243] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.822789 20640 raft_consensus.cc:2272] T 291227c6f9914476b4363d40f7cfebb8 P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.827217 20640 tablet_replica.cc:333] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.829784 20640 raft_consensus.cc:2243] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.830628 20640 raft_consensus.cc:2272] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.834197 20640 tablet_replica.cc:333] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.834975 20640 raft_consensus.cc:2243] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.835606 20640 raft_consensus.cc:2272] T a0e492aa4394405bb48ed3b957dd8f23 P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.838205 20640 tablet_replica.cc:333] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.839004 20640 raft_consensus.cc:2243] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.840083 20640 raft_consensus.cc:2272] T 701ea15eb74f4429a9b47522314b79a7 P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.842993 20640 tablet_replica.cc:333] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.843803 20640 raft_consensus.cc:2243] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.844923 20640 raft_consensus.cc:2272] T 0ec128cbd4ca4f3daa63f2db9749837f P 6d698a5544b946939790e7a3972db9fb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.847592 20640 tablet_replica.cc:333] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.848443 20640 raft_consensus.cc:2243] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.849681 20640 raft_consensus.cc:2272] T d90ebc4155df4717946aa00672ba6697 P 6d698a5544b946939790e7a3972db9fb [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:47.855302 22449 consensus_peers.cc:597] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:47.860530 20640 tablet_replica.cc:333] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.862234 20640 raft_consensus.cc:2243] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.862964 20640 raft_consensus.cc:2272] T 9911866d06f94adfb20f8f0e0890dcd9 P 6d698a5544b946939790e7a3972db9fb [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.865833 20640 tablet_replica.cc:333] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.866649 20640 raft_consensus.cc:2243] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.867280 20640 raft_consensus.cc:2272] T b9d0d92d0fde44e8b0697570a1c2024e P 6d698a5544b946939790e7a3972db9fb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.877473 20640 tablet_replica.cc:333] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.878576 20640 raft_consensus.cc:2243] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.879732 20640 raft_consensus.cc:2272] T b87224fb843940c68eca74d28db8e73c P 6d698a5544b946939790e7a3972db9fb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.889539 20640 tablet_replica.cc:333] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.890455 20640 raft_consensus.cc:2243] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.891556 20640 raft_consensus.cc:2272] T 31c81db970e24298b014b6d17fb12a0e P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.894392 20640 tablet_replica.cc:333] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.895377 20640 raft_consensus.cc:2243] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.896008 20640 raft_consensus.cc:2272] T 5871b64f4d9b45f99140a286177ff44f P 6d698a5544b946939790e7a3972db9fb [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:47.908087 22450 consensus_peers.cc:597] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:10:47.926800 20640 tablet_replica.cc:333] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.927731 20640 raft_consensus.cc:2243] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.929191 20640 raft_consensus.cc:2272] T e76639c6d03a4a9697beddbec2ef6411 P 6d698a5544b946939790e7a3972db9fb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.950904 20640 tablet_replica.cc:333] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.951894 20640 raft_consensus.cc:2243] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.953451 20640 raft_consensus.cc:2272] T 4e45c5ba8a1f4b0c958677540c41b258 P 6d698a5544b946939790e7a3972db9fb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.956264 20640 tablet_replica.cc:333] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.957005 20640 raft_consensus.cc:2243] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:10:47.966490 20640 raft_consensus.cc:2272] T a860581d33304a09b6bd77ea24698076 P 6d698a5544b946939790e7a3972db9fb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:47.976392 20640 tablet_replica.cc:333] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb: stopping tablet replica
I20260709 13:10:47.977173 20640 raft_consensus.cc:2243] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:47.978193 20640 raft_consensus.cc:2272] T a0a14b69a1b542de81c41c50c191d109 P 6d698a5544b946939790e7a3972db9fb [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:47.984733 22449 consensus_peers.cc:597] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:48.004659 28410 raft_consensus.cc:493] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:48.005412 28410 raft_consensus.cc:515] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:48.009884 28410 leader_election.cc:290] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:48.021852 22448 leader_election.cc:336] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
W20260709 13:10:48.025939 22450 leader_election.cc:336] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:48.027400 22450 leader_election.cc:304] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:48.029603 28410 raft_consensus.cc:2749] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:48.039839 22449 consensus_peers.cc:597] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:48.044777 22449 consensus_peers.cc:597] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:48.054234 28410 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:48.054986 28410 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:48.062795 22448 leader_election.cc:336] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:48.069322 28410 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:48.088989 22449 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 577 similar messages]
W20260709 13:10:48.091177 22450 leader_election.cc:336] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:48.095363 22450 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:48.101137 28410 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:48.108393 22449 consensus_peers.cc:597] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:48.118950 22449 consensus_peers.cc:597] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:48.165728 22449 consensus_peers.cc:597] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:48.187973 28410 raft_consensus.cc:493] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:48.188730 28410 raft_consensus.cc:515] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } attrs { replace: true } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:48.199723 22448 leader_election.cc:336] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:48.203914 28410 leader_election.cc:290] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:48.214841 22449 leader_election.cc:336] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:10:48.219765 22449 leader_election.cc:304] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:48.223492 28410 raft_consensus.cc:2749] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:10:48.224859 22450 leader_election.cc:336] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:48.334589 28410 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:48.335170 28410 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:48.337337 28410 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:48.351943 22448 leader_election.cc:336] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
W20260709 13:10:48.358526 22450 leader_election.cc:336] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:48.359475 22450 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:48.361506 28410 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:48.387141 28410 raft_consensus.cc:493] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:48.387810 28410 raft_consensus.cc:515] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:48.391319 28410 leader_election.cc:290] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:48.395051 22450 leader_election.cc:336] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:48.400419 22448 leader_election.cc:336] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:48.400981 22448 leader_election.cc:304] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:48.402930 28411 raft_consensus.cc:2749] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:48.527944 22450 consensus_peers.cc:597] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:48.557629 22450 consensus_peers.cc:597] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:48.627270 28439 raft_consensus.cc:493] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:48.628113 28439 raft_consensus.cc:515] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:48.629947 28434 raft_consensus.cc:493] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:48.630504 28434 raft_consensus.cc:515] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:48.632617 28434 leader_election.cc:290] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
I20260709 13:10:48.634882 28439 leader_election.cc:290] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:48.642171 22448 leader_election.cc:336] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:48.661054 28434 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:48.661799 28434 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:48.664137 28434 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:48.677924 22449 leader_election.cc:336] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111)
W20260709 13:10:48.699038 22449 leader_election.cc:336] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111)
W20260709 13:10:48.702946 22450 leader_election.cc:336] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:48.713122 22450 leader_election.cc:304] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
W20260709 13:10:48.714385 22450 leader_election.cc:336] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:48.715349 22450 leader_election.cc:304] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:48.714916 28439 raft_consensus.cc:2749] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:10:48.717608 28411 raft_consensus.cc:2749] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:48.737728 22450 leader_election.cc:336] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:48.738262 22450 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:48.739879 28434 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:48.749562 21649 catalog_manager.cc:4755] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e76639c6d03a4a9697beddbec2ef6411: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:48.771562 22450 consensus_peers.cc:597] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:48.794974 28434 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:48.795619 28434 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:48.797884 28434 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:48.804214 22448 leader_election.cc:336] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
W20260709 13:10:48.812861 22449 leader_election.cc:336] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111)
I20260709 13:10:48.813380 22449 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:48.814179 28434 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:10:48.943064 28439 raft_consensus.cc:493] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:48.943606 28439 raft_consensus.cc:515] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:48.945789 28439 leader_election.cc:290] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:48.953189 22450 leader_election.cc:336] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:48.955667 22449 leader_election.cc:336] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111)
I20260709 13:10:48.956144 22449 leader_election.cc:304] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:48.956881 28439 raft_consensus.cc:2749] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:10:48.987910 28434 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:48.988418 28434 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:48.990265 28434 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:48.994222 22450 leader_election.cc:336] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:48.995759 22449 leader_election.cc:336] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111)
I20260709 13:10:48.996124 22449 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:48.996733 28434 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:49.027369 28434 raft_consensus.cc:493] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:49.027828 28434 raft_consensus.cc:515] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:49.029819 28434 leader_election.cc:290] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:49.035112 22449 leader_election.cc:336] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111)
W20260709 13:10:49.037264 22448 leader_election.cc:336] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:49.037714 22448 leader_election.cc:304] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:49.038290 28434 raft_consensus.cc:2749] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:10:49.047029 28434 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:49.047654 28434 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:49.049675 28434 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:49.054122 22450 leader_election.cc:336] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:49.054625 22449 leader_election.cc:336] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111)
I20260709 13:10:49.055055 22449 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:49.055716 28434 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:49.071408 28434 raft_consensus.cc:493] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:49.071904 28434 raft_consensus.cc:515] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:49.073825 28434 leader_election.cc:290] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:49.077296 22448 leader_election.cc:336] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
W20260709 13:10:49.080252 22449 leader_election.cc:336] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111)
I20260709 13:10:49.080718 22449 leader_election.cc:304] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:49.081522 28439 raft_consensus.cc:2749] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:49.089650 28434 raft_consensus.cc:493] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:49.090225 28434 raft_consensus.cc:515] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:49.092525 28434 leader_election.cc:290] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:49.098711 28434 raft_consensus.cc:493] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
W20260709 13:10:49.099287 22449 leader_election.cc:336] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111)
I20260709 13:10:49.099243 28434 raft_consensus.cc:515] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:49.101840 22450 leader_election.cc:336] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:49.102238 22450 leader_election.cc:304] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:49.103184 28410 raft_consensus.cc:2749] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:10:49.103511 28434 leader_election.cc:290] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:49.106108 22448 leader_election.cc:336] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:49.108013 28434 raft_consensus.cc:493] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:49.108611 28434 raft_consensus.cc:515] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
W20260709 13:10:49.110466 22449 leader_election.cc:336] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111)
I20260709 13:10:49.110942 22449 leader_election.cc:304] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:49.112867 28439 raft_consensus.cc:2749] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:10:49.114356 28434 leader_election.cc:290] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:49.118572 22448 leader_election.cc:336] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
W20260709 13:10:49.126622 22450 consensus_peers.cc:597] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:49.126747 22449 leader_election.cc:336] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111)
I20260709 13:10:49.127310 22449 leader_election.cc:304] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:49.128037 28410 raft_consensus.cc:2749] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:10:49.140360 22450 consensus_peers.cc:597] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:49.154433 22450 consensus_peers.cc:597] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:49.162676 28434 raft_consensus.cc:493] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:49.163183 28434 raft_consensus.cc:515] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:49.165132 28434 leader_election.cc:290] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:49.169226 22449 leader_election.cc:336] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111)
W20260709 13:10:49.170233 22448 leader_election.cc:336] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:49.170604 22448 leader_election.cc:304] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:49.171197 28434 raft_consensus.cc:2749] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:49.191484 22450 consensus_peers.cc:597] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:10:49.206815 28410 raft_consensus.cc:493] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:49.207437 28410 raft_consensus.cc:515] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:49.209462 28410 leader_election.cc:290] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:49.216424 22449 leader_election.cc:336] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111)
W20260709 13:10:49.216925 22448 leader_election.cc:336] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:49.217366 22448 leader_election.cc:304] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:49.218073 28410 raft_consensus.cc:2749] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:10:49.325973 28434 raft_consensus.cc:493] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:49.327589 28434 raft_consensus.cc:515] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:49.330838 28434 leader_election.cc:290] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:49.335812 22449 leader_election.cc:336] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111)
W20260709 13:10:49.336618 22448 leader_election.cc:336] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:49.337083 22448 leader_election.cc:304] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:49.337836 28434 raft_consensus.cc:2749] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:10:49.394867 20640 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 21935)
W20260709 13:10:49.536451 22450 consensus_peers.cc:597] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:49.549692 22450 consensus_peers.cc:597] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:49.644310 22450 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:46645, user_credentials={real_user=slave}} blocked reactor thread for 94710.5us
W20260709 13:10:49.649945 22448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:34765, user_credentials={real_user=slave}} blocked reactor thread for 105841us
W20260709 13:10:49.663460 22450 consensus_peers.cc:597] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:49.663986 22450 consensus_peers.cc:597] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:49.669054 22450 consensus_peers.cc:597] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:10:49.679551 22448 consensus_peers.cc:597] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:49.683002 22448 consensus_peers.cc:597] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:49.702056 22448 consensus_peers.cc:597] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:49.709476 22448 consensus_peers.cc:597] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:49.709955 22448 consensus_peers.cc:597] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:49.773257 22448 consensus_peers.cc:597] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:49.817258 22450 consensus_peers.cc:597] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:49.847568 28445 raft_consensus.cc:493] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:49.848258 28445 raft_consensus.cc:515] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:49.850349 28445 leader_election.cc:290] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:49.853982 22448 leader_election.cc:336] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
W20260709 13:10:49.854512 22450 leader_election.cc:336] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:49.854916 22450 leader_election.cc:304] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:49.855559 28445 raft_consensus.cc:2749] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:10:49.878412 22448 consensus_peers.cc:597] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:49.878897 22448 consensus_peers.cc:597] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:49.900941 22448 consensus_peers.cc:597] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:49.924137 22448 consensus_peers.cc:597] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:49.941413 22449 consensus_peers.cc:597] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:50.016923 22449 consensus_peers.cc:597] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:50.019203 22449 consensus_peers.cc:597] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:50.041592 22449 consensus_peers.cc:597] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:50.060714 22449 consensus_peers.cc:597] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:50.114662 22448 consensus_peers.cc:597] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:50.135689 22450 consensus_peers.cc:597] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:10:50.147279 22449 consensus_peers.cc:597] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:50.201848 22449 consensus_peers.cc:597] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:50.221591 28444 raft_consensus.cc:493] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:50.222198 28444 raft_consensus.cc:515] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:50.223943 28444 leader_election.cc:290] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:50.227557 22448 leader_election.cc:336] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
W20260709 13:10:50.228013 22450 leader_election.cc:336] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:50.228418 22450 leader_election.cc:304] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:50.229101 28444 raft_consensus.cc:2749] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:10:50.259336 22448 consensus_peers.cc:597] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:50.263321 22448 consensus_peers.cc:597] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Couldn't send request to peer 6fadfd81c5a645f1806a284ddbb6bf0d. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:10:50.266113 22449 consensus_peers.cc:597] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:50.320740 28444 raft_consensus.cc:493] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:50.321445 28444 raft_consensus.cc:515] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:50.323397 28444 leader_election.cc:290] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:50.327162 22450 leader_election.cc:336] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:50.327771 22448 leader_election.cc:336] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:50.328181 22448 leader_election.cc:304] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:50.328933 28444 raft_consensus.cc:2749] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:50.335330 22449 consensus_peers.cc:597] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:50.376989 20640 tablet_server.cc:196] TabletServer@127.20.40.3:0 shutdown complete.
I20260709 13:10:50.380997 28444 raft_consensus.cc:493] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:50.381857 28444 raft_consensus.cc:515] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:50.384372 28444 leader_election.cc:290] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:50.389312 22448 leader_election.cc:336] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
W20260709 13:10:50.389958 22449 leader_election.cc:336] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111)
I20260709 13:10:50.390527 22449 leader_election.cc:304] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 6d698a5544b946939790e7a3972db9fb, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:50.391743 28444 raft_consensus.cc:2749] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:10:50.409978 22449 consensus_peers.cc:597] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:10:50.422654 22449 consensus_peers.cc:597] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Couldn't send request to peer 6d698a5544b946939790e7a3972db9fb. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:10:50.440039 28445 raft_consensus.cc:493] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:50.440711 28445 raft_consensus.cc:515] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:50.443284 28445 leader_election.cc:290] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:50.447005 22450 leader_election.cc:336] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:50.447644 22449 leader_election.cc:336] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111)
I20260709 13:10:50.448113 22449 leader_election.cc:304] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:50.448879 28445 raft_consensus.cc:2749] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:10:50.492334 22450 consensus_peers.cc:597] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd -> Peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Couldn't send request to peer 3843e9b794a245dd8608e04ec7915239. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:10:50.511294 20640 tablet_server.cc:179] TabletServer@127.20.40.4:0 shutting down...
I20260709 13:10:50.521704 28445 raft_consensus.cc:493] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:50.522469 28445 raft_consensus.cc:515] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:50.525537 28445 leader_election.cc:290] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
W20260709 13:10:50.531821 22449 leader_election.cc:336] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111)
W20260709 13:10:50.532909 22450 leader_election.cc:336] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:50.533321 22450 leader_election.cc:304] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:50.534129 28444 raft_consensus.cc:2749] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:10:50.553709 21694 debug-util.cc:398] Leaking SignalData structure 0x7b080000a320 after lost signal to thread 20643
W20260709 13:10:50.554833 21694 debug-util.cc:398] Leaking SignalData structure 0x7b08002ce5e0 after lost signal to thread 21697
W20260709 13:10:50.556310 21694 debug-util.cc:398] Leaking SignalData structure 0x7b08000b0fc0 after lost signal to thread 22509
I20260709 13:10:50.576838 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:50.577818 20640 tablet_replica.cc:333] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.579349 20640 raft_consensus.cc:2243] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.580520 20640 raft_consensus.cc:2272] T e76639c6d03a4a9697beddbec2ef6411 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.583581 20640 tablet_replica.cc:333] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.584542 20640 raft_consensus.cc:2243] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.586267 20640 raft_consensus.cc:2272] T 59340daad1394837bb0d56471ed8ce5a P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.589956 20640 tablet_replica.cc:333] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.590739 20640 raft_consensus.cc:2243] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.591833 20640 raft_consensus.cc:2272] T a740500460ba465faaeb007be4b83108 P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.594468 20640 tablet_replica.cc:333] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.595199 20640 raft_consensus.cc:2243] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.596230 20640 raft_consensus.cc:2272] T 2b5c7b1a9d544cacaea74aa99eefa301 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.599161 20640 tablet_replica.cc:333] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.599831 20640 raft_consensus.cc:2243] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.600319 20640 raft_consensus.cc:2272] T 1dcda663ffc2447db5619b817e1c5078 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.603030 20640 tablet_replica.cc:333] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.603717 20640 raft_consensus.cc:2243] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.604673 20640 raft_consensus.cc:2272] T 915629d8ce0e4452b6308425161f143a P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.608001 28445 raft_consensus.cc:493] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6d698a5544b946939790e7a3972db9fb)
I20260709 13:10:50.608501 20640 tablet_replica.cc:333] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.608731 28445 raft_consensus.cc:515] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:50.609651 20640 raft_consensus.cc:2243] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.611052 20640 raft_consensus.cc:2272] T 6c77d056b72142dbaf44be22749d2024 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.614715 20640 tablet_replica.cc:333] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.615697 20640 raft_consensus.cc:2243] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEARNER]: Raft consensus shutting down.
W20260709 13:10:50.615839 22450 leader_election.cc:336] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:50.616269 20640 pending_rounds.cc:70] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd: Trying to abort 1 pending ops.
W20260709 13:10:50.616783 22449 leader_election.cc:336] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881): Network error: Client connection negotiation failed: client connection to 127.20.40.3:43881: connect: Connection refused (error 111)
I20260709 13:10:50.617288 22449 leader_election.cc:304] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6d698a5544b946939790e7a3972db9fb
I20260709 13:10:50.616616 20640 pending_rounds.cc:77] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd: Aborting op as it isn't in flight: id { term: 10 index: 7 } timestamp: 7305636224613511168 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "d28f4c429d54450dbbeb1ac9f6b7cd55" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } } new_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } attrs { replace: true } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "6d698a5544b946939790e7a3972db9fb" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 43881 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: NON_VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: true } } } }
I20260709 13:10:50.618084 28444 raft_consensus.cc:2749] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:50.618234 20640 raft_consensus.cc:2917] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEARNER]: Aborting config change with OpId 10.7: Aborted: Op aborted
I20260709 13:10:50.618167 28445 leader_election.cc:290] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6d698a5544b946939790e7a3972db9fb (127.20.40.3:43881)
I20260709 13:10:50.619035 20640 raft_consensus.cc:2889] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:10:50.619396 20640 raft_consensus.cc:2272] T d28f4c429d54450dbbeb1ac9f6b7cd55 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 NON_PARTICIPANT]: Raft consensus is shut down!
I20260709 13:10:50.622514 20640 tablet_replica.cc:333] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.623358 20640 raft_consensus.cc:2243] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.624078 20640 raft_consensus.cc:2272] T 5e295b8b73874adcb77878c1ca4897ea P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.627568 20640 tablet_replica.cc:333] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.628541 20640 raft_consensus.cc:2243] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.629788 20640 raft_consensus.cc:2272] T 1969778971854d32a111e62af7be53fd P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.632741 20640 tablet_replica.cc:333] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.633462 20640 raft_consensus.cc:2243] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.634773 20640 raft_consensus.cc:2272] T d76fbf464db84dbeb90facb1538a9ca1 P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.638190 20640 tablet_replica.cc:333] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.638900 20640 raft_consensus.cc:2243] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.639513 20640 raft_consensus.cc:2272] T 291227c6f9914476b4363d40f7cfebb8 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.642918 20640 tablet_replica.cc:333] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.644014 20640 raft_consensus.cc:2243] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.645466 20640 raft_consensus.cc:2272] T b0e72cc3f09a4d549ebd824be85955a3 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.649253 20640 tablet_replica.cc:333] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.650307 20640 raft_consensus.cc:2243] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.651098 20640 raft_consensus.cc:2272] T bfdda4b9a4f14b5c90c55134ebfd6303 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.654170 20640 tablet_replica.cc:333] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.654770 20640 raft_consensus.cc:2243] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.655449 20640 raft_consensus.cc:2272] T b50256b3ab294021ae20aa34053b59e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.657857 20640 tablet_replica.cc:333] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.658432 20640 raft_consensus.cc:2243] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.659580 20640 raft_consensus.cc:2272] T 6dd623bab71d4824b1463c6a5d774292 P 8c6c2207af3d47b3acf352d81959f4dd [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.662241 20640 tablet_replica.cc:333] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.663021 20640 raft_consensus.cc:2243] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.664183 20640 raft_consensus.cc:2272] T a0e492aa4394405bb48ed3b957dd8f23 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.667006 20640 tablet_replica.cc:333] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.667732 20640 raft_consensus.cc:2243] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.668960 20640 raft_consensus.cc:2272] T 46dafcc946c640c6a029dd71c387264e P 8c6c2207af3d47b3acf352d81959f4dd [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.672014 20640 tablet_replica.cc:333] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.672952 20640 raft_consensus.cc:2243] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.674239 20640 raft_consensus.cc:2272] T 772d060b63de449b996b0ddc91936bcd P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.677487 20640 tablet_replica.cc:333] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.678170 20640 raft_consensus.cc:2243] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.678856 20640 raft_consensus.cc:2272] T 0ec128cbd4ca4f3daa63f2db9749837f P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.681223 20640 tablet_replica.cc:333] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.681895 20640 raft_consensus.cc:2243] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.682758 20640 raft_consensus.cc:2272] T 0564e1a5f9d940fa9d28c8d27271a4c5 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.685583 20640 tablet_replica.cc:333] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.686156 20640 raft_consensus.cc:2243] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.686729 20640 raft_consensus.cc:2272] T 8f23d2bb6e7e4e44b828b7f7ede73841 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.689112 20640 tablet_replica.cc:333] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.689857 20640 raft_consensus.cc:2243] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.691099 20640 raft_consensus.cc:2272] T 7e7bb11958aa45b0a1f77b20c2e9a6e5 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.691738 28445 raft_consensus.cc:493] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6fadfd81c5a645f1806a284ddbb6bf0d)
I20260709 13:10:50.692453 28445 raft_consensus.cc:515] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "3843e9b794a245dd8608e04ec7915239" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 46645 } } peers { permanent_uuid: "6fadfd81c5a645f1806a284ddbb6bf0d" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 34765 } } peers { permanent_uuid: "8c6c2207af3d47b3acf352d81959f4dd" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 37983 } attrs { promote: false } }
I20260709 13:10:50.694274 20640 tablet_replica.cc:333] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.695154 20640 raft_consensus.cc:2243] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.695984 20640 raft_consensus.cc:2272] T 7f2b8ba156604362aecf8501bef61de4 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.698946 20640 tablet_replica.cc:333] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.699846 20640 raft_consensus.cc:2243] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.700047 28445 leader_election.cc:290] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645), 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765)
W20260709 13:10:50.700595 22448 leader_election.cc:336] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:10:50.701604 20640 raft_consensus.cc:2272] T dee4ace3bc71491c9c9b19b0f5a8a667 P 8c6c2207af3d47b3acf352d81959f4dd [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:50.704286 22450 leader_election.cc:336] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
I20260709 13:10:50.704720 22450 leader_election.cc:304] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8c6c2207af3d47b3acf352d81959f4dd; no voters: 3843e9b794a245dd8608e04ec7915239, 6fadfd81c5a645f1806a284ddbb6bf0d
I20260709 13:10:50.705394 28445 raft_consensus.cc:2749] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:10:50.705628 20640 tablet_replica.cc:333] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.706745 20640 raft_consensus.cc:2243] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.707945 20640 raft_consensus.cc:2272] T 71a084e9c0014661925a846711e7a18f P 8c6c2207af3d47b3acf352d81959f4dd [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.711010 20640 tablet_replica.cc:333] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.711818 20640 raft_consensus.cc:2243] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.713091 20640 raft_consensus.cc:2272] T c7fc47e7b4534569b3d46ad6ddc619d5 P 8c6c2207af3d47b3acf352d81959f4dd [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.716022 20640 tablet_replica.cc:333] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.716850 20640 raft_consensus.cc:2243] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.718173 20640 raft_consensus.cc:2272] T 0b8098340ee849cfae4a080cc2544e82 P 8c6c2207af3d47b3acf352d81959f4dd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.721136 20640 tablet_replica.cc:333] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.721937 20640 raft_consensus.cc:2243] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.723256 20640 raft_consensus.cc:2272] T 5871b64f4d9b45f99140a286177ff44f P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.725948 20640 tablet_replica.cc:333] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.726784 20640 raft_consensus.cc:2243] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.727532 20640 raft_consensus.cc:2272] T 3f7cb5d9283d4cf7969db82011d35ed9 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.730460 20640 tablet_replica.cc:333] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.731244 20640 raft_consensus.cc:2243] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.731912 20640 raft_consensus.cc:2272] T c096033d73b64750a7e09d89d0a70c7b P 8c6c2207af3d47b3acf352d81959f4dd [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.735658 20640 tablet_replica.cc:333] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.736487 20640 raft_consensus.cc:2243] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.737568 20640 raft_consensus.cc:2272] T c6406f8b01c041c58abe3add218f6b41 P 8c6c2207af3d47b3acf352d81959f4dd [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.740916 20640 tablet_replica.cc:333] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.741688 20640 raft_consensus.cc:2243] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.742895 20640 raft_consensus.cc:2272] T 3b18a570f5764b538a612ae89ef0327c P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.745816 20640 tablet_replica.cc:333] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.746682 20640 raft_consensus.cc:2243] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.747494 20640 raft_consensus.cc:2272] T 3cde61de02cf40daa7e584ca0a574c26 P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.750640 20640 tablet_replica.cc:333] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.751391 20640 raft_consensus.cc:2243] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.752588 20640 raft_consensus.cc:2272] T 2da934436fc940e6abc7519a767e11a7 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.755482 20640 tablet_replica.cc:333] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.756281 20640 raft_consensus.cc:2243] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.757532 20640 raft_consensus.cc:2272] T 667c64e212614c7ca822788e9d37fc29 P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.760651 20640 tablet_replica.cc:333] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.761572 20640 raft_consensus.cc:2243] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.763062 20640 raft_consensus.cc:2272] T b9d0d92d0fde44e8b0697570a1c2024e P 8c6c2207af3d47b3acf352d81959f4dd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.766397 20640 tablet_replica.cc:333] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.767181 20640 raft_consensus.cc:2243] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.768432 20640 raft_consensus.cc:2272] T 9911866d06f94adfb20f8f0e0890dcd9 P 8c6c2207af3d47b3acf352d81959f4dd [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.771435 20640 tablet_replica.cc:333] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.772261 20640 raft_consensus.cc:2243] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.774009 20640 raft_consensus.cc:2272] T 773a4e5c42d942629a59d30efb0870f6 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.777230 20640 tablet_replica.cc:333] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.777963 20640 raft_consensus.cc:2243] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.778604 20640 raft_consensus.cc:2272] T a218be1e72294b138c21b46dfa317d11 P 8c6c2207af3d47b3acf352d81959f4dd [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.781740 20640 tablet_replica.cc:333] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.782459 20640 raft_consensus.cc:2243] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.783548 20640 raft_consensus.cc:2272] T 3b27c43ce1954bb1ad1f8a4e30f76005 P 8c6c2207af3d47b3acf352d81959f4dd [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.786257 20640 tablet_replica.cc:333] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.786953 20640 raft_consensus.cc:2243] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.788206 20640 raft_consensus.cc:2272] T ab7de8b45d37410487e1759ba66727e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.791286 20640 tablet_replica.cc:333] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.791992 20640 raft_consensus.cc:2243] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.792646 20640 raft_consensus.cc:2272] T 2141d5426fcc4d348541c5ff6e33b6e1 P 8c6c2207af3d47b3acf352d81959f4dd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.795358 20640 tablet_replica.cc:333] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.796077 20640 raft_consensus.cc:2243] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.797142 20640 raft_consensus.cc:2272] T 4e45c5ba8a1f4b0c958677540c41b258 P 8c6c2207af3d47b3acf352d81959f4dd [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.800487 20640 tablet_replica.cc:333] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.801132 20640 raft_consensus.cc:2243] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:50.801925 20640 raft_consensus.cc:2272] T 7b32fdbf1d5847cb8bb918426813576d P 8c6c2207af3d47b3acf352d81959f4dd [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:50.804661 20640 tablet_replica.cc:333] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd: stopping tablet replica
I20260709 13:10:50.805310 20640 raft_consensus.cc:2243] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:10:50.806447 20640 raft_consensus.cc:2272] T af88ee4a85a24987b0c1513dd7ce39ed P 8c6c2207af3d47b3acf352d81959f4dd [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:51.172084 20640 tablet_server.cc:196] TabletServer@127.20.40.4:0 shutdown complete.
I20260709 13:10:51.255425 20640 master.cc:562] Master@127.20.40.62:38057 shutting down...
W20260709 13:10:54.543119 21649 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111) [suppressed 284 similar messages]
W20260709 13:10:54.546365 21649 catalog_manager.cc:4755] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 1969778971854d32a111e62af7be53fd: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:10:56.967140 21649 catalog_manager.cc:4755] TS 3843e9b794a245dd8608e04ec7915239 (127.20.40.1:46645): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet e76639c6d03a4a9697beddbec2ef6411: Network error: Client connection negotiation failed: client connection to 127.20.40.1:46645: connect: Connection refused (error 111)
W20260709 13:11:16.209885 21647 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260709 13:11:16.214092 21647 catalog_manager.cc:4755] TS 6fadfd81c5a645f1806a284ddbb6bf0d (127.20.40.2:34765): ChangeConfig:REMOVE_PEER RPC failed for tablet 291227c6f9914476b4363d40f7cfebb8: Network error: Client connection negotiation failed: client connection to 127.20.40.2:34765: connect: Connection refused (error 111)
I20260709 13:11:17.846316 20640 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:17.847380 20640 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:17.847756 20640 tablet_replica.cc:333] T 00000000000000000000000000000000 P ff36b0eb624c458eb7f542eb2e635aa2: stopping tablet replica
I20260709 13:11:18.096853 20640 master.cc:584] Master@127.20.40.62:38057 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (234062 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:11:18.213217 20640 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.40.62:37793
I20260709 13:11:18.214561 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:18.220592 28456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:18.221912 28457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:18.222429 28459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:18.222906 20640 server_base.cc:1061] running on GCE node
I20260709 13:11:18.226328 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:18.226528 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:18.226717 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602678226702 us; error 0 us; skew 500 ppm
I20260709 13:11:18.227304 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:18.229890 20640 webserver.cc:533] Webserver started at http://127.20.40.62:44289/ using document root <none> and password file <none>
I20260709 13:11:18.230422 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:18.230611 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:18.230904 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:18.232216 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/master-0-root/instance:
uuid: "7b75aaa61fbe45d7bb4ff584eac755ae"
format_stamp: "Formatted at 2026-07-09 13:11:18 on dist-test-slave-rnv4"
I20260709 13:11:18.239133 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.001s	sys 0.008s
I20260709 13:11:18.243228 28464 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.244040 20640 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:11:18.244455 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/master-0-root
uuid: "7b75aaa61fbe45d7bb4ff584eac755ae"
format_stamp: "Formatted at 2026-07-09 13:11:18 on dist-test-slave-rnv4"
I20260709 13:11:18.244778 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:18.288057 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:18.289422 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:18.335803 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.62:37793
I20260709 13:11:18.335884 28515 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.62:37793 every 8 connection(s)
I20260709 13:11:18.340454 28516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:18.352008 28516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae: Bootstrap starting.
I20260709 13:11:18.357021 28516 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:18.361596 28516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae: No bootstrap required, opened a new log
I20260709 13:11:18.364220 28516 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b75aaa61fbe45d7bb4ff584eac755ae" member_type: VOTER }
I20260709 13:11:18.364740 28516 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:18.365070 28516 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b75aaa61fbe45d7bb4ff584eac755ae, State: Initialized, Role: FOLLOWER
I20260709 13:11:18.365899 28516 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b75aaa61fbe45d7bb4ff584eac755ae" member_type: VOTER }
I20260709 13:11:18.366531 28516 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:18.366777 28516 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:18.367090 28516 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:18.371625 28516 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b75aaa61fbe45d7bb4ff584eac755ae" member_type: VOTER }
I20260709 13:11:18.372193 28516 leader_election.cc:304] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b75aaa61fbe45d7bb4ff584eac755ae; no voters: 
I20260709 13:11:18.373459 28516 leader_election.cc:290] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:18.373970 28519 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:18.375360 28519 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae [term 1 LEADER]: Becoming Leader. State: Replica: 7b75aaa61fbe45d7bb4ff584eac755ae, State: Running, Role: LEADER
I20260709 13:11:18.376109 28519 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b75aaa61fbe45d7bb4ff584eac755ae" member_type: VOTER }
I20260709 13:11:18.376519 28516 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:18.383288 28521 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b75aaa61fbe45d7bb4ff584eac755ae. Latest consensus state: current_term: 1 leader_uuid: "7b75aaa61fbe45d7bb4ff584eac755ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b75aaa61fbe45d7bb4ff584eac755ae" member_type: VOTER } }
I20260709 13:11:18.383567 28520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b75aaa61fbe45d7bb4ff584eac755ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b75aaa61fbe45d7bb4ff584eac755ae" member_type: VOTER } }
I20260709 13:11:18.384012 28521 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:18.384140 28520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:18.386278 28529 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:18.392458 28529 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:18.393504 20640 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:18.402922 28529 catalog_manager.cc:1383] Generated new cluster ID: 2f7cffd384c3456b91f9c24a1eff4ccf
I20260709 13:11:18.403267 28529 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:18.428869 28529 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:18.430434 28529 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:18.453673 28529 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae: Generated new TSK 0
I20260709 13:11:18.454357 28529 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:18.460042 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:18.467042 28537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:18.467561 28538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:18.469403 28540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:18.471021 20640 server_base.cc:1061] running on GCE node
I20260709 13:11:18.474320 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:18.474597 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:18.474828 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602678474806 us; error 0 us; skew 500 ppm
I20260709 13:11:18.475620 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:18.478965 20640 webserver.cc:533] Webserver started at http://127.20.40.1:43083/ using document root <none> and password file <none>
I20260709 13:11:18.479497 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:18.479702 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:18.480005 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:18.481231 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-0-root/instance:
uuid: "44a14c00fc3d41bea8db00310408905a"
format_stamp: "Formatted at 2026-07-09 13:11:18 on dist-test-slave-rnv4"
I20260709 13:11:18.486300 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:11:18.490093 28545 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.491357 20640 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:11:18.491688 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-0-root
uuid: "44a14c00fc3d41bea8db00310408905a"
format_stamp: "Formatted at 2026-07-09 13:11:18 on dist-test-slave-rnv4"
I20260709 13:11:18.492015 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:18.514524 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:18.515806 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:18.517367 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:18.520030 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:18.520263 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.520520 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:18.520705 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.566794 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.1:44075
I20260709 13:11:18.566900 28607 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.1:44075 every 8 connection(s)
I20260709 13:11:18.572424 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:18.580981 28612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:18.583047 28613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:18.586705 28615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:18.587643 20640 server_base.cc:1061] running on GCE node
I20260709 13:11:18.590011 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:18.590317 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:18.590528 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602678590506 us; error 0 us; skew 500 ppm
I20260709 13:11:18.591351 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:18.593489 28608 heartbeater.cc:344] Connected to a master server at 127.20.40.62:37793
I20260709 13:11:18.593971 28608 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:18.594303 20640 webserver.cc:533] Webserver started at http://127.20.40.2:36317/ using document root <none> and password file <none>
I20260709 13:11:18.594866 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:18.594883 28608 heartbeater.cc:507] Master 127.20.40.62:37793 requested a full tablet report, sending...
I20260709 13:11:18.595185 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:18.595566 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:18.597133 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-1-root/instance:
uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
format_stamp: "Formatted at 2026-07-09 13:11:18 on dist-test-slave-rnv4"
I20260709 13:11:18.597630 28481 ts_manager.cc:194] Registered new tserver with Master: 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:18.599578 28481 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37772
I20260709 13:11:18.602486 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:11:18.606642 28620 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.607604 20640 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:11:18.607969 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-1-root
uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
format_stamp: "Formatted at 2026-07-09 13:11:18 on dist-test-slave-rnv4"
I20260709 13:11:18.608266 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:18.631433 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:18.632747 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:18.634441 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:18.636857 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:18.637092 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.637352 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:18.637554 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:11:18.682521 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.2:43021
I20260709 13:11:18.682658 28682 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.2:43021 every 8 connection(s)
I20260709 13:11:18.687646 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:18.696125 28686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:18.696260 28687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:18.699344 28689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:18.700479 20640 server_base.cc:1061] running on GCE node
I20260709 13:11:18.701578 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:18.701874 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:18.702086 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602678702068 us; error 0 us; skew 500 ppm
I20260709 13:11:18.702723 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:18.703162 28683 heartbeater.cc:344] Connected to a master server at 127.20.40.62:37793
I20260709 13:11:18.703572 28683 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:18.704519 28683 heartbeater.cc:507] Master 127.20.40.62:37793 requested a full tablet report, sending...
I20260709 13:11:18.705550 20640 webserver.cc:533] Webserver started at http://127.20.40.3:45645/ using document root <none> and password file <none>
I20260709 13:11:18.706255 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:18.706426 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:18.706732 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:18.706977 28481 ts_manager.cc:194] Registered new tserver with Master: bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:18.708025 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-2-root/instance:
uuid: "a1515f1138af4333a63996f5d0864d85"
format_stamp: "Formatted at 2026-07-09 13:11:18 on dist-test-slave-rnv4"
I20260709 13:11:18.708492 28481 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37786
I20260709 13:11:18.713548 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:11:18.717054 28694 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.717950 20640 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:11:18.718259 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-2-root
uuid: "a1515f1138af4333a63996f5d0864d85"
format_stamp: "Formatted at 2026-07-09 13:11:18 on dist-test-slave-rnv4"
I20260709 13:11:18.718561 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:18.732832 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:18.734170 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:18.735743 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:18.738055 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:18.738284 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.738531 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:18.738711 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.782470 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.3:41711
I20260709 13:11:18.782601 28756 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.3:41711 every 8 connection(s)
I20260709 13:11:18.788219 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:18.796768 28760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:18.798111 28761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:18.799774 28763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:18.801661 28757 heartbeater.cc:344] Connected to a master server at 127.20.40.62:37793
I20260709 13:11:18.802134 28757 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:18.803012 28757 heartbeater.cc:507] Master 127.20.40.62:37793 requested a full tablet report, sending...
I20260709 13:11:18.803508 20640 server_base.cc:1061] running on GCE node
I20260709 13:11:18.804800 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:18.805058 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:18.805277 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602678805261 us; error 0 us; skew 500 ppm
I20260709 13:11:18.805629 28481 ts_manager.cc:194] Registered new tserver with Master: a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:18.805922 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:18.807224 28481 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37792
I20260709 13:11:18.809257 20640 webserver.cc:533] Webserver started at http://127.20.40.4:45357/ using document root <none> and password file <none>
I20260709 13:11:18.809854 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:18.810056 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:18.810423 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:18.811614 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-3-root/instance:
uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
format_stamp: "Formatted at 2026-07-09 13:11:18 on dist-test-slave-rnv4"
I20260709 13:11:18.816371 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:11:18.820454 28768 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.821486 20640 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:11:18.821816 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-3-root
uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
format_stamp: "Formatted at 2026-07-09 13:11:18 on dist-test-slave-rnv4"
I20260709 13:11:18.822088 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:18.840322 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:18.841719 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:18.843262 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:18.845604 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:18.845850 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.846119 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:18.846297 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:18.891242 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.4:43597
I20260709 13:11:18.891336 28830 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.4:43597 every 8 connection(s)
I20260709 13:11:18.906620 28831 heartbeater.cc:344] Connected to a master server at 127.20.40.62:37793
I20260709 13:11:18.907059 28831 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:18.907941 28831 heartbeater.cc:507] Master 127.20.40.62:37793 requested a full tablet report, sending...
I20260709 13:11:18.910243 28481 ts_manager.cc:194] Registered new tserver with Master: b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:18.911194 20640 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016420557s
I20260709 13:11:18.911723 28481 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37802
I20260709 13:11:18.940645 28481 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37808:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:11:19.184710 28648 tablet_service.cc:1511] Processing CreateTablet for tablet 857ee7ea2ffe41cf9ed43a455e52901f (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:11:19.186697 28648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 857ee7ea2ffe41cf9ed43a455e52901f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.189316 28646 tablet_service.cc:1511] Processing CreateTablet for tablet 5951a1590104426cae727db543f49a83 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:11:19.191363 28646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5951a1590104426cae727db543f49a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.194308 28647 tablet_service.cc:1511] Processing CreateTablet for tablet 2988b7e9dc0942a69ce7dcb8db26ca27 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:11:19.194959 28645 tablet_service.cc:1511] Processing CreateTablet for tablet 0d12b4ce21794192969d6609d0ea4d69 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:11:19.195915 28647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2988b7e9dc0942a69ce7dcb8db26ca27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.196589 28645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d12b4ce21794192969d6609d0ea4d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.196497 28644 tablet_service.cc:1511] Processing CreateTablet for tablet d706fb62a0a7423ca484455f75a16592 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:11:19.197962 28644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d706fb62a0a7423ca484455f75a16592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.201951 28643 tablet_service.cc:1511] Processing CreateTablet for tablet d69a0e6ca32e4d8080aed2fe4405d7f5 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:11:19.203415 28643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d69a0e6ca32e4d8080aed2fe4405d7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.211308 28642 tablet_service.cc:1511] Processing CreateTablet for tablet 51806e14724e4433b368faa0c997a11e (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:11:19.212832 28642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51806e14724e4433b368faa0c997a11e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.217538 28641 tablet_service.cc:1511] Processing CreateTablet for tablet f5d51007007a4252908beaaaa3ee8374 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:11:19.219049 28641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d51007007a4252908beaaaa3ee8374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.231236 28640 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea260fc2f384cd7a7f947d2bf8cb49b (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:11:19.232810 28640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea260fc2f384cd7a7f947d2bf8cb49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.235235 28639 tablet_service.cc:1511] Processing CreateTablet for tablet 59ba7b5c67b14fcba09e4e6cd16fa09b (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:11:19.236801 28639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ba7b5c67b14fcba09e4e6cd16fa09b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.242369 28848 tablet_bootstrap.cc:492] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:19.244071 28647 tablet_service.cc:1511] Processing CreateTablet for tablet f0c32a52cb724ba28e6fc6c8cf8e9a88 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:11:19.245568 28647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c32a52cb724ba28e6fc6c8cf8e9a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.252547 28645 tablet_service.cc:1511] Processing CreateTablet for tablet b572160c667242bfbd4ece3e3f26f505 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:11:19.254027 28645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b572160c667242bfbd4ece3e3f26f505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.270953 28646 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff91a748d3f464ab00fc3e657057d73 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:11:19.272409 28646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff91a748d3f464ab00fc3e657057d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.277127 28848 tablet_bootstrap.cc:654] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.284502 28639 tablet_service.cc:1511] Processing CreateTablet for tablet b07d8385470b4fc285eb6703e6fa42b9 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:11:19.285928 28639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07d8385470b4fc285eb6703e6fa42b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.295359 28722 tablet_service.cc:1511] Processing CreateTablet for tablet 857ee7ea2ffe41cf9ed43a455e52901f (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:11:19.297003 28722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 857ee7ea2ffe41cf9ed43a455e52901f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.302987 28721 tablet_service.cc:1511] Processing CreateTablet for tablet f828b4ae5c2846c5a49f1212f73186f0 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:11:19.304862 28721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f828b4ae5c2846c5a49f1212f73186f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.310748 28573 tablet_service.cc:1511] Processing CreateTablet for tablet 857ee7ea2ffe41cf9ed43a455e52901f (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:11:19.312867 28573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 857ee7ea2ffe41cf9ed43a455e52901f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.315342 28572 tablet_service.cc:1511] Processing CreateTablet for tablet 2988b7e9dc0942a69ce7dcb8db26ca27 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:11:19.323341 28572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2988b7e9dc0942a69ce7dcb8db26ca27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.363747 28796 tablet_service.cc:1511] Processing CreateTablet for tablet 2988b7e9dc0942a69ce7dcb8db26ca27 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:11:19.365154 28570 tablet_service.cc:1511] Processing CreateTablet for tablet 0d12b4ce21794192969d6609d0ea4d69 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:11:19.366848 28565 tablet_service.cc:1511] Processing CreateTablet for tablet d1f041b85d184414b3939425b35e4a1c (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:11:19.367934 28568 tablet_service.cc:1511] Processing CreateTablet for tablet eb534ab2fc824a7abb24883eb39d17dc (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:11:19.363864 28569 tablet_service.cc:1511] Processing CreateTablet for tablet d706fb62a0a7423ca484455f75a16592 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:11:19.363747 28571 tablet_service.cc:1511] Processing CreateTablet for tablet f828b4ae5c2846c5a49f1212f73186f0 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:11:19.370697 28567 tablet_service.cc:1511] Processing CreateTablet for tablet 51806e14724e4433b368faa0c997a11e (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:11:19.368438 28796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2988b7e9dc0942a69ce7dcb8db26ca27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.371177 28720 tablet_service.cc:1511] Processing CreateTablet for tablet 5951a1590104426cae727db543f49a83 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:11:19.372822 28720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5951a1590104426cae727db543f49a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.373399 28566 tablet_service.cc:1511] Processing CreateTablet for tablet f5d51007007a4252908beaaaa3ee8374 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:11:19.375417 28570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d12b4ce21794192969d6609d0ea4d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.377898 28569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d706fb62a0a7423ca484455f75a16592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.378724 28566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d51007007a4252908beaaaa3ee8374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.379504 28565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f041b85d184414b3939425b35e4a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.380318 28568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb534ab2fc824a7abb24883eb39d17dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.385871 28571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f828b4ae5c2846c5a49f1212f73186f0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:19.388326 28528 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:19.389322 28567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51806e14724e4433b368faa0c997a11e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.310779 28644 tablet_service.cc:1511] Processing CreateTablet for tablet 841b18d7f11c485bba96eda7dce0c27e (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:11:19.395617 28644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841b18d7f11c485bba96eda7dce0c27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.400043 28719 tablet_service.cc:1511] Processing CreateTablet for tablet 0d12b4ce21794192969d6609d0ea4d69 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:11:19.401613 28719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d12b4ce21794192969d6609d0ea4d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.406654 28848 tablet_bootstrap.cc:492] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:19.407239 28848 ts_tablet_manager.cc:1403] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.165s	user 0.012s	sys 0.010s
I20260709 13:11:19.425832 28718 tablet_service.cc:1511] Processing CreateTablet for tablet eb534ab2fc824a7abb24883eb39d17dc (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:11:19.427556 28718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb534ab2fc824a7abb24883eb39d17dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.430208 28717 tablet_service.cc:1511] Processing CreateTablet for tablet d69a0e6ca32e4d8080aed2fe4405d7f5 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:11:19.432425 28717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d69a0e6ca32e4d8080aed2fe4405d7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.443926 28716 tablet_service.cc:1511] Processing CreateTablet for tablet 51806e14724e4433b368faa0c997a11e (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:11:19.446890 28715 tablet_service.cc:1511] Processing CreateTablet for tablet d1f041b85d184414b3939425b35e4a1c (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:11:19.449972 28714 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea260fc2f384cd7a7f947d2bf8cb49b (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:11:19.452775 28713 tablet_service.cc:1511] Processing CreateTablet for tablet 59ba7b5c67b14fcba09e4e6cd16fa09b (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:11:19.454537 28848 raft_consensus.cc:359] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:19.455367 28848 raft_consensus.cc:385] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.455668 28848 raft_consensus.cc:740] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.455895 28716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51806e14724e4433b368faa0c997a11e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.456453 28848 consensus_queue.cc:260] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:19.458462 28639 tablet_service.cc:1511] Processing CreateTablet for tablet f52ad167603d40ada7680f844e2e59c8 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:11:19.459764 28639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52ad167603d40ada7680f844e2e59c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.461867 28713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ba7b5c67b14fcba09e4e6cd16fa09b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.462668 28648 tablet_service.cc:1511] Processing CreateTablet for tablet 452914c1abfd43389431daaf7ebee1c0 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:11:19.463995 28648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452914c1abfd43389431daaf7ebee1c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.465121 28715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f041b85d184414b3939425b35e4a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.465550 28645 tablet_service.cc:1511] Processing CreateTablet for tablet a726976321d04177a6d77e9ef0041f3f (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:11:19.470567 28645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a726976321d04177a6d77e9ef0041f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.467481 28714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea260fc2f384cd7a7f947d2bf8cb49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.481585 28647 tablet_service.cc:1511] Processing CreateTablet for tablet c0093a1dad264ec1b3d9d3f896262ff7 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:11:19.483050 28647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0093a1dad264ec1b3d9d3f896262ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.494992 28641 tablet_service.cc:1511] Processing CreateTablet for tablet 47110731ce12413ab60b16f034fdceb3 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:11:19.496423 28640 tablet_service.cc:1511] Processing CreateTablet for tablet e876ee31f15e4349b3086338a4d5f288 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:11:19.473172 28642 tablet_service.cc:1511] Processing CreateTablet for tablet ce8eab4cd5b64393b62a304011e5b22d (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:11:19.499214 28640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e876ee31f15e4349b3086338a4d5f288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.499030 28643 tablet_service.cc:1511] Processing CreateTablet for tablet 1e4d79b8251f445ba4ee93c33bb13df3 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:11:19.500351 28643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e4d79b8251f445ba4ee93c33bb13df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.501315 28641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47110731ce12413ab60b16f034fdceb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.502553 28646 tablet_service.cc:1511] Processing CreateTablet for tablet 46835248ab9d4f43908a6c6a42642ba1 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:11:19.503981 28646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46835248ab9d4f43908a6c6a42642ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.511314 28852 tablet_bootstrap.cc:492] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:19.511286 28848 ts_tablet_manager.cc:1434] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.104s	user 0.008s	sys 0.002s
I20260709 13:11:19.513523 28853 tablet_bootstrap.cc:492] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:19.543192 28564 tablet_service.cc:1511] Processing CreateTablet for tablet 19240a871550411aafbc885984ade97d (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:11:19.547163 28570 tablet_service.cc:1511] Processing CreateTablet for tablet f0c32a52cb724ba28e6fc6c8cf8e9a88 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:11:19.550094 28642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce8eab4cd5b64393b62a304011e5b22d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.567443 28567 tablet_service.cc:1511] Processing CreateTablet for tablet 59ba7b5c67b14fcba09e4e6cd16fa09b (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:11:19.570861 28683 heartbeater.cc:499] Master 127.20.40.62:37793 was elected leader, sending a full tablet report...
I20260709 13:11:19.593768 28570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c32a52cb724ba28e6fc6c8cf8e9a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.598006 28720 tablet_service.cc:1511] Processing CreateTablet for tablet 19240a871550411aafbc885984ade97d (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:11:19.600250 28720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19240a871550411aafbc885984ade97d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.603307 28608 heartbeater.cc:499] Master 127.20.40.62:37793 was elected leader, sending a full tablet report...
I20260709 13:11:19.611732 28848 tablet_bootstrap.cc:492] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:19.615038 28794 tablet_service.cc:1511] Processing CreateTablet for tablet 5951a1590104426cae727db543f49a83 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:11:19.617072 28794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5951a1590104426cae727db543f49a83. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:19.617143 28468 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.40.2:43021, user_credentials={real_user=slave}} blocked reactor thread for 79647.8us
I20260709 13:11:19.619380 28793 tablet_service.cc:1511] Processing CreateTablet for tablet d706fb62a0a7423ca484455f75a16592 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:11:19.622628 28792 tablet_service.cc:1511] Processing CreateTablet for tablet eb534ab2fc824a7abb24883eb39d17dc (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:11:19.626353 28791 tablet_service.cc:1511] Processing CreateTablet for tablet d69a0e6ca32e4d8080aed2fe4405d7f5 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:11:19.612751 28795 tablet_service.cc:1511] Processing CreateTablet for tablet f828b4ae5c2846c5a49f1212f73186f0 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:11:19.629827 28568 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff91a748d3f464ab00fc3e657057d73 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:11:19.629788 28790 tablet_service.cc:1511] Processing CreateTablet for tablet f5d51007007a4252908beaaaa3ee8374 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:11:19.632321 28789 tablet_service.cc:1511] Processing CreateTablet for tablet d1f041b85d184414b3939425b35e4a1c (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:11:19.635318 28788 tablet_service.cc:1511] Processing CreateTablet for tablet 6ea260fc2f384cd7a7f947d2bf8cb49b (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:11:19.638839 28787 tablet_service.cc:1511] Processing CreateTablet for tablet f0c32a52cb724ba28e6fc6c8cf8e9a88 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:11:19.645859 28791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d69a0e6ca32e4d8080aed2fe4405d7f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.648087 28788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ea260fc2f384cd7a7f947d2bf8cb49b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.655289 28795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f828b4ae5c2846c5a49f1212f73186f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.657918 28787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0c32a52cb724ba28e6fc6c8cf8e9a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.662945 28564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19240a871550411aafbc885984ade97d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.664873 28568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff91a748d3f464ab00fc3e657057d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.667500 28790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5d51007007a4252908beaaaa3ee8374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.669811 28789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1f041b85d184414b3939425b35e4a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.670504 28793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d706fb62a0a7423ca484455f75a16592. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.675028 28852 tablet_bootstrap.cc:654] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.675768 28792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb534ab2fc824a7abb24883eb39d17dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.672783 28722 tablet_service.cc:1511] Processing CreateTablet for tablet b572160c667242bfbd4ece3e3f26f505 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
W20260709 13:11:19.687619 28684 tablet.cc:2406] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:11:19.689066 28644 tablet_service.cc:1511] Processing CreateTablet for tablet 586415758fd245b49bd0a4e20a2b11d8 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:11:19.690598 28644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 586415758fd245b49bd0a4e20a2b11d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.690222 28716 tablet_service.cc:1511] Processing CreateTablet for tablet 841b18d7f11c485bba96eda7dce0c27e (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:11:19.701575 28567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ba7b5c67b14fcba09e4e6cd16fa09b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.703141 28648 tablet_service.cc:1511] Processing CreateTablet for tablet fcf9ce9ce3ac4f848ae7f5b584711f3e (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:11:19.704550 28648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf9ce9ce3ac4f848ae7f5b584711f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.709743 28573 tablet_service.cc:1511] Processing CreateTablet for tablet b07d8385470b4fc285eb6703e6fa42b9 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:11:19.711498 28573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07d8385470b4fc285eb6703e6fa42b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.723274 28721 tablet_service.cc:1511] Processing CreateTablet for tablet 5ff91a748d3f464ab00fc3e657057d73 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:11:19.724812 28789 tablet_service.cc:1511] Processing CreateTablet for tablet 19240a871550411aafbc885984ade97d (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:11:19.726183 28789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19240a871550411aafbc885984ade97d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.726404 28853 tablet_bootstrap.cc:654] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.730212 28848 tablet_bootstrap.cc:654] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.747856 28713 tablet_service.cc:1511] Processing CreateTablet for tablet 45c6993be42044c3b7dbb095971f7c88 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
W20260709 13:11:19.749241 28466 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.40.1:44075, user_credentials={real_user=slave}} blocked reactor thread for 95367us
I20260709 13:11:19.753623 28722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b572160c667242bfbd4ece3e3f26f505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.755074 28648 tablet_service.cc:1511] Processing CreateTablet for tablet 2b32b6e56ce549b98fca9ad5f3798f2b (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:11:19.756767 28648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b32b6e56ce549b98fca9ad5f3798f2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.757800 28716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841b18d7f11c485bba96eda7dce0c27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.763630 28569 tablet_service.cc:1511] Processing CreateTablet for tablet a726976321d04177a6d77e9ef0041f3f (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:11:19.765019 28569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a726976321d04177a6d77e9ef0041f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.787822 28566 tablet_service.cc:1511] Processing CreateTablet for tablet 659cd3cf76964c27b1dfdccebc357594 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:11:19.789412 28566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 659cd3cf76964c27b1dfdccebc357594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.824965 28757 heartbeater.cc:499] Master 127.20.40.62:37793 was elected leader, sending a full tablet report...
I20260709 13:11:19.826326 28565 tablet_service.cc:1511] Processing CreateTablet for tablet 452914c1abfd43389431daaf7ebee1c0 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:11:19.825227 28855 tablet_bootstrap.cc:492] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:19.812907 28571 tablet_service.cc:1511] Processing CreateTablet for tablet c0093a1dad264ec1b3d9d3f896262ff7 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
W20260709 13:11:19.798171 28468 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.40.2:43021, user_credentials={real_user=slave}} blocked reactor thread for 44550.7us
I20260709 13:11:19.799988 28713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c6993be42044c3b7dbb095971f7c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.827126 28796 tablet_service.cc:1511] Processing CreateTablet for tablet b07d8385470b4fc285eb6703e6fa42b9 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:11:19.841969 28787 tablet_service.cc:1511] Processing CreateTablet for tablet 45c6993be42044c3b7dbb095971f7c88 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:11:19.858214 28796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b07d8385470b4fc285eb6703e6fa42b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.859745 28570 tablet_service.cc:1511] Processing CreateTablet for tablet e876ee31f15e4349b3086338a4d5f288 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:11:19.864111 28787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c6993be42044c3b7dbb095971f7c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.874244 28789 tablet_service.cc:1511] Processing CreateTablet for tablet b572160c667242bfbd4ece3e3f26f505 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:11:19.875772 28789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b572160c667242bfbd4ece3e3f26f505. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.878072 28721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ff91a748d3f464ab00fc3e657057d73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.877767 28572 tablet_service.cc:1511] Processing CreateTablet for tablet 45c6993be42044c3b7dbb095971f7c88 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:11:19.880532 28642 tablet_service.cc:1511] Processing CreateTablet for tablet 8e29bffebb804a5bbb9935518c059b2a (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:11:19.877058 28640 tablet_service.cc:1511] Processing CreateTablet for tablet 5e2ea288ac6c435eb4e1fd15b459a3ff (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:11:19.882061 28642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e29bffebb804a5bbb9935518c059b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.886525 28715 tablet_service.cc:1511] Processing CreateTablet for tablet c0093a1dad264ec1b3d9d3f896262ff7 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:11:19.888134 28640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e2ea288ac6c435eb4e1fd15b459a3ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.888629 28715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0093a1dad264ec1b3d9d3f896262ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.889250 28565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452914c1abfd43389431daaf7ebee1c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.890618 28854 raft_consensus.cc:493] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.894876 28854 raft_consensus.cc:515] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:19.892625 28645 tablet_service.cc:1511] Processing CreateTablet for tablet d40bb461a5034123ab09d156bd22ebbf (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:11:19.904541 28854 leader_election.cc:290] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:19.910241 28571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0093a1dad264ec1b3d9d3f896262ff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.910939 28719 tablet_service.cc:1511] Processing CreateTablet for tablet 659cd3cf76964c27b1dfdccebc357594 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:11:19.912487 28848 tablet_bootstrap.cc:492] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:19.913130 28848 ts_tablet_manager.cc:1403] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.399s	user 0.018s	sys 0.014s
I20260709 13:11:19.913803 28572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45c6993be42044c3b7dbb095971f7c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.914813 28831 heartbeater.cc:499] Master 127.20.40.62:37793 was elected leader, sending a full tablet report...
I20260709 13:11:19.919157 28852 tablet_bootstrap.cc:492] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:19.919749 28852 ts_tablet_manager.cc:1403] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.409s	user 0.014s	sys 0.009s
I20260709 13:11:19.922497 28855 tablet_bootstrap.cc:654] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:19.926182 28568 tablet_service.cc:1511] Processing CreateTablet for tablet 4d860d29a21a423cbbf0d8d9480d56ef (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:11:19.926307 28647 tablet_service.cc:1511] Processing CreateTablet for tablet 34233c4c336b444996374b970ddd2822 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:11:19.942854 28570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e876ee31f15e4349b3086338a4d5f288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.947525 28853 tablet_bootstrap.cc:492] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:19.949566 28853 ts_tablet_manager.cc:1403] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.438s	user 0.012s	sys 0.014s
I20260709 13:11:19.956171 28719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 659cd3cf76964c27b1dfdccebc357594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.963256 28853 raft_consensus.cc:359] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:19.964229 28853 raft_consensus.cc:385] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.964582 28853 raft_consensus.cc:740] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:19.964673 28717 tablet_service.cc:1511] Processing CreateTablet for tablet 4d860d29a21a423cbbf0d8d9480d56ef (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:11:19.966137 28717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d860d29a21a423cbbf0d8d9480d56ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.967626 28848 raft_consensus.cc:359] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:19.971949 28794 tablet_service.cc:1511] Processing CreateTablet for tablet a726976321d04177a6d77e9ef0041f3f (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:11:19.972365 28795 tablet_service.cc:1511] Processing CreateTablet for tablet f52ad167603d40ada7680f844e2e59c8 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:11:19.984869 28795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52ad167603d40ada7680f844e2e59c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.986634 28646 tablet_service.cc:1511] Processing CreateTablet for tablet 550aaae95149430d8f95525d197894f6 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:11:19.988211 28794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a726976321d04177a6d77e9ef0041f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.993777 28568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d860d29a21a423cbbf0d8d9480d56ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.995172 28791 tablet_service.cc:1511] Processing CreateTablet for tablet 4d860d29a21a423cbbf0d8d9480d56ef (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:11:19.997332 28791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d860d29a21a423cbbf0d8d9480d56ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.979941 28788 tablet_service.cc:1511] Processing CreateTablet for tablet e876ee31f15e4349b3086338a4d5f288 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:11:19.973052 28790 tablet_service.cc:1511] Processing CreateTablet for tablet 841b18d7f11c485bba96eda7dce0c27e (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:11:20.003371 28790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841b18d7f11c485bba96eda7dce0c27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.923499 28852 raft_consensus.cc:359] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:20.005703 28852 raft_consensus.cc:385] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.006168 28852 raft_consensus.cc:740] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.007089 28852 consensus_queue.cc:260] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:19.996186 28848 raft_consensus.cc:385] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:19.978824 28647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34233c4c336b444996374b970ddd2822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:19.977119 28718 tablet_service.cc:1511] Processing CreateTablet for tablet 452914c1abfd43389431daaf7ebee1c0 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:11:20.011946 28855 tablet_bootstrap.cc:492] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:19.952908 28714 tablet_service.cc:1511] Processing CreateTablet for tablet f52ad167603d40ada7680f844e2e59c8 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:11:20.037330 28573 tablet_service.cc:1511] Processing CreateTablet for tablet 1e4d79b8251f445ba4ee93c33bb13df3 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:11:20.038200 28718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 452914c1abfd43389431daaf7ebee1c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.038959 28573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e4d79b8251f445ba4ee93c33bb13df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.042261 28714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52ad167603d40ada7680f844e2e59c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.043771 28646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550aaae95149430d8f95525d197894f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.043905 28855 ts_tablet_manager.cc:1403] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.219s	user 0.014s	sys 0.003s
I20260709 13:11:20.001734 28648 tablet_service.cc:1511] Processing CreateTablet for tablet cf7befe583fe4534bdd8e703ee341d3e (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:11:20.045765 28645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d40bb461a5034123ab09d156bd22ebbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.047293 28855 raft_consensus.cc:359] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:20.048049 28855 raft_consensus.cc:385] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.048323 28855 raft_consensus.cc:740] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.049815 28648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7befe583fe4534bdd8e703ee341d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.051668 28855 consensus_queue.cc:260] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:20.023986 28848 raft_consensus.cc:740] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.052978 28853 consensus_queue.cc:260] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:20.083359 28848 consensus_queue.cc:260] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:20.088840 28788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e876ee31f15e4349b3086338a4d5f288. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.097388 28720 tablet_service.cc:1511] Processing CreateTablet for tablet ce8eab4cd5b64393b62a304011e5b22d (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:11:20.120929 28720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce8eab4cd5b64393b62a304011e5b22d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.095717 28848 ts_tablet_manager.cc:1434] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.182s	user 0.006s	sys 0.002s
I20260709 13:11:20.069548 28793 tablet_service.cc:1511] Processing CreateTablet for tablet 659cd3cf76964c27b1dfdccebc357594 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:11:20.123339 28713 tablet_service.cc:1511] Processing CreateTablet for tablet 47110731ce12413ab60b16f034fdceb3 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:11:20.124342 28793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 659cd3cf76964c27b1dfdccebc357594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.129042 28564 tablet_service.cc:1511] Processing CreateTablet for tablet 7c7ab1eff7a5409cb84e6bb33393456e (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:11:20.135277 28564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c7ab1eff7a5409cb84e6bb33393456e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.007105 28792 tablet_service.cc:1511] Processing CreateTablet for tablet ce8eab4cd5b64393b62a304011e5b22d (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:11:20.133538 28854 raft_consensus.cc:493] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.168629 28854 raft_consensus.cc:515] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:20.171136 28854 leader_election.cc:290] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:20.129916 28567 tablet_service.cc:1511] Processing CreateTablet for tablet 47110731ce12413ab60b16f034fdceb3 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:11:20.146756 28716 tablet_service.cc:1511] Processing CreateTablet for tablet 7c7ab1eff7a5409cb84e6bb33393456e (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:11:20.186640 28853 ts_tablet_manager.cc:1434] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.237s	user 0.007s	sys 0.014s
I20260709 13:11:20.179822 28848 tablet_bootstrap.cc:492] T 5951a1590104426cae727db543f49a83 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:20.110886 28796 tablet_service.cc:1511] Processing CreateTablet for tablet 1e4d79b8251f445ba4ee93c33bb13df3 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
W20260709 13:11:20.165341 28466 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.40.3:41711, user_credentials={real_user=slave}} blocked reactor thread for 88730.1us
I20260709 13:11:20.202589 28569 tablet_service.cc:1511] Processing CreateTablet for tablet 586415758fd245b49bd0a4e20a2b11d8 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:11:20.115463 28787 tablet_service.cc:1511] Processing CreateTablet for tablet 7c7ab1eff7a5409cb84e6bb33393456e (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:11:20.221726 28792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce8eab4cd5b64393b62a304011e5b22d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.235723 28565 tablet_service.cc:1511] Processing CreateTablet for tablet fcf9ce9ce3ac4f848ae7f5b584711f3e (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:11:20.238085 28570 tablet_service.cc:1511] Processing CreateTablet for tablet 57c146089a3249eea0254717e75c14c8 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:11:20.235634 28789 tablet_service.cc:1511] Processing CreateTablet for tablet fcf9ce9ce3ac4f848ae7f5b584711f3e (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:11:20.239773 28853 tablet_bootstrap.cc:492] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:20.233876 28787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c7ab1eff7a5409cb84e6bb33393456e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.241873 28717 tablet_service.cc:1511] Processing CreateTablet for tablet 57c146089a3249eea0254717e75c14c8 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
W20260709 13:11:20.234057 28468 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.40.2:43021, user_credentials={real_user=slave}} blocked reactor thread for 147948us
I20260709 13:11:20.242954 28721 tablet_service.cc:1511] Processing CreateTablet for tablet 46835248ab9d4f43908a6c6a42642ba1 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:11:20.231003 28713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47110731ce12413ab60b16f034fdceb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.245792 28722 tablet_service.cc:1511] Processing CreateTablet for tablet 586415758fd245b49bd0a4e20a2b11d8 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:11:20.247210 28722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 586415758fd245b49bd0a4e20a2b11d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.249568 28567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47110731ce12413ab60b16f034fdceb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.249779 28796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e4d79b8251f445ba4ee93c33bb13df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.255108 28791 tablet_service.cc:1511] Processing CreateTablet for tablet 57c146089a3249eea0254717e75c14c8 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:11:20.256567 28791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c146089a3249eea0254717e75c14c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.181453 28795 tablet_service.cc:1511] Processing CreateTablet for tablet 46835248ab9d4f43908a6c6a42642ba1 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:11:20.262349 28795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46835248ab9d4f43908a6c6a42642ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.262480 28852 ts_tablet_manager.cc:1434] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.342s	user 0.043s	sys 0.072s
I20260709 13:11:20.256258 28790 tablet_service.cc:1511] Processing CreateTablet for tablet 2b32b6e56ce549b98fca9ad5f3798f2b (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:11:20.263756 28716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c7ab1eff7a5409cb84e6bb33393456e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.264187 28790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b32b6e56ce549b98fca9ad5f3798f2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.266170 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2988b7e9dc0942a69ce7dcb8db26ca27" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:20.273497 28852 tablet_bootstrap.cc:492] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:20.273887 28806 raft_consensus.cc:2468] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 0.
I20260709 13:11:20.276949 28721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46835248ab9d4f43908a6c6a42642ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.283893 28718 tablet_service.cc:1511] Processing CreateTablet for tablet 2b32b6e56ce549b98fca9ad5f3798f2b (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:11:20.270428 28848 tablet_bootstrap.cc:654] T 5951a1590104426cae727db543f49a83 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:20.271277 28569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 586415758fd245b49bd0a4e20a2b11d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.287277 28565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf9ce9ce3ac4f848ae7f5b584711f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.289608 28715 tablet_service.cc:1511] Processing CreateTablet for tablet 8e29bffebb804a5bbb9935518c059b2a (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:11:20.272296 28864 raft_consensus.cc:493] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.293975 28570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c146089a3249eea0254717e75c14c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.293726 28622 leader_election.cc:304] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:20.296555 28854 raft_consensus.cc:2804] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:20.297082 28854 raft_consensus.cc:493] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.297405 28854 raft_consensus.cc:3060] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.262509 28855 ts_tablet_manager.cc:1434] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.218s	user 0.008s	sys 0.014s
I20260709 13:11:20.302708 28855 tablet_bootstrap.cc:492] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:20.305919 28864 raft_consensus.cc:515] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:20.311187 28853 tablet_bootstrap.cc:654] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:20.291489 28718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b32b6e56ce549b98fca9ad5f3798f2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.335989 28864 leader_election.cc:290] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:20.333669 28854 raft_consensus.cc:515] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:20.350623 28854 leader_election.cc:290] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:20.352372 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2988b7e9dc0942a69ce7dcb8db26ca27" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:20.353638 28806 raft_consensus.cc:3060] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.330256 28794 tablet_service.cc:1511] Processing CreateTablet for tablet d40bb461a5034123ab09d156bd22ebbf (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:11:20.323918 28789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcf9ce9ce3ac4f848ae7f5b584711f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.325588 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d12b4ce21794192969d6609d0ea4d69" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:20.372699 28572 tablet_service.cc:1511] Processing CreateTablet for tablet d40bb461a5034123ab09d156bd22ebbf (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:11:20.374102 28572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d40bb461a5034123ab09d156bd22ebbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.318604 28571 tablet_service.cc:1511] Processing CreateTablet for tablet 8e29bffebb804a5bbb9935518c059b2a (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:11:20.331283 28714 tablet_service.cc:1511] Processing CreateTablet for tablet 5e2ea288ac6c435eb4e1fd15b459a3ff (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:11:20.335330 28720 tablet_service.cc:1511] Processing CreateTablet for tablet 9a4abbb5e8f04c8388c1642217e7dbcb (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:11:20.386343 28788 tablet_service.cc:1511] Processing CreateTablet for tablet 9a4abbb5e8f04c8388c1642217e7dbcb (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:11:20.387305 28852 tablet_bootstrap.cc:654] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:20.387949 28622 leader_election.cc:343] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.391266 28717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57c146089a3249eea0254717e75c14c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.393790 28714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e2ea288ac6c435eb4e1fd15b459a3ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.397783 28720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4abbb5e8f04c8388c1642217e7dbcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.402690 28568 tablet_service.cc:1511] Processing CreateTablet for tablet 9a4abbb5e8f04c8388c1642217e7dbcb (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:11:20.381655 28806 raft_consensus.cc:2468] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 1.
I20260709 13:11:20.413463 28571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e29bffebb804a5bbb9935518c059b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.414134 28645 tablet_service.cc:1511] Processing CreateTablet for tablet 217202c939974f80b0c84019f3acfcaf (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 13:11:20.415236 28528 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:20.415748 28715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e29bffebb804a5bbb9935518c059b2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.432674 28796 tablet_service.cc:1511] Processing CreateTablet for tablet 5e2ea288ac6c435eb4e1fd15b459a3ff (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 13:11:20.407426 28466 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.40.4:43597, user_credentials={real_user=slave}} blocked reactor thread for 60836.6us
I20260709 13:11:20.446859 28569 tablet_service.cc:1511] Processing CreateTablet for tablet 34233c4c336b444996374b970ddd2822 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:11:20.448738 28645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217202c939974f80b0c84019f3acfcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.460618 28567 tablet_service.cc:1511] Processing CreateTablet for tablet cf7befe583fe4534bdd8e703ee341d3e (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:11:20.404175 28716 tablet_service.cc:1511] Processing CreateTablet for tablet 12cea3a9ab394674a67119867b34ce5a (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:11:20.440109 28794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d40bb461a5034123ab09d156bd22ebbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.470570 28568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4abbb5e8f04c8388c1642217e7dbcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.485724 28862 raft_consensus.cc:493] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.470304 28622 leader_election.cc:304] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:20.486424 28862 raft_consensus.cc:515] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:20.487164 28854 raft_consensus.cc:2804] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:20.489709 28796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e2ea288ac6c435eb4e1fd15b459a3ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.485975 28567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7befe583fe4534bdd8e703ee341d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.498062 28646 tablet_service.cc:1511] Processing CreateTablet for tablet b939cf3aa04842b1adacdee8818495fd (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:11:20.499625 28646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b939cf3aa04842b1adacdee8818495fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.515519 28848 tablet_bootstrap.cc:492] T 5951a1590104426cae727db543f49a83 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:20.516180 28848 ts_tablet_manager.cc:1403] T 5951a1590104426cae727db543f49a83 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.387s	user 0.023s	sys 0.026s
I20260709 13:11:20.519745 28848 raft_consensus.cc:359] T 5951a1590104426cae727db543f49a83 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:20.520536 28848 raft_consensus.cc:385] T 5951a1590104426cae727db543f49a83 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.520864 28848 raft_consensus.cc:740] T 5951a1590104426cae727db543f49a83 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.521713 28719 tablet_service.cc:1511] Processing CreateTablet for tablet 34233c4c336b444996374b970ddd2822 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:11:20.521833 28848 consensus_queue.cc:260] T 5951a1590104426cae727db543f49a83 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:20.525717 28788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a4abbb5e8f04c8388c1642217e7dbcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.529970 28716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cea3a9ab394674a67119867b34ce5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.474534 28564 tablet_service.cc:1511] Processing CreateTablet for tablet 12cea3a9ab394674a67119867b34ce5a (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:11:20.542520 28648 tablet_service.cc:1511] Processing CreateTablet for tablet 19e262f061cd4055b2b8c365deb5bf74 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:11:20.543269 28853 tablet_bootstrap.cc:492] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:20.545591 28569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34233c4c336b444996374b970ddd2822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.508936 28862 leader_election.cc:290] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:20.551069 28793 tablet_service.cc:1511] Processing CreateTablet for tablet cf7befe583fe4534bdd8e703ee341d3e (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:11:20.537328 28855 tablet_bootstrap.cc:654] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:20.561443 28648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e262f061cd4055b2b8c365deb5bf74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.566785 28787 tablet_service.cc:1511] Processing CreateTablet for tablet 550aaae95149430d8f95525d197894f6 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:11:20.562498 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51806e14724e4433b368faa0c997a11e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:20.562362 28789 tablet_service.cc:1511] Processing CreateTablet for tablet 12cea3a9ab394674a67119867b34ce5a (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:11:20.563185 28853 ts_tablet_manager.cc:1403] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.324s	user 0.029s	sys 0.019s
I20260709 13:11:20.567497 28852 tablet_bootstrap.cc:492] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:20.569721 28719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34233c4c336b444996374b970ddd2822. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.584256 28852 ts_tablet_manager.cc:1403] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.311s	user 0.022s	sys 0.004s
I20260709 13:11:20.567353 28645 tablet_service.cc:1511] Processing CreateTablet for tablet 0ed785ccac6a425f83665ef8e365bfc1 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:11:20.570190 28564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cea3a9ab394674a67119867b34ce5a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:20.577857 28547 leader_election.cc:343] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.590793 28721 tablet_service.cc:1511] Processing CreateTablet for tablet 550aaae95149430d8f95525d197894f6 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:11:20.592316 28721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550aaae95149430d8f95525d197894f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.594719 28852 raft_consensus.cc:359] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:20.595609 28852 raft_consensus.cc:385] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.595924 28852 raft_consensus.cc:740] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.582738 28791 tablet_service.cc:1511] Processing CreateTablet for tablet b939cf3aa04842b1adacdee8818495fd (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:11:20.601760 28645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ed785ccac6a425f83665ef8e365bfc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.596686 28852 consensus_queue.cc:260] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:20.559727 28854 raft_consensus.cc:697] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Becoming Leader. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
I20260709 13:11:20.580972 28853 raft_consensus.cc:359] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:20.605446 28853 raft_consensus.cc:385] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.609942 28853 raft_consensus.cc:740] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.610980 28853 consensus_queue.cc:260] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:20.613880 28853 ts_tablet_manager.cc:1434] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
W20260709 13:11:20.606623 28466 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.40.3:41711, user_credentials={real_user=slave}} blocked reactor thread for 46516.7us
I20260709 13:11:20.605679 28854 consensus_queue.cc:237] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:20.633983 28852 ts_tablet_manager.cc:1434] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.049s	user 0.004s	sys 0.004s
I20260709 13:11:20.617172 28787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550aaae95149430d8f95525d197894f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.646689 28853 tablet_bootstrap.cc:492] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:20.657015 28793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7befe583fe4534bdd8e703ee341d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.657864 28789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12cea3a9ab394674a67119867b34ce5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.659669 28869 raft_consensus.cc:493] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.660238 28869 raft_consensus.cc:515] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:20.664336 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d12b4ce21794192969d6609d0ea4d69" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:20.664676 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5951a1590104426cae727db543f49a83" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:20.665071 28732 raft_consensus.cc:2468] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:20.665652 28852 tablet_bootstrap.cc:492] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:20.665879 28848 ts_tablet_manager.cc:1434] T 5951a1590104426cae727db543f49a83 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.149s	user 0.009s	sys 0.015s
I20260709 13:11:20.666093 28869 leader_election.cc:290] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:20.666985 28848 tablet_bootstrap.cc:492] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
W20260709 13:11:20.667452 28696 leader_election.cc:343] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.668435 28547 leader_election.cc:304] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85; no voters: 
I20260709 13:11:20.669576 28869 raft_consensus.cc:2804] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:20.670037 28869 raft_consensus.cc:493] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.670478 28869 raft_consensus.cc:3060] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.671569 28795 tablet_service.cc:1511] Processing CreateTablet for tablet 9519acd190ba4590a2eaa1fcb1e9a60f (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:11:20.673082 28795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9519acd190ba4590a2eaa1fcb1e9a60f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.676527 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2988b7e9dc0942a69ce7dcb8db26ca27" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:20.678066 28582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d12b4ce21794192969d6609d0ea4d69" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:20.678256 28720 tablet_service.cc:1511] Processing CreateTablet for tablet 217202c939974f80b0c84019f3acfcaf (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:11:20.678169 28570 tablet_service.cc:1511] Processing CreateTablet for tablet 217202c939974f80b0c84019f3acfcaf (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:11:20.679527 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2988b7e9dc0942a69ce7dcb8db26ca27" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:20.680052 28720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217202c939974f80b0c84019f3acfcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.680224 28570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 217202c939974f80b0c84019f3acfcaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.692855 28648 tablet_service.cc:1511] Processing CreateTablet for tablet 28856e9437484cbdae4f48bf4ca6aaa1 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:11:20.694413 28648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28856e9437484cbdae4f48bf4ca6aaa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.695528 28791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b939cf3aa04842b1adacdee8818495fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.699739 28714 tablet_service.cc:1511] Processing CreateTablet for tablet 19e262f061cd4055b2b8c365deb5bf74 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:11:20.700547 28713 tablet_service.cc:1511] Processing CreateTablet for tablet 0ed785ccac6a425f83665ef8e365bfc1 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:11:20.702283 28713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ed785ccac6a425f83665ef8e365bfc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.704259 28714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e262f061cd4055b2b8c365deb5bf74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.706512 28715 tablet_service.cc:1511] Processing CreateTablet for tablet 9519acd190ba4590a2eaa1fcb1e9a60f (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:11:20.708144 28715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9519acd190ba4590a2eaa1fcb1e9a60f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.755162 28793 tablet_service.cc:1511] Processing CreateTablet for tablet 19e262f061cd4055b2b8c365deb5bf74 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:11:20.709982 28717 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44014 (request call id 25) took 1066 ms. Trace:
I20260709 13:11:20.756786 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5951a1590104426cae727db543f49a83" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:20.757617 28793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e262f061cd4055b2b8c365deb5bf74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.757591 28656 raft_consensus.cc:2468] T 5951a1590104426cae727db543f49a83 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 0.
I20260709 13:11:20.759325 28698 leader_election.cc:304] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:20.760568 28862 raft_consensus.cc:2804] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:20.760931 28862 raft_consensus.cc:493] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.761308 28862 raft_consensus.cc:3060] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.756680 28853 tablet_bootstrap.cc:654] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:20.757020 28717 rpcz_store.cc:276] 0709 13:11:19.643860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.240990 (+597130us) service_pool.cc:224] Handling call
0709 13:11:20.242711 (+  1721us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:20.242862 (+   151us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:20.500085 (+257223us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:20.709409 (+209324us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:20.709916 (+   507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:20.713642 28792 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37746 (request call id 20) took 1071 ms. Trace:
I20260709 13:11:20.767910 28792 rpcz_store.cc:276] 0709 13:11:19.642725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.005986 (+363261us) service_pool.cc:224] Handling call
0709 13:11:20.191817 (+185831us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:20.199835 (+  8018us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:20.587371 (+387536us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:20.712988 (+125617us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:20.713553 (+   565us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:20.720849 28869 raft_consensus.cc:515] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:20.770393 28640 tablet_service.cc:1511] Processing CreateTablet for tablet 92fb36508a8840ea8e84f00da15700a1 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:11:20.770704 28869 leader_election.cc:290] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:20.726011 28573 tablet_service.cc:1511] Processing CreateTablet for tablet b939cf3aa04842b1adacdee8818495fd (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:11:20.771855 28640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92fb36508a8840ea8e84f00da15700a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.772156 28573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b939cf3aa04842b1adacdee8818495fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.773789 28582 raft_consensus.cc:2393] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfd745f89b014f7b85fbf7d909fe2fb0 in current term 1: Already voted for candidate 44a14c00fc3d41bea8db00310408905a in this term.
W20260709 13:11:20.729761 28622 leader_election.cc:343] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:20.778460 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:44075, user_credentials={real_user=slave}} blocked reactor thread for 48749.2us
W20260709 13:11:20.779183 28622 leader_election.cc:343] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.728996 28565 tablet_service.cc:1511] Processing CreateTablet for tablet 28856e9437484cbdae4f48bf4ca6aaa1 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:11:20.780769 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d12b4ce21794192969d6609d0ea4d69" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:20.781224 28565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28856e9437484cbdae4f48bf4ca6aaa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.781533 28732 raft_consensus.cc:3060] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.730113 28658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51806e14724e4433b368faa0c997a11e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:20.731066 28564 tablet_service.cc:1511] Processing CreateTablet for tablet 0ed785ccac6a425f83665ef8e365bfc1 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:11:20.786974 28564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ed785ccac6a425f83665ef8e365bfc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.731315 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d12b4ce21794192969d6609d0ea4d69" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:20.732724 28569 tablet_service.cc:1511] Processing CreateTablet for tablet 9519acd190ba4590a2eaa1fcb1e9a60f (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:11:20.789784 28657 raft_consensus.cc:2468] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:20.741915 28791 tablet_service.cc:1511] Processing CreateTablet for tablet 28856e9437484cbdae4f48bf4ca6aaa1 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:11:20.790382 28569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9519acd190ba4590a2eaa1fcb1e9a60f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.791051 28658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d12b4ce21794192969d6609d0ea4d69" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:20.791699 28658 raft_consensus.cc:3060] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:20.791815 28549 leader_election.cc:343] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.792382 28549 leader_election.cc:304] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:20.793004 28622 leader_election.cc:304] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:20.791043 28791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28856e9437484cbdae4f48bf4ca6aaa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.796293 28869 raft_consensus.cc:2749] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:20.744931 28852 tablet_bootstrap.cc:654] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:20.745344 28466 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.20.40.4:43597, user_credentials={real_user=slave}} blocked reactor thread for 72082.3us
I20260709 13:11:20.800010 28732 raft_consensus.cc:2468] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:20.806994 28547 leader_election.cc:304] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85; no voters: 
I20260709 13:11:20.808202 28869 raft_consensus.cc:2804] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:20.808717 28869 raft_consensus.cc:697] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:20.809579 28869 consensus_queue.cc:237] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:20.822769 28855 tablet_bootstrap.cc:492] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:20.823395 28855 ts_tablet_manager.cc:1403] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.521s	user 0.020s	sys 0.006s
I20260709 13:11:20.829207 28480 catalog_manager.cc:5697] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2). New cstate: current_term: 1 leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:20.830643 28848 tablet_bootstrap.cc:654] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:20.831115 28855 raft_consensus.cc:359] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:20.831985 28855 raft_consensus.cc:385] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.832343 28855 raft_consensus.cc:740] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.833465 28855 consensus_queue.cc:260] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:20.836400 28714 tablet_service.cc:1511] Processing CreateTablet for tablet 66bc5681208146d19bff2322d4c254dd (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:11:20.837823 28714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66bc5681208146d19bff2322d4c254dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.838290 28717 tablet_service.cc:1511] Processing CreateTablet for tablet 92fb36508a8840ea8e84f00da15700a1 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:11:20.839641 28717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92fb36508a8840ea8e84f00da15700a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.842697 28788 tablet_service.cc:1511] Processing CreateTablet for tablet 66bc5681208146d19bff2322d4c254dd (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:11:20.845281 28788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66bc5681208146d19bff2322d4c254dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.846119 28567 tablet_service.cc:1511] Processing CreateTablet for tablet 66bc5681208146d19bff2322d4c254dd (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:11:20.829254 28658 raft_consensus.cc:2468] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:20.847714 28567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66bc5681208146d19bff2322d4c254dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.847647 28879 raft_consensus.cc:2749] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:20.859541 28853 tablet_bootstrap.cc:492] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:20.860373 28853 ts_tablet_manager.cc:1403] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.214s	user 0.013s	sys 0.001s
I20260709 13:11:20.841020 28862 raft_consensus.cc:515] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:20.878933 28862 leader_election.cc:290] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:20.880172 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5951a1590104426cae727db543f49a83" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
W20260709 13:11:20.881815 28696 leader_election.cc:343] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:20.886889 28658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5951a1590104426cae727db543f49a83" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:20.874466 28790 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:37746 (request call id 26) took 1025 ms. Trace:
I20260709 13:11:20.890750 28658 raft_consensus.cc:3060] T 5951a1590104426cae727db543f49a83 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:20.892444 28790 rpcz_store.cc:276] 0709 13:11:19.848402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.255360 (+406958us) service_pool.cc:224] Handling call
0709 13:11:20.263715 (+  8355us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:20.263802 (+    87us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:20.527880 (+264078us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:20.858086 (+330206us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:20.873493 (+ 15407us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:20.895124 28855 ts_tablet_manager.cc:1434] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.014s
I20260709 13:11:20.896742 28855 tablet_bootstrap.cc:492] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:20.904649 28852 tablet_bootstrap.cc:492] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:20.905290 28852 ts_tablet_manager.cc:1403] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.240s	user 0.009s	sys 0.005s
I20260709 13:11:20.918210 28658 raft_consensus.cc:2468] T 5951a1590104426cae727db543f49a83 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:20.919873 28698 leader_election.cc:304] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:20.920302 28852 raft_consensus.cc:359] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:20.921238 28852 raft_consensus.cc:385] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.921603 28852 raft_consensus.cc:740] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.921615 28862 raft_consensus.cc:2804] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:20.922436 28852 consensus_queue.cc:260] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:20.911053 28718 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44014 (request call id 26) took 1136 ms. Trace:
I20260709 13:11:20.928795 28718 rpcz_store.cc:276] 0709 13:11:19.781669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.282818 (+501149us) service_pool.cc:224] Handling call
0709 13:11:20.284886 (+  2068us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:11:20.284998 (+   112us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:11:20.596125 (+311127us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:20.876912 (+280787us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:20.910455 (+ 33543us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33}
I20260709 13:11:20.931030 28853 raft_consensus.cc:359] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:20.932220 28853 raft_consensus.cc:385] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.932646 28853 raft_consensus.cc:740] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.933764 28848 tablet_bootstrap.cc:492] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:20.934330 28848 ts_tablet_manager.cc:1403] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.268s	user 0.018s	sys 0.001s
I20260709 13:11:20.941618 28848 raft_consensus.cc:359] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:20.942404 28848 raft_consensus.cc:385] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:20.942703 28848 raft_consensus.cc:740] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:20.943447 28848 consensus_queue.cc:260] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:20.945637 28648 tablet_service.cc:1511] Processing CreateTablet for tablet bb853da5b7ff48d9a188d40610160f6c (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:11:20.947506 28648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb853da5b7ff48d9a188d40610160f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.949268 28853 consensus_queue.cc:260] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:20.949847 28848 ts_tablet_manager.cc:1434] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.005s
I20260709 13:11:20.952806 28793 tablet_service.cc:1511] Processing CreateTablet for tablet 92fb36508a8840ea8e84f00da15700a1 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:11:20.955322 28848 tablet_bootstrap.cc:492] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:20.963310 28714 tablet_service.cc:1511] Processing CreateTablet for tablet bb853da5b7ff48d9a188d40610160f6c (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:11:20.963348 28791 tablet_service.cc:1511] Processing CreateTablet for tablet b1a388b79acd4a278496df6d65fd7a44 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:11:20.966691 28853 ts_tablet_manager.cc:1434] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.106s	user 0.009s	sys 0.002s
I20260709 13:11:20.972146 28862 raft_consensus.cc:697] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:20.972577 28791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a388b79acd4a278496df6d65fd7a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.973402 28853 tablet_bootstrap.cc:492] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:20.973312 28862 consensus_queue.cc:237] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:20.978935 28793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92fb36508a8840ea8e84f00da15700a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.978354 28565 tablet_service.cc:1511] Processing CreateTablet for tablet bb853da5b7ff48d9a188d40610160f6c (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:11:20.980306 28565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb853da5b7ff48d9a188d40610160f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.989789 28648 tablet_service.cc:1511] Processing CreateTablet for tablet b1a388b79acd4a278496df6d65fd7a44 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:11:20.991590 28648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a388b79acd4a278496df6d65fd7a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.996042 28564 tablet_service.cc:1511] Processing CreateTablet for tablet b1a388b79acd4a278496df6d65fd7a44 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:11:20.997008 28714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb853da5b7ff48d9a188d40610160f6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:20.997475 28564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1a388b79acd4a278496df6d65fd7a44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:21.004071 28855 tablet_bootstrap.cc:654] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.015463 28790 tablet_service.cc:1511] Processing CreateTablet for tablet 8bb1e7780b6c42649546108a0bd97d7a (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:11:21.015463 28717 tablet_service.cc:1511] Processing CreateTablet for tablet 8bb1e7780b6c42649546108a0bd97d7a (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:11:21.015890 28567 tablet_service.cc:1511] Processing CreateTablet for tablet 8bb1e7780b6c42649546108a0bd97d7a (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:11:21.017103 28790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bb1e7780b6c42649546108a0bd97d7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:21.017103 28717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bb1e7780b6c42649546108a0bd97d7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:21.021608 28567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bb1e7780b6c42649546108a0bd97d7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:21.022495 28852 ts_tablet_manager.cc:1434] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.115s	user 0.005s	sys 0.008s
I20260709 13:11:21.023671 28852 tablet_bootstrap.cc:492] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:21.025817 28640 tablet_service.cc:1511] Processing CreateTablet for tablet 47ba06e13a9740d9b4ba185990852ada (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:11:21.028527 28640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ba06e13a9740d9b4ba185990852ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:21.028885 28713 tablet_service.cc:1511] Processing CreateTablet for tablet 47ba06e13a9740d9b4ba185990852ada (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:11:21.030349 28713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ba06e13a9740d9b4ba185990852ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:21.034176 28853 tablet_bootstrap.cc:654] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.061394 28478 catalog_manager.cc:5697] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:21.067673 28852 tablet_bootstrap.cc:654] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.068074 28879 consensus_queue.cc:1048] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:21.076193 28848 tablet_bootstrap.cc:654] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.086205 28855 tablet_bootstrap.cc:492] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:21.093657 28788 tablet_service.cc:1511] Processing CreateTablet for tablet 47ba06e13a9740d9b4ba185990852ada (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:11:21.099282 28855 ts_tablet_manager.cc:1403] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.203s	user 0.011s	sys 0.012s
I20260709 13:11:21.100009 28788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47ba06e13a9740d9b4ba185990852ada. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:21.103726 28855 raft_consensus.cc:359] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:21.105238 28855 raft_consensus.cc:385] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.116817 28855 raft_consensus.cc:740] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.120151 28853 tablet_bootstrap.cc:492] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:21.120748 28853 ts_tablet_manager.cc:1403] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.148s	user 0.016s	sys 0.016s
I20260709 13:11:21.127602 28565 tablet_service.cc:1511] Processing CreateTablet for tablet a0b02d1b7bd040599900df6d42e82e19 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:11:21.129257 28565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0b02d1b7bd040599900df6d42e82e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:21.134017 28640 tablet_service.cc:1511] Processing CreateTablet for tablet a0b02d1b7bd040599900df6d42e82e19 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:11:21.136747 28640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0b02d1b7bd040599900df6d42e82e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:21.142140 28718 tablet_service.cc:1511] Processing CreateTablet for tablet a0b02d1b7bd040599900df6d42e82e19 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:11:21.143725 28718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0b02d1b7bd040599900df6d42e82e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:21.136785 28887 raft_consensus.cc:493] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.144611 28887 raft_consensus.cc:515] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:21.146034 28648 tablet_service.cc:1511] Processing CreateTablet for tablet a1185c8b14ea4fd88ccfccb31e19dfd8 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:11:21.147704 28564 tablet_service.cc:1511] Processing CreateTablet for tablet a1185c8b14ea4fd88ccfccb31e19dfd8 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:11:21.148945 28564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1185c8b14ea4fd88ccfccb31e19dfd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:21.149873 28648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1185c8b14ea4fd88ccfccb31e19dfd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:21.151672 28793 tablet_service.cc:1511] Processing CreateTablet for tablet a1185c8b14ea4fd88ccfccb31e19dfd8 (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:11:21.151968 28853 raft_consensus.cc:359] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.152741 28853 raft_consensus.cc:385] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.153039 28853 raft_consensus.cc:740] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.158165 28855 consensus_queue.cc:260] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:21.161072 28887 leader_election.cc:290] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:21.166929 28715 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee04ccf18954bae9d40f7a5c460f71b (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:11:21.169257 28715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee04ccf18954bae9d40f7a5c460f71b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:21.169554 28622 consensus_peers.cc:597] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:21.172896 28855 ts_tablet_manager.cc:1434] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.073s	user 0.010s	sys 0.000s
I20260709 13:11:21.180161 28852 tablet_bootstrap.cc:492] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:21.180470 28791 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee04ccf18954bae9d40f7a5c460f71b (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:11:21.180858 28852 ts_tablet_manager.cc:1403] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.157s	user 0.006s	sys 0.016s
I20260709 13:11:21.181770 28853 consensus_queue.cc:260] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.153082 28793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1185c8b14ea4fd88ccfccb31e19dfd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:21.186054 28852 raft_consensus.cc:359] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.192586 28791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee04ccf18954bae9d40f7a5c460f71b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:21.190513 28852 raft_consensus.cc:385] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.205514 28852 raft_consensus.cc:740] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.206554 28852 consensus_queue.cc:260] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.192178 28855 tablet_bootstrap.cc:492] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:21.216094 28853 ts_tablet_manager.cc:1434] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.095s	user 0.000s	sys 0.008s
I20260709 13:11:21.218948 28855 tablet_bootstrap.cc:654] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.219194 28887 raft_consensus.cc:493] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.220119 28887 raft_consensus.cc:515] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:21.223196 28887 leader_election.cc:290] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:21.204502 28565 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee04ccf18954bae9d40f7a5c460f71b (DEFAULT_TABLE table=test-workload [id=105c06c69f79410b85ecdef773b1f3e3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:11:21.227136 28853 tablet_bootstrap.cc:492] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:21.227905 28848 tablet_bootstrap.cc:492] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:21.228528 28848 ts_tablet_manager.cc:1403] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.273s	user 0.013s	sys 0.009s
I20260709 13:11:21.235713 28852 ts_tablet_manager.cc:1434] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.000s
I20260709 13:11:21.236970 28852 tablet_bootstrap.cc:492] T 59ba7b5c67b14fcba09e4e6cd16fa09b P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:21.239346 28848 raft_consensus.cc:359] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.240593 28848 raft_consensus.cc:385] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.241134 28481 catalog_manager.cc:5697] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 1 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:21.241019 28848 raft_consensus.cc:740] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.248414 28848 consensus_queue.cc:260] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.252642 28848 ts_tablet_manager.cc:1434] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 13:11:21.266626 28853 tablet_bootstrap.cc:654] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.273092 28852 tablet_bootstrap.cc:654] T 59ba7b5c67b14fcba09e4e6cd16fa09b P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.273859 28869 raft_consensus.cc:493] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.274449 28869 raft_consensus.cc:515] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:21.276918 28869 leader_election.cc:290] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:21.290369 28565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee04ccf18954bae9d40f7a5c460f71b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:21.290429 28906 raft_consensus.cc:493] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.296034 28906 raft_consensus.cc:515] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.297621 28855 tablet_bootstrap.cc:492] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:21.299368 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706fb62a0a7423ca484455f75a16592" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:21.301923 28582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706fb62a0a7423ca484455f75a16592" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
W20260709 13:11:21.303326 28622 leader_election.cc:343] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:21.304169 28622 leader_election.cc:343] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.304615 28622 leader_election.cc:304] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:21.305572 28879 raft_consensus.cc:2749] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:21.299420 28906 leader_election.cc:290] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:21.310297 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb534ab2fc824a7abb24883eb39d17dc" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:21.298260 28855 ts_tablet_manager.cc:1403] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.124s	user 0.025s	sys 0.014s
I20260709 13:11:21.316998 28855 raft_consensus.cc:359] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.318733 28855 raft_consensus.cc:385] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.319188 28855 raft_consensus.cc:740] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.320183 28848 tablet_bootstrap.cc:492] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:21.321557 28855 consensus_queue.cc:260] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.323880 28855 ts_tablet_manager.cc:1434] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.005s
I20260709 13:11:21.324354 28853 tablet_bootstrap.cc:492] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:21.324957 28853 ts_tablet_manager.cc:1403] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.108s	user 0.014s	sys 0.011s
I20260709 13:11:21.325541 28855 tablet_bootstrap.cc:492] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:21.328394 28853 raft_consensus.cc:359] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.331265 28852 tablet_bootstrap.cc:492] T 59ba7b5c67b14fcba09e4e6cd16fa09b P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:21.331897 28852 ts_tablet_manager.cc:1403] T 59ba7b5c67b14fcba09e4e6cd16fa09b P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.095s	user 0.005s	sys 0.020s
I20260709 13:11:21.332729 28855 tablet_bootstrap.cc:654] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.340327 28848 tablet_bootstrap.cc:654] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.346732 28869 consensus_queue.cc:1048] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:11:21.349879 28547 leader_election.cc:343] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.329222 28853 raft_consensus.cc:385] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.352394 28853 raft_consensus.cc:740] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.355479 28852 raft_consensus.cc:359] T 59ba7b5c67b14fcba09e4e6cd16fa09b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.356688 28852 raft_consensus.cc:385] T 59ba7b5c67b14fcba09e4e6cd16fa09b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.357124 28852 raft_consensus.cc:740] T 59ba7b5c67b14fcba09e4e6cd16fa09b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.353304 28853 consensus_queue.cc:260] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.369119 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f041b85d184414b3939425b35e4a1c" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:21.370193 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19240a871550411aafbc885984ade97d" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:21.370339 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19240a871550411aafbc885984ade97d" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:21.369516 28582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f041b85d184414b3939425b35e4a1c" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:21.373088 28891 raft_consensus.cc:493] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:21.373397 28770 leader_election.cc:343] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:21.374719 28770 leader_election.cc:343] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:21.375494 28770 leader_election.cc:343] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.375870 28770 leader_election.cc:304] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:21.376668 28887 raft_consensus.cc:2749] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:21.374426 28869 consensus_queue.cc:1048] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:21.379325 28852 consensus_queue.cc:260] T 59ba7b5c67b14fcba09e4e6cd16fa09b P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.382349 28852 ts_tablet_manager.cc:1434] T 59ba7b5c67b14fcba09e4e6cd16fa09b P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.050s	user 0.012s	sys 0.000s
I20260709 13:11:21.382481 28853 ts_tablet_manager.cc:1434] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.057s	user 0.009s	sys 0.002s
I20260709 13:11:21.383354 28855 tablet_bootstrap.cc:492] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:21.383708 28906 raft_consensus.cc:493] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.383880 28852 tablet_bootstrap.cc:492] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:21.384315 28906 raft_consensus.cc:515] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.383877 28855 ts_tablet_manager.cc:1403] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.016s
I20260709 13:11:21.373840 28891 raft_consensus.cc:515] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:21.396126 28891 leader_election.cc:290] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:21.389591 28906 leader_election.cc:290] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:21.397231 28855 raft_consensus.cc:359] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.398114 28855 raft_consensus.cc:385] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.398447 28855 raft_consensus.cc:740] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.398211 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f828b4ae5c2846c5a49f1212f73186f0" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:21.399401 28855 consensus_queue.cc:260] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.401942 28855 ts_tablet_manager.cc:1434] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:21.403394 28855 tablet_bootstrap.cc:492] T 5951a1590104426cae727db543f49a83 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
W20260709 13:11:21.406293 28770 leader_election.cc:343] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.406870 28770 leader_election.cc:304] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:21.407006 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb534ab2fc824a7abb24883eb39d17dc" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:21.407794 28887 raft_consensus.cc:2749] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:21.410646 28547 leader_election.cc:343] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.411055 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ba7b5c67b14fcba09e4e6cd16fa09b" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:21.413630 28730 raft_consensus.cc:2468] T 59ba7b5c67b14fcba09e4e6cd16fa09b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 0.
I20260709 13:11:21.418401 28853 tablet_bootstrap.cc:492] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:21.419467 28582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ba7b5c67b14fcba09e4e6cd16fa09b" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:21.417320 28547 leader_election.cc:304] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:21.424836 28848 tablet_bootstrap.cc:492] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:21.427991 28848 ts_tablet_manager.cc:1403] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.108s	user 0.016s	sys 0.012s
I20260709 13:11:21.427799 28869 raft_consensus.cc:2749] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:21.425976 28622 leader_election.cc:343] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.430847 28622 leader_election.cc:304] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:21.432335 28906 raft_consensus.cc:2804] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:21.432720 28906 raft_consensus.cc:493] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.433125 28906 raft_consensus.cc:3060] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.432917 28891 consensus_queue.cc:1048] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:11:21.435606 28696 leader_election.cc:343] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:21.442180 28528 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:21.444409 28855 tablet_bootstrap.cc:654] T 5951a1590104426cae727db543f49a83 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.442222 28848 raft_consensus.cc:359] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:21.456050 28848 raft_consensus.cc:385] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.456470 28848 raft_consensus.cc:740] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.457681 28848 consensus_queue.cc:260] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:21.459116 28906 raft_consensus.cc:515] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.461241 28848 ts_tablet_manager.cc:1434] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:11:21.461755 28906 leader_election.cc:290] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:21.462752 28848 tablet_bootstrap.cc:492] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:21.462955 28582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ba7b5c67b14fcba09e4e6cd16fa09b" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
W20260709 13:11:21.464593 28622 leader_election.cc:343] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:21.465591 28696 consensus_peers.cc:597] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 -> Peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Couldn't send request to peer b8d512840fb74aaf82ac80c433d8dc2d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:21.469129 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ba7b5c67b14fcba09e4e6cd16fa09b" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:21.470971 28732 raft_consensus.cc:3060] T 59ba7b5c67b14fcba09e4e6cd16fa09b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.470052 28852 tablet_bootstrap.cc:654] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.477985 28848 tablet_bootstrap.cc:654] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.483763 28732 raft_consensus.cc:2468] T 59ba7b5c67b14fcba09e4e6cd16fa09b P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 1.
I20260709 13:11:21.486034 28622 leader_election.cc:304] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:21.487272 28906 raft_consensus.cc:2804] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:21.487814 28906 raft_consensus.cc:697] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Becoming Leader. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
I20260709 13:11:21.488726 28906 consensus_queue.cc:237] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.502477 28917 raft_consensus.cc:493] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.503329 28917 raft_consensus.cc:515] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.511040 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ee7ea2ffe41cf9ed43a455e52901f" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:21.511967 28732 raft_consensus.cc:2468] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:21.513734 28547 leader_election.cc:304] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85; no voters: 
I20260709 13:11:21.514828 28920 raft_consensus.cc:2804] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:21.515300 28920 raft_consensus.cc:493] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.516801 28920 raft_consensus.cc:3060] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.516958 28848 tablet_bootstrap.cc:492] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:21.517647 28848 ts_tablet_manager.cc:1403] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.055s	user 0.020s	sys 0.007s
I20260709 13:11:21.517848 28479 catalog_manager.cc:5697] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2). New cstate: current_term: 1 leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:21.519809 28853 tablet_bootstrap.cc:654] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.516137 28917 leader_election.cc:290] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:21.521234 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ee7ea2ffe41cf9ed43a455e52901f" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:21.524520 28848 raft_consensus.cc:359] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.525384 28848 raft_consensus.cc:385] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.525718 28848 raft_consensus.cc:740] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.526544 28848 consensus_queue.cc:260] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
W20260709 13:11:21.527953 28549 leader_election.cc:343] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.528980 28848 ts_tablet_manager.cc:1434] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:11:21.530083 28848 tablet_bootstrap.cc:492] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:21.533046 28920 raft_consensus.cc:515] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.534130 28582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f828b4ae5c2846c5a49f1212f73186f0" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:21.535552 28920 leader_election.cc:290] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
W20260709 13:11:21.535948 28696 leader_election.cc:343] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.536497 28696 leader_election.cc:304] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1515f1138af4333a63996f5d0864d85; no voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:21.537557 28889 raft_consensus.cc:2749] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:21.538213 28848 tablet_bootstrap.cc:654] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.538405 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ee7ea2ffe41cf9ed43a455e52901f" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:21.539084 28732 raft_consensus.cc:3060] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.539392 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ee7ea2ffe41cf9ed43a455e52901f" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
W20260709 13:11:21.541697 28549 leader_election.cc:343] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.542865 28920 raft_consensus.cc:493] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.543393 28920 raft_consensus.cc:515] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.546470 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706fb62a0a7423ca484455f75a16592" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
W20260709 13:11:21.548007 28547 leader_election.cc:343] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.549475 28732 raft_consensus.cc:2468] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:21.550537 28852 tablet_bootstrap.cc:492] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:21.551100 28852 ts_tablet_manager.cc:1403] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.167s	user 0.022s	sys 0.012s
I20260709 13:11:21.550866 28547 leader_election.cc:304] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85; no voters: bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:21.551880 28917 raft_consensus.cc:2804] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:21.552588 28917 raft_consensus.cc:697] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:21.553835 28917 consensus_queue.cc:237] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.554908 28852 raft_consensus.cc:359] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.555794 28852 raft_consensus.cc:385] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.557089 28853 tablet_bootstrap.cc:492] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:21.557796 28853 ts_tablet_manager.cc:1403] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.140s	user 0.012s	sys 0.005s
I20260709 13:11:21.558156 28855 tablet_bootstrap.cc:492] T 5951a1590104426cae727db543f49a83 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:21.558707 28855 ts_tablet_manager.cc:1403] T 5951a1590104426cae727db543f49a83 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.156s	user 0.016s	sys 0.007s
I20260709 13:11:21.562942 28855 raft_consensus.cc:359] T 5951a1590104426cae727db543f49a83 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:21.563993 28855 raft_consensus.cc:385] T 5951a1590104426cae727db543f49a83 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.562942 28853 raft_consensus.cc:359] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.564332 28855 raft_consensus.cc:740] T 5951a1590104426cae727db543f49a83 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.564524 28853 raft_consensus.cc:385] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.565006 28853 raft_consensus.cc:740] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.566759 28920 leader_election.cc:290] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:21.565266 28855 consensus_queue.cc:260] T 5951a1590104426cae727db543f49a83 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:21.567956 28848 tablet_bootstrap.cc:492] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:21.568832 28848 ts_tablet_manager.cc:1403] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.014s
I20260709 13:11:21.567996 28853 consensus_queue.cc:260] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.571447 28848 raft_consensus.cc:359] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.571825 28853 ts_tablet_manager.cc:1434] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:11:21.572086 28848 raft_consensus.cc:385] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.572474 28848 raft_consensus.cc:740] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.573138 28853 tablet_bootstrap.cc:492] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:21.573148 28848 consensus_queue.cc:260] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.568245 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706fb62a0a7423ca484455f75a16592" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:21.575989 28848 ts_tablet_manager.cc:1434] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:21.575891 28656 raft_consensus.cc:2468] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:21.577309 28848 tablet_bootstrap.cc:492] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:21.577508 28549 leader_election.cc:304] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:21.580298 28855 ts_tablet_manager.cc:1434] T 5951a1590104426cae727db543f49a83 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:11:21.580854 28853 tablet_bootstrap.cc:654] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.581517 28855 tablet_bootstrap.cc:492] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:21.580169 28480 catalog_manager.cc:5697] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:21.584446 28848 tablet_bootstrap.cc:654] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.589459 28852 raft_consensus.cc:740] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.590678 28852 consensus_queue.cc:260] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.593364 28853 tablet_bootstrap.cc:492] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:21.593937 28853 ts_tablet_manager.cc:1403] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 13:11:21.596125 28848 tablet_bootstrap.cc:492] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:21.596622 28848 ts_tablet_manager.cc:1403] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:11:21.597174 28887 raft_consensus.cc:493] T 5951a1590104426cae727db543f49a83 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.597304 28853 raft_consensus.cc:359] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:21.598052 28887 raft_consensus.cc:515] T 5951a1590104426cae727db543f49a83 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:21.598692 28853 raft_consensus.cc:385] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.599031 28853 raft_consensus.cc:740] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.599649 28848 raft_consensus.cc:359] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.600382 28848 raft_consensus.cc:385] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.599876 28853 consensus_queue.cc:260] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:21.600709 28848 raft_consensus.cc:740] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.602234 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5951a1590104426cae727db543f49a83" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:21.603844 28906 raft_consensus.cc:493] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.602536 28853 ts_tablet_manager.cc:1434] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:11:21.604594 28920 raft_consensus.cc:2804] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:21.604413 28906 raft_consensus.cc:515] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.605058 28920 raft_consensus.cc:493] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.605733 28853 tablet_bootstrap.cc:492] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:21.606060 28887 leader_election.cc:290] T 5951a1590104426cae727db543f49a83 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:21.606612 28887 raft_consensus.cc:493] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.606705 28906 leader_election.cc:290] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:21.607144 28887 raft_consensus.cc:515] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.609136 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ee7ea2ffe41cf9ed43a455e52901f" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:21.609201 28582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ee7ea2ffe41cf9ed43a455e52901f" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:21.605520 28920 raft_consensus.cc:3060] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.610209 28732 raft_consensus.cc:2393] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfd745f89b014f7b85fbf7d909fe2fb0 in current term 1: Already voted for candidate 44a14c00fc3d41bea8db00310408905a in this term.
I20260709 13:11:21.611414 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d51007007a4252908beaaaa3ee8374" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:21.612088 28622 leader_election.cc:304] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
W20260709 13:11:21.612896 28770 leader_election.cc:343] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.613327 28906 raft_consensus.cc:3060] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.603297 28848 consensus_queue.cc:260] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.622083 28853 tablet_bootstrap.cc:654] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.623529 28848 ts_tablet_manager.cc:1434] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:11:21.624610 28848 tablet_bootstrap.cc:492] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:21.627156 28887 leader_election.cc:290] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:21.628883 28658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d51007007a4252908beaaaa3ee8374" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:21.621421 28906 raft_consensus.cc:2749] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:21.630759 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5951a1590104426cae727db543f49a83" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:21.631964 28848 tablet_bootstrap.cc:654] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:21.630759 28772 leader_election.cc:343] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.633208 28772 leader_election.cc:304] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:21.635284 28902 raft_consensus.cc:2749] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:21.635411 28772 leader_election.cc:304] T 5951a1590104426cae727db543f49a83 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:21.635979 28902 raft_consensus.cc:493] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.636693 28902 raft_consensus.cc:515] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.639856 28902 leader_election.cc:290] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:21.642289 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c32a52cb724ba28e6fc6c8cf8e9a88" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
W20260709 13:11:21.644732 28770 leader_election.cc:343] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.647913 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c32a52cb724ba28e6fc6c8cf8e9a88" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:21.648789 28656 raft_consensus.cc:2468] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
I20260709 13:11:21.650652 28772 leader_election.cc:304] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:21.652263 28902 raft_consensus.cc:2749] T 5951a1590104426cae727db543f49a83 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:21.653200 28902 raft_consensus.cc:2804] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:21.653734 28902 raft_consensus.cc:493] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.654408 28902 raft_consensus.cc:3060] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.661875 28852 ts_tablet_manager.cc:1434] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.110s	user 0.009s	sys 0.002s
I20260709 13:11:21.664005 28852 tablet_bootstrap.cc:492] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:21.677601 28848 tablet_bootstrap.cc:492] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:21.678166 28848 ts_tablet_manager.cc:1403] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.054s	user 0.018s	sys 0.029s
I20260709 13:11:21.680495 28848 raft_consensus.cc:359] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:21.680985 28848 raft_consensus.cc:385] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.681178 28848 raft_consensus.cc:740] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.682006 28920 raft_consensus.cc:515] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.682317 28848 consensus_queue.cc:260] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:21.685393 28848 ts_tablet_manager.cc:1434] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:21.686504 28848 tablet_bootstrap.cc:492] T 51806e14724e4433b368faa0c997a11e P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:21.686388 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706fb62a0a7423ca484455f75a16592" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
W20260709 13:11:21.688189 28547 leader_election.cc:343] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.688987 28853 tablet_bootstrap.cc:492] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:21.689504 28853 ts_tablet_manager.cc:1403] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.084s	user 0.032s	sys 0.036s
I20260709 13:11:21.690344 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706fb62a0a7423ca484455f75a16592" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:21.690950 28656 raft_consensus.cc:3060] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.692617 28852 tablet_bootstrap.cc:654] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.689256 28902 raft_consensus.cc:515] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.693030 28853 raft_consensus.cc:359] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.693756 28853 raft_consensus.cc:385] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.694025 28853 raft_consensus.cc:740] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.694208 28855 tablet_bootstrap.cc:700] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent opening tablet: real 0.105s	user 0.005s	sys 0.000s
I20260709 13:11:21.694914 28855 tablet_bootstrap.cc:654] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.694756 28853 consensus_queue.cc:260] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.696388 28848 tablet_bootstrap.cc:654] T 51806e14724e4433b368faa0c997a11e P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.697129 28853 ts_tablet_manager.cc:1434] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:21.698108 28853 tablet_bootstrap.cc:492] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:21.699091 28656 raft_consensus.cc:2468] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:21.700349 28549 leader_election.cc:304] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:21.701237 28917 raft_consensus.cc:2804] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:21.701777 28917 raft_consensus.cc:697] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:21.702596 28917 consensus_queue.cc:237] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.704164 28853 tablet_bootstrap.cc:654] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.707787 28920 leader_election.cc:290] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:21.713618 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c32a52cb724ba28e6fc6c8cf8e9a88" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
W20260709 13:11:21.717320 28770 leader_election.cc:343] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.723548 28902 leader_election.cc:290] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:21.723794 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c32a52cb724ba28e6fc6c8cf8e9a88" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:21.724428 28656 raft_consensus.cc:3060] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.737854 28848 tablet_bootstrap.cc:492] T 51806e14724e4433b368faa0c997a11e P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:21.738389 28848 ts_tablet_manager.cc:1403] T 51806e14724e4433b368faa0c997a11e P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.024s
I20260709 13:11:21.740875 28852 tablet_bootstrap.cc:492] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:21.741667 28852 ts_tablet_manager.cc:1403] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.004s
I20260709 13:11:21.740958 28479 catalog_manager.cc:5697] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:21.744705 28852 raft_consensus.cc:359] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:21.745461 28852 raft_consensus.cc:385] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.745883 28852 raft_consensus.cc:740] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.741211 28848 raft_consensus.cc:359] T 51806e14724e4433b368faa0c997a11e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.746649 28848 raft_consensus.cc:385] T 51806e14724e4433b368faa0c997a11e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.746856 28656 raft_consensus.cc:2468] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:21.747545 28852 consensus_queue.cc:260] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:21.746954 28848 raft_consensus.cc:740] T 51806e14724e4433b368faa0c997a11e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.748291 28772 leader_election.cc:304] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:21.748929 28848 consensus_queue.cc:260] T 51806e14724e4433b368faa0c997a11e P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.749635 28853 tablet_bootstrap.cc:492] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:21.749673 28902 raft_consensus.cc:2804] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:21.750177 28853 ts_tablet_manager.cc:1403] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.013s
I20260709 13:11:21.750725 28902 raft_consensus.cc:697] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:21.751026 28848 ts_tablet_manager.cc:1434] T 51806e14724e4433b368faa0c997a11e P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:11:21.752009 28848 tablet_bootstrap.cc:492] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:21.751693 28902 consensus_queue.cc:237] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.753350 28855 tablet_bootstrap.cc:492] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:21.762387 28848 tablet_bootstrap.cc:654] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.765460 28917 raft_consensus.cc:493] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.757540 28853 raft_consensus.cc:359] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:21.770934 28855 ts_tablet_manager.cc:1403] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.190s	user 0.016s	sys 0.006s
I20260709 13:11:21.771153 28853 raft_consensus.cc:385] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.771827 28853 raft_consensus.cc:740] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.771116 28917 raft_consensus.cc:515] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:21.755425 28852 ts_tablet_manager.cc:1434] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:11:21.772693 28853 consensus_queue.cc:260] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:21.774212 28852 tablet_bootstrap.cc:492] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:21.774919 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f828b4ae5c2846c5a49f1212f73186f0" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:21.775398 28853 ts_tablet_manager.cc:1434] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.025s	user 0.011s	sys 0.009s
I20260709 13:11:21.775667 28732 raft_consensus.cc:2468] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:21.776458 28853 tablet_bootstrap.cc:492] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:21.777261 28547 leader_election.cc:304] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85; no voters: 
I20260709 13:11:21.778281 28920 raft_consensus.cc:2804] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:21.778702 28920 raft_consensus.cc:493] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.779031 28920 raft_consensus.cc:3060] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.779080 28869 raft_consensus.cc:493] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.779592 28869 raft_consensus.cc:515] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:21.779912 28906 raft_consensus.cc:493] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.780469 28906 raft_consensus.cc:515] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.781701 28869 leader_election.cc:290] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:21.782701 28906 leader_election.cc:290] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:21.783087 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f041b85d184414b3939425b35e4a1c" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:21.783754 28805 raft_consensus.cc:2468] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:21.784157 28853 tablet_bootstrap.cc:654] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.784533 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07d8385470b4fc285eb6703e6fa42b9" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:21.785353 28855 raft_consensus.cc:359] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
W20260709 13:11:21.785960 28622 leader_election.cc:343] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.786248 28855 raft_consensus.cc:385] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.786322 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f041b85d184414b3939425b35e4a1c" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:21.786692 28855 raft_consensus.cc:740] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.787232 28852 tablet_bootstrap.cc:654] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.785986 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07d8385470b4fc285eb6703e6fa42b9" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:21.787827 28855 consensus_queue.cc:260] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
W20260709 13:11:21.789300 28622 leader_election.cc:343] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.789848 28622 leader_election.cc:304] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:21.791574 28547 leader_election.cc:304] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:21.792862 28869 raft_consensus.cc:2804] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:21.793314 28869 raft_consensus.cc:493] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.793766 28869 raft_consensus.cc:3060] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.796346 28853 tablet_bootstrap.cc:492] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:21.796933 28853 ts_tablet_manager.cc:1403] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 13:11:21.787060 28732 raft_consensus.cc:2468] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:21.799734 28906 raft_consensus.cc:2749] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:21.800153 28853 raft_consensus.cc:359] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.800972 28853 raft_consensus.cc:385] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.801287 28853 raft_consensus.cc:740] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.801443 28855 ts_tablet_manager.cc:1434] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:11:21.802342 28853 consensus_queue.cc:260] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.802917 28855 tablet_bootstrap.cc:492] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:21.808352 28920 raft_consensus.cc:515] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:21.812510 28853 ts_tablet_manager.cc:1434] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.008s
I20260709 13:11:21.813222 28917 leader_election.cc:290] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:21.814551 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f828b4ae5c2846c5a49f1212f73186f0" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:21.816016 28855 tablet_bootstrap.cc:654] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.820724 28853 tablet_bootstrap.cc:492] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:21.821324 28805 raft_consensus.cc:2468] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:21.818763 28869 raft_consensus.cc:515] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:21.825021 28869 leader_election.cc:290] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:21.827184 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f041b85d184414b3939425b35e4a1c" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:21.828974 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f041b85d184414b3939425b35e4a1c" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:21.829840 28805 raft_consensus.cc:3060] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.828203 28732 raft_consensus.cc:3060] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.848405 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f828b4ae5c2846c5a49f1212f73186f0" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:21.849370 28730 raft_consensus.cc:3060] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.850206 28853 tablet_bootstrap.cc:654] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.859387 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f828b4ae5c2846c5a49f1212f73186f0" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:21.866712 28806 raft_consensus.cc:3060] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.857048 28479 catalog_manager.cc:5697] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 0 to 1, leader changed from <none> to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 1 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:21.870801 28853 tablet_bootstrap.cc:492] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:21.871552 28853 ts_tablet_manager.cc:1403] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.004s
I20260709 13:11:21.874742 28853 raft_consensus.cc:359] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.875100 28732 raft_consensus.cc:2468] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:21.875597 28853 raft_consensus.cc:385] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.884249 28805 raft_consensus.cc:2468] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:21.858110 28920 leader_election.cc:290] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:21.885147 28869 raft_consensus.cc:493] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.885730 28869 raft_consensus.cc:515] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.886277 28547 leader_election.cc:304] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:21.887701 28730 raft_consensus.cc:2468] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:21.887972 28869 leader_election.cc:290] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:21.885208 28853 raft_consensus.cc:740] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.888803 28869 raft_consensus.cc:2804] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:21.889091 28853 consensus_queue.cc:260] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.889556 28869 raft_consensus.cc:697] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:21.890843 28853 ts_tablet_manager.cc:1434] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:11:21.891783 28853 tablet_bootstrap.cc:492] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:21.890861 28869 consensus_queue.cc:237] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:21.892382 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2988b7e9dc0942a69ce7dcb8db26ca27" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:21.895339 28906 raft_consensus.cc:493] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.896040 28906 raft_consensus.cc:515] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:21.898645 28853 tablet_bootstrap.cc:654] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.899813 28906 leader_election.cc:290] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:21.899878 28879 raft_consensus.cc:493] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.900594 28879 raft_consensus.cc:515] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:21.903069 28879 leader_election.cc:290] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:21.906823 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea260fc2f384cd7a7f947d2bf8cb49b" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:21.908295 28804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b572160c667242bfbd4ece3e3f26f505" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:21.908182 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b572160c667242bfbd4ece3e3f26f505" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:21.909612 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea260fc2f384cd7a7f947d2bf8cb49b" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
W20260709 13:11:21.910926 28622 leader_election.cc:343] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:21.911701 28622 leader_election.cc:343] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.912038 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2988b7e9dc0942a69ce7dcb8db26ca27" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:21.912109 28622 leader_election.cc:304] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d
W20260709 13:11:21.913699 28622 leader_election.cc:343] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:21.914523 28622 leader_election.cc:343] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:21.915051 28622 leader_election.cc:304] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:21.916603 28879 raft_consensus.cc:2749] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:21.917456 28879 raft_consensus.cc:2749] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:21.918891 28889 raft_consensus.cc:493] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.919452 28889 raft_consensus.cc:515] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.919945 28547 leader_election.cc:304] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:21.921468 28945 raft_consensus.cc:2749] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:21.923308 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51806e14724e4433b368faa0c997a11e" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:21.924094 28656 raft_consensus.cc:2468] T 51806e14724e4433b368faa0c997a11e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 0.
I20260709 13:11:21.925290 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51806e14724e4433b368faa0c997a11e" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:21.926081 28583 raft_consensus.cc:2468] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 0.
I20260709 13:11:21.927460 28696 leader_election.cc:304] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85; no voters: 
I20260709 13:11:21.927740 28889 leader_election.cc:290] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:21.928474 28855 tablet_bootstrap.cc:492] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:21.928463 28862 raft_consensus.cc:2804] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:21.929348 28862 raft_consensus.cc:493] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.929852 28547 leader_election.cc:304] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85; no voters: 
I20260709 13:11:21.930258 28855 ts_tablet_manager.cc:1403] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.128s	user 0.028s	sys 0.058s
I20260709 13:11:21.929888 28862 raft_consensus.cc:3060] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.934331 28852 tablet_bootstrap.cc:492] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:21.934975 28848 tablet_bootstrap.cc:492] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:21.935123 28855 raft_consensus.cc:359] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.937605 28848 ts_tablet_manager.cc:1403] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.186s	user 0.029s	sys 0.043s
I20260709 13:11:21.937601 28855 raft_consensus.cc:385] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.938474 28855 raft_consensus.cc:740] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.939677 28855 consensus_queue.cc:260] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.937088 28920 raft_consensus.cc:2804] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:21.943506 28855 ts_tablet_manager.cc:1434] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 13:11:21.943363 28848 raft_consensus.cc:359] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.943754 28920 raft_consensus.cc:697] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:21.944139 28848 raft_consensus.cc:385] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.944448 28848 raft_consensus.cc:740] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.944914 28855 tablet_bootstrap.cc:492] T 6ea260fc2f384cd7a7f947d2bf8cb49b P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:21.945086 28920 consensus_queue.cc:237] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:21.945153 28848 consensus_queue.cc:260] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.940580 28862 raft_consensus.cc:515] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.947180 28852 ts_tablet_manager.cc:1403] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.173s	user 0.023s	sys 0.044s
I20260709 13:11:21.949404 28848 ts_tablet_manager.cc:1434] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:11:21.950790 28848 tablet_bootstrap.cc:492] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:21.953227 28479 catalog_manager.cc:5697] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:21.953883 28852 raft_consensus.cc:359] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:21.954054 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51806e14724e4433b368faa0c997a11e" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:21.954537 28852 raft_consensus.cc:385] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.954772 28583 raft_consensus.cc:3060] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.954875 28852 raft_consensus.cc:740] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.955873 28852 consensus_queue.cc:260] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:21.956933 28848 tablet_bootstrap.cc:654] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.964318 28583 raft_consensus.cc:2468] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:21.967605 28852 ts_tablet_manager.cc:1434] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:11:21.968727 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51806e14724e4433b368faa0c997a11e" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:21.969662 28656 raft_consensus.cc:3060] T 51806e14724e4433b368faa0c997a11e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:21.972442 28855 tablet_bootstrap.cc:654] T 6ea260fc2f384cd7a7f947d2bf8cb49b P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.983389 28852 tablet_bootstrap.cc:492] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:21.984135 28853 tablet_bootstrap.cc:492] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:21.984848 28853 ts_tablet_manager.cc:1403] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.093s	user 0.023s	sys 0.030s
I20260709 13:11:21.988757 28853 raft_consensus.cc:359] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.989908 28853 raft_consensus.cc:385] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:21.990273 28853 raft_consensus.cc:740] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:21.991232 28852 tablet_bootstrap.cc:654] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:21.992151 28853 consensus_queue.cc:260] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:21.993367 28696 leader_election.cc:304] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85; no voters: 
I20260709 13:11:21.992057 28862 leader_election.cc:290] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:21.991698 28806 raft_consensus.cc:2468] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:21.994486 28889 raft_consensus.cc:2804] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:21.999781 28869 consensus_queue.cc:1048] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:11:22.004123 28848 tablet_bootstrap.cc:492] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:22.011564 28848 ts_tablet_manager.cc:1403] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.061s	user 0.018s	sys 0.036s
I20260709 13:11:22.009336 28479 catalog_manager.cc:5697] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:22.012777 28889 raft_consensus.cc:697] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:22.004705 28582 raft_consensus.cc:3060] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.014621 28848 raft_consensus.cc:359] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.013697 28889 consensus_queue.cc:237] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:22.015374 28848 raft_consensus.cc:385] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.016322 28848 raft_consensus.cc:740] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.017009 28848 consensus_queue.cc:260] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:21.998268 28855 tablet_bootstrap.cc:492] T 6ea260fc2f384cd7a7f947d2bf8cb49b P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:22.019097 28855 ts_tablet_manager.cc:1403] T 6ea260fc2f384cd7a7f947d2bf8cb49b P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.074s	user 0.008s	sys 0.008s
I20260709 13:11:22.019204 28848 ts_tablet_manager.cc:1434] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:22.024514 28848 tablet_bootstrap.cc:492] T d69a0e6ca32e4d8080aed2fe4405d7f5 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:22.000501 28656 raft_consensus.cc:2468] T 51806e14724e4433b368faa0c997a11e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:21.995608 28853 ts_tablet_manager.cc:1434] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.001s
I20260709 13:11:22.027223 28853 tablet_bootstrap.cc:492] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:22.029145 28920 raft_consensus.cc:493] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.022809 28855 raft_consensus.cc:359] T 6ea260fc2f384cd7a7f947d2bf8cb49b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.034263 28855 raft_consensus.cc:385] T 6ea260fc2f384cd7a7f947d2bf8cb49b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.034732 28855 raft_consensus.cc:740] T 6ea260fc2f384cd7a7f947d2bf8cb49b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.035020 28906 consensus_queue.cc:1048] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:22.037520 28848 tablet_bootstrap.cc:654] T d69a0e6ca32e4d8080aed2fe4405d7f5 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.043889 28855 consensus_queue.cc:260] T 6ea260fc2f384cd7a7f947d2bf8cb49b P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.046356 28855 ts_tablet_manager.cc:1434] T 6ea260fc2f384cd7a7f947d2bf8cb49b P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:11:22.030776 28920 raft_consensus.cc:515] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.047516 28855 tablet_bootstrap.cc:492] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:22.049988 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d51007007a4252908beaaaa3ee8374" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:22.051141 28806 raft_consensus.cc:2468] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:22.052515 28547 leader_election.cc:304] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:22.053730 28869 raft_consensus.cc:2804] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:22.054148 28869 raft_consensus.cc:493] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.054581 28848 tablet_bootstrap.cc:492] T d69a0e6ca32e4d8080aed2fe4405d7f5 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:22.055068 28855 tablet_bootstrap.cc:654] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.055318 28848 ts_tablet_manager.cc:1403] T d69a0e6ca32e4d8080aed2fe4405d7f5 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.002s
I20260709 13:11:22.054530 28869 raft_consensus.cc:3060] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.042992 28853 tablet_bootstrap.cc:654] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.065340 28658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d51007007a4252908beaaaa3ee8374" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:22.066576 28658 raft_consensus.cc:2468] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:22.074584 28582 raft_consensus.cc:3060] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.074451 28848 raft_consensus.cc:359] T d69a0e6ca32e4d8080aed2fe4405d7f5 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.075361 28848 raft_consensus.cc:385] T d69a0e6ca32e4d8080aed2fe4405d7f5 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.075687 28848 raft_consensus.cc:740] T d69a0e6ca32e4d8080aed2fe4405d7f5 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.076011 28917 consensus_queue.cc:1048] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:22.080466 28869 raft_consensus.cc:515] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.060298 28477 catalog_manager.cc:5697] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 1 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:22.085345 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d51007007a4252908beaaaa3ee8374" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:22.084242 28848 consensus_queue.cc:260] T d69a0e6ca32e4d8080aed2fe4405d7f5 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.086248 28806 raft_consensus.cc:3060] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.088764 28848 ts_tablet_manager.cc:1434] T d69a0e6ca32e4d8080aed2fe4405d7f5 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:11:22.089854 28848 tablet_bootstrap.cc:492] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
W20260709 13:11:22.094805 28698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:43021, user_credentials={real_user=slave}} blocked reactor thread for 71547.1us
I20260709 13:11:22.096768 28869 leader_election.cc:290] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:22.097743 28658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d51007007a4252908beaaaa3ee8374" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:22.100662 28920 leader_election.cc:290] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:22.099828 28658 raft_consensus.cc:3060] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.100070 28889 raft_consensus.cc:493] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.127971 28855 tablet_bootstrap.cc:492] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:22.128511 28855 ts_tablet_manager.cc:1403] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.027s
I20260709 13:11:22.133924 28805 raft_consensus.cc:3060] T 5951a1590104426cae727db543f49a83 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.139086 28803 raft_consensus.cc:3060] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.116806 28889 raft_consensus.cc:515] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.167667 28855 raft_consensus.cc:359] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.168503 28855 raft_consensus.cc:385] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.168874 28855 raft_consensus.cc:740] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.169600 28855 consensus_queue.cc:260] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.163522 28917 raft_consensus.cc:493] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.173812 28855 ts_tablet_manager.cc:1434] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.002s
I20260709 13:11:22.174938 28855 tablet_bootstrap.cc:492] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:22.178514 28848 tablet_bootstrap.cc:654] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.178916 28879 consensus_queue.cc:1048] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:22.180189 28889 leader_election.cc:290] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:22.184121 28853 tablet_bootstrap.cc:492] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:22.184633 28853 ts_tablet_manager.cc:1403] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.158s	user 0.010s	sys 0.004s
I20260709 13:11:22.197299 28804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea260fc2f384cd7a7f947d2bf8cb49b" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:22.198066 28581 raft_consensus.cc:3060] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.198344 28804 raft_consensus.cc:2468] T 6ea260fc2f384cd7a7f947d2bf8cb49b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 0.
I20260709 13:11:22.174337 28917 raft_consensus.cc:515] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:22.203578 28917 leader_election.cc:290] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:22.194444 28806 raft_consensus.cc:2468] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:22.205117 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff91a748d3f464ab00fc3e657057d73" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:22.205485 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff91a748d3f464ab00fc3e657057d73" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:22.206009 28655 raft_consensus.cc:2468] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
W20260709 13:11:22.206945 28547 leader_election.cc:343] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.207755 28547 leader_election.cc:304] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:22.208102 28549 leader_election.cc:304] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:22.208645 28869 raft_consensus.cc:2804] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:22.209096 28869 raft_consensus.cc:697] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:22.209249 28945 raft_consensus.cc:2804] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:22.209703 28945 raft_consensus.cc:493] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.210048 28945 raft_consensus.cc:3060] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.208910 28853 raft_consensus.cc:359] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.210136 28869 consensus_queue.cc:237] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.210772 28853 raft_consensus.cc:385] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.211683 28852 tablet_bootstrap.cc:492] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:22.212189 28852 ts_tablet_manager.cc:1403] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.229s	user 0.042s	sys 0.028s
I20260709 13:11:22.211131 28853 raft_consensus.cc:740] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.213441 28696 leader_election.cc:304] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:22.213948 28853 consensus_queue.cc:260] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.214480 28862 raft_consensus.cc:2804] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:22.215086 28862 raft_consensus.cc:493] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.215513 28862 raft_consensus.cc:3060] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.216807 28853 ts_tablet_manager.cc:1434] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:11:22.217921 28853 tablet_bootstrap.cc:492] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:22.233670 28852 raft_consensus.cc:359] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.234897 28852 raft_consensus.cc:385] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.235277 28852 raft_consensus.cc:740] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
W20260709 13:11:22.242268 28962 log.cc:927] Time spent T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:11:22.231401 28658 raft_consensus.cc:2468] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:22.244807 28852 consensus_queue.cc:260] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.256345 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea260fc2f384cd7a7f947d2bf8cb49b" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:22.257301 28656 raft_consensus.cc:2468] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 0.
I20260709 13:11:22.258682 28887 raft_consensus.cc:493] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.259202 28887 raft_consensus.cc:515] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.266590 28852 ts_tablet_manager.cc:1434] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.054s	user 0.005s	sys 0.003s
I20260709 13:11:22.267375 28852 tablet_bootstrap.cc:492] T eb534ab2fc824a7abb24883eb39d17dc P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:22.271668 28969 consensus_queue.cc:1048] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:11:22.274737 28855 tablet_bootstrap.cc:654] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.275236 28902 consensus_queue.cc:1048] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:22.276444 28862 raft_consensus.cc:515] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.281625 28887 leader_election.cc:290] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:22.284173 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706fb62a0a7423ca484455f75a16592" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:22.284849 28657 raft_consensus.cc:2468] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:22.266016 28945 raft_consensus.cc:515] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:22.285933 28772 leader_election.cc:304] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:22.287847 28945 leader_election.cc:290] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:22.288967 28917 raft_consensus.cc:493] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.296804 28917 raft_consensus.cc:515] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.297112 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea260fc2f384cd7a7f947d2bf8cb49b" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:22.298075 28806 raft_consensus.cc:3060] T 6ea260fc2f384cd7a7f947d2bf8cb49b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.289475 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea260fc2f384cd7a7f947d2bf8cb49b" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:22.298776 28656 raft_consensus.cc:3060] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.301677 28887 consensus_queue.cc:1048] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:22.313784 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff91a748d3f464ab00fc3e657057d73" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:22.314451 28657 raft_consensus.cc:3060] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.316383 28917 leader_election.cc:290] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:22.319906 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c32a52cb724ba28e6fc6c8cf8e9a88" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:22.320835 28804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0c32a52cb724ba28e6fc6c8cf8e9a88" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:22.295590 28862 leader_election.cc:290] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:22.323082 28806 raft_consensus.cc:2468] T 6ea260fc2f384cd7a7f947d2bf8cb49b P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:22.323427 28547 leader_election.cc:304] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:22.324457 28970 consensus_queue.cc:1048] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:22.328282 28696 leader_election.cc:304] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:22.329279 28862 raft_consensus.cc:2804] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:22.329715 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff91a748d3f464ab00fc3e657057d73" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:22.329876 28862 raft_consensus.cc:697] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:22.317248 28852 tablet_bootstrap.cc:654] T eb534ab2fc824a7abb24883eb39d17dc P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.333655 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706fb62a0a7423ca484455f75a16592" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
W20260709 13:11:22.336174 28547 leader_election.cc:343] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.334200 28862 consensus_queue.cc:237] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.342998 28869 consensus_queue.cc:1048] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:22.346742 28657 raft_consensus.cc:2468] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:22.347430 28853 tablet_bootstrap.cc:654] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.354307 28902 raft_consensus.cc:2804] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:22.356724 28549 leader_election.cc:304] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:22.360968 28855 tablet_bootstrap.cc:492] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:22.361723 28855 ts_tablet_manager.cc:1403] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.187s	user 0.023s	sys 0.020s
I20260709 13:11:22.364966 28848 tablet_bootstrap.cc:492] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:22.363916 28917 raft_consensus.cc:2804] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:22.367871 28902 raft_consensus.cc:493] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:22.369261 28848 ts_tablet_manager.cc:1403] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.280s	user 0.015s	sys 0.010s
I20260709 13:11:22.368366 28902 raft_consensus.cc:3060] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.372200 28917 raft_consensus.cc:697] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:22.394191 28855 raft_consensus.cc:359] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.397408 28477 catalog_manager.cc:5697] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 1 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.395124 28656 raft_consensus.cc:2468] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:22.398396 28855 raft_consensus.cc:385] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.397624 28848 raft_consensus.cc:359] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.400992 28848 raft_consensus.cc:385] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.401247 28848 raft_consensus.cc:740] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.381026 28970 raft_consensus.cc:2749] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:22.400583 28855 raft_consensus.cc:740] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.401850 28848 consensus_queue.cc:260] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.405851 28848 ts_tablet_manager.cc:1434] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:11:22.406821 28848 tablet_bootstrap.cc:492] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:22.410414 28855 consensus_queue.cc:260] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.416446 28855 ts_tablet_manager.cc:1434] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 13:11:22.417904 28852 tablet_bootstrap.cc:492] T eb534ab2fc824a7abb24883eb39d17dc P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:22.418421 28852 ts_tablet_manager.cc:1403] T eb534ab2fc824a7abb24883eb39d17dc P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.151s	user 0.010s	sys 0.005s
I20260709 13:11:22.419477 28855 tablet_bootstrap.cc:492] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:22.422356 28902 raft_consensus.cc:515] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.423511 28803 raft_consensus.cc:1240] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Rejecting Update request from peer 44a14c00fc3d41bea8db00310408905a for earlier term 1. Current term is 2. Ops: []
I20260709 13:11:22.428498 28852 raft_consensus.cc:359] T eb534ab2fc824a7abb24883eb39d17dc P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.430318 28852 raft_consensus.cc:385] T eb534ab2fc824a7abb24883eb39d17dc P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.430603 28852 raft_consensus.cc:740] T eb534ab2fc824a7abb24883eb39d17dc P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.431962 28852 consensus_queue.cc:260] T eb534ab2fc824a7abb24883eb39d17dc P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.435200 28902 leader_election.cc:290] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:22.435309 28972 consensus_queue.cc:1059] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:22.436210 28869 raft_consensus.cc:493] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.436368 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706fb62a0a7423ca484455f75a16592" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:22.436678 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706fb62a0a7423ca484455f75a16592" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:22.436848 28869 raft_consensus.cc:515] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.437813 28972 raft_consensus.cc:3055] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:22.438179 28972 raft_consensus.cc:740] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:22.438692 28770 leader_election.cc:304] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:22.438977 28972 consensus_queue.cc:260] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.439656 28902 raft_consensus.cc:2749] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:22.440085 28972 raft_consensus.cc:3060] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:22.441079 28869 leader_election.cc:290] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:22.441227 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07d8385470b4fc285eb6703e6fa42b9" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:22.440438 28852 ts_tablet_manager.cc:1434] T eb534ab2fc824a7abb24883eb39d17dc P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 13:11:22.440352 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07d8385470b4fc285eb6703e6fa42b9" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:22.442591 28657 raft_consensus.cc:2468] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
W20260709 13:11:22.442880 28547 leader_election.cc:343] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.444139 28549 leader_election.cc:304] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:22.444885 28869 raft_consensus.cc:2804] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:22.445293 28869 raft_consensus.cc:493] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.445739 28869 raft_consensus.cc:3060] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:22.440403 28945 consensus_queue.cc:1175] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:11:22.434600 28917 consensus_queue.cc:237] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
W20260709 13:11:22.455389 28528 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:22.458087 28869 raft_consensus.cc:515] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.462098 28853 tablet_bootstrap.cc:492] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:22.475191 28853 ts_tablet_manager.cc:1403] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.257s	user 0.024s	sys 0.005s
I20260709 13:11:22.462496 28852 tablet_bootstrap.cc:492] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:22.467702 28970 consensus_queue.cc:1048] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:22.481132 28855 tablet_bootstrap.cc:654] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.484062 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07d8385470b4fc285eb6703e6fa42b9" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:22.484593 28848 tablet_bootstrap.cc:654] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:22.486104 28547 leader_election.cc:343] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.495139 28853 raft_consensus.cc:359] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.499472 28853 raft_consensus.cc:385] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.499848 28853 raft_consensus.cc:740] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.505594 28852 tablet_bootstrap.cc:654] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.507720 28902 raft_consensus.cc:493] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.508293 28902 raft_consensus.cc:515] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.510455 28902 leader_election.cc:290] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:22.512156 28972 consensus_queue.cc:1048] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:22.498791 28869 leader_election.cc:290] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:22.513801 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb534ab2fc824a7abb24883eb39d17dc" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:22.516238 28853 consensus_queue.cc:260] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.519937 28732 raft_consensus.cc:2468] T eb534ab2fc824a7abb24883eb39d17dc P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
I20260709 13:11:22.521147 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07d8385470b4fc285eb6703e6fa42b9" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:22.521929 28654 raft_consensus.cc:3060] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.522899 28770 leader_election.cc:304] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:22.524070 28902 raft_consensus.cc:2804] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:22.524498 28902 raft_consensus.cc:493] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.524873 28902 raft_consensus.cc:3060] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.528486 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb534ab2fc824a7abb24883eb39d17dc" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:22.533979 28583 raft_consensus.cc:2468] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
I20260709 13:11:22.535285 28848 tablet_bootstrap.cc:492] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:22.535828 28848 ts_tablet_manager.cc:1403] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.129s	user 0.013s	sys 0.003s
I20260709 13:11:22.536692 28887 raft_consensus.cc:493] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.537232 28887 raft_consensus.cc:515] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.538779 28848 raft_consensus.cc:359] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:22.539471 28848 raft_consensus.cc:385] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.539744 28848 raft_consensus.cc:740] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.539793 28887 leader_election.cc:290] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:22.540354 28855 tablet_bootstrap.cc:492] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:22.540485 28902 raft_consensus.cc:515] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.540582 28848 consensus_queue.cc:260] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:22.540943 28855 ts_tablet_manager.cc:1403] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.122s	user 0.016s	sys 0.012s
I20260709 13:11:22.542021 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d69a0e6ca32e4d8080aed2fe4405d7f5" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:22.543290 28848 ts_tablet_manager.cc:1434] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:22.542797 28657 raft_consensus.cc:2468] T d69a0e6ca32e4d8080aed2fe4405d7f5 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
I20260709 13:11:22.544432 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d69a0e6ca32e4d8080aed2fe4405d7f5" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:22.545770 28732 raft_consensus.cc:2468] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
I20260709 13:11:22.546602 28848 tablet_bootstrap.cc:492] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:22.545152 28917 consensus_queue.cc:1048] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:11:22.547683 28772 leader_election.cc:304] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:22.549774 28887 raft_consensus.cc:2804] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:22.550242 28887 raft_consensus.cc:493] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.550678 28887 raft_consensus.cc:3060] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.554664 28848 tablet_bootstrap.cc:654] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.556025 28853 ts_tablet_manager.cc:1434] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.001s
I20260709 13:11:22.557997 28902 leader_election.cc:290] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:22.558499 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb534ab2fc824a7abb24883eb39d17dc" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:22.558552 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb534ab2fc824a7abb24883eb39d17dc" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:22.559231 28732 raft_consensus.cc:3060] T eb534ab2fc824a7abb24883eb39d17dc P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.559389 28583 raft_consensus.cc:3060] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.560577 28654 raft_consensus.cc:2468] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:22.562700 28853 tablet_bootstrap.cc:492] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:22.565604 28549 leader_election.cc:304] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:22.566784 28917 raft_consensus.cc:2804] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:22.568482 28917 raft_consensus.cc:697] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:22.569614 28917 consensus_queue.cc:237] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.570195 28583 raft_consensus.cc:2468] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:22.573004 28770 leader_election.cc:304] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:22.574132 28983 raft_consensus.cc:2804] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:22.574601 28983 raft_consensus.cc:697] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:22.575374 28983 consensus_queue.cc:237] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.527485 28477 catalog_manager.cc:5697] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.582504 28732 raft_consensus.cc:2468] T eb534ab2fc824a7abb24883eb39d17dc P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:22.584262 28852 tablet_bootstrap.cc:492] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:22.584724 28852 ts_tablet_manager.cc:1403] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.122s	user 0.016s	sys 0.004s
I20260709 13:11:22.585497 28855 raft_consensus.cc:359] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.586212 28855 raft_consensus.cc:385] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.586463 28855 raft_consensus.cc:740] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.602909 28853 tablet_bootstrap.cc:654] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.604959 28848 tablet_bootstrap.cc:492] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:22.605568 28848 ts_tablet_manager.cc:1403] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.003s
I20260709 13:11:22.605422 28855 consensus_queue.cc:260] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.606369 28983 raft_consensus.cc:493] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.606812 28983 raft_consensus.cc:515] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.607672 28855 ts_tablet_manager.cc:1434] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.000s
I20260709 13:11:22.587266 28852 raft_consensus.cc:359] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.595594 28889 consensus_queue.cc:1048] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:22.609758 28852 raft_consensus.cc:385] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.610085 28852 raft_consensus.cc:740] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.610414 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07d8385470b4fc285eb6703e6fa42b9" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:22.610764 28862 consensus_queue.cc:1048] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:22.611799 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07d8385470b4fc285eb6703e6fa42b9" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:22.608939 28855 tablet_bootstrap.cc:492] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:22.613147 28654 raft_consensus.cc:2393] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8d512840fb74aaf82ac80c433d8dc2d in current term 1: Already voted for candidate 44a14c00fc3d41bea8db00310408905a in this term.
I20260709 13:11:22.612627 28852 consensus_queue.cc:260] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.608875 28848 raft_consensus.cc:359] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:22.596956 28887 raft_consensus.cc:515] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.616308 28848 raft_consensus.cc:385] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.619129 28772 leader_election.cc:304] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:22.622444 28855 tablet_bootstrap.cc:654] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.622987 28848 raft_consensus.cc:740] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.626802 28852 ts_tablet_manager.cc:1434] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.002s
I20260709 13:11:22.628055 28852 tablet_bootstrap.cc:492] T 841b18d7f11c485bba96eda7dce0c27e P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:22.626557 28848 consensus_queue.cc:260] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:22.605263 28480 catalog_manager.cc:5697] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 0 to 1, leader changed from <none> to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 1 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.615358 28983 leader_election.cc:290] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:22.637825 28902 raft_consensus.cc:3060] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.638000 28479 catalog_manager.cc:5697] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.644423 28479 catalog_manager.cc:5697] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.660784 28902 raft_consensus.cc:2749] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:22.667820 28852 tablet_bootstrap.cc:654] T 841b18d7f11c485bba96eda7dce0c27e P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.672960 28853 tablet_bootstrap.cc:492] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:22.673732 28853 ts_tablet_manager.cc:1403] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.111s	user 0.014s	sys 0.009s
I20260709 13:11:22.675959 28848 ts_tablet_manager.cc:1434] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.070s	user 0.011s	sys 0.035s
I20260709 13:11:22.677321 28848 tablet_bootstrap.cc:492] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:22.680960 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d69a0e6ca32e4d8080aed2fe4405d7f5" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:22.681706 28654 raft_consensus.cc:3060] T d69a0e6ca32e4d8080aed2fe4405d7f5 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.690181 28654 raft_consensus.cc:2468] T d69a0e6ca32e4d8080aed2fe4405d7f5 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:22.691656 28772 leader_election.cc:304] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:22.692654 28902 raft_consensus.cc:2804] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:22.677184 28853 raft_consensus.cc:359] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.693949 28853 raft_consensus.cc:385] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.694480 28853 raft_consensus.cc:740] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.694507 28848 tablet_bootstrap.cc:654] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.697849 28902 raft_consensus.cc:697] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:22.700309 28902 consensus_queue.cc:237] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.717020 28853 consensus_queue.cc:260] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.724255 28853 ts_tablet_manager.cc:1434] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 13:11:22.725193 28887 leader_election.cc:290] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:22.726377 28853 tablet_bootstrap.cc:492] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:22.729278 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d69a0e6ca32e4d8080aed2fe4405d7f5" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:22.730008 28730 raft_consensus.cc:3060] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.730237 28855 tablet_bootstrap.cc:492] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:22.730432 28917 consensus_queue.cc:1048] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:22.730751 28855 ts_tablet_manager.cc:1403] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.122s	user 0.023s	sys 0.026s
I20260709 13:11:22.741154 28852 tablet_bootstrap.cc:492] T 841b18d7f11c485bba96eda7dce0c27e P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:22.741827 28852 ts_tablet_manager.cc:1403] T 841b18d7f11c485bba96eda7dce0c27e P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.114s	user 0.018s	sys 0.006s
I20260709 13:11:22.744725 28852 raft_consensus.cc:359] T 841b18d7f11c485bba96eda7dce0c27e P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.745554 28852 raft_consensus.cc:385] T 841b18d7f11c485bba96eda7dce0c27e P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.747049 28852 raft_consensus.cc:740] T 841b18d7f11c485bba96eda7dce0c27e P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.747984 28852 consensus_queue.cc:260] T 841b18d7f11c485bba96eda7dce0c27e P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.742707 28730 raft_consensus.cc:2468] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:22.754427 28853 tablet_bootstrap.cc:654] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.756206 28855 raft_consensus.cc:359] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.756961 28855 raft_consensus.cc:385] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.757230 28855 raft_consensus.cc:740] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.761293 28855 consensus_queue.cc:260] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.763746 28855 ts_tablet_manager.cc:1434] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:11:22.763338 28480 catalog_manager.cc:5697] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 0 to 1, leader changed from <none> to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 1 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:22.764761 28855 tablet_bootstrap.cc:492] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:22.765452 28852 ts_tablet_manager.cc:1434] T 841b18d7f11c485bba96eda7dce0c27e P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:11:22.767621 28852 tablet_bootstrap.cc:492] T 45c6993be42044c3b7dbb095971f7c88 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:22.770963 28855 tablet_bootstrap.cc:654] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.776434 28852 tablet_bootstrap.cc:654] T 45c6993be42044c3b7dbb095971f7c88 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.782544 28848 tablet_bootstrap.cc:492] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:22.783226 28848 ts_tablet_manager.cc:1403] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.106s	user 0.019s	sys 0.004s
I20260709 13:11:22.786118 28848 raft_consensus.cc:359] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.786818 28848 raft_consensus.cc:385] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.787070 28848 raft_consensus.cc:740] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.787734 28848 consensus_queue.cc:260] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.792074 28848 ts_tablet_manager.cc:1434] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:22.793090 28848 tablet_bootstrap.cc:492] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:22.801731 28852 tablet_bootstrap.cc:492] T 45c6993be42044c3b7dbb095971f7c88 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:22.802304 28852 ts_tablet_manager.cc:1403] T 45c6993be42044c3b7dbb095971f7c88 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.006s
I20260709 13:11:22.805013 28852 raft_consensus.cc:359] T 45c6993be42044c3b7dbb095971f7c88 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.805711 28852 raft_consensus.cc:385] T 45c6993be42044c3b7dbb095971f7c88 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.805972 28852 raft_consensus.cc:740] T 45c6993be42044c3b7dbb095971f7c88 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.806737 29000 raft_consensus.cc:493] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.806869 28852 consensus_queue.cc:260] T 45c6993be42044c3b7dbb095971f7c88 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.807241 29000 raft_consensus.cc:515] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:22.809850 29000 leader_election.cc:290] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:22.815092 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47110731ce12413ab60b16f034fdceb3" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:22.816061 28887 raft_consensus.cc:493] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.816571 28887 raft_consensus.cc:515] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
W20260709 13:11:22.817169 28622 leader_election.cc:343] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.818734 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47110731ce12413ab60b16f034fdceb3" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:22.818732 28887 leader_election.cc:290] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:22.819917 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c6993be42044c3b7dbb095971f7c88" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:22.820657 28730 raft_consensus.cc:2468] T 45c6993be42044c3b7dbb095971f7c88 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
I20260709 13:11:22.822170 28770 leader_election.cc:304] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:22.823014 28887 raft_consensus.cc:2804] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:22.823387 28887 raft_consensus.cc:493] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.823751 28887 raft_consensus.cc:3060] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.824530 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c6993be42044c3b7dbb095971f7c88" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
W20260709 13:11:22.826611 28622 leader_election.cc:343] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.827087 28622 leader_election.cc:304] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
W20260709 13:11:22.828583 28770 leader_election.cc:343] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.832008 29000 raft_consensus.cc:2749] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:22.833597 28970 consensus_queue.cc:1048] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:22.806435 28848 tablet_bootstrap.cc:654] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.837925 28996 raft_consensus.cc:493] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.838413 28996 raft_consensus.cc:515] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.842876 28996 leader_election.cc:290] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:22.843354 28852 ts_tablet_manager.cc:1434] T 45c6993be42044c3b7dbb095971f7c88 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:11:22.843533 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841b18d7f11c485bba96eda7dce0c27e" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:22.845918 28730 raft_consensus.cc:2468] T 841b18d7f11c485bba96eda7dce0c27e P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 0.
I20260709 13:11:22.846897 28852 tablet_bootstrap.cc:492] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:22.846402 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841b18d7f11c485bba96eda7dce0c27e" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:22.849171 28622 leader_election.cc:304] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:22.850667 28996 raft_consensus.cc:2804] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:22.852878 28996 raft_consensus.cc:493] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.853545 28996 raft_consensus.cc:3060] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:22.855237 28622 leader_election.cc:343] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.851776 28887 raft_consensus.cc:515] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.859784 28887 leader_election.cc:290] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:22.860483 28970 raft_consensus.cc:493] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.860773 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c6993be42044c3b7dbb095971f7c88" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:22.861032 28970 raft_consensus.cc:515] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
W20260709 13:11:22.862213 28770 leader_election.cc:343] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.863083 28970 leader_election.cc:290] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:22.863010 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c6993be42044c3b7dbb095971f7c88" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:22.863775 28730 raft_consensus.cc:3060] T 45c6993be42044c3b7dbb095971f7c88 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.866173 28862 consensus_queue.cc:1048] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:22.866896 28855 tablet_bootstrap.cc:492] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:22.867378 28855 ts_tablet_manager.cc:1403] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.103s	user 0.023s	sys 0.030s
I20260709 13:11:22.867311 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19240a871550411aafbc885984ade97d" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:22.868057 28732 raft_consensus.cc:2468] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:22.869311 28547 leader_election.cc:304] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85; no voters: 
I20260709 13:11:22.869853 28996 raft_consensus.cc:515] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.871101 28855 raft_consensus.cc:359] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.871785 28855 raft_consensus.cc:385] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.872052 28855 raft_consensus.cc:740] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.872840 28855 consensus_queue.cc:260] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:22.873502 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841b18d7f11c485bba96eda7dce0c27e" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:22.874353 28732 raft_consensus.cc:3060] T 841b18d7f11c485bba96eda7dce0c27e P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.875046 28855 ts_tablet_manager.cc:1434] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:22.875998 28855 tablet_bootstrap.cc:492] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:22.876566 28730 raft_consensus.cc:2468] T 45c6993be42044c3b7dbb095971f7c88 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:22.877583 28970 raft_consensus.cc:2804] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:22.877905 28770 leader_election.cc:304] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:22.878822 28970 raft_consensus.cc:493] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.878334 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19240a871550411aafbc885984ade97d" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:22.879204 28970 raft_consensus.cc:3060] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.879695 28805 raft_consensus.cc:2468] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:22.880620 28887 raft_consensus.cc:2804] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:22.881896 28887 raft_consensus.cc:697] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:22.882727 28853 tablet_bootstrap.cc:492] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:22.886700 28853 ts_tablet_manager.cc:1403] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.161s	user 0.022s	sys 0.008s
I20260709 13:11:22.886871 28887 consensus_queue.cc:237] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.888092 28970 raft_consensus.cc:515] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.889761 28945 raft_consensus.cc:493] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.885519 28732 raft_consensus.cc:2468] T 841b18d7f11c485bba96eda7dce0c27e P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 1.
I20260709 13:11:22.890457 29000 raft_consensus.cc:493] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.890297 28945 raft_consensus.cc:515] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.891127 29000 raft_consensus.cc:515] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:22.891782 28622 leader_election.cc:304] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:22.892825 28879 raft_consensus.cc:2804] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:22.893630 29000 leader_election.cc:290] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:22.893481 28879 raft_consensus.cc:697] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Becoming Leader. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
I20260709 13:11:22.894565 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a726976321d04177a6d77e9ef0041f3f" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:22.894961 28879 consensus_queue.cc:237] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
W20260709 13:11:22.896618 28549 leader_election.cc:343] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.897871 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a726976321d04177a6d77e9ef0041f3f" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:22.890368 28853 raft_consensus.cc:359] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:22.899176 28853 raft_consensus.cc:385] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.899471 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452914c1abfd43389431daaf7ebee1c0" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:22.899906 28855 tablet_bootstrap.cc:654] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.900699 28996 leader_election.cc:290] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
W20260709 13:11:22.900995 28547 leader_election.cc:343] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.901283 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841b18d7f11c485bba96eda7dce0c27e" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:22.901774 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452914c1abfd43389431daaf7ebee1c0" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:22.901979 28547 leader_election.cc:304] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0
W20260709 13:11:22.903039 28622 leader_election.cc:343] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.903350 28972 raft_consensus.cc:2749] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:22.899538 28853 raft_consensus.cc:740] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
W20260709 13:11:22.904938 28622 leader_election.cc:343] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.905910 28852 tablet_bootstrap.cc:654] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.905488 28853 consensus_queue.cc:260] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:22.893383 28945 leader_election.cc:290] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:22.906952 28583 raft_consensus.cc:2468] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 0.
I20260709 13:11:22.910583 28622 leader_election.cc:304] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:22.912112 28996 raft_consensus.cc:2804] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:22.912599 28996 raft_consensus.cc:493] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.913060 28996 raft_consensus.cc:3060] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.915714 28853 ts_tablet_manager.cc:1434] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:11:22.917083 28853 tablet_bootstrap.cc:492] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:22.918052 28955 consensus_queue.cc:1048] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:22.927801 28481 catalog_manager.cc:5697] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 0 to 1, leader changed from <none> to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 1 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.928539 28996 raft_consensus.cc:515] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:22.941340 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452914c1abfd43389431daaf7ebee1c0" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:22.942183 28583 raft_consensus.cc:3060] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.943399 28879 raft_consensus.cc:493] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.943980 28879 raft_consensus.cc:515] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:22.946305 28879 leader_election.cc:290] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:22.948410 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf9ce9ce3ac4f848ae7f5b584711f3e" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:22.959532 28917 consensus_queue.cc:1048] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:22.963541 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf9ce9ce3ac4f848ae7f5b584711f3e" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
W20260709 13:11:22.965708 28622 leader_election.cc:343] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:22.966789 28622 leader_election.cc:343] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:22.971133 28848 tablet_bootstrap.cc:492] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:22.971812 28848 ts_tablet_manager.cc:1403] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.179s	user 0.013s	sys 0.015s
I20260709 13:11:22.971971 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19240a871550411aafbc885984ade97d" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:22.972743 28730 raft_consensus.cc:3060] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.974160 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19240a871550411aafbc885984ade97d" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:22.974758 28803 raft_consensus.cc:3060] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:22.975031 28848 raft_consensus.cc:359] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:22.975777 28848 raft_consensus.cc:385] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.976063 28848 raft_consensus.cc:740] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.982352 28855 tablet_bootstrap.cc:492] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:22.982923 28855 ts_tablet_manager.cc:1403] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.107s	user 0.018s	sys 0.017s
I20260709 13:11:22.983800 28803 raft_consensus.cc:2468] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:22.976791 28848 consensus_queue.cc:260] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:22.985049 28547 leader_election.cc:304] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:22.986792 28917 raft_consensus.cc:2804] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:22.987368 28853 tablet_bootstrap.cc:654] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:22.987505 28917 raft_consensus.cc:697] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:22.987834 28848 ts_tablet_manager.cc:1434] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:11:22.988451 28917 consensus_queue.cc:237] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.990705 28855 raft_consensus.cc:359] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.991425 28855 raft_consensus.cc:385] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:22.991788 28855 raft_consensus.cc:740] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:22.992627 28855 consensus_queue.cc:260] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:22.997154 28852 tablet_bootstrap.cc:492] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:22.994714 28855 ts_tablet_manager.cc:1434] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:11:22.997530 28970 leader_election.cc:290] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:22.997750 28852 ts_tablet_manager.cc:1403] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.154s	user 0.021s	sys 0.001s
I20260709 13:11:22.998641 28917 consensus_queue.cc:1048] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:22.989054 28848 tablet_bootstrap.cc:492] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:23.004377 28853 tablet_bootstrap.cc:492] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:23.004944 28853 ts_tablet_manager.cc:1403] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.000s
I20260709 13:11:23.004071 28852 raft_consensus.cc:359] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.006605 28852 raft_consensus.cc:385] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.006876 28852 raft_consensus.cc:740] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.009078 28848 tablet_bootstrap.cc:654] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.009047 28852 consensus_queue.cc:260] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.011869 28853 raft_consensus.cc:359] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.012848 28853 raft_consensus.cc:385] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.013275 28853 raft_consensus.cc:740] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.014519 28853 consensus_queue.cc:260] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.018162 28853 ts_tablet_manager.cc:1434] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:11:23.020795 28855 tablet_bootstrap.cc:492] T b572160c667242bfbd4ece3e3f26f505 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:23.020740 28481 catalog_manager.cc:5697] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:23.022758 28852 ts_tablet_manager.cc:1434] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:11:23.028793 28730 raft_consensus.cc:2468] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:23.019660 28853 tablet_bootstrap.cc:492] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:23.042536 28955 raft_consensus.cc:493] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.043249 28955 raft_consensus.cc:515] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.045579 28955 leader_election.cc:290] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:23.048246 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b572160c667242bfbd4ece3e3f26f505" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:23.031817 28855 tablet_bootstrap.cc:654] T b572160c667242bfbd4ece3e3f26f505 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:23.049506 28696 leader_election.cc:343] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.034099 28852 tablet_bootstrap.cc:492] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:23.042623 28996 leader_election.cc:290] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:23.052273 28853 tablet_bootstrap.cc:654] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.033553 28622 leader_election.cc:304] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:23.057292 28996 raft_consensus.cc:2749] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:23.054708 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:43597, user_credentials={real_user=slave}} blocked reactor thread for 87947.4us
I20260709 13:11:23.068081 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452914c1abfd43389431daaf7ebee1c0" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:23.069813 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b572160c667242bfbd4ece3e3f26f505" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:23.070547 28654 raft_consensus.cc:2468] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 0.
W20260709 13:11:23.071842 28622 leader_election.cc:343] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.072194 28698 leader_election.cc:304] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:23.072925 28852 tablet_bootstrap.cc:654] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.073505 28955 raft_consensus.cc:2804] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:23.073926 28955 raft_consensus.cc:493] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.074316 28955 raft_consensus.cc:3060] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.078781 28848 tablet_bootstrap.cc:492] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:23.079340 28848 ts_tablet_manager.cc:1403] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.020s
W20260709 13:11:23.079818 28547 consensus_peers.cc:597] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a -> Peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Couldn't send request to peer a1515f1138af4333a63996f5d0864d85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:23.082222 28848 raft_consensus.cc:359] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.082968 28848 raft_consensus.cc:385] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.083235 28848 raft_consensus.cc:740] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.083904 28848 consensus_queue.cc:260] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.086094 28848 ts_tablet_manager.cc:1434] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:11:23.087147 28848 tablet_bootstrap.cc:492] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:23.086802 28955 raft_consensus.cc:515] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.079988 28481 catalog_manager.cc:5697] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2). New cstate: current_term: 1 leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:22.966382 28583 raft_consensus.cc:2468] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 1.
I20260709 13:11:23.091295 28622 leader_election.cc:304] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:23.092854 28996 raft_consensus.cc:2804] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:23.089846 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b572160c667242bfbd4ece3e3f26f505" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:23.093786 28996 raft_consensus.cc:697] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Becoming Leader. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
I20260709 13:11:23.094033 28654 raft_consensus.cc:3060] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.094929 28996 consensus_queue.cc:237] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:23.096050 28855 tablet_bootstrap.cc:492] T b572160c667242bfbd4ece3e3f26f505 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:23.096596 28855 ts_tablet_manager.cc:1403] T b572160c667242bfbd4ece3e3f26f505 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.076s	user 0.017s	sys 0.017s
I20260709 13:11:23.097289 28848 tablet_bootstrap.cc:654] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.097998 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b572160c667242bfbd4ece3e3f26f505" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
W20260709 13:11:23.099401 28696 leader_election.cc:343] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.099325 28855 raft_consensus.cc:359] T b572160c667242bfbd4ece3e3f26f505 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.100057 28855 raft_consensus.cc:385] T b572160c667242bfbd4ece3e3f26f505 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.100340 28855 raft_consensus.cc:740] T b572160c667242bfbd4ece3e3f26f505 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.100697 28852 tablet_bootstrap.cc:492] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:23.101420 28852 ts_tablet_manager.cc:1403] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.000s
I20260709 13:11:23.102823 28853 tablet_bootstrap.cc:492] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:23.107892 28955 leader_election.cc:290] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:23.109411 28869 raft_consensus.cc:493] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.110107 28869 raft_consensus.cc:515] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.156845 28855 consensus_queue.cc:260] T b572160c667242bfbd4ece3e3f26f505 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.162994 28852 raft_consensus.cc:359] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:23.164330 28853 ts_tablet_manager.cc:1403] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.145s	user 0.028s	sys 0.017s
I20260709 13:11:23.189318 28852 raft_consensus.cc:385] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.190388 28852 raft_consensus.cc:740] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.191442 28852 consensus_queue.cc:260] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:23.168370 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e876ee31f15e4349b3086338a4d5f288" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:23.170886 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e876ee31f15e4349b3086338a4d5f288" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:23.186575 28917 consensus_queue.cc:1048] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:23.195796 28656 raft_consensus.cc:2468] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:23.197142 28549 leader_election.cc:304] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:23.197628 28848 tablet_bootstrap.cc:492] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
W20260709 13:11:23.197898 28547 leader_election.cc:343] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.198150 28848 ts_tablet_manager.cc:1403] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.111s	user 0.045s	sys 0.050s
I20260709 13:11:23.198187 28917 raft_consensus.cc:2804] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:23.200217 28917 raft_consensus.cc:493] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.200584 28917 raft_consensus.cc:3060] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.168797 28855 ts_tablet_manager.cc:1434] T b572160c667242bfbd4ece3e3f26f505 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.072s	user 0.004s	sys 0.017s
I20260709 13:11:23.201102 28848 raft_consensus.cc:359] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.201936 28848 raft_consensus.cc:385] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.195623 28902 consensus_queue.cc:1048] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:23.202517 28848 raft_consensus.cc:740] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.203400 28848 consensus_queue.cc:260] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.205617 28848 ts_tablet_manager.cc:1434] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:11:23.205714 28476 catalog_manager.cc:5697] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2). New cstate: current_term: 1 leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:23.206686 28848 tablet_bootstrap.cc:492] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:23.180207 28654 raft_consensus.cc:2468] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:23.192099 28853 raft_consensus.cc:359] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:23.209642 28853 raft_consensus.cc:385] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.210083 28853 raft_consensus.cc:740] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.210238 28698 leader_election.cc:304] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:23.209090 28902 raft_consensus.cc:493] T b572160c667242bfbd4ece3e3f26f505 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.211576 28889 raft_consensus.cc:2804] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:23.211256 28902 raft_consensus.cc:515] T b572160c667242bfbd4ece3e3f26f505 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.212108 28889 raft_consensus.cc:697] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:23.213415 28848 tablet_bootstrap.cc:654] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.212953 28889 consensus_queue.cc:237] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.215348 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b572160c667242bfbd4ece3e3f26f505" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:23.216162 28656 raft_consensus.cc:2393] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8d512840fb74aaf82ac80c433d8dc2d in current term 1: Already voted for candidate a1515f1138af4333a63996f5d0864d85 in this term.
I20260709 13:11:23.216684 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b572160c667242bfbd4ece3e3f26f505" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:23.170593 28869 leader_election.cc:290] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:23.218890 28770 leader_election.cc:304] T b572160c667242bfbd4ece3e3f26f505 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:23.220064 28902 leader_election.cc:290] T b572160c667242bfbd4ece3e3f26f505 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:23.220564 28852 ts_tablet_manager.cc:1434] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.118s	user 0.009s	sys 0.019s
I20260709 13:11:23.202330 28855 tablet_bootstrap.cc:492] T 841b18d7f11c485bba96eda7dce0c27e P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:23.221376 28902 raft_consensus.cc:3060] T b572160c667242bfbd4ece3e3f26f505 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.221635 28852 tablet_bootstrap.cc:492] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:23.237157 28855 tablet_bootstrap.cc:654] T 841b18d7f11c485bba96eda7dce0c27e P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.226882 28853 consensus_queue.cc:260] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:23.248714 28902 raft_consensus.cc:2749] T b572160c667242bfbd4ece3e3f26f505 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:23.249182 28853 ts_tablet_manager.cc:1434] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.001s
I20260709 13:11:23.250285 28853 tablet_bootstrap.cc:492] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:23.254633 28902 consensus_queue.cc:1048] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:23.238113 28848 tablet_bootstrap.cc:492] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:23.261014 28848 ts_tablet_manager.cc:1403] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.002s
I20260709 13:11:23.263952 28848 raft_consensus.cc:359] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.229112 28478 catalog_manager.cc:5697] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 1 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:23.228895 28887 consensus_queue.cc:1048] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:11:23.275592 28855 tablet_bootstrap.cc:492] T 841b18d7f11c485bba96eda7dce0c27e P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:23.276247 28855 ts_tablet_manager.cc:1403] T 841b18d7f11c485bba96eda7dce0c27e P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.003s
I20260709 13:11:23.279035 28855 raft_consensus.cc:359] T 841b18d7f11c485bba96eda7dce0c27e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.279755 28855 raft_consensus.cc:385] T 841b18d7f11c485bba96eda7dce0c27e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.280022 28855 raft_consensus.cc:740] T 841b18d7f11c485bba96eda7dce0c27e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.280692 28855 consensus_queue.cc:260] T 841b18d7f11c485bba96eda7dce0c27e P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.242189 28852 tablet_bootstrap.cc:654] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.241741 28917 raft_consensus.cc:515] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.282375 28855 ts_tablet_manager.cc:1434] T 841b18d7f11c485bba96eda7dce0c27e P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260709 13:11:23.283286 28855 tablet_bootstrap.cc:492] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:23.284098 28917 leader_election.cc:290] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:23.284320 28902 consensus_queue.cc:1048] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:23.285808 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e876ee31f15e4349b3086338a4d5f288" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:23.286415 28654 raft_consensus.cc:3060] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.289573 28855 tablet_bootstrap.cc:654] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.265239 28848 raft_consensus.cc:385] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.290359 28848 raft_consensus.cc:740] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.291545 28848 consensus_queue.cc:260] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.294693 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e876ee31f15e4349b3086338a4d5f288" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
W20260709 13:11:23.296893 28547 leader_election.cc:343] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.297163 28848 ts_tablet_manager.cc:1434] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:11:23.299767 28848 tablet_bootstrap.cc:492] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:23.316861 28848 tablet_bootstrap.cc:654] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.319306 28654 raft_consensus.cc:2468] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:23.320665 28887 raft_consensus.cc:493] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.321120 28549 leader_election.cc:304] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:23.321468 28887 raft_consensus.cc:515] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.322929 28869 raft_consensus.cc:2804] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:23.323953 28869 raft_consensus.cc:697] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:23.324900 28887 leader_election.cc:290] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:23.326889 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52ad167603d40ada7680f844e2e59c8" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:23.328760 28770 leader_election.cc:343] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.329069 28853 tablet_bootstrap.cc:654] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.324968 28869 consensus_queue.cc:237] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.332378 28658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52ad167603d40ada7680f844e2e59c8" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
W20260709 13:11:23.334143 28772 leader_election.cc:343] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.334671 28772 leader_election.cc:304] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:23.338760 28887 raft_consensus.cc:2749] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:23.339700 28887 consensus_queue.cc:1048] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:23.340806 28852 tablet_bootstrap.cc:492] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:23.341354 28852 ts_tablet_manager.cc:1403] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.120s	user 0.010s	sys 0.000s
I20260709 13:11:23.343014 28887 raft_consensus.cc:493] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.343722 28887 raft_consensus.cc:515] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:23.347728 28887 leader_election.cc:290] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:23.349390 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d860d29a21a423cbbf0d8d9480d56ef" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:23.350328 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d860d29a21a423cbbf0d8d9480d56ef" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:23.351641 28770 leader_election.cc:343] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:23.352924 28770 leader_election.cc:343] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.353636 28770 leader_election.cc:304] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:23.355433 29032 raft_consensus.cc:2749] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:23.356781 28852 raft_consensus.cc:359] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:23.357647 28852 raft_consensus.cc:385] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.358011 28852 raft_consensus.cc:740] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.358775 28852 consensus_queue.cc:260] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:23.366010 28855 tablet_bootstrap.cc:492] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:23.366742 28855 ts_tablet_manager.cc:1403] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.048s
I20260709 13:11:23.367139 28889 raft_consensus.cc:493] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.367728 28889 raft_consensus.cc:515] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:23.369975 28855 raft_consensus.cc:359] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.370923 28855 raft_consensus.cc:385] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.371289 28855 raft_consensus.cc:740] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.371831 28658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff91a748d3f464ab00fc3e657057d73" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:23.372031 28855 consensus_queue.cc:260] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.373760 28889 leader_election.cc:290] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:23.374384 28855 ts_tablet_manager.cc:1434] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:23.375461 28855 tablet_bootstrap.cc:492] T a726976321d04177a6d77e9ef0041f3f P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:23.377126 28852 ts_tablet_manager.cc:1434] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:11:23.380188 28996 raft_consensus.cc:493] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.384294 28996 raft_consensus.cc:515] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.385648 28848 tablet_bootstrap.cc:492] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:23.388863 28848 ts_tablet_manager.cc:1403] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.089s	user 0.009s	sys 0.005s
I20260709 13:11:23.385641 28853 tablet_bootstrap.cc:492] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:23.389864 28853 ts_tablet_manager.cc:1403] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.140s	user 0.005s	sys 0.007s
I20260709 13:11:23.390610 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a726976321d04177a6d77e9ef0041f3f" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:23.391489 28581 raft_consensus.cc:2468] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 0.
I20260709 13:11:23.391706 28848 raft_consensus.cc:359] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.392449 28848 raft_consensus.cc:385] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.392696 28848 raft_consensus.cc:740] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.393321 28848 consensus_queue.cc:260] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.394807 28622 leader_election.cc:304] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:23.395709 28906 raft_consensus.cc:2804] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:11:23.383534 28770 consensus_peers.cc:597] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:23.386538 28996 leader_election.cc:290] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:23.382119 28855 tablet_bootstrap.cc:654] T a726976321d04177a6d77e9ef0041f3f P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.387617 28852 tablet_bootstrap.cc:492] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:23.381870 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff91a748d3f464ab00fc3e657057d73" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:23.388139 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a726976321d04177a6d77e9ef0041f3f" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:23.396116 28906 raft_consensus.cc:493] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.397785 28906 raft_consensus.cc:3060] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.398785 28696 leader_election.cc:304] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1515f1138af4333a63996f5d0864d85; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:23.399892 28889 raft_consensus.cc:2749] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:23.395808 28848 ts_tablet_manager.cc:1434] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:23.401448 28848 tablet_bootstrap.cc:492] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:23.405649 28879 consensus_queue.cc:1048] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:23.407435 28853 raft_consensus.cc:359] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:23.408136 28848 tablet_bootstrap.cc:654] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.408375 28853 raft_consensus.cc:385] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.408701 28853 raft_consensus.cc:740] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.409396 28853 consensus_queue.cc:260] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:23.411588 28853 ts_tablet_manager.cc:1434] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.021s	user 0.000s	sys 0.004s
W20260709 13:11:23.412128 28622 leader_election.cc:343] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.420097 28853 tablet_bootstrap.cc:492] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:23.423941 28852 tablet_bootstrap.cc:654] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.428200 28887 raft_consensus.cc:493] T 841b18d7f11c485bba96eda7dce0c27e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.429231 28853 tablet_bootstrap.cc:654] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.440037 28887 raft_consensus.cc:515] T 841b18d7f11c485bba96eda7dce0c27e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.440886 28803 raft_consensus.cc:3060] T 841b18d7f11c485bba96eda7dce0c27e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.442263 28887 leader_election.cc:290] T 841b18d7f11c485bba96eda7dce0c27e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:23.431536 28480 catalog_manager.cc:5697] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:23.443257 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841b18d7f11c485bba96eda7dce0c27e" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:23.443507 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841b18d7f11c485bba96eda7dce0c27e" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:23.433990 28848 tablet_bootstrap.cc:492] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:23.435271 28996 raft_consensus.cc:493] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.436128 28869 consensus_queue.cc:1048] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:23.445006 28996 raft_consensus.cc:515] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:23.426126 28906 raft_consensus.cc:515] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.446982 28772 leader_election.cc:304] T 841b18d7f11c485bba96eda7dce0c27e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:23.444727 28848 ts_tablet_manager.cc:1403] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.012s
I20260709 13:11:23.456981 28996 leader_election.cc:290] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:23.456496 28906 leader_election.cc:290] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:23.467190 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a726976321d04177a6d77e9ef0041f3f" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:23.465292 28852 tablet_bootstrap.cc:492] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:23.467991 28855 tablet_bootstrap.cc:492] T a726976321d04177a6d77e9ef0041f3f P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:23.469410 28852 ts_tablet_manager.cc:1403] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.082s	user 0.018s	sys 0.000s
I20260709 13:11:23.469465 28855 ts_tablet_manager.cc:1403] T a726976321d04177a6d77e9ef0041f3f P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.094s	user 0.015s	sys 0.022s
I20260709 13:11:23.479544 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0093a1dad264ec1b3d9d3f896262ff7" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:23.480391 28583 raft_consensus.cc:2468] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 0.
I20260709 13:11:23.482577 28852 raft_consensus.cc:359] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:23.483394 28852 raft_consensus.cc:385] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.483698 28852 raft_consensus.cc:740] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.491871 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a726976321d04177a6d77e9ef0041f3f" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:23.492540 28581 raft_consensus.cc:3060] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.491340 28852 consensus_queue.cc:260] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:23.497709 28889 raft_consensus.cc:493] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.498250 28889 raft_consensus.cc:515] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:23.499570 28853 tablet_bootstrap.cc:492] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:23.500094 28853 ts_tablet_manager.cc:1403] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.006s
W20260709 13:11:23.500697 28622 leader_election.cc:343] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.501497 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0093a1dad264ec1b3d9d3f896262ff7" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:23.502125 28732 raft_consensus.cc:2468] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 0.
I20260709 13:11:23.502794 28853 raft_consensus.cc:359] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:23.503474 28853 raft_consensus.cc:385] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.503741 28853 raft_consensus.cc:740] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.504168 28581 raft_consensus.cc:2468] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 1.
I20260709 13:11:23.504623 28853 consensus_queue.cc:260] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:23.505455 28862 raft_consensus.cc:493] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.505648 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0093a1dad264ec1b3d9d3f896262ff7" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:23.505936 28862 raft_consensus.cc:515] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:23.506392 28656 raft_consensus.cc:2468] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 0.
I20260709 13:11:23.507154 28853 ts_tablet_manager.cc:1434] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:23.507761 28698 leader_election.cc:304] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:23.511385 28853 tablet_bootstrap.cc:492] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:23.507913 28862 leader_election.cc:290] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:23.513273 28848 raft_consensus.cc:359] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.513988 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d860d29a21a423cbbf0d8d9480d56ef" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:23.511222 28869 consensus_queue.cc:1048] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:23.514652 28583 raft_consensus.cc:2468] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 0.
I20260709 13:11:23.514736 28855 raft_consensus.cc:359] T a726976321d04177a6d77e9ef0041f3f P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.511940 28889 leader_election.cc:290] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:23.512825 28955 raft_consensus.cc:2804] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:23.513224 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d860d29a21a423cbbf0d8d9480d56ef" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:23.517021 28887 raft_consensus.cc:2749] T 841b18d7f11c485bba96eda7dce0c27e P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:23.519444 28806 raft_consensus.cc:2468] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 0.
I20260709 13:11:23.506398 28622 leader_election.cc:304] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:23.515569 28855 raft_consensus.cc:385] T a726976321d04177a6d77e9ef0041f3f P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.521389 28955 raft_consensus.cc:493] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.514241 28848 raft_consensus.cc:385] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.522377 28855 raft_consensus.cc:740] T a726976321d04177a6d77e9ef0041f3f P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.524488 28848 raft_consensus.cc:740] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.522827 28622 leader_election.cc:304] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:23.527534 28848 consensus_queue.cc:260] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.528846 28996 raft_consensus.cc:2804] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:23.522631 28906 raft_consensus.cc:2804] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:23.530773 28906 raft_consensus.cc:493] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.531034 28848 ts_tablet_manager.cc:1434] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.000s
I20260709 13:11:23.531206 28906 raft_consensus.cc:3060] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.532143 28848 tablet_bootstrap.cc:492] T 1e4d79b8251f445ba4ee93c33bb13df3 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:23.525457 28855 consensus_queue.cc:260] T a726976321d04177a6d77e9ef0041f3f P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.530139 28996 raft_consensus.cc:697] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Becoming Leader. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
I20260709 13:11:23.524430 28955 raft_consensus.cc:3060] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.517414 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0093a1dad264ec1b3d9d3f896262ff7" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:23.536841 28581 raft_consensus.cc:2468] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 0.
I20260709 13:11:23.536386 28996 consensus_queue.cc:237] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.540263 28696 leader_election.cc:304] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85; no voters: 
I20260709 13:11:23.541595 28889 raft_consensus.cc:2804] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:23.541993 28889 raft_consensus.cc:493] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.542335 28889 raft_consensus.cc:3060] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.548394 28906 raft_consensus.cc:515] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:23.556425 28855 ts_tablet_manager.cc:1434] T a726976321d04177a6d77e9ef0041f3f P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.000s
I20260709 13:11:23.557523 28855 tablet_bootstrap.cc:492] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:23.563867 29000 consensus_queue.cc:1048] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:23.564453 28730 raft_consensus.cc:3060] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.565487 28887 raft_consensus.cc:493] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.566056 28887 raft_consensus.cc:515] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.568356 28887 leader_election.cc:290] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:23.574410 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e876ee31f15e4349b3086338a4d5f288" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:23.575381 28656 raft_consensus.cc:2393] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8d512840fb74aaf82ac80c433d8dc2d in current term 1: Already voted for candidate 44a14c00fc3d41bea8db00310408905a in this term.
I20260709 13:11:23.576361 28955 raft_consensus.cc:515] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:23.577956 28853 tablet_bootstrap.cc:654] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.591250 28852 ts_tablet_manager.cc:1434] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.121s	user 0.010s	sys 0.000s
I20260709 13:11:23.592335 28852 tablet_bootstrap.cc:492] T 452914c1abfd43389431daaf7ebee1c0 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:23.594163 28848 tablet_bootstrap.cc:654] T 1e4d79b8251f445ba4ee93c33bb13df3 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.598452 28658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0093a1dad264ec1b3d9d3f896262ff7" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:23.599344 28658 raft_consensus.cc:2393] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a1515f1138af4333a63996f5d0864d85 in current term 1: Already voted for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in this term.
I20260709 13:11:23.599509 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0093a1dad264ec1b3d9d3f896262ff7" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:23.600095 28583 raft_consensus.cc:3060] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.608326 28583 raft_consensus.cc:2468] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:23.600044 28955 leader_election.cc:290] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:23.593983 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e876ee31f15e4349b3086338a4d5f288" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:23.621661 28696 leader_election.cc:304] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85; no voters: bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:23.626654 28770 leader_election.cc:304] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:23.627652 28955 raft_consensus.cc:2804] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:23.620882 28996 raft_consensus.cc:493] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.641268 28906 leader_election.cc:290] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:23.641531 28862 consensus_queue.cc:1048] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:23.641916 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0093a1dad264ec1b3d9d3f896262ff7" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:23.642757 28581 raft_consensus.cc:2393] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bfd745f89b014f7b85fbf7d909fe2fb0 in current term 1: Already voted for candidate a1515f1138af4333a63996f5d0864d85 in this term.
I20260709 13:11:23.643679 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0093a1dad264ec1b3d9d3f896262ff7" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:23.647856 28889 raft_consensus.cc:515] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:23.630097 28887 raft_consensus.cc:3060] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.653003 28855 tablet_bootstrap.cc:654] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.630399 28955 raft_consensus.cc:697] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:23.656250 28955 consensus_queue.cc:237] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:23.657522 29055 consensus_queue.cc:1048] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:23.654639 28996 raft_consensus.cc:515] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.668313 28889 leader_election.cc:290] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:23.669812 28852 tablet_bootstrap.cc:654] T 452914c1abfd43389431daaf7ebee1c0 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.671437 28853 tablet_bootstrap.cc:492] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:23.671940 28853 ts_tablet_manager.cc:1403] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.161s	user 0.011s	sys 0.004s
I20260709 13:11:23.677870 28848 tablet_bootstrap.cc:492] T 1e4d79b8251f445ba4ee93c33bb13df3 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:23.678406 28848 ts_tablet_manager.cc:1403] T 1e4d79b8251f445ba4ee93c33bb13df3 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.147s	user 0.012s	sys 0.002s
I20260709 13:11:23.682456 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d860d29a21a423cbbf0d8d9480d56ef" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:23.682936 28622 leader_election.cc:304] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
W20260709 13:11:23.684115 28528 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:23.683830 28853 raft_consensus.cc:359] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:23.663292 28478 catalog_manager.cc:5697] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2). New cstate: current_term: 1 leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:23.683130 28581 raft_consensus.cc:3060] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.684124 29000 raft_consensus.cc:2749] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:23.690625 28853 raft_consensus.cc:385] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.692111 28853 raft_consensus.cc:740] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.693897 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d860d29a21a423cbbf0d8d9480d56ef" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:23.697208 28805 raft_consensus.cc:3060] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.704542 28581 raft_consensus.cc:2468] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:23.705789 28696 leader_election.cc:304] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85; no voters: 
I20260709 13:11:23.708768 28887 raft_consensus.cc:2749] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:23.694218 28853 consensus_queue.cc:260] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
W20260709 13:11:23.713842 28622 consensus_peers.cc:597] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Couldn't send request to peer a1515f1138af4333a63996f5d0864d85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:23.716914 28996 leader_election.cc:290] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:23.717868 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8eab4cd5b64393b62a304011e5b22d" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:23.719339 28848 raft_consensus.cc:359] T 1e4d79b8251f445ba4ee93c33bb13df3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.720083 28848 raft_consensus.cc:385] T 1e4d79b8251f445ba4ee93c33bb13df3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.720369 28848 raft_consensus.cc:740] T 1e4d79b8251f445ba4ee93c33bb13df3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
W20260709 13:11:23.720912 28622 leader_election.cc:343] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.721107 28848 consensus_queue.cc:260] T 1e4d79b8251f445ba4ee93c33bb13df3 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.711796 28955 raft_consensus.cc:2804] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:23.722014 28996 consensus_queue.cc:1048] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:23.725508 28853 ts_tablet_manager.cc:1434] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.053s	user 0.003s	sys 0.005s
I20260709 13:11:23.726990 28853 tablet_bootstrap.cc:492] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:23.737052 28853 tablet_bootstrap.cc:654] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.741667 28879 raft_consensus.cc:493] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.742401 28879 raft_consensus.cc:515] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.746055 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b32b6e56ce549b98fca9ad5f3798f2b" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:23.747465 28879 leader_election.cc:290] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
W20260709 13:11:23.748539 28622 leader_election.cc:343] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.722573 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8eab4cd5b64393b62a304011e5b22d" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:23.760324 28848 ts_tablet_manager.cc:1434] T 1e4d79b8251f445ba4ee93c33bb13df3 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.000s
I20260709 13:11:23.762252 28848 tablet_bootstrap.cc:492] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:23.762315 28479 catalog_manager.cc:5697] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 1 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:23.758930 28955 raft_consensus.cc:697] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:23.764748 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b32b6e56ce549b98fca9ad5f3798f2b" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:23.765225 28955 consensus_queue.cc:237] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
W20260709 13:11:23.778357 28622 leader_election.cc:343] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.778894 28622 leader_election.cc:304] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:23.780432 28996 raft_consensus.cc:2749] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:23.790091 28855 tablet_bootstrap.cc:492] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:23.790786 28855 ts_tablet_manager.cc:1403] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.233s	user 0.035s	sys 0.010s
I20260709 13:11:23.799716 28855 raft_consensus.cc:359] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.800765 28855 raft_consensus.cc:385] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.803427 28855 raft_consensus.cc:740] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.804786 28855 consensus_queue.cc:260] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
W20260709 13:11:23.808485 28622 leader_election.cc:343] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.818984 28855 ts_tablet_manager.cc:1434] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.003s
I20260709 13:11:23.820452 28855 tablet_bootstrap.cc:492] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:23.818367 28805 raft_consensus.cc:2468] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:23.809057 28622 leader_election.cc:304] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:23.826890 28906 raft_consensus.cc:2749] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:23.835990 28996 raft_consensus.cc:493] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:23.837800 28996 raft_consensus.cc:515] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.841004 28996 leader_election.cc:290] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:23.842275 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706fb62a0a7423ca484455f75a16592" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:23.843971 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706fb62a0a7423ca484455f75a16592" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:23.846347 28805 raft_consensus.cc:2393] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfd745f89b014f7b85fbf7d909fe2fb0 in current term 2: Already voted for candidate b8d512840fb74aaf82ac80c433d8dc2d in this term.
I20260709 13:11:23.847252 29032 raft_consensus.cc:493] T a726976321d04177a6d77e9ef0041f3f P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.847852 29032 raft_consensus.cc:515] T a726976321d04177a6d77e9ef0041f3f P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.848361 28902 raft_consensus.cc:493] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.848824 28902 raft_consensus.cc:515] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.850411 29032 leader_election.cc:290] T a726976321d04177a6d77e9ef0041f3f P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:23.850570 28902 leader_election.cc:290] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:23.846275 28581 raft_consensus.cc:2468] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 2.
I20260709 13:11:23.852808 28853 tablet_bootstrap.cc:492] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:23.855746 28853 ts_tablet_manager.cc:1403] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.129s	user 0.012s	sys 0.033s
I20260709 13:11:23.855978 28848 tablet_bootstrap.cc:654] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.856978 28917 consensus_queue.cc:1048] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:23.853394 28582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a726976321d04177a6d77e9ef0041f3f" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:23.853665 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4d79b8251f445ba4ee93c33bb13df3" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:23.858822 28853 raft_consensus.cc:359] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:23.860180 28582 raft_consensus.cc:2393] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8d512840fb74aaf82ac80c433d8dc2d in current term 1: Already voted for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in this term.
W20260709 13:11:23.860996 28770 leader_election.cc:343] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.860162 28853 raft_consensus.cc:385] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.861814 28853 raft_consensus.cc:740] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.862815 28853 consensus_queue.cc:260] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:23.857111 28622 leader_election.cc:304] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:23.865190 28853 ts_tablet_manager.cc:1434] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:11:23.853511 28852 tablet_bootstrap.cc:492] T 452914c1abfd43389431daaf7ebee1c0 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:23.874385 28855 tablet_bootstrap.cc:654] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.874873 28996 raft_consensus.cc:2804] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:23.876839 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a726976321d04177a6d77e9ef0041f3f" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:23.877549 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4d79b8251f445ba4ee93c33bb13df3" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:23.879673 28852 ts_tablet_manager.cc:1403] T 452914c1abfd43389431daaf7ebee1c0 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.288s	user 0.026s	sys 0.031s
I20260709 13:11:23.885032 28853 tablet_bootstrap.cc:492] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:23.882009 28996 raft_consensus.cc:493] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:23.893014 28772 leader_election.cc:304] T a726976321d04177a6d77e9ef0041f3f P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:23.894528 28902 raft_consensus.cc:3060] T a726976321d04177a6d77e9ef0041f3f P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.895205 28917 raft_consensus.cc:493] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.895789 28917 raft_consensus.cc:515] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:23.896759 28853 tablet_bootstrap.cc:654] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:23.891571 28996 raft_consensus.cc:3060] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:23.885633 28656 raft_consensus.cc:2468] T 1e4d79b8251f445ba4ee93c33bb13df3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
I20260709 13:11:23.903923 28772 leader_election.cc:304] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:23.905249 29032 raft_consensus.cc:2804] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:23.905718 29032 raft_consensus.cc:493] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.906086 29032 raft_consensus.cc:3060] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.907073 28478 catalog_manager.cc:5697] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 1 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:23.912192 28917 leader_election.cc:290] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:23.917348 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659cd3cf76964c27b1dfdccebc357594" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:23.918212 28917 consensus_queue.cc:1048] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:23.918398 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659cd3cf76964c27b1dfdccebc357594" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:23.919528 28582 raft_consensus.cc:3060] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:23.922643 28547 leader_election.cc:343] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:23.930601 28547 leader_election.cc:343] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.923322 29032 raft_consensus.cc:515] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.925154 28902 raft_consensus.cc:2749] T a726976321d04177a6d77e9ef0041f3f P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:23.926311 28848 tablet_bootstrap.cc:492] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:23.933504 28848 ts_tablet_manager.cc:1403] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.172s	user 0.027s	sys 0.009s
I20260709 13:11:23.931082 28547 leader_election.cc:304] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:23.940007 28945 raft_consensus.cc:2749] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:23.941098 28848 raft_consensus.cc:359] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.943584 28848 raft_consensus.cc:385] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.943993 28848 raft_consensus.cc:740] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.945710 28848 consensus_queue.cc:260] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:23.947621 28855 tablet_bootstrap.cc:492] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:23.948400 28855 ts_tablet_manager.cc:1403] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.128s	user 0.014s	sys 0.004s
I20260709 13:11:23.949832 28848 ts_tablet_manager.cc:1434] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 13:11:23.953655 28852 raft_consensus.cc:359] T 452914c1abfd43389431daaf7ebee1c0 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:23.954480 28852 raft_consensus.cc:385] T 452914c1abfd43389431daaf7ebee1c0 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.954794 28848 tablet_bootstrap.cc:492] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:23.943264 28996 raft_consensus.cc:515] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:23.960078 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4d79b8251f445ba4ee93c33bb13df3" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
W20260709 13:11:23.961520 28770 leader_election.cc:343] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:23.963335 29032 leader_election.cc:290] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:23.954761 28852 raft_consensus.cc:740] T 452914c1abfd43389431daaf7ebee1c0 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.964959 28852 consensus_queue.cc:260] T 452914c1abfd43389431daaf7ebee1c0 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:23.957206 28996 leader_election.cc:290] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:23.972949 28855 raft_consensus.cc:359] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:23.973841 28855 raft_consensus.cc:385] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:23.973896 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706fb62a0a7423ca484455f75a16592" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:23.974236 28855 raft_consensus.cc:740] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:23.974761 28805 raft_consensus.cc:2393] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bfd745f89b014f7b85fbf7d909fe2fb0 in current term 2: Already voted for candidate b8d512840fb74aaf82ac80c433d8dc2d in this term.
I20260709 13:11:23.975147 28855 consensus_queue.cc:260] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:23.978207 28855 ts_tablet_manager.cc:1434] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:11:23.979182 28855 tablet_bootstrap.cc:492] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:23.979537 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e4d79b8251f445ba4ee93c33bb13df3" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:23.980219 28656 raft_consensus.cc:3060] T 1e4d79b8251f445ba4ee93c33bb13df3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:23.986423 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706fb62a0a7423ca484455f75a16592" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:24.001396 28852 ts_tablet_manager.cc:1434] T 452914c1abfd43389431daaf7ebee1c0 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.120s	user 0.006s	sys 0.001s
I20260709 13:11:24.002655 28852 tablet_bootstrap.cc:492] T 659cd3cf76964c27b1dfdccebc357594 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:24.009502 28581 raft_consensus.cc:2468] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 2.
I20260709 13:11:24.012854 28853 tablet_bootstrap.cc:492] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:24.016135 28996 consensus_queue.cc:1048] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:11:24.019147 28853 ts_tablet_manager.cc:1403] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.138s	user 0.017s	sys 0.021s
I20260709 13:11:24.016584 28906 raft_consensus.cc:493] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.020675 28906 raft_consensus.cc:515] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:24.021843 28855 tablet_bootstrap.cc:654] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.022171 28853 raft_consensus.cc:359] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:24.022854 28906 leader_election.cc:290] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:24.017984 28622 leader_election.cc:304] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:24.026422 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46835248ab9d4f43908a6c6a42642ba1" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:24.007355 28656 raft_consensus.cc:2468] T 1e4d79b8251f445ba4ee93c33bb13df3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:24.029109 28906 raft_consensus.cc:2804] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:24.022872 28853 raft_consensus.cc:385] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.045027 28853 raft_consensus.cc:740] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.054859 28945 raft_consensus.cc:493] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.055652 28945 raft_consensus.cc:515] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
W20260709 13:11:24.057410 28622 leader_election.cc:343] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.058342 28945 leader_election.cc:290] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:24.061522 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586415758fd245b49bd0a4e20a2b11d8" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:24.062839 28855 tablet_bootstrap.cc:492] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:24.062700 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586415758fd245b49bd0a4e20a2b11d8" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:24.065119 28906 raft_consensus.cc:697] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 LEADER]: Becoming Leader. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
I20260709 13:11:24.065568 28855 ts_tablet_manager.cc:1403] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.087s	user 0.018s	sys 0.005s
I20260709 13:11:24.063441 28853 consensus_queue.cc:260] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:24.066350 28906 consensus_queue.cc:237] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
W20260709 13:11:24.066929 28549 leader_election.cc:343] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.067700 28853 ts_tablet_manager.cc:1434] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 13:11:24.069129 28848 tablet_bootstrap.cc:654] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.068778 28855 raft_consensus.cc:359] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:24.069661 28855 raft_consensus.cc:385] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.070001 28855 raft_consensus.cc:740] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.070875 28855 consensus_queue.cc:260] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
W20260709 13:11:24.070385 28547 leader_election.cc:343] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.071975 28547 leader_election.cc:304] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:24.070879 28852 tablet_bootstrap.cc:654] T 659cd3cf76964c27b1dfdccebc357594 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.074968 29027 raft_consensus.cc:2749] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.073246 28855 ts_tablet_manager.cc:1434] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:24.077600 28772 leader_election.cc:304] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:24.078482 29032 raft_consensus.cc:2804] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.078359 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46835248ab9d4f43908a6c6a42642ba1" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:24.079042 29032 raft_consensus.cc:697] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:24.079933 29032 consensus_queue.cc:237] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:24.083031 28855 tablet_bootstrap.cc:492] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
W20260709 13:11:24.088909 28622 leader_election.cc:343] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.089479 28622 leader_election.cc:304] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:24.091872 28955 consensus_queue.cc:1048] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.096153 28848 tablet_bootstrap.cc:492] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:24.096644 28848 ts_tablet_manager.cc:1403] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.142s	user 0.003s	sys 0.013s
I20260709 13:11:24.100569 28853 tablet_bootstrap.cc:492] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:24.102512 28996 raft_consensus.cc:2749] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.093323 28855 tablet_bootstrap.cc:654] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.103474 28879 consensus_queue.cc:1048] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:24.104593 28848 raft_consensus.cc:359] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:24.105294 28848 raft_consensus.cc:385] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.105611 28848 raft_consensus.cc:740] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.100198 28476 catalog_manager.cc:5697] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 0 to 1, leader changed from <none> to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 1 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.108577 28848 consensus_queue.cc:260] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:24.111908 28848 ts_tablet_manager.cc:1434] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 13:11:24.112872 28848 tablet_bootstrap.cc:492] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:24.103503 28852 tablet_bootstrap.cc:492] T 659cd3cf76964c27b1dfdccebc357594 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:24.113463 28852 ts_tablet_manager.cc:1403] T 659cd3cf76964c27b1dfdccebc357594 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.111s	user 0.012s	sys 0.004s
I20260709 13:11:24.107856 28479 catalog_manager.cc:5697] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 reported cstate change: term changed from 1 to 2, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:24.121208 28852 raft_consensus.cc:359] T 659cd3cf76964c27b1dfdccebc357594 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:24.122225 28852 raft_consensus.cc:385] T 659cd3cf76964c27b1dfdccebc357594 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.122581 28852 raft_consensus.cc:740] T 659cd3cf76964c27b1dfdccebc357594 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.124377 29027 raft_consensus.cc:493] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.124970 29027 raft_consensus.cc:515] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:24.127341 29027 leader_election.cc:290] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:24.127808 28848 tablet_bootstrap.cc:654] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.128991 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf9ce9ce3ac4f848ae7f5b584711f3e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
W20260709 13:11:24.130613 28547 leader_election.cc:343] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.130862 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf9ce9ce3ac4f848ae7f5b584711f3e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:24.131579 28656 raft_consensus.cc:2468] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:24.137652 28549 leader_election.cc:304] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:24.139223 29027 raft_consensus.cc:2804] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.139719 29027 raft_consensus.cc:493] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.140110 29027 raft_consensus.cc:3060] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.158967 28852 consensus_queue.cc:260] T 659cd3cf76964c27b1dfdccebc357594 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:24.126675 28853 tablet_bootstrap.cc:654] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.170990 28852 ts_tablet_manager.cc:1434] T 659cd3cf76964c27b1dfdccebc357594 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260709 13:11:24.172050 28852 tablet_bootstrap.cc:492] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:24.175230 29027 raft_consensus.cc:515] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:24.178200 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf9ce9ce3ac4f848ae7f5b584711f3e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:24.178417 28906 raft_consensus.cc:493] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.179558 28955 raft_consensus.cc:493] T 452914c1abfd43389431daaf7ebee1c0 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.180154 28955 raft_consensus.cc:515] T 452914c1abfd43389431daaf7ebee1c0 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
W20260709 13:11:24.181950 28547 leader_election.cc:343] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.183007 28955 leader_election.cc:290] T 452914c1abfd43389431daaf7ebee1c0 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:24.184602 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452914c1abfd43389431daaf7ebee1c0" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:24.185029 28906 raft_consensus.cc:515] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:24.186781 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452914c1abfd43389431daaf7ebee1c0" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:24.187435 28906 leader_election.cc:290] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:24.189788 28698 leader_election.cc:304] T 452914c1abfd43389431daaf7ebee1c0 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1515f1138af4333a63996f5d0864d85; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:24.191119 28955 raft_consensus.cc:2749] T 452914c1abfd43389431daaf7ebee1c0 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.195258 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586415758fd245b49bd0a4e20a2b11d8" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:24.196247 28580 raft_consensus.cc:2468] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 0.
I20260709 13:11:24.198658 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586415758fd245b49bd0a4e20a2b11d8" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:24.200203 28622 leader_election.cc:343] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.200482 28955 consensus_queue.cc:1048] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:24.224707 28622 leader_election.cc:304] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:24.227766 29032 raft_consensus.cc:493] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.228534 29032 raft_consensus.cc:515] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:24.229589 29055 consensus_queue.cc:1048] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.231246 29032 leader_election.cc:290] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:24.234858 28582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7ab1eff7a5409cb84e6bb33393456e" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
W20260709 13:11:24.236459 28770 leader_election.cc:343] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.237463 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7ab1eff7a5409cb84e6bb33393456e" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:24.239149 28770 leader_election.cc:343] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.239691 28770 leader_election.cc:304] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:24.241492 29000 raft_consensus.cc:2804] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.241894 29000 raft_consensus.cc:493] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.242246 29000 raft_consensus.cc:3060] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.243413 29027 leader_election.cc:290] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:24.244932 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf9ce9ce3ac4f848ae7f5b584711f3e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:24.245724 28657 raft_consensus.cc:3060] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.246950 29032 raft_consensus.cc:2749] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.251603 28855 tablet_bootstrap.cc:492] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:24.252149 28855 ts_tablet_manager.cc:1403] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.169s	user 0.040s	sys 0.042s
I20260709 13:11:24.253657 29052 consensus_queue.cc:1048] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.254945 28855 raft_consensus.cc:359] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:24.255703 28855 raft_consensus.cc:385] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.255968 28855 raft_consensus.cc:740] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.256098 28848 tablet_bootstrap.cc:492] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:24.256886 28848 ts_tablet_manager.cc:1403] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.144s	user 0.037s	sys 0.032s
I20260709 13:11:24.257149 28855 consensus_queue.cc:260] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:24.260413 28657 raft_consensus.cc:2468] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:24.264387 28549 leader_election.cc:304] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:24.266781 28970 raft_consensus.cc:2804] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.267279 28970 raft_consensus.cc:697] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:24.267992 28855 ts_tablet_manager.cc:1434] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:11:24.268087 28970 consensus_queue.cc:237] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:24.272850 28848 raft_consensus.cc:359] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:24.273628 28848 raft_consensus.cc:385] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.273902 28848 raft_consensus.cc:740] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.273937 28732 raft_consensus.cc:3060] T 452914c1abfd43389431daaf7ebee1c0 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.274641 28848 consensus_queue.cc:260] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:24.277469 28852 tablet_bootstrap.cc:654] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.279232 28853 tablet_bootstrap.cc:492] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:24.279752 28853 ts_tablet_manager.cc:1403] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.179s	user 0.009s	sys 0.002s
I20260709 13:11:24.280244 28902 raft_consensus.cc:493] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.280987 28902 raft_consensus.cc:515] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:24.282518 28853 raft_consensus.cc:359] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:24.283200 28853 raft_consensus.cc:385] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.283526 28853 raft_consensus.cc:740] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.283771 28902 leader_election.cc:290] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:24.284394 28853 consensus_queue.cc:260] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:24.285972 29000 raft_consensus.cc:515] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:24.286805 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659cd3cf76964c27b1dfdccebc357594" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:24.287446 28730 raft_consensus.cc:2468] T 659cd3cf76964c27b1dfdccebc357594 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
I20260709 13:11:24.288446 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659cd3cf76964c27b1dfdccebc357594" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:24.289127 28581 raft_consensus.cc:2468] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
I20260709 13:11:24.292078 28770 leader_election.cc:304] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:24.289958 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586415758fd245b49bd0a4e20a2b11d8" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:24.294317 28580 raft_consensus.cc:3060] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.294396 28902 raft_consensus.cc:2804] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.295051 28902 raft_consensus.cc:493] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.295511 28902 raft_consensus.cc:3060] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.300379 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "586415758fd245b49bd0a4e20a2b11d8" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
W20260709 13:11:24.301931 28622 leader_election.cc:343] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.303423 28848 ts_tablet_manager.cc:1434] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 13:11:24.304462 28848 tablet_bootstrap.cc:492] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:24.307140 28580 raft_consensus.cc:2468] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 1.
I20260709 13:11:24.308574 28622 leader_election.cc:304] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:24.309450 28906 raft_consensus.cc:2804] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.310295 28906 raft_consensus.cc:697] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Becoming Leader. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
I20260709 13:11:24.311444 28906 consensus_queue.cc:237] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:24.321027 28853 ts_tablet_manager.cc:1434] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.041s	user 0.003s	sys 0.006s
I20260709 13:11:24.322605 28853 tablet_bootstrap.cc:492] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:24.324539 28855 tablet_bootstrap.cc:492] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:24.314213 29000 leader_election.cc:290] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:24.334193 28848 tablet_bootstrap.cc:654] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.335913 28855 tablet_bootstrap.cc:654] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.346374 28902 raft_consensus.cc:515] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:24.362095 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659cd3cf76964c27b1dfdccebc357594" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:24.365146 28479 catalog_manager.cc:5697] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.365738 28730 raft_consensus.cc:3060] T 659cd3cf76964c27b1dfdccebc357594 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.368884 28853 tablet_bootstrap.cc:654] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.374043 28902 leader_election.cc:290] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:24.375800 28879 raft_consensus.cc:493] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.376493 28879 raft_consensus.cc:515] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:24.373111 28476 catalog_manager.cc:5697] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2). New cstate: current_term: 1 leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.379345 28879 leader_election.cc:290] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:24.382202 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659cd3cf76964c27b1dfdccebc357594" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:24.383126 28580 raft_consensus.cc:3060] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.391160 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52ad167603d40ada7680f844e2e59c8" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:24.391782 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52ad167603d40ada7680f844e2e59c8" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:24.391979 28805 raft_consensus.cc:2468] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 0.
W20260709 13:11:24.395761 28622 leader_election.cc:343] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.396759 28622 leader_election.cc:304] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:24.398926 28906 raft_consensus.cc:2804] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.399397 28906 raft_consensus.cc:493] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.399780 28906 raft_consensus.cc:3060] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.423034 28730 raft_consensus.cc:2468] T 659cd3cf76964c27b1dfdccebc357594 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:24.432731 28855 tablet_bootstrap.cc:492] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:24.433337 28855 ts_tablet_manager.cc:1403] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.119s	user 0.022s	sys 0.003s
I20260709 13:11:24.438755 28855 raft_consensus.cc:359] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:24.439502 28855 raft_consensus.cc:385] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.439842 28855 raft_consensus.cc:740] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.440562 28855 consensus_queue.cc:260] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:24.444540 28770 leader_election.cc:304] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:24.444926 28580 raft_consensus.cc:2468] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:24.445590 28902 raft_consensus.cc:2804] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.446111 28902 raft_consensus.cc:697] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:24.446950 28902 consensus_queue.cc:237] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:24.448956 28852 tablet_bootstrap.cc:492] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:24.449611 28852 ts_tablet_manager.cc:1403] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.278s	user 0.018s	sys 0.015s
I20260709 13:11:24.450407 28855 ts_tablet_manager.cc:1434] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:11:24.451725 28855 tablet_bootstrap.cc:492] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:24.459446 28848 tablet_bootstrap.cc:492] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:24.460045 28848 ts_tablet_manager.cc:1403] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.156s	user 0.020s	sys 0.020s
I20260709 13:11:24.460189 28906 raft_consensus.cc:515] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:24.463012 28887 raft_consensus.cc:493] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.463403 28848 raft_consensus.cc:359] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:24.463575 28887 raft_consensus.cc:515] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:24.464205 28848 raft_consensus.cc:385] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.464541 28848 raft_consensus.cc:740] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.464706 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52ad167603d40ada7680f844e2e59c8" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:24.465312 28805 raft_consensus.cc:3060] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.465232 28848 consensus_queue.cc:260] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:24.465763 28887 leader_election.cc:290] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:24.466471 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52ad167603d40ada7680f844e2e59c8" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:24.467736 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c146089a3249eea0254717e75c14c8" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:24.469135 28770 leader_election.cc:343] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.472563 28852 raft_consensus.cc:359] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:24.473292 28852 raft_consensus.cc:385] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.475908 28852 raft_consensus.cc:740] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
W20260709 13:11:24.476858 28622 leader_election.cc:343] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.476672 28852 consensus_queue.cc:260] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:24.477777 28855 tablet_bootstrap.cc:654] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.477770 28853 tablet_bootstrap.cc:492] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:24.478406 28853 ts_tablet_manager.cc:1403] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.156s	user 0.031s	sys 0.005s
I20260709 13:11:24.479157 28848 ts_tablet_manager.cc:1434] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:11:24.481412 28853 raft_consensus.cc:359] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:24.482225 28848 tablet_bootstrap.cc:492] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:24.482334 28853 raft_consensus.cc:385] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.482734 28853 raft_consensus.cc:740] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.487097 28853 consensus_queue.cc:260] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:24.489128 28848 tablet_bootstrap.cc:654] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.486886 28852 ts_tablet_manager.cc:1434] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:11:24.491962 28852 tablet_bootstrap.cc:492] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:24.493533 28853 ts_tablet_manager.cc:1434] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:11:24.494577 28853 tablet_bootstrap.cc:492] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:24.497637 28855 tablet_bootstrap.cc:492] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:24.500641 28582 raft_consensus.cc:1275] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Refusing update from remote peer bfd745f89b014f7b85fbf7d909fe2fb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:24.502372 28879 consensus_queue.cc:1048] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:24.503328 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c146089a3249eea0254717e75c14c8" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:24.504812 28476 catalog_manager.cc:5697] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 0 to 1, leader changed from <none> to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 1 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.507313 28806 raft_consensus.cc:1275] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Refusing update from remote peer bfd745f89b014f7b85fbf7d909fe2fb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:24.504828 28848 tablet_bootstrap.cc:492] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
W20260709 13:11:24.508440 28770 leader_election.cc:343] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.508641 28848 ts_tablet_manager.cc:1403] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.001s
I20260709 13:11:24.508728 28906 leader_election.cc:290] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:24.508949 28770 leader_election.cc:304] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:24.512389 28848 raft_consensus.cc:359] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:24.514065 28848 raft_consensus.cc:385] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.514385 28848 raft_consensus.cc:740] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.512228 28902 raft_consensus.cc:2749] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.517599 28906 consensus_queue.cc:1048] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.519207 28853 tablet_bootstrap.cc:654] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.518330 28805 raft_consensus.cc:2468] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 1.
I20260709 13:11:24.520519 28622 leader_election.cc:304] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:24.515197 28848 consensus_queue.cc:260] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:24.521735 28879 raft_consensus.cc:2804] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.522733 28879 raft_consensus.cc:697] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Becoming Leader. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
I20260709 13:11:24.498150 28855 ts_tablet_manager.cc:1403] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.000s
I20260709 13:11:24.523434 28848 ts_tablet_manager.cc:1434] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:11:24.525408 28848 tablet_bootstrap.cc:492] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:24.523850 28879 consensus_queue.cc:237] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:24.532136 28848 tablet_bootstrap.cc:654] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.533706 28855 raft_consensus.cc:359] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:24.534531 28855 raft_consensus.cc:385] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.534824 28855 raft_consensus.cc:740] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.541194 28902 consensus_queue.cc:1048] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:24.543560 28955 raft_consensus.cc:493] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.544174 28955 raft_consensus.cc:515] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:24.546345 28852 tablet_bootstrap.cc:654] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.549739 29000 raft_consensus.cc:493] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.548720 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8eab4cd5b64393b62a304011e5b22d" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:24.564980 28657 raft_consensus.cc:2468] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 0.
I20260709 13:11:24.547329 28855 consensus_queue.cc:260] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:24.555862 28853 tablet_bootstrap.cc:492] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:24.566288 28698 leader_election.cc:304] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:24.566727 28853 ts_tablet_manager.cc:1403] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.007s
I20260709 13:11:24.547115 28955 leader_election.cc:290] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:24.558842 28852 tablet_bootstrap.cc:492] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:24.567808 28852 ts_tablet_manager.cc:1403] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.000s
I20260709 13:11:24.567937 28855 ts_tablet_manager.cc:1434] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:11:24.569293 28855 tablet_bootstrap.cc:492] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:24.569703 28853 raft_consensus.cc:359] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:24.570529 28853 raft_consensus.cc:385] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.570804 28853 raft_consensus.cc:740] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.571527 28853 consensus_queue.cc:260] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:24.572815 29000 raft_consensus.cc:515] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:24.574340 28853 ts_tablet_manager.cc:1434] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:11:24.574450 28902 raft_consensus.cc:493] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.575471 28853 tablet_bootstrap.cc:492] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:24.575085 28902 raft_consensus.cc:515] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:24.576575 28476 catalog_manager.cc:5697] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2). New cstate: current_term: 1 leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:24.578451 28582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf9ce9ce3ac4f848ae7f5b584711f3e" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:24.588845 29000 leader_election.cc:290] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:24.589563 29027 raft_consensus.cc:493] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.590164 29027 raft_consensus.cc:515] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:24.590471 28582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34233c4c336b444996374b970ddd2822" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:24.592744 29027 leader_election.cc:290] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
W20260709 13:11:24.593322 28622 leader_election.cc:343] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.593729 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7ab1eff7a5409cb84e6bb33393456e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:24.593327 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34233c4c336b444996374b970ddd2822" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:24.598169 28547 leader_election.cc:343] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.599495 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7ab1eff7a5409cb84e6bb33393456e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:24.600440 28803 raft_consensus.cc:2468] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:24.602409 28547 leader_election.cc:304] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:24.603659 29027 raft_consensus.cc:2804] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.604187 29027 raft_consensus.cc:493] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.604616 29027 raft_consensus.cc:3060] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.562503 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8eab4cd5b64393b62a304011e5b22d" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:24.567168 29055 raft_consensus.cc:2804] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.608606 29055 raft_consensus.cc:493] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.609073 29055 raft_consensus.cc:3060] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:24.617417 28622 leader_election.cc:343] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.618059 28622 leader_election.cc:304] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:24.620376 28902 leader_election.cc:290] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:24.622633 29027 raft_consensus.cc:515] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:24.628368 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7ab1eff7a5409cb84e6bb33393456e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
W20260709 13:11:24.630144 28547 leader_election.cc:343] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.634467 28887 raft_consensus.cc:493] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.635073 28887 raft_consensus.cc:515] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:24.637637 28996 raft_consensus.cc:2749] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.637871 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7ab1eff7a5409cb84e6bb33393456e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:24.638496 28803 raft_consensus.cc:3060] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.641690 28887 leader_election.cc:290] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:24.643644 28582 raft_consensus.cc:3060] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.644085 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46835248ab9d4f43908a6c6a42642ba1" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:24.647800 28770 leader_election.cc:343] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.654095 28887 consensus_queue.cc:1048] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:11:24.656411 28696 leader_election.cc:343] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.662657 29055 raft_consensus.cc:515] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:24.666671 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8eab4cd5b64393b62a304011e5b22d" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:24.667287 28654 raft_consensus.cc:3060] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.667979 28852 raft_consensus.cc:359] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:24.668684 28852 raft_consensus.cc:385] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.668938 28852 raft_consensus.cc:740] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.671909 28853 tablet_bootstrap.cc:654] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.675877 28855 tablet_bootstrap.cc:654] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.676667 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf9ce9ce3ac4f848ae7f5b584711f3e" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:24.677591 28657 raft_consensus.cc:2393] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8d512840fb74aaf82ac80c433d8dc2d in current term 1: Already voted for candidate 44a14c00fc3d41bea8db00310408905a in this term.
I20260709 13:11:24.675429 29027 leader_election.cc:290] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:24.687860 28806 raft_consensus.cc:3060] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.690543 29055 leader_election.cc:290] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:24.689180 28654 raft_consensus.cc:2468] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:24.691728 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8eab4cd5b64393b62a304011e5b22d" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:24.692605 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46835248ab9d4f43908a6c6a42642ba1" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
W20260709 13:11:24.693229 28696 leader_election.cc:343] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.693256 28654 raft_consensus.cc:2468] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
I20260709 13:11:24.697993 28698 leader_election.cc:304] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:24.699645 28970 raft_consensus.cc:493] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.699792 29055 raft_consensus.cc:2804] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.700179 28970 raft_consensus.cc:515] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:24.701784 29055 raft_consensus.cc:697] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:24.702350 28970 leader_election.cc:290] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:24.703125 29055 consensus_queue.cc:237] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:24.703922 28772 leader_election.cc:304] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:24.704936 28803 raft_consensus.cc:2468] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:24.705221 28772 leader_election.cc:304] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:24.674350 28852 consensus_queue.cc:260] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:24.720598 28848 tablet_bootstrap.cc:492] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:24.721215 28848 ts_tablet_manager.cc:1403] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.196s	user 0.018s	sys 0.032s
I20260709 13:11:24.722110 28887 raft_consensus.cc:2804] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.722581 28887 raft_consensus.cc:493] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.722954 28887 raft_consensus.cc:3060] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.724254 28848 raft_consensus.cc:359] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:24.725037 28848 raft_consensus.cc:385] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.725555 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47110731ce12413ab60b16f034fdceb3" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:24.726279 28654 raft_consensus.cc:2468] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:24.728525 28549 leader_election.cc:304] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:24.725330 28848 raft_consensus.cc:740] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.740694 28848 consensus_queue.cc:260] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:24.747273 28852 ts_tablet_manager.cc:1434] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.179s	user 0.007s	sys 0.003s
I20260709 13:11:24.750355 28853 tablet_bootstrap.cc:492] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:24.751245 28853 ts_tablet_manager.cc:1403] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.176s	user 0.019s	sys 0.027s
I20260709 13:11:24.739640 29027 raft_consensus.cc:2804] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:24.766798 29027 raft_consensus.cc:493] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.767421 29027 raft_consensus.cc:3060] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.762372 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47110731ce12413ab60b16f034fdceb3" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:24.745514 28906 raft_consensus.cc:493] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.780220 28855 tablet_bootstrap.cc:492] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:24.780763 28855 ts_tablet_manager.cc:1403] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.212s	user 0.021s	sys 0.004s
I20260709 13:11:24.782186 28848 ts_tablet_manager.cc:1434] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 13:11:24.783614 28848 tablet_bootstrap.cc:492] T cf7befe583fe4534bdd8e703ee341d3e P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:24.789414 28852 tablet_bootstrap.cc:492] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:24.770354 28547 leader_election.cc:304] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:24.788108 29032 raft_consensus.cc:2749] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.775450 28906 raft_consensus.cc:515] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:24.814118 28848 tablet_bootstrap.cc:654] T cf7befe583fe4534bdd8e703ee341d3e P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.816054 28945 raft_consensus.cc:2804] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.816668 28945 raft_consensus.cc:697] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:24.816738 28480 catalog_manager.cc:5697] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 1 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:24.822814 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:43597, user_credentials={real_user=slave}} blocked reactor thread for 74185.7us
I20260709 13:11:24.824587 29000 consensus_queue.cc:1048] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.828857 28906 leader_election.cc:290] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:24.828935 28945 consensus_queue.cc:237] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:24.831213 28889 raft_consensus.cc:493] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.831750 28889 raft_consensus.cc:515] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:24.834900 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e29bffebb804a5bbb9935518c059b2a" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:24.836447 28887 raft_consensus.cc:515] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:24.837903 28889 leader_election.cc:290] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:24.838644 28887 leader_election.cc:290] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:24.842142 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52ad167603d40ada7680f844e2e59c8" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
W20260709 13:11:24.842142 28528 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:11:24.844689 28622 leader_election.cc:343] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.845319 28906 raft_consensus.cc:493] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.845847 28906 raft_consensus.cc:515] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:24.847864 28852 tablet_bootstrap.cc:654] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.847986 28906 leader_election.cc:290] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:24.861891 28853 raft_consensus.cc:359] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:24.862754 28853 raft_consensus.cc:385] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.862738 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40bb461a5034123ab09d156bd22ebbf" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:24.867044 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46835248ab9d4f43908a6c6a42642ba1" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:24.868235 28855 raft_consensus.cc:359] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:24.869190 28855 raft_consensus.cc:385] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.869510 28855 raft_consensus.cc:740] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.863189 28853 raft_consensus.cc:740] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.870316 28855 consensus_queue.cc:260] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
W20260709 13:11:24.870956 28770 leader_election.cc:343] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.872944 28855 ts_tablet_manager.cc:1434] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.092s	user 0.002s	sys 0.004s
W20260709 13:11:24.875169 28547 leader_election.cc:343] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.870443 28853 consensus_queue.cc:260] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:24.877382 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46835248ab9d4f43908a6c6a42642ba1" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:24.878301 28654 raft_consensus.cc:3060] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.880431 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52ad167603d40ada7680f844e2e59c8" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:24.881304 28805 raft_consensus.cc:2393] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1515f1138af4333a63996f5d0864d85 in current term 1: Already voted for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in this term.
W20260709 13:11:24.878060 28622 leader_election.cc:343] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.884505 28917 consensus_queue.cc:1048] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:11:24.886713 28622 consensus_peers.cc:597] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Couldn't send request to peer a1515f1138af4333a63996f5d0864d85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:24.887063 28654 raft_consensus.cc:2468] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:24.888324 28772 leader_election.cc:304] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:24.889685 28887 raft_consensus.cc:2804] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:24.890337 28887 raft_consensus.cc:697] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:24.889351 29027 raft_consensus.cc:515] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:24.891431 28887 consensus_queue.cc:237] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:24.893867 29027 leader_election.cc:290] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:24.895854 28696 leader_election.cc:304] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1515f1138af4333a63996f5d0864d85; no voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:24.897459 29052 raft_consensus.cc:3060] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.899143 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e29bffebb804a5bbb9935518c059b2a" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:24.919282 28848 tablet_bootstrap.cc:492] T cf7befe583fe4534bdd8e703ee341d3e P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:24.919873 28852 tablet_bootstrap.cc:492] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:24.920399 28852 ts_tablet_manager.cc:1403] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.131s	user 0.011s	sys 0.002s
I20260709 13:11:24.921797 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40bb461a5034123ab09d156bd22ebbf" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:24.923067 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47110731ce12413ab60b16f034fdceb3" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:24.893872 28855 tablet_bootstrap.cc:492] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:24.925657 29109 consensus_queue.cc:1048] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.930692 28855 tablet_bootstrap.cc:654] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:24.933779 28852 raft_consensus.cc:359] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:24.934494 28852 raft_consensus.cc:385] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.934739 28852 raft_consensus.cc:740] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.936007 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47110731ce12413ab60b16f034fdceb3" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:24.936849 28657 raft_consensus.cc:3060] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:24.940930 28480 catalog_manager.cc:5697] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:24.941687 28852 consensus_queue.cc:260] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:24.943744 28852 ts_tablet_manager.cc:1434] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:11:24.944672 28852 tablet_bootstrap.cc:492] T 46835248ab9d4f43908a6c6a42642ba1 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:24.919895 28848 ts_tablet_manager.cc:1403] T cf7befe583fe4534bdd8e703ee341d3e P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.137s	user 0.011s	sys 0.009s
W20260709 13:11:24.947950 28622 leader_election.cc:343] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.948477 28622 leader_election.cc:304] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
W20260709 13:11:24.949672 28622 leader_election.cc:343] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.950095 28622 leader_election.cc:304] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:24.950872 28848 raft_consensus.cc:359] T cf7befe583fe4534bdd8e703ee341d3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:24.951395 28853 ts_tablet_manager.cc:1434] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.200s	user 0.008s	sys 0.000s
I20260709 13:11:24.951587 28848 raft_consensus.cc:385] T cf7befe583fe4534bdd8e703ee341d3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:24.951902 28848 raft_consensus.cc:740] T cf7befe583fe4534bdd8e703ee341d3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:24.952301 28996 raft_consensus.cc:2749] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.952970 28996 raft_consensus.cc:2749] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.952576 28848 consensus_queue.cc:260] T cf7befe583fe4534bdd8e703ee341d3e P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:24.953961 29052 raft_consensus.cc:2749] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:24.955359 28970 consensus_queue.cc:1048] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:24.957746 28906 consensus_queue.cc:1048] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:24.959712 28657 raft_consensus.cc:2468] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:24.960906 28853 tablet_bootstrap.cc:492] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:24.976233 29000 consensus_queue.cc:1048] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:11:24.956166 28547 leader_election.cc:343] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:24.983592 28852 tablet_bootstrap.cc:654] T 46835248ab9d4f43908a6c6a42642ba1 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.010907 28853 tablet_bootstrap.cc:654] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.014312 28848 ts_tablet_manager.cc:1434] T cf7befe583fe4534bdd8e703ee341d3e P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.000s
I20260709 13:11:25.015465 28848 tablet_bootstrap.cc:492] T 550aaae95149430d8f95525d197894f6 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:25.034483 29113 raft_consensus.cc:493] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.047515 28855 tablet_bootstrap.cc:492] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:25.050189 28855 ts_tablet_manager.cc:1403] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.157s	user 0.053s	sys 0.037s
I20260709 13:11:25.050046 29113 raft_consensus.cc:515] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:25.053164 28855 raft_consensus.cc:359] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:25.054013 28855 raft_consensus.cc:385] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.054291 28855 raft_consensus.cc:740] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.054679 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c146089a3249eea0254717e75c14c8" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:25.048617 28549 leader_election.cc:304] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:25.055305 28855 consensus_queue.cc:260] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
W20260709 13:11:25.062831 28547 leader_election.cc:343] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.063110 28855 ts_tablet_manager.cc:1434] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:11:25.064198 28855 tablet_bootstrap.cc:492] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:25.062295 28848 tablet_bootstrap.cc:654] T 550aaae95149430d8f95525d197894f6 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.053056 29113 leader_election.cc:290] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:25.072485 28945 raft_consensus.cc:2804] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:25.078224 29116 consensus_queue.cc:1048] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:25.090073 28853 tablet_bootstrap.cc:492] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:25.097906 28853 ts_tablet_manager.cc:1403] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.146s	user 0.014s	sys 0.004s
I20260709 13:11:25.100310 28804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c146089a3249eea0254717e75c14c8" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:25.096254 28945 raft_consensus.cc:697] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:25.110617 28855 tablet_bootstrap.cc:654] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.106257 28804 raft_consensus.cc:2468] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:25.114533 28852 tablet_bootstrap.cc:492] T 46835248ab9d4f43908a6c6a42642ba1 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:25.115123 28852 ts_tablet_manager.cc:1403] T 46835248ab9d4f43908a6c6a42642ba1 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.171s	user 0.012s	sys 0.001s
I20260709 13:11:25.118641 28852 raft_consensus.cc:359] T 46835248ab9d4f43908a6c6a42642ba1 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:25.119447 28852 raft_consensus.cc:385] T 46835248ab9d4f43908a6c6a42642ba1 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.119732 28852 raft_consensus.cc:740] T 46835248ab9d4f43908a6c6a42642ba1 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.120633 28852 consensus_queue.cc:260] T 46835248ab9d4f43908a6c6a42642ba1 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:25.122941 28852 ts_tablet_manager.cc:1434] T 46835248ab9d4f43908a6c6a42642ba1 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:25.123898 28852 tablet_bootstrap.cc:492] T 586415758fd245b49bd0a4e20a2b11d8 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:25.116397 28945 consensus_queue.cc:237] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:25.130401 28852 tablet_bootstrap.cc:654] T 586415758fd245b49bd0a4e20a2b11d8 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.148516 28547 leader_election.cc:304] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:25.150297 28945 raft_consensus.cc:2804] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:25.150703 28945 raft_consensus.cc:493] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.151054 28945 raft_consensus.cc:3060] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.156131 28853 raft_consensus.cc:359] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:25.156987 28853 raft_consensus.cc:385] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.159121 28853 raft_consensus.cc:740] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.160650 28853 consensus_queue.cc:260] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:25.161687 28848 tablet_bootstrap.cc:492] T 550aaae95149430d8f95525d197894f6 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:25.162231 28848 ts_tablet_manager.cc:1403] T 550aaae95149430d8f95525d197894f6 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.147s	user 0.019s	sys 0.002s
I20260709 13:11:25.162763 28853 ts_tablet_manager.cc:1434] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.064s	user 0.007s	sys 0.000s
I20260709 13:11:25.163774 28853 tablet_bootstrap.cc:492] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:25.165056 28848 raft_consensus.cc:359] T 550aaae95149430d8f95525d197894f6 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:25.166010 28848 raft_consensus.cc:385] T 550aaae95149430d8f95525d197894f6 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.166311 28848 raft_consensus.cc:740] T 550aaae95149430d8f95525d197894f6 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.167964 28945 raft_consensus.cc:515] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:25.171628 28855 tablet_bootstrap.cc:492] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:25.171368 28848 consensus_queue.cc:260] T 550aaae95149430d8f95525d197894f6 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:25.172168 28855 ts_tablet_manager.cc:1403] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.108s	user 0.011s	sys 0.013s
W20260709 13:11:25.172978 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:43597, user_credentials={real_user=slave}} blocked reactor thread for 50122.3us
I20260709 13:11:25.178478 28848 ts_tablet_manager.cc:1434] T 550aaae95149430d8f95525d197894f6 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:11:25.178887 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c146089a3249eea0254717e75c14c8" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:25.195818 28906 raft_consensus.cc:493] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.195889 28547 leader_election.cc:343] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.196440 28906 raft_consensus.cc:515] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:25.198024 28906 leader_election.cc:290] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:25.198190 28848 tablet_bootstrap.cc:492] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:25.200428 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2ea288ac6c435eb4e1fd15b459a3ff" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:25.202452 28622 leader_election.cc:343] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.180905 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c146089a3249eea0254717e75c14c8" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:25.179004 28945 leader_election.cc:290] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:25.203249 28805 raft_consensus.cc:3060] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.183179 28855 raft_consensus.cc:359] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:25.205771 28855 raft_consensus.cc:385] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.185361 28852 tablet_bootstrap.cc:492] T 586415758fd245b49bd0a4e20a2b11d8 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:25.206122 28855 raft_consensus.cc:740] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.187430 29112 raft_consensus.cc:493] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.206878 29112 raft_consensus.cc:515] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:25.207154 28855 consensus_queue.cc:260] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:25.206652 28852 ts_tablet_manager.cc:1403] T 586415758fd245b49bd0a4e20a2b11d8 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.002s
I20260709 13:11:25.209002 28855 ts_tablet_manager.cc:1434] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.002s
I20260709 13:11:25.210371 28855 tablet_bootstrap.cc:492] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:25.211243 28804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cea3a9ab394674a67119867b34ce5a" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:25.213260 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cea3a9ab394674a67119867b34ce5a" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:25.202332 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2ea288ac6c435eb4e1fd15b459a3ff" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
W20260709 13:11:25.215673 28547 leader_election.cc:343] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.184355 28853 tablet_bootstrap.cc:654] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:25.216372 28547 leader_election.cc:343] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.216933 28848 tablet_bootstrap.cc:654] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.216821 28547 leader_election.cc:304] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:25.209085 29112 leader_election.cc:290] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:25.203222 28478 catalog_manager.cc:5697] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 0 to 1, leader changed from <none> to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 1 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:25.218590 29112 raft_consensus.cc:2749] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:25.219419 28622 leader_election.cc:343] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.219859 28622 leader_election.cc:304] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:25.220548 29000 raft_consensus.cc:2749] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:25.220206 28852 raft_consensus.cc:359] T 586415758fd245b49bd0a4e20a2b11d8 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:25.221799 28855 tablet_bootstrap.cc:654] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.221805 28852 raft_consensus.cc:385] T 586415758fd245b49bd0a4e20a2b11d8 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.222982 28852 raft_consensus.cc:740] T 586415758fd245b49bd0a4e20a2b11d8 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.223847 28852 consensus_queue.cc:260] T 586415758fd245b49bd0a4e20a2b11d8 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:25.226375 29116 raft_consensus.cc:493] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.226879 29116 raft_consensus.cc:515] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:25.229079 29116 leader_election.cc:290] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:25.230611 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b939cf3aa04842b1adacdee8818495fd" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:25.231201 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b939cf3aa04842b1adacdee8818495fd" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
W20260709 13:11:25.232633 28772 leader_election.cc:343] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:25.233421 28770 leader_election.cc:343] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.234020 28770 leader_election.cc:304] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:25.235689 29116 raft_consensus.cc:2749] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:25.237600 28855 tablet_bootstrap.cc:492] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:25.237764 28853 tablet_bootstrap.cc:492] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:25.238385 28853 ts_tablet_manager.cc:1403] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.005s
I20260709 13:11:25.238595 28855 ts_tablet_manager.cc:1403] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.005s
I20260709 13:11:25.241456 28855 raft_consensus.cc:359] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:25.242277 28855 raft_consensus.cc:385] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.242602 28855 raft_consensus.cc:740] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.235728 28852 ts_tablet_manager.cc:1434] T 586415758fd245b49bd0a4e20a2b11d8 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.003s
I20260709 13:11:25.243921 28852 tablet_bootstrap.cc:492] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:25.243521 28855 consensus_queue.cc:260] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:25.246199 28805 raft_consensus.cc:2468] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:25.246706 28855 ts_tablet_manager.cc:1434] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:11:25.248219 28547 leader_election.cc:304] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:25.249486 28945 raft_consensus.cc:2804] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:25.249961 28945 raft_consensus.cc:697] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:25.250598 28852 tablet_bootstrap.cc:654] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.250814 28945 consensus_queue.cc:237] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:25.241106 28853 raft_consensus.cc:359] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:25.253599 28853 raft_consensus.cc:385] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.253890 28853 raft_consensus.cc:740] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.254638 28853 consensus_queue.cc:260] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:25.257027 28855 tablet_bootstrap.cc:492] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:25.257521 28853 ts_tablet_manager.cc:1434] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:11:25.258852 28853 tablet_bootstrap.cc:492] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:25.263942 28479 catalog_manager.cc:5697] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:25.267935 28853 tablet_bootstrap.cc:654] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.272213 28730 raft_consensus.cc:3060] T 586415758fd245b49bd0a4e20a2b11d8 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.273278 28852 tablet_bootstrap.cc:492] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:25.274772 28852 ts_tablet_manager.cc:1403] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.001s
I20260709 13:11:25.275843 29116 raft_consensus.cc:493] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.276479 28855 tablet_bootstrap.cc:654] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.276350 29116 raft_consensus.cc:515] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:25.277694 28852 raft_consensus.cc:359] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:25.278438 28852 raft_consensus.cc:385] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.278699 28852 raft_consensus.cc:740] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.278915 29116 leader_election.cc:290] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:25.282122 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7befe583fe4534bdd8e703ee341d3e" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:25.279454 28852 consensus_queue.cc:260] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:25.288515 28852 ts_tablet_manager.cc:1434] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:11:25.289927 28657 raft_consensus.cc:2468] T cf7befe583fe4534bdd8e703ee341d3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
I20260709 13:11:25.294910 29052 raft_consensus.cc:493] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.295612 28772 leader_election.cc:304] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:25.295502 29052 raft_consensus.cc:515] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:25.296495 29116 raft_consensus.cc:2804] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:25.296742 28852 tablet_bootstrap.cc:492] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:25.296926 28803 raft_consensus.cc:3060] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.296931 29116 raft_consensus.cc:493] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.297714 29116 raft_consensus.cc:3060] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.303061 28848 tablet_bootstrap.cc:492] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:25.303623 28848 ts_tablet_manager.cc:1403] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.106s	user 0.018s	sys 0.014s
I20260709 13:11:25.304965 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7befe583fe4534bdd8e703ee341d3e" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:25.305969 29116 raft_consensus.cc:515] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:25.308284 29116 leader_election.cc:290] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:25.309398 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7befe583fe4534bdd8e703ee341d3e" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:25.310055 28657 raft_consensus.cc:3060] T cf7befe583fe4534bdd8e703ee341d3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.310333 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7befe583fe4534bdd8e703ee341d3e" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:25.311998 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47110731ce12413ab60b16f034fdceb3" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
W20260709 13:11:25.314258 28770 leader_election.cc:343] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.314374 28889 consensus_queue.cc:1048] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:25.314716 29112 consensus_queue.cc:1048] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:11:25.315354 28770 leader_election.cc:343] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.314930 28479 catalog_manager.cc:5697] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:25.323490 28848 raft_consensus.cc:359] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:25.324276 28848 raft_consensus.cc:385] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.324559 28848 raft_consensus.cc:740] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.325543 29052 leader_election.cc:290] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:25.327126 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47110731ce12413ab60b16f034fdceb3" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:25.328790 28656 raft_consensus.cc:2393] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1515f1138af4333a63996f5d0864d85 in current term 1: Already voted for candidate 44a14c00fc3d41bea8db00310408905a in this term.
I20260709 13:11:25.330194 28698 leader_election.cc:304] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1515f1138af4333a63996f5d0864d85; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:25.331476 29052 raft_consensus.cc:3060] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.342773 28853 tablet_bootstrap.cc:492] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:25.343367 28853 ts_tablet_manager.cc:1403] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.085s	user 0.008s	sys 0.013s
I20260709 13:11:25.345031 28657 raft_consensus.cc:2468] T cf7befe583fe4534bdd8e703ee341d3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:25.346470 28855 tablet_bootstrap.cc:492] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:25.349629 28887 raft_consensus.cc:493] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.350288 28855 ts_tablet_manager.cc:1403] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.000s
I20260709 13:11:25.350229 28887 raft_consensus.cc:515] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:25.351421 28731 raft_consensus.cc:3060] T 46835248ab9d4f43908a6c6a42642ba1 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.353161 28855 raft_consensus.cc:359] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:25.353893 28855 raft_consensus.cc:385] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.353592 28853 raft_consensus.cc:359] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:25.354182 28855 raft_consensus.cc:740] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.354323 28853 raft_consensus.cc:385] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.354686 28853 raft_consensus.cc:740] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.355849 28772 leader_election.cc:304] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:25.357323 29108 raft_consensus.cc:2804] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:25.357546 28732 raft_consensus.cc:3060] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.357844 29108 raft_consensus.cc:697] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:25.358702 29108 consensus_queue.cc:237] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:25.325268 28848 consensus_queue.cc:260] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:25.359200 28853 consensus_queue.cc:260] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:25.362171 28853 ts_tablet_manager.cc:1434] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:11:25.363940 28855 consensus_queue.cc:260] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:25.364778 28848 ts_tablet_manager.cc:1434] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 13:11:25.367638 28848 tablet_bootstrap.cc:492] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:25.368103 28855 ts_tablet_manager.cc:1434] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:11:25.369019 28855 tablet_bootstrap.cc:492] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:25.355955 28887 leader_election.cc:290] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:25.374655 28889 consensus_queue.cc:1048] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:25.375149 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8eab4cd5b64393b62a304011e5b22d" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:25.379532 29113 raft_consensus.cc:493] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.379720 28855 tablet_bootstrap.cc:654] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.380079 29113 raft_consensus.cc:515] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:25.382287 29113 leader_election.cc:290] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:25.382354 28887 consensus_queue.cc:1048] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:25.386490 29112 consensus_queue.cc:1048] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:11:25.387239 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40bb461a5034123ab09d156bd22ebbf" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:25.388106 28654 raft_consensus.cc:2468] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:25.389654 28549 leader_election.cc:304] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:25.390717 29112 raft_consensus.cc:2804] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:25.391139 29112 raft_consensus.cc:493] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.391609 29112 raft_consensus.cc:3060] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.393733 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40bb461a5034123ab09d156bd22ebbf" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:25.397764 28853 tablet_bootstrap.cc:492] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:25.399809 28855 tablet_bootstrap.cc:492] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:25.400338 28855 ts_tablet_manager.cc:1403] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.011s
W20260709 13:11:25.402908 28547 leader_election.cc:343] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.403427 28855 raft_consensus.cc:359] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:25.409051 28855 raft_consensus.cc:385] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.409389 28855 raft_consensus.cc:740] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.410705 28889 raft_consensus.cc:493] T 46835248ab9d4f43908a6c6a42642ba1 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.410238 28855 consensus_queue.cc:260] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:25.411302 28889 raft_consensus.cc:515] T 46835248ab9d4f43908a6c6a42642ba1 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:25.413183 28855 ts_tablet_manager.cc:1434] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:11:25.406963 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8eab4cd5b64393b62a304011e5b22d" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:25.414531 28772 leader_election.cc:304] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:25.416020 28889 leader_election.cc:290] T 46835248ab9d4f43908a6c6a42642ba1 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:25.419273 28855 tablet_bootstrap.cc:492] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:25.424455 28848 tablet_bootstrap.cc:654] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.420928 29109 consensus_queue.cc:1048] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:11:25.429229 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46835248ab9d4f43908a6c6a42642ba1" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:25.426657 29052 raft_consensus.cc:2749] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:25.445065 28853 tablet_bootstrap.cc:654] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.449879 28887 raft_consensus.cc:2749] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:25.453989 28804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46835248ab9d4f43908a6c6a42642ba1" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:25.456362 28855 tablet_bootstrap.cc:654] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.458225 28852 tablet_bootstrap.cc:654] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.467680 29112 raft_consensus.cc:515] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:25.481213 28478 catalog_manager.cc:5697] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 0 to 1, leader changed from <none> to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 1 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:25.558756 28696 leader_election.cc:304] T 46835248ab9d4f43908a6c6a42642ba1 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1515f1138af4333a63996f5d0864d85; no voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:25.561313 29109 raft_consensus.cc:493] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.561905 29109 raft_consensus.cc:515] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:25.563858 29109 leader_election.cc:290] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:25.566658 29112 leader_election.cc:290] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:25.568598 29108 raft_consensus.cc:493] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.569284 29108 raft_consensus.cc:515] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:25.571045 28852 tablet_bootstrap.cc:492] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:25.571564 28852 ts_tablet_manager.cc:1403] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.275s	user 0.019s	sys 0.008s
I20260709 13:11:25.579375 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cea3a9ab394674a67119867b34ce5a" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:25.591599 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cea3a9ab394674a67119867b34ce5a" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:25.577793 29108 leader_election.cc:290] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:25.582926 29052 raft_consensus.cc:2749] T 46835248ab9d4f43908a6c6a42642ba1 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:25.594760 28852 raft_consensus.cc:359] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:25.599928 28852 raft_consensus.cc:385] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:11:25.599102 28698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:43021, user_credentials={real_user=slave}} blocked reactor thread for 115973us
I20260709 13:11:25.587424 28996 raft_consensus.cc:493] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.605780 28658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40bb461a5034123ab09d156bd22ebbf" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
W20260709 13:11:25.606029 28770 leader_election.cc:343] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.605908 28996 raft_consensus.cc:515] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:25.608129 28996 leader_election.cc:290] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:25.608786 28658 raft_consensus.cc:3060] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.594828 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550aaae95149430d8f95525d197894f6" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:25.590114 28945 raft_consensus.cc:493] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.610230 28945 raft_consensus.cc:515] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:25.612001 28945 leader_election.cc:290] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:25.592509 28581 raft_consensus.cc:2468] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
W20260709 13:11:25.615000 28770 leader_election.cc:343] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.617755 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217202c939974f80b0c84019f3acfcaf" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:25.617794 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34233c4c336b444996374b970ddd2822" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:25.616724 28770 leader_election.cc:304] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:25.621522 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40bb461a5034123ab09d156bd22ebbf" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:25.622489 29116 raft_consensus.cc:2804] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:11:25.624034 28547 leader_election.cc:343] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.600313 28852 raft_consensus.cc:740] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.623087 29116 raft_consensus.cc:493] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.594111 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550aaae95149430d8f95525d197894f6" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:25.626919 28656 raft_consensus.cc:2468] T 550aaae95149430d8f95525d197894f6 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
I20260709 13:11:25.625777 29000 raft_consensus.cc:493] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.625207 28852 consensus_queue.cc:260] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
W20260709 13:11:25.622910 29152 log.cc:927] Time spent T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:11:25.630398 28852 ts_tablet_manager.cc:1434] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.002s
I20260709 13:11:25.627684 29116 raft_consensus.cc:3060] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.635399 28658 raft_consensus.cc:2468] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:25.637084 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34233c4c336b444996374b970ddd2822" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:25.637802 28656 raft_consensus.cc:2468] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:25.637832 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217202c939974f80b0c84019f3acfcaf" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:25.637285 28549 leader_election.cc:304] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:25.642268 29112 raft_consensus.cc:2804] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:25.642710 28549 leader_election.cc:304] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:25.643177 29113 consensus_queue.cc:1048] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:25.643595 28945 raft_consensus.cc:2804] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:25.629261 29000 raft_consensus.cc:515] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:25.644043 28945 raft_consensus.cc:493] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.647661 28945 raft_consensus.cc:3060] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:25.648092 28547 leader_election.cc:343] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.644510 29112 raft_consensus.cc:697] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:25.649226 28772 leader_election.cc:304] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:25.650065 29109 raft_consensus.cc:2804] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:25.650470 29109 raft_consensus.cc:493] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.650811 29109 raft_consensus.cc:3060] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.650117 29112 consensus_queue.cc:237] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:25.652356 29000 leader_election.cc:290] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:25.645171 28848 tablet_bootstrap.cc:492] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
W20260709 13:11:25.646657 28622 leader_election.cc:343] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:25.653673 28622 leader_election.cc:343] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.654064 28622 leader_election.cc:304] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:25.655277 28996 raft_consensus.cc:2749] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:25.655318 28945 raft_consensus.cc:515] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:25.657406 28945 leader_election.cc:290] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:25.660539 28848 ts_tablet_manager.cc:1403] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.293s	user 0.019s	sys 0.020s
I20260709 13:11:25.660316 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b32b6e56ce549b98fca9ad5f3798f2b" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:25.663151 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b32b6e56ce549b98fca9ad5f3798f2b" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:25.664556 28852 tablet_bootstrap.cc:492] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
W20260709 13:11:25.665340 28622 leader_election.cc:343] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.665814 29116 raft_consensus.cc:515] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:25.667878 29116 leader_election.cc:290] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:25.667702 28848 raft_consensus.cc:359] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:25.669374 29109 raft_consensus.cc:515] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:25.669848 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cea3a9ab394674a67119867b34ce5a" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:25.682545 28848 raft_consensus.cc:385] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.682988 28848 raft_consensus.cc:740] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.671932 28855 tablet_bootstrap.cc:492] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:25.671778 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12cea3a9ab394674a67119867b34ce5a" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
W20260709 13:11:25.672672 28622 leader_election.cc:343] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.673060 28853 tablet_bootstrap.cc:492] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:25.684471 28853 ts_tablet_manager.cc:1403] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.287s	user 0.044s	sys 0.042s
I20260709 13:11:25.685055 28855 ts_tablet_manager.cc:1403] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.267s	user 0.017s	sys 0.025s
W20260709 13:11:25.685259 28770 leader_election.cc:343] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.686230 28580 raft_consensus.cc:3060] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.687697 28855 raft_consensus.cc:359] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:25.687477 28853 raft_consensus.cc:359] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:25.688186 28855 raft_consensus.cc:385] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.688315 28853 raft_consensus.cc:385] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.684226 28622 leader_election.cc:304] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:25.688804 28853 raft_consensus.cc:740] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.678186 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34233c4c336b444996374b970ddd2822" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:25.689272 29000 raft_consensus.cc:2749] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:25.688416 28855 raft_consensus.cc:740] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.674450 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34233c4c336b444996374b970ddd2822" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:25.691375 28654 raft_consensus.cc:3060] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.691049 28855 consensus_queue.cc:260] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:25.692567 29109 leader_election.cc:290] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:25.693357 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550aaae95149430d8f95525d197894f6" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:25.694095 28656 raft_consensus.cc:3060] T 550aaae95149430d8f95525d197894f6 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.696808 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550aaae95149430d8f95525d197894f6" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
W20260709 13:11:25.699540 28770 leader_election.cc:343] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.700383 28855 ts_tablet_manager.cc:1434] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
W20260709 13:11:25.700731 28547 leader_election.cc:343] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.701418 28848 consensus_queue.cc:260] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:25.703570 28848 ts_tablet_manager.cc:1434] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 13:11:25.703918 28853 consensus_queue.cc:260] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:25.706246 28852 tablet_bootstrap.cc:654] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.709070 28855 tablet_bootstrap.cc:492] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:25.710301 28848 tablet_bootstrap.cc:492] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:25.710685 28580 raft_consensus.cc:2468] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:25.712044 28770 leader_election.cc:304] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:25.712743 28917 consensus_queue.cc:1048] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:25.713171 29109 raft_consensus.cc:2804] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:25.713954 29109 raft_consensus.cc:697] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:25.724984 29109 consensus_queue.cc:237] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:25.730161 28848 tablet_bootstrap.cc:654] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.730878 29108 raft_consensus.cc:493] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.731393 29108 raft_consensus.cc:515] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:25.730183 28656 raft_consensus.cc:2468] T 550aaae95149430d8f95525d197894f6 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:25.733695 29108 leader_election.cc:290] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:25.735029 28772 leader_election.cc:304] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:25.736630 28853 ts_tablet_manager.cc:1434] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:11:25.738090 28853 tablet_bootstrap.cc:492] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:25.742890 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9519acd190ba4590a2eaa1fcb1e9a60f" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:25.744508 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9519acd190ba4590a2eaa1fcb1e9a60f" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:25.744709 28770 leader_election.cc:343] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.740677 29113 consensus_queue.cc:1048] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:11:25.741878 29108 raft_consensus.cc:2804] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:25.748116 29108 raft_consensus.cc:697] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:25.748934 29108 consensus_queue.cc:237] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:25.741250 28654 raft_consensus.cc:2468] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:25.750814 28549 leader_election.cc:304] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
W20260709 13:11:25.752707 28770 leader_election.cc:343] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.753484 28770 leader_election.cc:304] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:25.755682 29116 raft_consensus.cc:2749] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:25.757928 28770 consensus_peers.cc:597] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.760066 28855 tablet_bootstrap.cc:654] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.775170 28480 catalog_manager.cc:5697] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:25.786406 28476 catalog_manager.cc:5697] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 0 to 1, leader changed from <none> to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 1 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:25.769273 29113 raft_consensus.cc:2804] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:25.802129 29112 raft_consensus.cc:493] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.808728 29113 raft_consensus.cc:697] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:25.809227 29112 raft_consensus.cc:515] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:25.832011 29113 consensus_queue.cc:237] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:25.836771 28853 tablet_bootstrap.cc:654] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.847173 28848 tablet_bootstrap.cc:492] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:25.847786 28848 ts_tablet_manager.cc:1403] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.138s	user 0.022s	sys 0.041s
I20260709 13:11:25.850942 28848 raft_consensus.cc:359] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:25.852154 28848 raft_consensus.cc:385] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.852435 28848 raft_consensus.cc:740] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.853140 28848 consensus_queue.cc:260] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:25.854939 28848 ts_tablet_manager.cc:1434] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:25.855207 29112 leader_election.cc:290] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:25.856019 28848 tablet_bootstrap.cc:492] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
W20260709 13:11:25.861662 28547 consensus_peers.cc:597] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a -> Peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Couldn't send request to peer a1515f1138af4333a63996f5d0864d85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:25.860340 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4abbb5e8f04c8388c1642217e7dbcb" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
W20260709 13:11:25.866807 28547 leader_election.cc:343] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.869704 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4abbb5e8f04c8388c1642217e7dbcb" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:25.873346 28547 leader_election.cc:343] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.873914 28547 leader_election.cc:304] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:25.874804 28917 raft_consensus.cc:2749] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:25.882619 28852 tablet_bootstrap.cc:492] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:25.883154 28852 ts_tablet_manager.cc:1403] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.219s	user 0.017s	sys 0.008s
I20260709 13:11:25.883206 28853 tablet_bootstrap.cc:492] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:25.883812 28853 ts_tablet_manager.cc:1403] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.146s	user 0.013s	sys 0.000s
I20260709 13:11:25.886045 28852 raft_consensus.cc:359] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:25.886802 28852 raft_consensus.cc:385] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.887123 28852 raft_consensus.cc:740] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.887789 28852 consensus_queue.cc:260] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:25.890437 28852 ts_tablet_manager.cc:1434] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:11:25.890807 28848 tablet_bootstrap.cc:654] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.891331 28852 tablet_bootstrap.cc:492] T 9a4abbb5e8f04c8388c1642217e7dbcb P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:25.886526 28853 raft_consensus.cc:359] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:25.894778 28853 raft_consensus.cc:385] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.895131 28853 raft_consensus.cc:740] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.895313 29156 raft_consensus.cc:493] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.895884 29156 raft_consensus.cc:515] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:25.896101 28853 consensus_queue.cc:260] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:25.898680 28853 ts_tablet_manager.cc:1434] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:11:25.898985 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2ea288ac6c435eb4e1fd15b459a3ff" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:25.899693 28656 raft_consensus.cc:2468] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 0.
I20260709 13:11:25.901247 28698 leader_election.cc:304] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:25.901490 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2ea288ac6c435eb4e1fd15b459a3ff" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:25.899678 28853 tablet_bootstrap.cc:492] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:25.902463 29055 raft_consensus.cc:2804] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:25.902930 29055 raft_consensus.cc:493] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.903326 29055 raft_consensus.cc:3060] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.903434 28855 tablet_bootstrap.cc:492] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
W20260709 13:11:25.903558 28696 leader_election.cc:343] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:25.904178 28855 ts_tablet_manager.cc:1403] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.195s	user 0.017s	sys 0.014s
I20260709 13:11:25.904794 29156 leader_election.cc:290] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:25.910657 28852 tablet_bootstrap.cc:654] T 9a4abbb5e8f04c8388c1642217e7dbcb P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.908936 28855 raft_consensus.cc:359] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:25.911245 28855 raft_consensus.cc:385] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.911653 28855 raft_consensus.cc:740] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.912662 28855 consensus_queue.cc:260] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:25.914698 28853 tablet_bootstrap.cc:654] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.923228 29116 consensus_queue.cc:1048] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:25.925810 28855 ts_tablet_manager.cc:1434] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.002s
I20260709 13:11:25.940059 28855 tablet_bootstrap.cc:492] T 5e2ea288ac6c435eb4e1fd15b459a3ff P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:25.941648 28848 tablet_bootstrap.cc:492] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:25.942309 28848 ts_tablet_manager.cc:1403] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.087s	user 0.016s	sys 0.011s
I20260709 13:11:25.951713 28476 catalog_manager.cc:5697] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 0 to 1, leader changed from <none> to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 1 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:25.938506 29055 raft_consensus.cc:515] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:25.958581 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2ea288ac6c435eb4e1fd15b459a3ff" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:25.959219 28656 raft_consensus.cc:3060] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:25.960913 29132 raft_consensus.cc:493] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.962997 28848 raft_consensus.cc:359] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:25.963758 28848 raft_consensus.cc:385] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:25.964028 28848 raft_consensus.cc:740] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:25.964630 28848 consensus_queue.cc:260] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:25.969990 28848 ts_tablet_manager.cc:1434] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 13:11:25.971724 28848 tablet_bootstrap.cc:492] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:25.971117 28480 catalog_manager.cc:5697] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:25.974014 29055 leader_election.cc:290] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:25.978680 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2ea288ac6c435eb4e1fd15b459a3ff" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:25.983700 28848 tablet_bootstrap.cc:654] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.991791 28853 tablet_bootstrap.cc:492] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:25.992401 28853 ts_tablet_manager.cc:1403] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.093s	user 0.008s	sys 0.020s
I20260709 13:11:25.992543 28855 tablet_bootstrap.cc:654] T 5e2ea288ac6c435eb4e1fd15b459a3ff P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:25.994230 28656 raft_consensus.cc:2468] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:25.961516 29132 raft_consensus.cc:515] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:25.997031 29132 leader_election.cc:290] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:25.997911 28698 leader_election.cc:304] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
W20260709 13:11:26.000294 28696 leader_election.cc:343] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.001613 29156 raft_consensus.cc:2804] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:26.001842 28852 tablet_bootstrap.cc:492] T 9a4abbb5e8f04c8388c1642217e7dbcb P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:26.002233 29156 raft_consensus.cc:697] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:26.002470 28852 ts_tablet_manager.cc:1403] T 9a4abbb5e8f04c8388c1642217e7dbcb P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.000s
I20260709 13:11:26.003196 29156 consensus_queue.cc:237] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:26.005674 28852 raft_consensus.cc:359] T 9a4abbb5e8f04c8388c1642217e7dbcb P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:26.008635 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b939cf3aa04842b1adacdee8818495fd" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:26.009265 28852 raft_consensus.cc:385] T 9a4abbb5e8f04c8388c1642217e7dbcb P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.009511 28805 raft_consensus.cc:2468] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 0.
I20260709 13:11:26.009586 28853 raft_consensus.cc:359] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:26.011893 28853 raft_consensus.cc:385] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.012234 28853 raft_consensus.cc:740] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.009639 28852 raft_consensus.cc:740] T 9a4abbb5e8f04c8388c1642217e7dbcb P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.013669 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b939cf3aa04842b1adacdee8818495fd" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:26.013947 28852 consensus_queue.cc:260] T 9a4abbb5e8f04c8388c1642217e7dbcb P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:26.012514 28622 leader_election.cc:304] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:26.021732 28887 raft_consensus.cc:493] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.022146 29131 raft_consensus.cc:2804] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:26.022872 29131 raft_consensus.cc:493] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.022308 28887 raft_consensus.cc:515] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:26.023386 29131 raft_consensus.cc:3060] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.025388 28887 leader_election.cc:290] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:26.027349 28852 ts_tablet_manager.cc:1434] T 9a4abbb5e8f04c8388c1642217e7dbcb P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:11:26.028956 28852 tablet_bootstrap.cc:492] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:26.036458 29109 raft_consensus.cc:493] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:26.038439 28622 leader_election.cc:343] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.038583 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40bb461a5034123ab09d156bd22ebbf" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:26.039424 28654 raft_consensus.cc:2393] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8d512840fb74aaf82ac80c433d8dc2d in current term 1: Already voted for candidate 44a14c00fc3d41bea8db00310408905a in this term.
I20260709 13:11:26.037077 29109 raft_consensus.cc:515] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:26.044806 29109 leader_election.cc:290] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:26.047382 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4abbb5e8f04c8388c1642217e7dbcb" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:26.048503 28581 raft_consensus.cc:2468] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
I20260709 13:11:26.047580 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4abbb5e8f04c8388c1642217e7dbcb" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:26.050688 28729 raft_consensus.cc:2468] T 9a4abbb5e8f04c8388c1642217e7dbcb P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
I20260709 13:11:26.052553 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40bb461a5034123ab09d156bd22ebbf" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:26.013739 28853 consensus_queue.cc:260] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:26.055997 28770 leader_election.cc:304] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:26.059016 28770 leader_election.cc:304] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:26.060586 28853 ts_tablet_manager.cc:1434] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.002s
I20260709 13:11:26.060696 29116 raft_consensus.cc:2804] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:26.061460 29116 raft_consensus.cc:493] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.061935 29116 raft_consensus.cc:3060] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.065645 28887 raft_consensus.cc:3060] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.081786 28853 tablet_bootstrap.cc:492] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:26.093592 29159 consensus_queue.cc:1048] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:26.084005 29131 raft_consensus.cc:515] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:26.097749 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b939cf3aa04842b1adacdee8818495fd" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:26.098726 28805 raft_consensus.cc:3060] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.110327 29131 leader_election.cc:290] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:26.110821 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b939cf3aa04842b1adacdee8818495fd" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:26.094362 29116 raft_consensus.cc:515] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
W20260709 13:11:26.112341 28622 leader_election.cc:343] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.114396 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4abbb5e8f04c8388c1642217e7dbcb" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:26.115298 28729 raft_consensus.cc:3060] T 9a4abbb5e8f04c8388c1642217e7dbcb P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.122680 28478 catalog_manager.cc:5697] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 1 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.124577 29132 raft_consensus.cc:493] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.125342 29132 raft_consensus.cc:515] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:26.128911 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e262f061cd4055b2b8c365deb5bf74" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:26.130514 28622 leader_election.cc:343] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.131023 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e262f061cd4055b2b8c365deb5bf74" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:26.133296 29113 raft_consensus.cc:493] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.133916 29113 raft_consensus.cc:515] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:26.136718 29113 leader_election.cc:290] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:26.138803 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7befe583fe4534bdd8e703ee341d3e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:26.141018 28848 tablet_bootstrap.cc:492] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
W20260709 13:11:26.141201 28622 leader_election.cc:343] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.149538 28622 leader_election.cc:304] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:26.150707 28996 raft_consensus.cc:2749] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:26.149221 28848 ts_tablet_manager.cc:1403] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.178s	user 0.032s	sys 0.045s
I20260709 13:11:26.154803 28848 raft_consensus.cc:359] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:26.155580 28848 raft_consensus.cc:385] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.155891 28848 raft_consensus.cc:740] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.143915 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7befe583fe4534bdd8e703ee341d3e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:26.160983 28549 leader_election.cc:304] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:26.162586 29116 leader_election.cc:290] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:26.165179 28729 raft_consensus.cc:2468] T 9a4abbb5e8f04c8388c1642217e7dbcb P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:26.144609 29132 leader_election.cc:290] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:26.165478 28582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a4abbb5e8f04c8388c1642217e7dbcb" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:26.166817 28582 raft_consensus.cc:3060] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.166863 28770 leader_election.cc:304] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:26.168303 29116 raft_consensus.cc:2804] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:26.169366 29116 raft_consensus.cc:697] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:26.170199 29159 raft_consensus.cc:2749] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:26.170914 29159 raft_consensus.cc:493] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.171403 29159 raft_consensus.cc:515] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:26.108685 28805 raft_consensus.cc:2468] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 1.
I20260709 13:11:26.093308 28853 tablet_bootstrap.cc:654] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.177772 29159 leader_election.cc:290] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:26.177412 28582 raft_consensus.cc:2468] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:26.185639 28848 consensus_queue.cc:260] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:26.178397 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e29bffebb804a5bbb9935518c059b2a" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:26.196197 28731 raft_consensus.cc:2468] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:26.180980 28622 leader_election.cc:304] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:26.183723 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e29bffebb804a5bbb9935518c059b2a" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:26.197559 28656 raft_consensus.cc:2468] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:26.198473 28996 raft_consensus.cc:2804] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:26.199128 28996 raft_consensus.cc:697] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Becoming Leader. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
I20260709 13:11:26.199738 28848 ts_tablet_manager.cc:1434] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:11:26.200739 28547 leader_election.cc:304] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85; no voters: 
I20260709 13:11:26.200239 28996 consensus_queue.cc:237] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:26.203002 28853 tablet_bootstrap.cc:492] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:26.203276 29159 raft_consensus.cc:2804] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:26.203531 28853 ts_tablet_manager.cc:1403] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.122s	user 0.009s	sys 0.001s
I20260709 13:11:26.203711 29159 raft_consensus.cc:493] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.204164 29159 raft_consensus.cc:3060] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.206590 28853 raft_consensus.cc:359] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:26.207360 28853 raft_consensus.cc:385] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.207666 28853 raft_consensus.cc:740] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.200773 28848 tablet_bootstrap.cc:492] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:26.178229 29116 consensus_queue.cc:237] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:26.195305 28582 raft_consensus.cc:3060] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.208323 28853 consensus_queue.cc:260] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:26.223603 28853 ts_tablet_manager.cc:1434] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.001s
I20260709 13:11:26.235401 28848 tablet_bootstrap.cc:654] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.243203 28887 raft_consensus.cc:2749] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:26.244328 28852 tablet_bootstrap.cc:654] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.247958 28945 consensus_queue.cc:1048] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:26.248719 28853 tablet_bootstrap.cc:492] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:26.251430 29159 raft_consensus.cc:515] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:26.261653 29109 consensus_queue.cc:1048] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:26.263937 28855 tablet_bootstrap.cc:492] T 5e2ea288ac6c435eb4e1fd15b459a3ff P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:26.270676 28855 ts_tablet_manager.cc:1403] T 5e2ea288ac6c435eb4e1fd15b459a3ff P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.331s	user 0.080s	sys 0.079s
I20260709 13:11:26.266423 28476 catalog_manager.cc:5697] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 0 to 1, leader changed from <none> to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 1 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:26.276268 28770 consensus_peers.cc:597] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Couldn't send request to peer a1515f1138af4333a63996f5d0864d85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:26.275949 28855 raft_consensus.cc:359] T 5e2ea288ac6c435eb4e1fd15b459a3ff P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:26.281088 29159 leader_election.cc:290] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:26.281723 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e29bffebb804a5bbb9935518c059b2a" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:26.282414 28654 raft_consensus.cc:3060] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.285985 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e29bffebb804a5bbb9935518c059b2a" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:26.286648 28731 raft_consensus.cc:3060] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:26.291610 28528 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:26.295686 28855 raft_consensus.cc:385] T 5e2ea288ac6c435eb4e1fd15b459a3ff P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.296273 28855 raft_consensus.cc:740] T 5e2ea288ac6c435eb4e1fd15b459a3ff P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.297019 28855 consensus_queue.cc:260] T 5e2ea288ac6c435eb4e1fd15b459a3ff P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:26.295780 28476 catalog_manager.cc:5697] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2). New cstate: current_term: 1 leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:26.300843 28852 tablet_bootstrap.cc:492] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:26.301998 28852 ts_tablet_manager.cc:1403] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.273s	user 0.012s	sys 0.003s
I20260709 13:11:26.303160 28848 tablet_bootstrap.cc:492] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:26.303059 29116 consensus_queue.cc:1048] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:26.303712 28848 ts_tablet_manager.cc:1403] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.103s	user 0.008s	sys 0.004s
I20260709 13:11:26.304857 28852 raft_consensus.cc:359] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:26.305634 28852 raft_consensus.cc:385] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.307782 28852 raft_consensus.cc:740] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.308478 28852 consensus_queue.cc:260] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:26.306308 28848 raft_consensus.cc:359] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:26.309386 28848 raft_consensus.cc:385] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.309695 28848 raft_consensus.cc:740] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.307430 28853 tablet_bootstrap.cc:654] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.300931 28855 ts_tablet_manager.cc:1434] T 5e2ea288ac6c435eb4e1fd15b459a3ff P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 13:11:26.312994 28855 tablet_bootstrap.cc:492] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:26.319555 28855 tablet_bootstrap.cc:654] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.320369 29159 consensus_queue.cc:1048] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:26.322376 28848 consensus_queue.cc:260] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:26.324764 28848 ts_tablet_manager.cc:1434] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:11:26.325784 28848 tablet_bootstrap.cc:492] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:26.329190 28852 ts_tablet_manager.cc:1434] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:11:26.330121 28852 tablet_bootstrap.cc:492] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
W20260709 13:11:26.330276 28770 consensus_peers.cc:597] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d -> Peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Couldn't send request to peer a1515f1138af4333a63996f5d0864d85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:26.331996 28853 tablet_bootstrap.cc:492] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:26.332515 28853 ts_tablet_manager.cc:1403] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.084s	user 0.007s	sys 0.003s
I20260709 13:11:26.337402 28853 raft_consensus.cc:359] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:26.338106 28853 raft_consensus.cc:385] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.338366 28853 raft_consensus.cc:740] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.339154 28848 tablet_bootstrap.cc:654] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.338943 28853 consensus_queue.cc:260] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:26.347826 28853 ts_tablet_manager.cc:1434] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.006s
I20260709 13:11:26.348660 28853 tablet_bootstrap.cc:492] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:26.351770 28855 tablet_bootstrap.cc:492] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:26.352244 28855 ts_tablet_manager.cc:1403] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.000s
I20260709 13:11:26.319581 28654 raft_consensus.cc:2468] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:26.356678 28855 raft_consensus.cc:359] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:26.359107 28852 tablet_bootstrap.cc:654] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.359741 28549 leader_election.cc:304] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:26.357369 28855 raft_consensus.cc:385] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.360317 28855 raft_consensus.cc:740] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.363716 28855 consensus_queue.cc:260] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:26.362838 29113 raft_consensus.cc:2804] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:26.368453 29113 raft_consensus.cc:697] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:26.369293 29113 consensus_queue.cc:237] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:26.371986 28855 ts_tablet_manager.cc:1434] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:11:26.374455 28855 tablet_bootstrap.cc:492] T 28856e9437484cbdae4f48bf4ca6aaa1 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:26.375409 28731 raft_consensus.cc:2468] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:26.383373 28730 raft_consensus.cc:3060] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.384505 29131 raft_consensus.cc:493] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.385070 29131 raft_consensus.cc:515] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:26.393237 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed785ccac6a425f83665ef8e365bfc1" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
W20260709 13:11:26.395673 28622 leader_election.cc:343] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.398347 29131 leader_election.cc:290] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:26.398306 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed785ccac6a425f83665ef8e365bfc1" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:26.402755 28622 leader_election.cc:343] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.403136 28622 leader_election.cc:304] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:26.404238 29131 raft_consensus.cc:2749] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:26.406982 28848 tablet_bootstrap.cc:492] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:26.407639 28848 ts_tablet_manager.cc:1403] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.009s
I20260709 13:11:26.411550 28848 raft_consensus.cc:359] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:26.410167 29113 consensus_queue.cc:1048] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:11:26.413180 28848 raft_consensus.cc:385] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.413507 28848 raft_consensus.cc:740] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.414623 28848 consensus_queue.cc:260] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:26.423462 28853 tablet_bootstrap.cc:654] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.427542 28855 tablet_bootstrap.cc:654] T 28856e9437484cbdae4f48bf4ca6aaa1 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.427757 28848 ts_tablet_manager.cc:1434] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.002s
I20260709 13:11:26.428741 28848 tablet_bootstrap.cc:492] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:26.450431 28852 tablet_bootstrap.cc:492] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:26.453979 28848 tablet_bootstrap.cc:654] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.453320 28853 tablet_bootstrap.cc:492] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:26.454877 28853 ts_tablet_manager.cc:1403] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.002s
I20260709 13:11:26.454032 28852 ts_tablet_manager.cc:1403] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.124s	user 0.010s	sys 0.003s
I20260709 13:11:26.457705 28479 catalog_manager.cc:5697] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.460777 28852 raft_consensus.cc:359] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:26.461809 28852 raft_consensus.cc:385] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.462152 28852 raft_consensus.cc:740] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.447544 28855 tablet_bootstrap.cc:492] T 28856e9437484cbdae4f48bf4ca6aaa1 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:26.463389 28855 ts_tablet_manager.cc:1403] T 28856e9437484cbdae4f48bf4ca6aaa1 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.089s	user 0.016s	sys 0.007s
I20260709 13:11:26.467943 28853 raft_consensus.cc:359] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:26.469022 28853 raft_consensus.cc:385] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.469830 28852 consensus_queue.cc:260] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:26.472533 28852 ts_tablet_manager.cc:1434] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:11:26.473798 28852 tablet_bootstrap.cc:492] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:26.469370 28853 raft_consensus.cc:740] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.477916 29131 raft_consensus.cc:493] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.478457 29131 raft_consensus.cc:515] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:26.478776 28853 consensus_queue.cc:260] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:26.480531 29131 leader_election.cc:290] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:26.481518 28855 raft_consensus.cc:359] T 28856e9437484cbdae4f48bf4ca6aaa1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:26.482228 28855 raft_consensus.cc:385] T 28856e9437484cbdae4f48bf4ca6aaa1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.482487 28855 raft_consensus.cc:740] T 28856e9437484cbdae4f48bf4ca6aaa1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.483126 28855 consensus_queue.cc:260] T 28856e9437484cbdae4f48bf4ca6aaa1 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:26.485287 28855 ts_tablet_manager.cc:1434] T 28856e9437484cbdae4f48bf4ca6aaa1 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.022s	user 0.000s	sys 0.004s
I20260709 13:11:26.481238 28853 ts_tablet_manager.cc:1434] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:11:26.488610 28853 tablet_bootstrap.cc:492] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:26.489668 28855 tablet_bootstrap.cc:492] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:26.494100 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb853da5b7ff48d9a188d40610160f6c" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
W20260709 13:11:26.496384 28622 leader_election.cc:343] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.497203 28855 tablet_bootstrap.cc:654] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.500056 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb853da5b7ff48d9a188d40610160f6c" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:26.502867 28622 leader_election.cc:343] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.503360 28622 leader_election.cc:304] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:26.504112 29131 raft_consensus.cc:2749] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:26.504252 28804 raft_consensus.cc:3060] T 5e2ea288ac6c435eb4e1fd15b459a3ff P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.505123 28945 raft_consensus.cc:493] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.505671 28945 raft_consensus.cc:515] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:26.506088 28852 tablet_bootstrap.cc:654] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.496901 28853 tablet_bootstrap.cc:654] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.510007 28945 leader_election.cc:290] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:26.510593 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9519acd190ba4590a2eaa1fcb1e9a60f" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:26.511165 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9519acd190ba4590a2eaa1fcb1e9a60f" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:26.512072 28805 raft_consensus.cc:2468] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:26.512372 29156 raft_consensus.cc:493] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.512900 29156 raft_consensus.cc:515] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:26.516803 28547 leader_election.cc:304] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:26.518049 29113 raft_consensus.cc:2804] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:26.518527 29113 raft_consensus.cc:493] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.518952 29113 raft_consensus.cc:3060] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:26.527030 28547 leader_election.cc:343] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.526085 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c146089a3249eea0254717e75c14c8" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:26.530980 28848 tablet_bootstrap.cc:492] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:26.531520 28848 ts_tablet_manager.cc:1403] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.103s	user 0.017s	sys 0.011s
I20260709 13:11:26.528776 29156 leader_election.cc:290] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:26.533938 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c146089a3249eea0254717e75c14c8" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:26.542595 28696 leader_election.cc:304] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1515f1138af4333a63996f5d0864d85; no voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:26.544387 28889 raft_consensus.cc:2749] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:26.551402 28848 raft_consensus.cc:359] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:26.554746 28848 raft_consensus.cc:385] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.555083 28848 raft_consensus.cc:740] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.558673 28848 consensus_queue.cc:260] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:26.563699 28889 consensus_queue.cc:1048] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:26.573985 28848 ts_tablet_manager.cc:1434] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.002s
I20260709 13:11:26.575126 28848 tablet_bootstrap.cc:492] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:26.585309 28852 tablet_bootstrap.cc:492] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:26.587348 28917 raft_consensus.cc:493] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.587961 28917 raft_consensus.cc:515] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:26.586318 28852 ts_tablet_manager.cc:1403] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.113s	user 0.011s	sys 0.010s
I20260709 13:11:26.598656 28658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217202c939974f80b0c84019f3acfcaf" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:26.599462 28658 raft_consensus.cc:2468] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:26.600179 28855 tablet_bootstrap.cc:492] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:26.600764 28855 ts_tablet_manager.cc:1403] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.111s	user 0.026s	sys 0.038s
I20260709 13:11:26.602145 28848 tablet_bootstrap.cc:654] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.579586 29113 raft_consensus.cc:515] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:26.605166 29113 leader_election.cc:290] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:26.605753 28549 leader_election.cc:304] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:26.600236 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217202c939974f80b0c84019f3acfcaf" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:26.607438 28853 tablet_bootstrap.cc:492] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:26.597112 28917 leader_election.cc:290] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:26.608161 28917 raft_consensus.cc:2804] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:26.608613 28917 raft_consensus.cc:493] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.608937 28917 raft_consensus.cc:3060] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.608172 28853 ts_tablet_manager.cc:1403] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.120s	user 0.013s	sys 0.005s
I20260709 13:11:26.613782 28852 raft_consensus.cc:359] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:26.614472 28852 raft_consensus.cc:385] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.614741 28852 raft_consensus.cc:740] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.617188 28853 raft_consensus.cc:359] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:26.619987 29131 raft_consensus.cc:493] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.622766 29131 raft_consensus.cc:515] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:26.604059 28855 raft_consensus.cc:359] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:26.624244 28855 raft_consensus.cc:385] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.624616 28855 raft_consensus.cc:740] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.624927 29131 leader_election.cc:290] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:26.621893 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9519acd190ba4590a2eaa1fcb1e9a60f" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:26.625914 28805 raft_consensus.cc:3060] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.625485 28855 consensus_queue.cc:260] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:26.627393 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28856e9437484cbdae4f48bf4ca6aaa1" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:26.628085 28806 raft_consensus.cc:2468] T 28856e9437484cbdae4f48bf4ca6aaa1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 0.
I20260709 13:11:26.629738 29131 raft_consensus.cc:493] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.629817 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28856e9437484cbdae4f48bf4ca6aaa1" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:26.630508 29131 raft_consensus.cc:515] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:26.632524 28855 ts_tablet_manager.cc:1434] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.004s
I20260709 13:11:26.633653 28855 tablet_bootstrap.cc:492] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:26.633500 28622 leader_election.cc:304] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:26.635753 28802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92fb36508a8840ea8e84f00da15700a1" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:26.636013 28805 raft_consensus.cc:2468] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:26.637169 28853 raft_consensus.cc:385] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.632594 29131 leader_election.cc:290] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:26.638460 29132 raft_consensus.cc:2804] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:26.643496 28855 tablet_bootstrap.cc:654] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:26.639098 28622 leader_election.cc:343] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.638847 28917 raft_consensus.cc:515] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:26.643672 28853 raft_consensus.cc:740] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.643739 29132 raft_consensus.cc:493] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.644630 28853 consensus_queue.cc:260] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:26.645167 29132 raft_consensus.cc:3060] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.647589 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9519acd190ba4590a2eaa1fcb1e9a60f" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:26.652752 28658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217202c939974f80b0c84019f3acfcaf" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:26.653863 28658 raft_consensus.cc:3060] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.646807 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92fb36508a8840ea8e84f00da15700a1" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:26.655272 28853 ts_tablet_manager.cc:1434] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 13:11:26.658437 29132 raft_consensus.cc:515] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:26.660691 29132 leader_election.cc:290] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
W20260709 13:11:26.642894 28547 leader_election.cc:343] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:26.644647 28622 leader_election.cc:343] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.645666 28917 leader_election.cc:290] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:26.664157 28802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28856e9437484cbdae4f48bf4ca6aaa1" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:26.664819 28802 raft_consensus.cc:3060] T 28856e9437484cbdae4f48bf4ca6aaa1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.666710 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28856e9437484cbdae4f48bf4ca6aaa1" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:26.667757 28848 tablet_bootstrap.cc:492] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:26.668246 28848 ts_tablet_manager.cc:1403] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.093s	user 0.008s	sys 0.031s
I20260709 13:11:26.668543 28658 raft_consensus.cc:2468] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:26.671324 28848 raft_consensus.cc:359] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:26.672626 28549 leader_election.cc:304] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:26.672047 28848 raft_consensus.cc:385] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.673501 28848 raft_consensus.cc:740] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.673946 28945 raft_consensus.cc:2804] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:11:26.668292 28622 leader_election.cc:343] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.674752 28945 raft_consensus.cc:697] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:26.674218 28848 consensus_queue.cc:260] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:26.676062 28945 consensus_queue.cc:237] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:26.680243 28848 ts_tablet_manager.cc:1434] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:11:26.684984 28848 tablet_bootstrap.cc:492] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:26.686444 28855 tablet_bootstrap.cc:492] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:26.686960 28855 ts_tablet_manager.cc:1403] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.012s
I20260709 13:11:26.687911 28802 raft_consensus.cc:2468] T 28856e9437484cbdae4f48bf4ca6aaa1 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 1.
I20260709 13:11:26.689514 28622 leader_election.cc:304] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:26.690490 28996 raft_consensus.cc:2804] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:26.690979 28996 raft_consensus.cc:697] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Becoming Leader. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
W20260709 13:11:26.691233 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:41711, user_credentials={real_user=slave}} blocked reactor thread for 48378.7us
I20260709 13:11:26.691797 28996 consensus_queue.cc:237] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:26.692792 28848 tablet_bootstrap.cc:654] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.693007 28855 raft_consensus.cc:359] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:26.693840 28855 raft_consensus.cc:385] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.694190 28855 raft_consensus.cc:740] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.695102 28855 consensus_queue.cc:260] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:26.697865 28855 ts_tablet_manager.cc:1434] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 13:11:26.699100 28855 tablet_bootstrap.cc:492] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:26.703711 28547 leader_election.cc:304] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:26.704830 28945 raft_consensus.cc:2804] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:26.706303 29108 consensus_queue.cc:1048] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:26.711349 28853 tablet_bootstrap.cc:492] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
W20260709 13:11:26.712278 28698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:43021, user_credentials={real_user=slave}} blocked reactor thread for 59464.2us
I20260709 13:11:26.713660 28852 consensus_queue.cc:260] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:26.715670 28889 consensus_queue.cc:1048] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:26.718374 28580 raft_consensus.cc:3060] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.721536 28945 raft_consensus.cc:697] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:26.722975 28945 consensus_queue.cc:237] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:26.715445 28855 tablet_bootstrap.cc:654] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.738852 29131 consensus_queue.cc:1048] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:26.744913 29131 raft_consensus.cc:493] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.745638 29131 raft_consensus.cc:515] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:26.747876 29131 leader_election.cc:290] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:26.756961 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a388b79acd4a278496df6d65fd7a44" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:26.758455 29108 raft_consensus.cc:493] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.759064 29108 raft_consensus.cc:515] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:26.762336 29108 leader_election.cc:290] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:26.764955 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a388b79acd4a278496df6d65fd7a44" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:26.765658 29108 raft_consensus.cc:493] T 5e2ea288ac6c435eb4e1fd15b459a3ff P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.766170 29108 raft_consensus.cc:515] T 5e2ea288ac6c435eb4e1fd15b459a3ff P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:26.769236 29108 leader_election.cc:290] T 5e2ea288ac6c435eb4e1fd15b459a3ff P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
W20260709 13:11:26.770196 28622 leader_election.cc:343] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:26.770844 28622 leader_election.cc:343] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.771236 28622 leader_election.cc:304] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:26.772087 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bc5681208146d19bff2322d4c254dd" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:26.777464 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bc5681208146d19bff2322d4c254dd" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:26.779192 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2ea288ac6c435eb4e1fd15b459a3ff" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:26.783854 28770 leader_election.cc:343] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.783247 28480 catalog_manager.cc:5697] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:26.797087 28855 tablet_bootstrap.cc:492] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:26.797864 28855 ts_tablet_manager.cc:1403] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.099s	user 0.011s	sys 0.005s
W20260709 13:11:26.798753 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:43597, user_credentials={real_user=slave}} blocked reactor thread for 151898us
I20260709 13:11:26.801221 28855 raft_consensus.cc:359] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:26.801393 29108 raft_consensus.cc:493] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.802495 29108 raft_consensus.cc:515] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:26.802175 28855 raft_consensus.cc:385] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.803512 28855 raft_consensus.cc:740] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.803092 28480 catalog_manager.cc:5697] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:26.805493 28855 consensus_queue.cc:260] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:26.824910 29132 raft_consensus.cc:2749] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:26.828842 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:43597, user_credentials={real_user=slave}} blocked reactor thread for 58012.2us
I20260709 13:11:26.831913 28855 ts_tablet_manager.cc:1434] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:11:26.836305 28852 ts_tablet_manager.cc:1434] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.247s	user 0.008s	sys 0.000s
W20260709 13:11:26.845383 28622 leader_election.cc:343] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.845898 28622 leader_election.cc:304] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:26.847092 28852 tablet_bootstrap.cc:492] T 12cea3a9ab394674a67119867b34ce5a P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:26.848882 29132 raft_consensus.cc:2749] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:11:26.849529 28770 leader_election.cc:343] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.850073 28770 leader_election.cc:304] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:26.850979 29116 raft_consensus.cc:2749] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:26.851272 28855 tablet_bootstrap.cc:492] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:26.863695 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217202c939974f80b0c84019f3acfcaf" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:26.865477 28848 tablet_bootstrap.cc:492] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:26.866014 28848 ts_tablet_manager.cc:1403] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.181s	user 0.055s	sys 0.086s
W20260709 13:11:26.869735 28547 leader_election.cc:343] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.871531 28855 tablet_bootstrap.cc:654] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.880713 29108 leader_election.cc:290] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:26.880820 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b32b6e56ce549b98fca9ad5f3798f2b" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:26.884172 28855 tablet_bootstrap.cc:492] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:26.884733 28855 ts_tablet_manager.cc:1403] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.005s
I20260709 13:11:26.885669 28848 raft_consensus.cc:359] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:26.886356 28848 raft_consensus.cc:385] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.886612 28848 raft_consensus.cc:740] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
W20260709 13:11:26.884661 28770 leader_election.cc:343] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:26.887749 29116 consensus_queue.cc:1048] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:26.890832 28855 raft_consensus.cc:359] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:26.892481 28855 raft_consensus.cc:385] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:26.893095 28855 raft_consensus.cc:740] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:26.894045 28855 consensus_queue.cc:260] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:26.893097 28480 catalog_manager.cc:5697] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2). New cstate: current_term: 1 leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:26.898209 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b32b6e56ce549b98fca9ad5f3798f2b" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:26.898877 28654 raft_consensus.cc:2468] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
I20260709 13:11:26.899148 29209 raft_consensus.cc:493] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.899657 29209 raft_consensus.cc:515] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:26.896135 28853 tablet_bootstrap.cc:654] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.902448 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550aaae95149430d8f95525d197894f6" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:26.896503 28855 ts_tablet_manager.cc:1434] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.005s
I20260709 13:11:26.896879 28658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e2ea288ac6c435eb4e1fd15b459a3ff" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:26.905419 28855 tablet_bootstrap.cc:492] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:26.912912 28855 tablet_bootstrap.cc:654] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.916800 28772 leader_election.cc:304] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:26.918512 29108 raft_consensus.cc:2804] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:26.919049 29108 raft_consensus.cc:493] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.919476 29108 raft_consensus.cc:3060] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.920485 29209 leader_election.cc:290] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:26.929541 28945 consensus_queue.cc:1048] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:26.931118 28852 tablet_bootstrap.cc:654] T 12cea3a9ab394674a67119867b34ce5a P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:26.927634 28804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550aaae95149430d8f95525d197894f6" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:26.935153 28772 leader_election.cc:304] T 5e2ea288ac6c435eb4e1fd15b459a3ff P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:26.936474 28887 raft_consensus.cc:2749] T 5e2ea288ac6c435eb4e1fd15b459a3ff P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:26.940554 28848 consensus_queue.cc:260] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:26.941376 29219 raft_consensus.cc:493] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.941938 29219 raft_consensus.cc:515] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:26.944473 29219 leader_election.cc:290] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:26.960882 28848 ts_tablet_manager.cc:1434] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.000s
I20260709 13:11:26.961992 28848 tablet_bootstrap.cc:492] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0: Bootstrap starting.
I20260709 13:11:26.964609 29132 consensus_queue.cc:1048] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:26.967715 28730 raft_consensus.cc:3060] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:26.970741 28945 raft_consensus.cc:493] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.971544 28945 raft_consensus.cc:515] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:26.973315 28804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ba06e13a9740d9b4ba185990852ada" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:26.982254 28853 tablet_bootstrap.cc:492] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:26.982771 28853 ts_tablet_manager.cc:1403] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.272s	user 0.011s	sys 0.004s
I20260709 13:11:26.983716 28887 raft_consensus.cc:493] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.984244 28887 raft_consensus.cc:515] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:26.986596 28887 leader_election.cc:290] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:26.987792 28696 leader_election.cc:304] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1515f1138af4333a63996f5d0864d85; no voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:26.988010 28945 leader_election.cc:290] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
W20260709 13:11:26.989423 28622 leader_election.cc:343] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:26.989774 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:43597, user_credentials={real_user=slave}} blocked reactor thread for 60920.8us
I20260709 13:11:26.992188 29108 raft_consensus.cc:515] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:26.992542 28658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed785ccac6a425f83665ef8e365bfc1" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:26.994061 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ba06e13a9740d9b4ba185990852ada" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:27.003230 29209 raft_consensus.cc:2749] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:27.025056 29108 leader_election.cc:290] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:27.022595 28658 raft_consensus.cc:2468] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
W20260709 13:11:27.031747 28622 leader_election.cc:343] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.032367 28622 leader_election.cc:304] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:27.033689 28658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b32b6e56ce549b98fca9ad5f3798f2b" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:27.034675 28549 leader_election.cc:304] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:27.034807 28658 raft_consensus.cc:3060] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.046290 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb1e7780b6c42649546108a0bd97d7a" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:27.049364 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed785ccac6a425f83665ef8e365bfc1" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:27.050542 28887 raft_consensus.cc:493] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.041987 28917 raft_consensus.cc:2804] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:27.051056 28887 raft_consensus.cc:515] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:27.051445 28917 raft_consensus.cc:493] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.051884 28917 raft_consensus.cc:3060] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.042558 28996 raft_consensus.cc:2749] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:27.054406 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a388b79acd4a278496df6d65fd7a44" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:27.055070 28656 raft_consensus.cc:2468] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
I20260709 13:11:27.056262 28772 leader_election.cc:304] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:27.057152 29108 raft_consensus.cc:2804] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:27.057544 29108 raft_consensus.cc:493] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.057866 29108 raft_consensus.cc:3060] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.058651 28887 leader_election.cc:290] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
W20260709 13:11:27.061255 28770 leader_election.cc:343] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:27.063925 28547 leader_election.cc:343] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.071587 28917 raft_consensus.cc:515] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:27.062255 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b32b6e56ce549b98fca9ad5f3798f2b" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
W20260709 13:11:27.074110 28770 leader_election.cc:343] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.074295 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed785ccac6a425f83665ef8e365bfc1" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:27.074910 28656 raft_consensus.cc:3060] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.083649 28656 raft_consensus.cc:2468] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:27.085554 28855 tablet_bootstrap.cc:492] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:27.086221 28855 ts_tablet_manager.cc:1403] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.181s	user 0.049s	sys 0.087s
I20260709 13:11:27.088806 28549 leader_election.cc:304] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:27.089085 28855 raft_consensus.cc:359] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:27.089866 28855 raft_consensus.cc:385] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.090138 28855 raft_consensus.cc:740] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.090197 29108 raft_consensus.cc:515] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:27.091715 28996 raft_consensus.cc:493] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.092248 28996 raft_consensus.cc:515] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:27.092772 29108 leader_election.cc:290] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:27.093750 28852 tablet_bootstrap.cc:492] T 12cea3a9ab394674a67119867b34ce5a P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:27.094300 28852 ts_tablet_manager.cc:1403] T 12cea3a9ab394674a67119867b34ce5a P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.247s	user 0.009s	sys 0.006s
I20260709 13:11:27.094338 28996 leader_election.cc:290] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:27.096248 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a388b79acd4a278496df6d65fd7a44" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:27.093896 29159 raft_consensus.cc:2804] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:27.096958 28654 raft_consensus.cc:3060] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.097270 29159 raft_consensus.cc:697] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:27.097868 28853 raft_consensus.cc:359] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:27.096619 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1185c8b14ea4fd88ccfccb31e19dfd8" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:27.098212 29159 consensus_queue.cc:237] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
W20260709 13:11:27.083515 28547 leader_election.cc:343] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.098682 28853 raft_consensus.cc:385] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.101136 28853 raft_consensus.cc:740] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.102237 28853 consensus_queue.cc:260] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:27.103511 28855 consensus_queue.cc:260] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:27.103740 28852 raft_consensus.cc:359] T 12cea3a9ab394674a67119867b34ce5a P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:27.104749 28852 raft_consensus.cc:385] T 12cea3a9ab394674a67119867b34ce5a P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.105123 28852 raft_consensus.cc:740] T 12cea3a9ab394674a67119867b34ce5a P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
W20260709 13:11:27.104918 28622 leader_election.cc:343] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.105669 28945 consensus_queue.cc:1048] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:11:27.176365 28581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb1e7780b6c42649546108a0bd97d7a" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:27.181443 28579 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a388b79acd4a278496df6d65fd7a44" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:27.181680 28852 consensus_queue.cc:260] T 12cea3a9ab394674a67119867b34ce5a P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:27.184120 28852 ts_tablet_manager.cc:1434] T 12cea3a9ab394674a67119867b34ce5a P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.000s
I20260709 13:11:27.175237 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1185c8b14ea4fd88ccfccb31e19dfd8" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:27.179713 28577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a388b79acd4a278496df6d65fd7a44" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:27.200335 28658 raft_consensus.cc:2468] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:27.189481 28853 ts_tablet_manager.cc:1434] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.206s	user 0.008s	sys 0.001s
W20260709 13:11:27.191859 28770 leader_election.cc:343] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.192607 29108 raft_consensus.cc:493] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:27.206280 28549 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:43021, user_credentials={real_user=slave}} blocked reactor thread for 75770.4us
I20260709 13:11:27.209533 29108 raft_consensus.cc:515] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
W20260709 13:11:27.201686 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:43597, user_credentials={real_user=slave}} blocked reactor thread for 78326.9us
I20260709 13:11:27.211668 29108 leader_election.cc:290] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:27.192824 28654 raft_consensus.cc:2468] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:27.212369 28770 leader_election.cc:304] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:27.193738 28917 leader_election.cc:290] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:27.200654 28848 tablet_bootstrap.cc:654] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.212695 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed785ccac6a425f83665ef8e365bfc1" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:27.201313 28855 ts_tablet_manager.cc:1434] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.115s	user 0.010s	sys 0.000s
I20260709 13:11:27.205811 28852 tablet_bootstrap.cc:492] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:27.216742 29108 raft_consensus.cc:2749] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:27.206127 29208 consensus_queue.cc:1048] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
W20260709 13:11:27.218780 28547 leader_election.cc:343] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:27.219970 28547 consensus_peers.cc:597] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a -> Peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Couldn't send request to peer a1515f1138af4333a63996f5d0864d85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:27.220561 28853 tablet_bootstrap.cc:492] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:27.222496 29231 consensus_queue.cc:1048] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:11:27.226217 28770 leader_election.cc:343] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.230161 28855 tablet_bootstrap.cc:492] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:27.225251 28852 tablet_bootstrap.cc:654] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:27.240895 28547 consensus_peers.cc:597] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a -> Peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Couldn't send request to peer a1515f1138af4333a63996f5d0864d85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:27.242604 28855 tablet_bootstrap.cc:654] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:27.242897 28770 leader_election.cc:343] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.250447 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e262f061cd4055b2b8c365deb5bf74" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:27.250887 28622 leader_election.cc:343] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.251410 28622 leader_election.cc:304] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d
W20260709 13:11:27.254650 28770 leader_election.cc:343] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.258832 28580 raft_consensus.cc:3060] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.260718 28729 raft_consensus.cc:3060] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.253657 28996 raft_consensus.cc:2749] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:27.280794 28476 catalog_manager.cc:5697] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:27.282943 28996 consensus_queue.cc:1048] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:11:27.290913 28848 tablet_bootstrap.cc:492] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0: No bootstrap required, opened a new log
I20260709 13:11:27.294916 28848 ts_tablet_manager.cc:1403] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent bootstrapping tablet: real 0.333s	user 0.018s	sys 0.001s
I20260709 13:11:27.293176 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e262f061cd4055b2b8c365deb5bf74" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:27.300932 28852 tablet_bootstrap.cc:492] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:27.301587 28852 ts_tablet_manager.cc:1403] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.117s	user 0.020s	sys 0.000s
I20260709 13:11:27.301153 28654 raft_consensus.cc:2468] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
I20260709 13:11:27.318950 28996 consensus_queue.cc:1048] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:27.336375 28772 leader_election.cc:304] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
W20260709 13:11:27.350896 28528 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:27.352815 28731 raft_consensus.cc:3060] T 12cea3a9ab394674a67119867b34ce5a P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.348688 29218 raft_consensus.cc:2804] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:27.357278 29218 raft_consensus.cc:697] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:27.358181 29218 consensus_queue.cc:237] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:27.369949 28853 tablet_bootstrap.cc:654] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.380663 28855 tablet_bootstrap.cc:492] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:27.386427 28855 ts_tablet_manager.cc:1403] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.156s	user 0.021s	sys 0.005s
I20260709 13:11:27.377727 28772 leader_election.cc:304] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:27.400187 29218 raft_consensus.cc:2804] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:27.400542 28772 leader_election.cc:304] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:27.403208 28887 raft_consensus.cc:2804] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:27.403575 28887 raft_consensus.cc:493] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.403888 28887 raft_consensus.cc:3060] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.405500 28852 raft_consensus.cc:359] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:27.406211 28852 raft_consensus.cc:385] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.406454 28852 raft_consensus.cc:740] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.400707 29218 raft_consensus.cc:697] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:27.418164 28848 raft_consensus.cc:359] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:27.418957 28848 raft_consensus.cc:385] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.419265 28848 raft_consensus.cc:740] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.420887 29218 consensus_queue.cc:237] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:27.422497 29108 raft_consensus.cc:493] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.423211 29108 raft_consensus.cc:515] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:27.425917 28887 raft_consensus.cc:515] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:27.420006 28848 consensus_queue.cc:260] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:27.428390 28848 ts_tablet_manager.cc:1434] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0: Time spent starting tablet: real 0.132s	user 0.002s	sys 0.003s
I20260709 13:11:27.428957 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e262f061cd4055b2b8c365deb5bf74" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
W20260709 13:11:27.430469 28770 leader_election.cc:343] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.408269 28852 consensus_queue.cc:260] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:27.431923 28887 leader_election.cc:290] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:27.432370 28852 ts_tablet_manager.cc:1434] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.130s	user 0.006s	sys 0.000s
I20260709 13:11:27.446502 28852 tablet_bootstrap.cc:492] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:27.432871 29108 leader_election.cc:290] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:27.437345 28855 raft_consensus.cc:359] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:27.451134 28855 raft_consensus.cc:385] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.451444 28855 raft_consensus.cc:740] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.452126 28855 consensus_queue.cc:260] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:27.437861 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92fb36508a8840ea8e84f00da15700a1" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:27.443653 28476 catalog_manager.cc:5697] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 0 to 1, leader changed from <none> to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 1 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:27.455195 28770 leader_election.cc:343] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.461102 28852 tablet_bootstrap.cc:654] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.466271 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92fb36508a8840ea8e84f00da15700a1" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:27.466459 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e262f061cd4055b2b8c365deb5bf74" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:27.466989 28654 raft_consensus.cc:2468] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
I20260709 13:11:27.467401 28656 raft_consensus.cc:3060] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.483511 28656 raft_consensus.cc:2468] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:27.485096 28855 ts_tablet_manager.cc:1434] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.098s	user 0.006s	sys 0.000s
I20260709 13:11:27.486162 28855 tablet_bootstrap.cc:492] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:27.488801 28852 tablet_bootstrap.cc:492] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:27.489087 28772 leader_election.cc:304] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:27.490258 29108 raft_consensus.cc:2804] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:27.490696 29108 raft_consensus.cc:493] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.491031 29108 raft_consensus.cc:3060] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.491497 28853 tablet_bootstrap.cc:492] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:27.491986 28853 ts_tablet_manager.cc:1403] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.272s	user 0.008s	sys 0.014s
I20260709 13:11:27.489333 28852 ts_tablet_manager.cc:1403] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.002s
I20260709 13:11:27.495985 28852 raft_consensus.cc:359] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:27.496666 28852 raft_consensus.cc:385] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.496929 28852 raft_consensus.cc:740] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.497329 28855 tablet_bootstrap.cc:654] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.500324 28853 raft_consensus.cc:359] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:27.501029 28853 raft_consensus.cc:385] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.501308 28853 raft_consensus.cc:740] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.502205 28852 consensus_queue.cc:260] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:27.502836 28772 leader_election.cc:304] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:27.504127 28887 raft_consensus.cc:2804] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:27.504487 28852 ts_tablet_manager.cc:1434] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.001s
I20260709 13:11:27.504563 28887 raft_consensus.cc:697] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:27.505970 28852 tablet_bootstrap.cc:492] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:27.506269 28887 consensus_queue.cc:237] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:27.504927 28853 consensus_queue.cc:260] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:27.512874 29108 raft_consensus.cc:515] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:27.514142 28853 ts_tablet_manager.cc:1434] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:11:27.514906 29108 leader_election.cc:290] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:27.515079 28853 tablet_bootstrap.cc:492] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:27.516530 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92fb36508a8840ea8e84f00da15700a1" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
W20260709 13:11:27.517954 28770 leader_election.cc:343] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.528388 28853 tablet_bootstrap.cc:654] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.530364 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92fb36508a8840ea8e84f00da15700a1" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:27.531157 28656 raft_consensus.cc:3060] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.533247 28852 tablet_bootstrap.cc:654] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.538539 28656 raft_consensus.cc:2468] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:27.543496 28853 tablet_bootstrap.cc:492] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:27.544005 28853 ts_tablet_manager.cc:1403] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.004s
I20260709 13:11:27.542634 28479 catalog_manager.cc:5697] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 0 to 1, leader changed from <none> to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 1 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:27.548712 28772 leader_election.cc:304] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:27.549820 29244 raft_consensus.cc:2804] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:27.550433 29244 raft_consensus.cc:697] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:27.551277 29244 consensus_queue.cc:237] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:27.551803 28852 tablet_bootstrap.cc:492] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:27.554092 28852 ts_tablet_manager.cc:1403] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.000s
I20260709 13:11:27.555670 28853 raft_consensus.cc:359] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:27.556365 28853 raft_consensus.cc:385] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.556617 28853 raft_consensus.cc:740] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.562704 28852 raft_consensus.cc:359] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:27.563457 28852 raft_consensus.cc:385] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.563736 28852 raft_consensus.cc:740] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.565243 28852 consensus_queue.cc:260] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:27.566520 28855 tablet_bootstrap.cc:492] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:27.567050 28855 ts_tablet_manager.cc:1403] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.008s
I20260709 13:11:27.567544 28852 ts_tablet_manager.cc:1434] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:11:27.569461 28852 tablet_bootstrap.cc:492] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:27.569661 28855 raft_consensus.cc:359] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:27.570412 28855 raft_consensus.cc:385] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.570679 28855 raft_consensus.cc:740] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.564692 28853 consensus_queue.cc:260] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:27.571564 28480 catalog_manager.cc:5697] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 0 to 1, leader changed from <none> to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 1 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:27.573367 28480 catalog_manager.cc:5697] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 0 to 1, leader changed from <none> to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 1 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:27.577796 28853 ts_tablet_manager.cc:1434] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:11:27.578753 28853 tablet_bootstrap.cc:492] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:27.579748 28855 consensus_queue.cc:260] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:27.586748 28855 ts_tablet_manager.cc:1434] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:11:27.587623 29209 raft_consensus.cc:493] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.588160 29209 raft_consensus.cc:515] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:27.590237 29209 leader_election.cc:290] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:27.590967 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b32b6e56ce549b98fca9ad5f3798f2b" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:27.591777 28855 tablet_bootstrap.cc:492] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d: Bootstrap starting.
I20260709 13:11:27.591701 28656 raft_consensus.cc:2393] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1515f1138af4333a63996f5d0864d85 in current term 1: Already voted for candidate b8d512840fb74aaf82ac80c433d8dc2d in this term.
I20260709 13:11:27.591684 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b32b6e56ce549b98fca9ad5f3798f2b" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:27.594075 28696 leader_election.cc:304] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1515f1138af4333a63996f5d0864d85; no voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:27.594851 29209 raft_consensus.cc:3060] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.596104 28852 tablet_bootstrap.cc:654] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.601725 29209 raft_consensus.cc:2749] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:27.604311 28853 tablet_bootstrap.cc:654] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.611405 28855 tablet_bootstrap.cc:654] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.616803 28855 tablet_bootstrap.cc:492] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d: No bootstrap required, opened a new log
I20260709 13:11:27.617221 28855 ts_tablet_manager.cc:1403] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.002s
I20260709 13:11:27.619447 28855 raft_consensus.cc:359] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:27.620157 28855 raft_consensus.cc:385] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.620419 28855 raft_consensus.cc:740] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.620935 28853 tablet_bootstrap.cc:492] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:27.621028 28855 consensus_queue.cc:260] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:27.621544 28853 ts_tablet_manager.cc:1403] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.004s
I20260709 13:11:27.621266 28852 tablet_bootstrap.cc:492] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:27.622246 28852 ts_tablet_manager.cc:1403] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.010s
I20260709 13:11:27.624595 28853 raft_consensus.cc:359] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:27.625350 28853 raft_consensus.cc:385] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.625666 28853 raft_consensus.cc:740] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.625988 28852 raft_consensus.cc:359] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:27.626725 28852 raft_consensus.cc:385] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.626451 28853 consensus_queue.cc:260] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:27.627022 28852 raft_consensus.cc:740] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.627784 28852 consensus_queue.cc:260] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:27.630060 28852 ts_tablet_manager.cc:1434] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:27.631136 28852 tablet_bootstrap.cc:492] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:27.632915 28855 ts_tablet_manager.cc:1434] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:11:27.638279 28852 tablet_bootstrap.cc:654] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.645284 28729 raft_consensus.cc:3060] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.647490 29217 raft_consensus.cc:493] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.647969 29217 raft_consensus.cc:515] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:27.650173 29217 leader_election.cc:290] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
W20260709 13:11:27.650532 28547 consensus_peers.cc:597] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a -> Peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Couldn't send request to peer a1515f1138af4333a63996f5d0864d85. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:27.651782 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e262f061cd4055b2b8c365deb5bf74" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:27.652690 28655 raft_consensus.cc:2393] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1515f1138af4333a63996f5d0864d85 in current term 1: Already voted for candidate b8d512840fb74aaf82ac80c433d8dc2d in this term.
I20260709 13:11:27.657272 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e262f061cd4055b2b8c365deb5bf74" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:27.659497 28696 leader_election.cc:304] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1515f1138af4333a63996f5d0864d85; no voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:27.662103 29209 raft_consensus.cc:3060] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.663054 29159 raft_consensus.cc:493] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.663618 29159 raft_consensus.cc:515] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:27.667273 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a388b79acd4a278496df6d65fd7a44" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:27.671465 29209 raft_consensus.cc:2749] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:27.675884 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a388b79acd4a278496df6d65fd7a44" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:27.676966 28656 raft_consensus.cc:2393] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44a14c00fc3d41bea8db00310408905a in current term 1: Already voted for candidate b8d512840fb74aaf82ac80c433d8dc2d in this term.
I20260709 13:11:27.674010 29159 leader_election.cc:290] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:27.678258 28549 leader_election.cc:304] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:27.679481 29231 raft_consensus.cc:3060] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.689185 29231 raft_consensus.cc:2749] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:27.689347 28852 tablet_bootstrap.cc:492] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:27.689917 28853 ts_tablet_manager.cc:1434] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 13:11:27.690009 28852 ts_tablet_manager.cc:1403] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.006s
I20260709 13:11:27.691812 29244 raft_consensus.cc:493] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.692323 29244 raft_consensus.cc:515] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:27.692817 28996 raft_consensus.cc:493] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.693361 28996 raft_consensus.cc:515] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:27.694782 29244 leader_election.cc:290] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:27.695506 28996 leader_election.cc:290] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:27.696326 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1185c8b14ea4fd88ccfccb31e19dfd8" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:27.696978 28656 raft_consensus.cc:2468] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
I20260709 13:11:27.696707 28852 raft_consensus.cc:359] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:27.697721 28852 raft_consensus.cc:385] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.698091 28852 raft_consensus.cc:740] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.698118 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b02d1b7bd040599900df6d42e82e19" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:27.699050 29112 consensus_queue.cc:1048] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:27.700143 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b02d1b7bd040599900df6d42e82e19" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:27.699133 28772 leader_election.cc:304] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:27.700187 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1185c8b14ea4fd88ccfccb31e19dfd8" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
W20260709 13:11:27.700598 28622 leader_election.cc:343] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.699203 28852 consensus_queue.cc:260] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
W20260709 13:11:27.701872 28622 leader_election.cc:343] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.702010 29244 raft_consensus.cc:2804] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:27.702312 28622 leader_election.cc:304] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:27.702422 29244 raft_consensus.cc:493] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.703047 28996 raft_consensus.cc:2749] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:27.702872 29244 raft_consensus.cc:3060] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:27.703559 28770 leader_election.cc:343] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.704555 28852 ts_tablet_manager.cc:1434] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 13:11:27.705646 28852 tablet_bootstrap.cc:492] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:27.709558 28887 raft_consensus.cc:493] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.709992 28853 tablet_bootstrap.cc:492] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:27.710049 28887 raft_consensus.cc:515] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:27.712157 28887 leader_election.cc:290] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:27.714250 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee04ccf18954bae9d40f7a5c460f71b" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:27.715077 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee04ccf18954bae9d40f7a5c460f71b" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
W20260709 13:11:27.715960 28770 leader_election.cc:343] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:27.717325 28770 leader_election.cc:343] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.716825 28852 tablet_bootstrap.cc:654] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.717934 28770 leader_election.cc:304] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:27.719072 28887 raft_consensus.cc:2749] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:27.719424 28853 tablet_bootstrap.cc:654] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.724583 29244 raft_consensus.cc:515] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:27.733742 28729 raft_consensus.cc:3060] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.744957 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1185c8b14ea4fd88ccfccb31e19dfd8" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
W20260709 13:11:27.750133 28770 leader_election.cc:343] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.750108 28852 tablet_bootstrap.cc:492] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:27.751227 28852 ts_tablet_manager.cc:1403] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.046s	user 0.019s	sys 0.004s
I20260709 13:11:27.751644 29209 raft_consensus.cc:493] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:27.752239 29209 raft_consensus.cc:515] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:27.756156 29209 leader_election.cc:290] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:27.759802 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9519acd190ba4590a2eaa1fcb1e9a60f" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:27.760509 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9519acd190ba4590a2eaa1fcb1e9a60f" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:27.762094 29244 leader_election.cc:290] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:27.762876 28852 raft_consensus.cc:359] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:27.763598 28852 raft_consensus.cc:385] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.763854 28852 raft_consensus.cc:740] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.764119 28853 tablet_bootstrap.cc:492] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:27.764571 28853 ts_tablet_manager.cc:1403] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.009s
I20260709 13:11:27.764473 28852 consensus_queue.cc:260] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:27.766904 28852 ts_tablet_manager.cc:1434] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:11:27.767278 28853 raft_consensus.cc:359] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:27.767947 28852 tablet_bootstrap.cc:492] T 92fb36508a8840ea8e84f00da15700a1 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:27.769121 28696 leader_election.cc:304] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1515f1138af4333a63996f5d0864d85; no voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:27.770772 29217 raft_consensus.cc:2749] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:27.771836 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1185c8b14ea4fd88ccfccb31e19dfd8" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:27.772403 28656 raft_consensus.cc:3060] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.773736 29112 raft_consensus.cc:493] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.774226 29112 raft_consensus.cc:515] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:27.775867 28852 tablet_bootstrap.cc:654] T 92fb36508a8840ea8e84f00da15700a1 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.767966 28853 raft_consensus.cc:385] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.776566 29112 leader_election.cc:290] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:27.777307 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb853da5b7ff48d9a188d40610160f6c" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:27.777980 28654 raft_consensus.cc:2468] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:27.779217 28549 leader_election.cc:304] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:27.776889 28853 raft_consensus.cc:740] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.780548 28853 consensus_queue.cc:260] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:27.781633 29208 raft_consensus.cc:2804] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:27.782042 29208 raft_consensus.cc:493] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.782400 29208 raft_consensus.cc:3060] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.782977 28853 ts_tablet_manager.cc:1434] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.004s
I20260709 13:11:27.784936 28853 tablet_bootstrap.cc:492] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:27.790305 29208 raft_consensus.cc:515] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:27.794236 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb853da5b7ff48d9a188d40610160f6c" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:27.795096 28655 raft_consensus.cc:3060] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.797891 28853 tablet_bootstrap.cc:654] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.798511 28852 tablet_bootstrap.cc:492] T 92fb36508a8840ea8e84f00da15700a1 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:27.799084 28852 ts_tablet_manager.cc:1403] T 92fb36508a8840ea8e84f00da15700a1 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.001s
I20260709 13:11:27.802265 28852 raft_consensus.cc:359] T 92fb36508a8840ea8e84f00da15700a1 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:27.803032 28852 raft_consensus.cc:385] T 92fb36508a8840ea8e84f00da15700a1 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.803367 28852 raft_consensus.cc:740] T 92fb36508a8840ea8e84f00da15700a1 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
W20260709 13:11:27.803649 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:41711, user_credentials={real_user=slave}} blocked reactor thread for 46769.4us
I20260709 13:11:27.804358 28852 consensus_queue.cc:260] T 92fb36508a8840ea8e84f00da15700a1 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:27.804400 29208 leader_election.cc:290] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:27.806144 28655 raft_consensus.cc:2468] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:27.807487 28549 leader_election.cc:304] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:27.808225 28852 ts_tablet_manager.cc:1434] T 92fb36508a8840ea8e84f00da15700a1 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:11:27.808957 29208 raft_consensus.cc:2804] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:27.809610 29208 raft_consensus.cc:697] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:27.811144 29208 consensus_queue.cc:237] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:27.814482 28853 tablet_bootstrap.cc:492] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:27.815027 28853 ts_tablet_manager.cc:1403] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.004s
I20260709 13:11:27.817723 28853 raft_consensus.cc:359] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:27.818379 28853 raft_consensus.cc:385] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.818648 28853 raft_consensus.cc:740] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.819679 28853 consensus_queue.cc:260] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:27.823956 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb853da5b7ff48d9a188d40610160f6c" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:27.824393 28852 tablet_bootstrap.cc:492] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:27.828728 28853 ts_tablet_manager.cc:1434] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:11:27.829799 28853 tablet_bootstrap.cc:492] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:27.831668 28852 tablet_bootstrap.cc:654] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.836544 28853 tablet_bootstrap.cc:654] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.836941 28852 tablet_bootstrap.cc:492] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:27.837481 28852 ts_tablet_manager.cc:1403] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.007s
W20260709 13:11:27.841156 28547 leader_election.cc:343] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.842686 28656 raft_consensus.cc:2468] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:27.845392 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb853da5b7ff48d9a188d40610160f6c" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:27.850068 28772 leader_election.cc:304] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:27.851790 29244 raft_consensus.cc:2804] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:27.852352 29244 raft_consensus.cc:697] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:27.853247 29244 consensus_queue.cc:237] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
W20260709 13:11:27.858542 28547 leader_election.cc:343] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.845855 28852 raft_consensus.cc:359] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:27.865411 28852 raft_consensus.cc:385] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.865746 28852 raft_consensus.cc:740] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.866549 28852 consensus_queue.cc:260] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:27.868827 28852 ts_tablet_manager.cc:1434] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 13:11:27.869895 28852 tablet_bootstrap.cc:492] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:27.873095 29108 consensus_queue.cc:1048] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:27.876866 28852 tablet_bootstrap.cc:654] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:27.876708 28477 catalog_manager.cc:5697] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:27.885191 29244 raft_consensus.cc:493] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.885771 29244 raft_consensus.cc:515] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:27.888531 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ba06e13a9740d9b4ba185990852ada" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:27.889140 28656 raft_consensus.cc:2468] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 0.
I20260709 13:11:27.893033 29108 consensus_queue.cc:1048] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:27.901855 28772 leader_election.cc:304] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:27.903297 29218 raft_consensus.cc:2804] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:27.903759 29218 raft_consensus.cc:493] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.904165 29218 raft_consensus.cc:3060] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:27.906792 28477 catalog_manager.cc:5697] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 0 to 1, leader changed from <none> to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 1 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:27.912398 28853 tablet_bootstrap.cc:492] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:27.913586 28853 ts_tablet_manager.cc:1403] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.026s
I20260709 13:11:27.919019 28853 raft_consensus.cc:359] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:27.921684 29209 raft_consensus.cc:493] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.922336 29209 raft_consensus.cc:515] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:27.926739 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed785ccac6a425f83665ef8e365bfc1" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:27.928395 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed785ccac6a425f83665ef8e365bfc1" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:27.931805 28698 leader_election.cc:304] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1515f1138af4333a63996f5d0864d85; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:27.933059 29156 raft_consensus.cc:2749] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:27.936998 29116 consensus_queue.cc:1048] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:27.938004 29209 leader_election.cc:290] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:27.943197 28887 consensus_queue.cc:1048] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:11:27.945344 28772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:43021, user_credentials={real_user=slave}} blocked reactor thread for 43588.6us
I20260709 13:11:27.946978 28887 consensus_queue.cc:1048] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:27.920711 28852 tablet_bootstrap.cc:492] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:27.953845 28852 ts_tablet_manager.cc:1403] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.084s	user 0.016s	sys 0.017s
I20260709 13:11:27.956431 29218 raft_consensus.cc:515] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:27.957056 28852 raft_consensus.cc:359] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:27.957816 28852 raft_consensus.cc:385] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.958060 28852 raft_consensus.cc:740] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.958670 28852 consensus_queue.cc:260] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:27.921808 28853 raft_consensus.cc:385] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:27.959576 28853 raft_consensus.cc:740] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:27.960239 28853 consensus_queue.cc:260] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:27.960830 29244 leader_election.cc:290] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:27.964285 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ba06e13a9740d9b4ba185990852ada" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:27.966257 28853 ts_tablet_manager.cc:1434] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:11:27.967236 28853 tablet_bootstrap.cc:492] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:27.967509 29116 consensus_queue.cc:1048] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:27.970528 28852 ts_tablet_manager.cc:1434] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:11:27.971519 28852 tablet_bootstrap.cc:492] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
W20260709 13:11:27.966113 28770 leader_election.cc:343] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:27.976847 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ba06e13a9740d9b4ba185990852ada" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:27.978196 29231 raft_consensus.cc:493] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.993705 29112 raft_consensus.cc:493] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.977419 28852 tablet_bootstrap.cc:654] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.009995 29112 raft_consensus.cc:515] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:28.012163 29112 leader_election.cc:290] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:27.995895 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ba06e13a9740d9b4ba185990852ada" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:28.015075 28656 raft_consensus.cc:3060] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.015228 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bc5681208146d19bff2322d4c254dd" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:28.015851 28730 raft_consensus.cc:2468] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:28.017391 28547 leader_election.cc:304] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85; no voters: 
I20260709 13:11:28.019441 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bc5681208146d19bff2322d4c254dd" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
W20260709 13:11:27.979040 28770 leader_election.cc:343] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.006997 28853 tablet_bootstrap.cc:654] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.020095 28805 raft_consensus.cc:2468] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:28.025138 28656 raft_consensus.cc:2468] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:28.035836 28772 leader_election.cc:304] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:28.037828 29116 raft_consensus.cc:2804] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:27.979141 29218 leader_election.cc:290] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:28.038389 29116 raft_consensus.cc:697] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:28.039393 29116 consensus_queue.cc:237] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:28.040314 28730 raft_consensus.cc:3060] T 92fb36508a8840ea8e84f00da15700a1 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.009078 29231 raft_consensus.cc:515] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:28.048556 29231 leader_election.cc:290] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:28.051004 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b02d1b7bd040599900df6d42e82e19" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:28.029790 29112 raft_consensus.cc:2804] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:28.054061 29112 raft_consensus.cc:493] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.054473 29112 raft_consensus.cc:3060] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:28.066869 28547 leader_election.cc:343] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.074882 29209 raft_consensus.cc:493] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.075825 29209 raft_consensus.cc:515] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
W20260709 13:11:28.080963 29273 log.cc:927] Time spent T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:11:28.083426 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb1e7780b6c42649546108a0bd97d7a" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:28.084213 28805 raft_consensus.cc:2468] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 0.
I20260709 13:11:28.090131 28696 leader_election.cc:304] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:28.093909 29217 raft_consensus.cc:2804] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:28.094372 29217 raft_consensus.cc:493] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.094745 29217 raft_consensus.cc:3060] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.086373 29112 raft_consensus.cc:515] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:28.098831 29210 raft_consensus.cc:493] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.094708 28852 tablet_bootstrap.cc:492] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:28.099788 28852 ts_tablet_manager.cc:1403] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.128s	user 0.029s	sys 0.048s
I20260709 13:11:28.099432 29210 raft_consensus.cc:515] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:28.102577 29210 leader_election.cc:290] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:28.103946 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bc5681208146d19bff2322d4c254dd" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:28.104290 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb853da5b7ff48d9a188d40610160f6c" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:28.104692 28731 raft_consensus.cc:3060] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.105139 28654 raft_consensus.cc:2393] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1515f1138af4333a63996f5d0864d85 in current term 1: Already voted for candidate 44a14c00fc3d41bea8db00310408905a in this term.
I20260709 13:11:28.102492 28852 raft_consensus.cc:359] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:28.106734 28852 raft_consensus.cc:385] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.107017 28852 raft_consensus.cc:740] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.107620 28852 consensus_queue.cc:260] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:28.109014 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb853da5b7ff48d9a188d40610160f6c" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:28.109809 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bc5681208146d19bff2322d4c254dd" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:28.110421 28805 raft_consensus.cc:3060] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.112711 28852 ts_tablet_manager.cc:1434] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:11:28.113710 28852 tablet_bootstrap.cc:492] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:28.126027 28852 tablet_bootstrap.cc:654] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.126405 29218 consensus_queue.cc:1048] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:28.133157 28853 tablet_bootstrap.cc:492] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a: No bootstrap required, opened a new log
I20260709 13:11:28.133762 28853 ts_tablet_manager.cc:1403] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.167s	user 0.013s	sys 0.013s
I20260709 13:11:28.134995 29218 consensus_queue.cc:1048] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:28.145248 28805 raft_consensus.cc:2468] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:28.145648 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b02d1b7bd040599900df6d42e82e19" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:28.150430 29159 raft_consensus.cc:493] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.136556 28853 raft_consensus.cc:359] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:28.147459 28731 raft_consensus.cc:2468] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:28.151420 28853 raft_consensus.cc:385] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.151930 28853 raft_consensus.cc:740] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.150498 28656 raft_consensus.cc:2468] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 0.
I20260709 13:11:28.137961 29209 leader_election.cc:290] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:28.136277 28696 leader_election.cc:304] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1515f1138af4333a63996f5d0864d85; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:28.151150 29159 raft_consensus.cc:515] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:28.150825 28547 leader_election.cc:304] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:28.152658 28853 consensus_queue.cc:260] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:28.153532 29209 raft_consensus.cc:3060] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.154090 29208 raft_consensus.cc:2804] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:28.154717 28853 ts_tablet_manager.cc:1434] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:11:28.154862 29208 raft_consensus.cc:697] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:28.155436 28549 leader_election.cc:304] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:28.155927 29208 consensus_queue.cc:237] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:28.157631 29113 raft_consensus.cc:2804] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:28.158106 29113 raft_consensus.cc:493] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.158492 29113 raft_consensus.cc:3060] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.159380 29217 raft_consensus.cc:515] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:28.161974 29159 leader_election.cc:290] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:28.098917 29112 leader_election.cc:290] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
W20260709 13:11:28.165900 28696 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:44075, user_credentials={real_user=slave}} blocked reactor thread for 49002.2us
I20260709 13:11:28.168975 29209 raft_consensus.cc:2749] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:28.179075 29209 raft_consensus.cc:493] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.180413 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb1e7780b6c42649546108a0bd97d7a" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:28.181967 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb1e7780b6c42649546108a0bd97d7a" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:28.182837 28583 raft_consensus.cc:3060] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.182189 29209 raft_consensus.cc:515] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:28.182010 28805 raft_consensus.cc:3060] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.188719 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ba06e13a9740d9b4ba185990852ada" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:28.191154 28655 raft_consensus.cc:2393] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1515f1138af4333a63996f5d0864d85 in current term 1: Already voted for candidate b8d512840fb74aaf82ac80c433d8dc2d in this term.
I20260709 13:11:28.192065 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ba06e13a9740d9b4ba185990852ada" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:28.192806 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1185c8b14ea4fd88ccfccb31e19dfd8" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:28.195333 28696 leader_election.cc:304] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1515f1138af4333a63996f5d0864d85; no voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:28.196956 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1185c8b14ea4fd88ccfccb31e19dfd8" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:28.197626 29210 raft_consensus.cc:3060] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.199932 29209 leader_election.cc:290] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:28.202419 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb1e7780b6c42649546108a0bd97d7a" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:28.179721 29217 leader_election.cc:290] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:28.203850 28656 raft_consensus.cc:2393] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44a14c00fc3d41bea8db00310408905a in current term 1: Already voted for candidate b8d512840fb74aaf82ac80c433d8dc2d in this term.
I20260709 13:11:28.208325 29113 raft_consensus.cc:515] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:28.210829 29113 leader_election.cc:290] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:28.214509 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b02d1b7bd040599900df6d42e82e19" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:28.215229 28656 raft_consensus.cc:3060] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.219317 28852 tablet_bootstrap.cc:492] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:28.220065 28852 ts_tablet_manager.cc:1403] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.107s	user 0.035s	sys 0.046s
I20260709 13:11:28.219753 28477 catalog_manager.cc:5697] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 0 to 1, leader changed from <none> to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 1 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:28.223831 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b02d1b7bd040599900df6d42e82e19" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:28.219321 28583 raft_consensus.cc:2468] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:28.224594 28852 raft_consensus.cc:359] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:28.225606 28852 raft_consensus.cc:385] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.225639 28696 leader_election.cc:304] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85; no voters: 
I20260709 13:11:28.226066 28852 raft_consensus.cc:740] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.227222 28852 consensus_queue.cc:260] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:28.228574 29156 raft_consensus.cc:2804] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:28.229562 28852 ts_tablet_manager.cc:1434] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:11:28.230880 28852 tablet_bootstrap.cc:492] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85: Bootstrap starting.
I20260709 13:11:28.234094 28805 raft_consensus.cc:2468] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:28.235627 29156 raft_consensus.cc:697] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:28.236678 29156 consensus_queue.cc:237] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:28.238250 28852 tablet_bootstrap.cc:654] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:28.205250 29210 raft_consensus.cc:2749] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:28.255862 28547 leader_election.cc:304] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:28.250216 28729 raft_consensus.cc:3060] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.265681 29112 raft_consensus.cc:3060] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.278434 29112 raft_consensus.cc:2749] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:28.295934 28656 raft_consensus.cc:2468] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 1.
I20260709 13:11:28.297255 28852 tablet_bootstrap.cc:492] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85: No bootstrap required, opened a new log
I20260709 13:11:28.297137 29231 consensus_queue.cc:1048] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:11:28.299953 28547 leader_election.cc:343] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:28.300812 28852 ts_tablet_manager.cc:1403] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85: Time spent bootstrapping tablet: real 0.070s	user 0.025s	sys 0.038s
I20260709 13:11:28.305701 28852 raft_consensus.cc:359] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:28.306900 28852 raft_consensus.cc:385] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:28.307317 28852 raft_consensus.cc:740] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Initialized, Role: FOLLOWER
I20260709 13:11:28.308437 28852 consensus_queue.cc:260] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:28.316644 28852 ts_tablet_manager.cc:1434] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.004s
I20260709 13:11:28.322762 28549 leader_election.cc:304] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: a1515f1138af4333a63996f5d0864d85
I20260709 13:11:28.325544 28477 catalog_manager.cc:5697] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:28.325497 29159 raft_consensus.cc:2804] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:28.332700 29159 raft_consensus.cc:697] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:28.334329 29159 consensus_queue.cc:237] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
W20260709 13:11:28.357173 28547 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.4:43597, user_credentials={real_user=slave}} blocked reactor thread for 43869.1us
I20260709 13:11:28.359776 28479 catalog_manager.cc:5697] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 1 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:28.382279 29116 consensus_queue.cc:1048] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:28.421375 29289 consensus_queue.cc:1048] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:28.430548 29156 raft_consensus.cc:493] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.431100 29156 raft_consensus.cc:515] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:28.434020 28802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee04ccf18954bae9d40f7a5c460f71b" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:28.434695 28802 raft_consensus.cc:2468] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 0.
I20260709 13:11:28.434939 29156 leader_election.cc:290] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:28.436000 28696 leader_election.cc:304] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:28.435983 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee04ccf18954bae9d40f7a5c460f71b" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:28.437193 28583 raft_consensus.cc:2468] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 0.
I20260709 13:11:28.437198 29156 raft_consensus.cc:2804] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:28.438705 29156 raft_consensus.cc:493] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.439085 29156 raft_consensus.cc:3060] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.502542 29156 raft_consensus.cc:515] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:28.507862 29156 leader_election.cc:290] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:28.511096 28583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee04ccf18954bae9d40f7a5c460f71b" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:28.511878 28583 raft_consensus.cc:3060] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.513797 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee04ccf18954bae9d40f7a5c460f71b" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:28.514416 28806 raft_consensus.cc:3060] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.480437 28479 catalog_manager.cc:5697] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 0 to 1, leader changed from <none> to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 1 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:28.533237 28583 raft_consensus.cc:2468] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:28.540056 28696 leader_election.cc:304] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85; no voters: 
I20260709 13:11:28.540059 28806 raft_consensus.cc:2468] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:28.541064 29244 consensus_queue.cc:1048] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:28.543242 29156 raft_consensus.cc:2804] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:28.544046 29156 raft_consensus.cc:697] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:28.544984 29156 consensus_queue.cc:237] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:28.556926 29244 consensus_queue.cc:1048] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:28.600797 28479 catalog_manager.cc:5697] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 1 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:28.608518 29108 consensus_queue.cc:1048] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:28.627113 29156 consensus_queue.cc:1048] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:28.649900 29289 consensus_queue.cc:1048] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:28.659013 29282 consensus_queue.cc:1048] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:28.678826 29113 consensus_queue.cc:1048] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:28.734658 29209 raft_consensus.cc:493] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.735226 29209 raft_consensus.cc:515] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:28.737066 29209 leader_election.cc:290] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:28.738101 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b02d1b7bd040599900df6d42e82e19" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:28.738067 28580 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b02d1b7bd040599900df6d42e82e19" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:28.739055 28656 raft_consensus.cc:2393] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1515f1138af4333a63996f5d0864d85 in current term 1: Already voted for candidate 44a14c00fc3d41bea8db00310408905a in this term.
I20260709 13:11:28.740206 28698 leader_election.cc:304] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1515f1138af4333a63996f5d0864d85; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:28.740900 29209 raft_consensus.cc:3060] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:28.747202 29209 raft_consensus.cc:2749] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:28.761015 29231 consensus_queue.cc:1048] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:28.775040 29231 consensus_queue.cc:1048] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:29.030244 29282 consensus_queue.cc:1048] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:29.044600 29156 consensus_queue.cc:1048] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:29.974041 20640 tablet_server.cc:179] TabletServer@127.20.40.1:0 shutting down...
W20260709 13:11:29.991571 28770 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:11:29.996243 28770 consensus_peers.cc:597] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:30.006052 28696 consensus_peers.cc:597] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:30.022532 28696 consensus_peers.cc:597] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:30.041287 28622 consensus_peers.cc:597] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.051453 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:30.052441 20640 tablet_replica.cc:333] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.053812 20640 raft_consensus.cc:2243] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.058207 20640 raft_consensus.cc:2272] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.060858 20640 tablet_replica.cc:333] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.061416 20640 raft_consensus.cc:2243] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.062426 20640 raft_consensus.cc:2272] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.065171 20640 tablet_replica.cc:333] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.066372 20640 raft_consensus.cc:2243] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.067922 20640 raft_consensus.cc:2272] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.070803 20640 tablet_replica.cc:333] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.071480 20640 raft_consensus.cc:2243] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.072474 20640 raft_consensus.cc:2272] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.074852 20640 tablet_replica.cc:333] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.075536 20640 raft_consensus.cc:2243] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.076427 20640 raft_consensus.cc:2272] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.078799 20640 tablet_replica.cc:333] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.079469 20640 raft_consensus.cc:2243] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.079908 20640 raft_consensus.cc:2272] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.082144 20640 tablet_replica.cc:333] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.082652 20640 raft_consensus.cc:2243] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.083078 20640 raft_consensus.cc:2272] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.085588 20640 tablet_replica.cc:333] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.086613 20640 raft_consensus.cc:2243] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.087837 20640 raft_consensus.cc:2272] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.090487 20640 tablet_replica.cc:333] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.091174 20640 raft_consensus.cc:2243] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.092214 20640 raft_consensus.cc:2272] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.096007 20640 tablet_replica.cc:333] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.096704 20640 raft_consensus.cc:2243] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.097472 20640 raft_consensus.cc:2272] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:30.099292 28770 consensus_peers.cc:597] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.101202 20640 tablet_replica.cc:333] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.102275 20640 raft_consensus.cc:2243] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.103466 20640 raft_consensus.cc:2272] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:30.104840 28770 consensus_peers.cc:597] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.106972 20640 tablet_replica.cc:333] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.107973 20640 raft_consensus.cc:2243] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.108608 20640 raft_consensus.cc:2272] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.110905 20640 tablet_replica.cc:333] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.111434 20640 raft_consensus.cc:2243] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.112263 20640 raft_consensus.cc:2272] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.114349 20640 tablet_replica.cc:333] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.114921 20640 raft_consensus.cc:2243] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.115358 20640 raft_consensus.cc:2272] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.117901 20640 tablet_replica.cc:333] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.118479 20640 raft_consensus.cc:2243] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.119001 20640 raft_consensus.cc:2272] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.121912 20640 tablet_replica.cc:333] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.122771 20640 raft_consensus.cc:2243] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.123919 20640 raft_consensus.cc:2272] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.127220 20640 tablet_replica.cc:333] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.128010 20640 raft_consensus.cc:2243] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.128679 20640 raft_consensus.cc:2272] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.132543 20640 tablet_replica.cc:333] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.133634 20640 raft_consensus.cc:2243] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.134948 20640 raft_consensus.cc:2272] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.137904 20640 tablet_replica.cc:333] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.138864 20640 raft_consensus.cc:2243] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.139983 20640 raft_consensus.cc:2272] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.143766 20640 tablet_replica.cc:333] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.144505 20640 raft_consensus.cc:2243] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.145097 20640 raft_consensus.cc:2272] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.148435 20640 tablet_replica.cc:333] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.149268 20640 raft_consensus.cc:2243] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:30.149701 28770 consensus_peers.cc:597] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.149904 20640 raft_consensus.cc:2272] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.153152 20640 tablet_replica.cc:333] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
W20260709 13:11:30.153641 28770 consensus_peers.cc:597] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.153826 20640 raft_consensus.cc:2243] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.154466 20640 raft_consensus.cc:2272] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.156661 20640 tablet_replica.cc:333] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.157217 20640 raft_consensus.cc:2243] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.158157 20640 raft_consensus.cc:2272] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.161127 20640 tablet_replica.cc:333] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.161798 20640 raft_consensus.cc:2243] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.162292 20640 raft_consensus.cc:2272] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.164544 20640 tablet_replica.cc:333] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.165359 20640 raft_consensus.cc:2243] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.166033 20640 raft_consensus.cc:2272] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.168322 20640 tablet_replica.cc:333] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.168984 20640 raft_consensus.cc:2243] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.170354 20640 raft_consensus.cc:2272] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.173499 20640 tablet_replica.cc:333] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.174216 20640 raft_consensus.cc:2243] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.174947 20640 raft_consensus.cc:2272] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.177863 20640 tablet_replica.cc:333] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.178606 20640 raft_consensus.cc:2243] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.179207 20640 raft_consensus.cc:2272] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.182004 20640 tablet_replica.cc:333] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.182770 20640 raft_consensus.cc:2243] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.183807 20640 raft_consensus.cc:2272] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.187005 20640 tablet_replica.cc:333] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.187830 20640 raft_consensus.cc:2243] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.188756 20640 raft_consensus.cc:2272] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.191896 20640 tablet_replica.cc:333] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.192765 20640 raft_consensus.cc:2243] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:11:30.193648 28622 consensus_peers.cc:597] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.193925 20640 raft_consensus.cc:2272] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.196519 20640 tablet_replica.cc:333] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.197067 20640 raft_consensus.cc:2243] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.197909 20640 raft_consensus.cc:2272] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.200191 20640 tablet_replica.cc:333] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.200732 20640 raft_consensus.cc:2243] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.201186 20640 raft_consensus.cc:2272] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.203428 20640 tablet_replica.cc:333] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.204031 20640 raft_consensus.cc:2243] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.204638 20640 raft_consensus.cc:2272] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.207110 20640 tablet_replica.cc:333] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.208225 20640 raft_consensus.cc:2243] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.209458 20640 raft_consensus.cc:2272] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:30.212456 28770 consensus_peers.cc:597] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.213017 20640 tablet_replica.cc:333] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.213904 20640 raft_consensus.cc:2243] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.214819 20640 raft_consensus.cc:2272] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.218101 20640 tablet_replica.cc:333] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.218926 20640 raft_consensus.cc:2243] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.219539 20640 raft_consensus.cc:2272] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:30.221761 28622 consensus_peers.cc:597] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.222533 20640 tablet_replica.cc:333] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.223249 20640 raft_consensus.cc:2243] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.223855 20640 raft_consensus.cc:2272] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.226475 20640 tablet_replica.cc:333] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.227108 20640 raft_consensus.cc:2243] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.227632 20640 raft_consensus.cc:2272] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.230158 20640 tablet_replica.cc:333] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.230787 20640 raft_consensus.cc:2243] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.231779 20640 raft_consensus.cc:2272] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.234349 20640 tablet_replica.cc:333] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.235059 20640 raft_consensus.cc:2243] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.235599 20640 raft_consensus.cc:2272] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.238709 20640 tablet_replica.cc:333] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.239414 20640 raft_consensus.cc:2243] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:30.240171 28622 consensus_peers.cc:597] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.240171 20640 raft_consensus.cc:2272] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.243083 20640 tablet_replica.cc:333] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.243646 20640 raft_consensus.cc:2243] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.244628 20640 raft_consensus.cc:2272] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.247320 20640 tablet_replica.cc:333] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.247946 20640 raft_consensus.cc:2243] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:30.248570 20640 raft_consensus.cc:2272] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:30.251368 20640 tablet_replica.cc:333] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a: stopping tablet replica
I20260709 13:11:30.252049 20640 raft_consensus.cc:2243] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:30.253082 20640 raft_consensus.cc:2272] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:30.327870 28622 consensus_peers.cc:597] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:30.328346 28622 consensus_peers.cc:597] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.335121 20640 tablet_server.cc:196] TabletServer@127.20.40.1:0 shutdown complete.
W20260709 13:11:30.343816 28622 consensus_peers.cc:597] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:30.358597 28696 consensus_peers.cc:597] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:30.377393 28770 consensus_peers.cc:597] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:30.378160 28770 consensus_peers.cc:597] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:30.394728 28622 consensus_peers.cc:597] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:30.414904 28696 consensus_peers.cc:597] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.446168 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:30.456662 29316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:30.461969 29317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:30.487038 29319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:30.490461 20640 server_base.cc:1061] running on GCE node
I20260709 13:11:30.496729 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:30.497103 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:30.497390 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602690497366 us; error 0 us; skew 500 ppm
I20260709 13:11:30.498361 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:11:30.501655 28770 consensus_peers.cc:597] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.502753 20640 webserver.cc:533] Webserver started at http://127.20.40.1:43083/ using document root <none> and password file <none>
I20260709 13:11:30.503495 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:30.503769 20640 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:11:30.508361 20640 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.001s	sys 0.004s
I20260709 13:11:30.518143 29324 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:30.519157 20640 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 13:11:30.519516 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-0-root
uuid: "44a14c00fc3d41bea8db00310408905a"
format_stamp: "Formatted at 2026-07-09 13:11:18 on dist-test-slave-rnv4"
I20260709 13:11:30.520076 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602420111825-20640-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:11:30.528424 28696 consensus_peers.cc:597] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.544773 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:30.546362 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:30.548645 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:30.553288 29331 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:11:30.578392 28770 consensus_peers.cc:597] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:30.812577 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:11:30.812969 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.261s	user 0.008s	sys 0.001s
I20260709 13:11:30.813324 20640 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:11:30.819620 29331 tablet_bootstrap.cc:492] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:30.852315 29331 tablet_bootstrap.cc:492] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:30.853277 29331 tablet_bootstrap.cc:492] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:30.853952 29331 ts_tablet_manager.cc:1403] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.035s	user 0.025s	sys 0.008s
I20260709 13:11:30.856806 29331 raft_consensus.cc:359] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:30.857744 29331 raft_consensus.cc:740] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.858629 29331 consensus_queue.cc:260] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:30.867837 29331 ts_tablet_manager.cc:1434] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:11:30.868654 29331 tablet_bootstrap.cc:492] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:30.889853 29331 tablet_bootstrap.cc:492] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:30.890815 29331 tablet_bootstrap.cc:492] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:30.891451 29331 ts_tablet_manager.cc:1403] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:11:30.893815 29331 raft_consensus.cc:359] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:30.894625 29331 raft_consensus.cc:740] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.895619 29331 consensus_queue.cc:260] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:30.897845 29331 ts_tablet_manager.cc:1434] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:11:30.898640 29331 tablet_bootstrap.cc:492] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:30.921298 29331 tablet_bootstrap.cc:492] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:30.922539 29331 tablet_bootstrap.cc:492] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:30.923207 29331 ts_tablet_manager.cc:1403] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 13:11:30.925714 29331 raft_consensus.cc:359] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:30.944012 29331 raft_consensus.cc:740] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.944867 29331 consensus_queue.cc:260] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:30.946943 29331 ts_tablet_manager.cc:1434] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.008s
I20260709 13:11:30.947716 29331 tablet_bootstrap.cc:492] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:30.969537 29331 tablet_bootstrap.cc:492] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:30.970502 29331 tablet_bootstrap.cc:492] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:30.971114 29331 ts_tablet_manager.cc:1403] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.016s
I20260709 13:11:30.973779 29331 raft_consensus.cc:359] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:30.974583 29331 raft_consensus.cc:740] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:30.975426 29331 consensus_queue.cc:260] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:30.977348 29331 ts_tablet_manager.cc:1434] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:11:30.978305 29331 tablet_bootstrap.cc:492] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:31.007344 29331 tablet_bootstrap.cc:492] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:31.008323 29331 tablet_bootstrap.cc:492] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:31.008950 29331 ts_tablet_manager.cc:1403] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.031s	user 0.027s	sys 0.000s
I20260709 13:11:31.011315 29331 raft_consensus.cc:359] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.011976 29331 raft_consensus.cc:740] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.012809 29331 consensus_queue.cc:260] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.015204 29331 ts_tablet_manager.cc:1434] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:11:31.016064 29331 tablet_bootstrap.cc:492] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:31.032294 29331 tablet_bootstrap.cc:492] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:31.033290 29331 tablet_bootstrap.cc:492] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:31.033987 29331 ts_tablet_manager.cc:1403] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 13:11:31.036610 29331 raft_consensus.cc:359] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.037333 29331 raft_consensus.cc:740] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.038044 29331 consensus_queue.cc:260] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.040136 29331 ts_tablet_manager.cc:1434] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:11:31.040959 29331 tablet_bootstrap.cc:492] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:31.058997 29331 tablet_bootstrap.cc:492] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:31.060009 29331 tablet_bootstrap.cc:492] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:31.060698 29331 ts_tablet_manager.cc:1403] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 13:11:31.063284 29331 raft_consensus.cc:359] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.064004 29331 raft_consensus.cc:740] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.064677 29331 consensus_queue.cc:260] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.066772 29331 ts_tablet_manager.cc:1434] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:11:31.067588 29331 tablet_bootstrap.cc:492] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:31.083289 29331 tablet_bootstrap.cc:492] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:31.084312 29331 tablet_bootstrap.cc:492] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:31.084990 29331 ts_tablet_manager.cc:1403] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:11:31.087622 29331 raft_consensus.cc:359] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.088449 29331 raft_consensus.cc:740] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.089195 29331 consensus_queue.cc:260] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.091454 29331 ts_tablet_manager.cc:1434] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:11:31.092338 29331 tablet_bootstrap.cc:492] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:31.110352 29331 tablet_bootstrap.cc:492] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:31.111099 29331 tablet_bootstrap.cc:492] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:31.111732 29331 ts_tablet_manager.cc:1403] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:11:31.113879 29331 raft_consensus.cc:359] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.114413 29331 raft_consensus.cc:740] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.115091 29331 consensus_queue.cc:260] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.116698 29331 ts_tablet_manager.cc:1434] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:11:31.117311 29331 tablet_bootstrap.cc:492] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:31.136014 29331 tablet_bootstrap.cc:492] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:31.136762 29331 tablet_bootstrap.cc:492] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:31.137276 29331 ts_tablet_manager.cc:1403] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.008s
I20260709 13:11:31.139153 29331 raft_consensus.cc:359] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.139675 29331 raft_consensus.cc:740] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.140193 29331 consensus_queue.cc:260] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.141637 29331 ts_tablet_manager.cc:1434] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:11:31.142249 29331 tablet_bootstrap.cc:492] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:31.153065 29331 tablet_bootstrap.cc:492] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:31.153927 29331 tablet_bootstrap.cc:492] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:31.154448 29331 ts_tablet_manager.cc:1403] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.012s	user 0.007s	sys 0.004s
I20260709 13:11:31.156349 29331 raft_consensus.cc:359] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.156950 29331 raft_consensus.cc:740] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.157629 29331 consensus_queue.cc:260] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.160027 29331 ts_tablet_manager.cc:1434] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:11:31.160688 29331 tablet_bootstrap.cc:492] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:31.167076 29131 raft_consensus.cc:493] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.167687 29131 raft_consensus.cc:515] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.169804 29131 leader_election.cc:290] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:31.172703 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed785ccac6a425f83665ef8e365bfc1" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:31.174628 29331 tablet_bootstrap.cc:492] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:31.175616 29331 tablet_bootstrap.cc:492] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
W20260709 13:11:31.175633 28622 leader_election.cc:336] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.175876 20640 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:11:31.176244 29331 ts_tablet_manager.cc:1403] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:11:31.176295 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.363s	user 0.276s	sys 0.006s
I20260709 13:11:31.176262 28622 leader_election.cc:304] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:31.177491 29131 raft_consensus.cc:2749] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:31.179081 29331 raft_consensus.cc:359] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.179814 29331 raft_consensus.cc:740] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.180562 29331 consensus_queue.cc:260] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.182682 29331 ts_tablet_manager.cc:1434] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:11:31.183483 29331 tablet_bootstrap.cc:492] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:31.188472 29314 raft_consensus.cc:493] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.189335 29314 raft_consensus.cc:515] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.191365 29333 raft_consensus.cc:493] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.191896 29314 leader_election.cc:290] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.191992 29333 raft_consensus.cc:515] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.194417 29333 leader_election.cc:290] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:31.196055 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7ab1eff7a5409cb84e6bb33393456e" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:31.201395 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b02d1b7bd040599900df6d42e82e19" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:31.202907 28770 leader_election.cc:336] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.203500 28770 leader_election.cc:304] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:31.205196 28887 raft_consensus.cc:2749] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:31.214288 29331 tablet_bootstrap.cc:492] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:31.215678 29331 tablet_bootstrap.cc:492] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:31.216540 29331 ts_tablet_manager.cc:1403] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.008s
I20260709 13:11:31.220090 29331 raft_consensus.cc:359] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.221026 29331 raft_consensus.cc:740] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.222134 29331 consensus_queue.cc:260] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
W20260709 13:11:31.224680 28622 leader_election.cc:336] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.225255 29331 ts_tablet_manager.cc:1434] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:11:31.225178 28622 leader_election.cc:304] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:31.226123 29333 raft_consensus.cc:2749] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:31.226413 29331 tablet_bootstrap.cc:492] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:31.257068 29331 tablet_bootstrap.cc:492] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:31.258263 29331 tablet_bootstrap.cc:492] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:31.258886 29331 ts_tablet_manager.cc:1403] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.004s
I20260709 13:11:31.261651 29331 raft_consensus.cc:359] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.262336 29331 raft_consensus.cc:740] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.263027 29331 consensus_queue.cc:260] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.265082 29331 ts_tablet_manager.cc:1434] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:11:31.265862 29331 tablet_bootstrap.cc:492] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:31.265883 28887 raft_consensus.cc:493] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.266487 28887 raft_consensus.cc:515] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.268393 28887 leader_election.cc:290] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.270188 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d51007007a4252908beaaaa3ee8374" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:31.273988 29314 raft_consensus.cc:493] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.274523 29314 raft_consensus.cc:515] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.276628 29314 leader_election.cc:290] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.277752 29131 raft_consensus.cc:493] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.278415 29131 raft_consensus.cc:515] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.285655 29307 raft_consensus.cc:493] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.285660 29341 raft_consensus.cc:493] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.287530 29341 raft_consensus.cc:515] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.288185 29307 raft_consensus.cc:515] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.293767 29333 raft_consensus.cc:493] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.294667 29333 raft_consensus.cc:515] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.297214 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e29bffebb804a5bbb9935518c059b2a" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:31.303936 28770 leader_election.cc:336] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.306097 29307 leader_election.cc:290] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:31.312152 29341 leader_election.cc:290] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.314193 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47110731ce12413ab60b16f034fdceb3" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
W20260709 13:11:31.321573 28622 leader_election.cc:336] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.322396 28622 leader_election.cc:304] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:31.323654 29307 raft_consensus.cc:2749] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:31.326201 28770 leader_election.cc:336] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.281186 29131 leader_election.cc:290] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:31.328821 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f828b4ae5c2846c5a49f1212f73186f0" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:31.331583 29333 leader_election.cc:290] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.332741 29339 raft_consensus.cc:493] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
W20260709 13:11:31.333142 28622 leader_election.cc:336] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.334020 28772 leader_election.cc:304] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:31.348038 29108 raft_consensus.cc:2749] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:31.351341 28887 raft_consensus.cc:493] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
W20260709 13:11:31.351529 28622 leader_election.cc:336] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.352072 28887 raft_consensus.cc:515] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.335759 29315 raft_consensus.cc:493] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.356529 29315 raft_consensus.cc:515] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.357374 28887 leader_election.cc:290] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.359898 29315 leader_election.cc:290] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.360812 29315 raft_consensus.cc:493] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.361637 29315 raft_consensus.cc:515] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.343320 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb853da5b7ff48d9a188d40610160f6c" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:31.333489 29339 raft_consensus.cc:515] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.334486 29156 raft_consensus.cc:493] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.369896 29156 raft_consensus.cc:515] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.372653 29156 leader_election.cc:290] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.340767 29375 raft_consensus.cc:493] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.373643 29375 raft_consensus.cc:515] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.376885 29375 leader_election.cc:290] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.341770 28770 leader_election.cc:304] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:31.378041 28887 raft_consensus.cc:2749] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:31.339762 29331 tablet_bootstrap.cc:492] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:31.382681 29331 tablet_bootstrap.cc:492] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:31.383651 29331 ts_tablet_manager.cc:1403] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.118s	user 0.026s	sys 0.044s
I20260709 13:11:31.386528 29307 raft_consensus.cc:493] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.387040 29131 raft_consensus.cc:493] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.387382 29307 raft_consensus.cc:515] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.387720 29131 raft_consensus.cc:515] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.389863 29131 leader_election.cc:290] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:31.391263 29339 leader_election.cc:290] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.393222 29307 leader_election.cc:290] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:31.396314 29331 raft_consensus.cc:359] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.399076 29108 raft_consensus.cc:493] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.336306 29341 raft_consensus.cc:493] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.400947 29341 raft_consensus.cc:515] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.404188 29341 leader_election.cc:290] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.404814 29314 raft_consensus.cc:493] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.399832 29108 raft_consensus.cc:515] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.404986 29341 raft_consensus.cc:493] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.405411 29314 raft_consensus.cc:515] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.408669 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c146089a3249eea0254717e75c14c8" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:31.409341 28729 raft_consensus.cc:2468] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:31.409461 29314 leader_election.cc:290] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.406854 29108 leader_election.cc:290] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.411911 29315 leader_election.cc:290] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.415716 28770 leader_election.cc:304] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
W20260709 13:11:31.416988 28696 leader_election.cc:336] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.417457 29108 raft_consensus.cc:2804] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.418195 29108 raft_consensus.cc:493] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.417817 28696 leader_election.cc:304] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1515f1138af4333a63996f5d0864d85; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:31.418715 29108 raft_consensus.cc:3060] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.399773 29331 raft_consensus.cc:740] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.421850 29331 consensus_queue.cc:260] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.425397 29331 ts_tablet_manager.cc:1434] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.001s
I20260709 13:11:31.426563 29331 tablet_bootstrap.cc:492] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
W20260709 13:11:31.434155 28770 leader_election.cc:336] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.435971 29315 raft_consensus.cc:2749] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:31.436762 28770 leader_election.cc:336] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
W20260709 13:11:31.440593 28622 leader_election.cc:336] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.408226 29341 raft_consensus.cc:515] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.443014 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d51007007a4252908beaaaa3ee8374" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:31.443729 28805 raft_consensus.cc:2468] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 1.
W20260709 13:11:31.444329 28770 leader_election.cc:336] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.447485 29341 leader_election.cc:290] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.449456 29108 raft_consensus.cc:515] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.452430 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c146089a3249eea0254717e75c14c8" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:31.453307 28806 raft_consensus.cc:2393] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a1515f1138af4333a63996f5d0864d85 in current term 2: Already voted for candidate b8d512840fb74aaf82ac80c433d8dc2d in this term.
I20260709 13:11:31.454200 29314 raft_consensus.cc:493] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.454659 29377 raft_consensus.cc:493] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.454898 29314 raft_consensus.cc:515] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.455551 29377 raft_consensus.cc:515] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.464023 29315 raft_consensus.cc:493] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.466113 29339 raft_consensus.cc:493] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.466689 29339 raft_consensus.cc:515] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.464951 29315 raft_consensus.cc:515] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.467736 29108 leader_election.cc:290] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.468667 29339 leader_election.cc:290] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
W20260709 13:11:31.441422 28622 leader_election.cc:336] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.471479 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff91a748d3f464ab00fc3e657057d73" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:31.472460 28730 raft_consensus.cc:2468] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 1.
I20260709 13:11:31.474484 29314 leader_election.cc:290] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.475241 28887 raft_consensus.cc:493] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.475783 28887 raft_consensus.cc:515] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.477017 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217202c939974f80b0c84019f3acfcaf" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:31.477909 28887 leader_election.cc:290] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.474414 29315 leader_election.cc:290] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.479358 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bc5681208146d19bff2322d4c254dd" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:31.479991 29307 raft_consensus.cc:493] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.480121 28805 raft_consensus.cc:2468] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:31.477962 28730 raft_consensus.cc:2468] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 1.
I20260709 13:11:31.480705 29307 raft_consensus.cc:515] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.483713 29307 leader_election.cc:290] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:31.484979 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c146089a3249eea0254717e75c14c8" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:31.485646 28730 raft_consensus.cc:3060] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.487349 29378 raft_consensus.cc:493] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.488216 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b02d1b7bd040599900df6d42e82e19" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:31.487946 29378 raft_consensus.cc:515] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.488858 28656 raft_consensus.cc:2468] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:31.490599 29378 leader_election.cc:290] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.494218 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217202c939974f80b0c84019f3acfcaf" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:31.494911 28656 raft_consensus.cc:2468] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:31.496311 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bc5681208146d19bff2322d4c254dd" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:31.496598 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e29bffebb804a5bbb9935518c059b2a" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:31.496901 28729 raft_consensus.cc:2468] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:31.497155 28656 raft_consensus.cc:2468] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:31.498865 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34233c4c336b444996374b970ddd2822" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:31.500545 29307 raft_consensus.cc:493] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.501397 29307 raft_consensus.cc:515] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.502142 28658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff91a748d3f464ab00fc3e657057d73" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:31.502808 28658 raft_consensus.cc:2468] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:31.500749 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed785ccac6a425f83665ef8e365bfc1" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:31.504181 28656 raft_consensus.cc:2468] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:31.504298 29307 leader_election.cc:290] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.512538 28698 leader_election.cc:304] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:31.513170 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f041b85d184414b3939425b35e4a1c" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:31.505638 28622 leader_election.cc:304] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:31.517496 29315 raft_consensus.cc:2804] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.517908 29315 raft_consensus.cc:493] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.518249 29333 raft_consensus.cc:2804] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.518787 29333 raft_consensus.cc:493] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.519232 29333 raft_consensus.cc:3060] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.505931 29341 raft_consensus.cc:493] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.520825 29341 raft_consensus.cc:515] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.521855 28698 leader_election.cc:304] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:31.522630 29339 raft_consensus.cc:2804] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.522995 29339 raft_consensus.cc:493] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.523358 29339 raft_consensus.cc:3060] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.524145 29341 leader_election.cc:290] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.507091 29307 raft_consensus.cc:493] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.518276 29315 raft_consensus.cc:3060] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.527282 28887 raft_consensus.cc:493] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.527902 28887 raft_consensus.cc:515] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.525230 29307 raft_consensus.cc:515] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.529913 28887 leader_election.cc:290] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.505534 29378 raft_consensus.cc:493] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.533772 29378 raft_consensus.cc:515] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.534653 29315 raft_consensus.cc:515] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.536257 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f828b4ae5c2846c5a49f1212f73186f0" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:31.536629 29315 leader_election.cc:290] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.537055 28805 raft_consensus.cc:2468] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:31.539139 29307 leader_election.cc:290] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.541785 29339 raft_consensus.cc:515] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.543455 28698 leader_election.cc:304] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:31.511729 29377 leader_election.cc:290] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.544528 28698 leader_election.cc:304] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:31.545284 28698 leader_election.cc:304] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:31.546209 29334 raft_consensus.cc:493] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.547029 29339 leader_election.cc:290] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.546824 29334 raft_consensus.cc:515] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.547662 29341 raft_consensus.cc:2804] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.548064 29341 raft_consensus.cc:493] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.548415 29341 raft_consensus.cc:3060] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.548702 29339 raft_consensus.cc:2804] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.549106 29339 raft_consensus.cc:493] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.549103 29334 leader_election.cc:290] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:31.550166 29334 raft_consensus.cc:493] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.550527 29380 raft_consensus.cc:2804] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.536474 29378 leader_election.cc:290] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.552261 28622 leader_election.cc:304] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:31.552884 28730 raft_consensus.cc:2468] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 2.
I20260709 13:11:31.541126 28696 leader_election.cc:304] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:31.550966 29334 raft_consensus.cc:515] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.553480 29307 raft_consensus.cc:2749] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:31.532982 29333 raft_consensus.cc:515] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.556169 29378 raft_consensus.cc:2804] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.555045 29334 leader_election.cc:290] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:31.550956 29380 raft_consensus.cc:493] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.556707 29378 raft_consensus.cc:493] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.557356 29380 raft_consensus.cc:3060] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.557452 29378 raft_consensus.cc:3060] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.549540 29339 raft_consensus.cc:3060] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.561826 28658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d12b4ce21794192969d6609d0ea4d69" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:31.562613 28658 raft_consensus.cc:2468] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:31.555430 28622 leader_election.cc:304] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:31.559980 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9519acd190ba4590a2eaa1fcb1e9a60f" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:31.563421 28729 raft_consensus.cc:2468] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:31.558277 28696 leader_election.cc:304] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:31.565378 29334 raft_consensus.cc:2804] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.565629 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e876ee31f15e4349b3086338a4d5f288" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:31.565877 29334 raft_consensus.cc:493] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.566752 29334 raft_consensus.cc:3060] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.568166 29375 raft_consensus.cc:2804] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.568620 29375 raft_consensus.cc:493] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.569034 29375 raft_consensus.cc:3060] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.569556 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19240a871550411aafbc885984ade97d" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:31.576848 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf9ce9ce3ac4f848ae7f5b584711f3e" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:31.574647 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b02d1b7bd040599900df6d42e82e19" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:31.579283 28657 raft_consensus.cc:2468] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:31.579613 28656 raft_consensus.cc:3060] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.579281 28698 leader_election.cc:304] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:31.573711 29315 raft_consensus.cc:493] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.571717 28770 leader_election.cc:304] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:31.582451 29156 raft_consensus.cc:2804] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.582912 29156 raft_consensus.cc:493] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.583089 29377 raft_consensus.cc:2804] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.583457 29156 raft_consensus.cc:3060] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.575464 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217202c939974f80b0c84019f3acfcaf" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:31.583647 29377 raft_consensus.cc:493] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.584245 28655 raft_consensus.cc:3060] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.584326 29377 raft_consensus.cc:3060] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.583559 29315 raft_consensus.cc:515] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.588394 29315 leader_election.cc:290] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.589186 29339 raft_consensus.cc:515] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.603689 29339 leader_election.cc:290] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.594552 29108 raft_consensus.cc:493] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.596021 29376 raft_consensus.cc:493] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.604036 29341 raft_consensus.cc:515] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.604498 29108 raft_consensus.cc:515] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.604619 29376 raft_consensus.cc:515] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.606180 29378 raft_consensus.cc:515] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.570344 29333 leader_election.cc:290] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.598105 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9519acd190ba4590a2eaa1fcb1e9a60f" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:31.607197 29108 leader_election.cc:290] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.607278 28805 raft_consensus.cc:2468] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:31.608774 29375 raft_consensus.cc:515] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.609282 28655 raft_consensus.cc:2468] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:31.610458 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7ab1eff7a5409cb84e6bb33393456e" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
W20260709 13:11:31.611137 28696 leader_election.cc:336] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.601311 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb853da5b7ff48d9a188d40610160f6c" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:31.611364 28805 raft_consensus.cc:2468] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:31.597043 28770 leader_election.cc:304] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:31.606739 29376 leader_election.cc:290] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.598944 29156 raft_consensus.cc:515] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.612058 28657 raft_consensus.cc:2468] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:31.613086 28656 raft_consensus.cc:2468] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:31.613297 29108 raft_consensus.cc:2804] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:31.613792 29108 raft_consensus.cc:697] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:31.616989 28698 leader_election.cc:304] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:31.617535 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ed785ccac6a425f83665ef8e365bfc1" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:31.624645 28657 raft_consensus.cc:3060] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.624765 29376 raft_consensus.cc:2804] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:31.625381 29376 raft_consensus.cc:697] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:31.626544 28772 leader_election.cc:304] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:31.618187 29108 consensus_queue.cc:237] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.627596 28698 leader_election.cc:304] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:31.628633 28887 raft_consensus.cc:2749] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:31.628783 29339 raft_consensus.cc:2804] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:31.628903 28698 leader_election.cc:304] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:31.629669 29339 raft_consensus.cc:697] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:31.620015 28770 leader_election.cc:304] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
W20260709 13:11:31.612285 28696 leader_election.cc:336] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.638466 28887 raft_consensus.cc:2804] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.611217 29375 leader_election.cc:290] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.621181 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40bb461a5034123ab09d156bd22ebbf" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:31.638929 28887 raft_consensus.cc:493] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.639355 28805 raft_consensus.cc:2468] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 1.
I20260709 13:11:31.639485 28622 leader_election.cc:304] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:31.639375 28887 raft_consensus.cc:3060] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.640533 29385 raft_consensus.cc:2764] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:11:31.639585 29333 raft_consensus.cc:493] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.642380 29385 raft_consensus.cc:493] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
W20260709 13:11:31.642573 28622 leader_election.cc:336] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.642976 29385 raft_consensus.cc:515] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.645609 29385 leader_election.cc:290] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.641561 29333 raft_consensus.cc:515] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.647424 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40bb461a5034123ab09d156bd22ebbf" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:31.626444 29376 consensus_queue.cc:237] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.619310 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e29bffebb804a5bbb9935518c059b2a" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:31.648185 28654 raft_consensus.cc:2468] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:31.648568 28656 raft_consensus.cc:3060] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.647771 28622 leader_election.cc:304] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
W20260709 13:11:31.652194 28622 leader_election.cc:336] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.652683 29385 raft_consensus.cc:2804] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:31.652920 28622 leader_election.cc:336] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.618978 29377 raft_consensus.cc:515] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
W20260709 13:11:31.653582 28622 leader_election.cc:336] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.630590 29315 raft_consensus.cc:2804] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.631712 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d12b4ce21794192969d6609d0ea4d69" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:31.654294 29315 raft_consensus.cc:493] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.654480 28655 raft_consensus.cc:3060] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.654784 29315 raft_consensus.cc:3060] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.655306 29377 leader_election.cc:290] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.606563 29341 leader_election.cc:290] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.631883 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07d8385470b4fc285eb6703e6fa42b9" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:31.633634 28802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d51007007a4252908beaaaa3ee8374" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:31.657047 28802 raft_consensus.cc:3060] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.623944 29334 raft_consensus.cc:515] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.660401 29334 leader_election.cc:290] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:31.638000 29339 consensus_queue.cc:237] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.662199 29333 leader_election.cc:290] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:31.621543 29156 leader_election.cc:290] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.663205 29315 raft_consensus.cc:515] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
W20260709 13:11:31.643106 28770 leader_election.cc:336] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
W20260709 13:11:31.664577 28770 leader_election.cc:336] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
W20260709 13:11:31.665284 28770 leader_election.cc:336] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.665730 28770 leader_election.cc:304] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:31.654476 28772 leader_election.cc:304] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:31.666612 29377 raft_consensus.cc:2749] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:31.666792 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb853da5b7ff48d9a188d40610160f6c" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
W20260709 13:11:31.638943 28696 leader_election.cc:336] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.667451 28654 raft_consensus.cc:3060] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:31.668241 28696 leader_election.cc:336] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.667256 28477 catalog_manager.cc:5697] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 1 to 2, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 2 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:31.668697 28696 leader_election.cc:304] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1515f1138af4333a63996f5d0864d85; no voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:31.669281 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e876ee31f15e4349b3086338a4d5f288" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
W20260709 13:11:31.669729 28696 leader_election.cc:336] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.669998 28806 raft_consensus.cc:2468] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 1.
I20260709 13:11:31.670254 28696 leader_election.cc:304] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1515f1138af4333a63996f5d0864d85; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:31.653175 29385 raft_consensus.cc:493] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.635949 29378 leader_election.cc:290] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.671756 29375 raft_consensus.cc:2749] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:31.672216 29378 raft_consensus.cc:2749] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:31.672969 29385 raft_consensus.cc:3060] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.667320 29377 raft_consensus.cc:2804] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.675770 28654 raft_consensus.cc:2468] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:31.676117 29377 raft_consensus.cc:493] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.676600 29377 raft_consensus.cc:3060] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.676242 28887 raft_consensus.cc:515] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.677135 28698 leader_election.cc:304] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:31.678102 29378 raft_consensus.cc:2804] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:31.678645 29378 raft_consensus.cc:697] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:31.678855 28657 raft_consensus.cc:2468] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:31.679657 29378 consensus_queue.cc:237] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.680205 28698 leader_election.cc:304] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:31.681346 29375 raft_consensus.cc:2804] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:31.621758 29380 raft_consensus.cc:515] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.681955 29375 raft_consensus.cc:697] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:31.682721 29315 leader_election.cc:290] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.682946 29375 consensus_queue.cc:237] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.620709 29331 tablet_bootstrap.cc:492] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:31.684916 29331 tablet_bootstrap.cc:492] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:31.685103 28887 leader_election.cc:290] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.685766 29331 ts_tablet_manager.cc:1403] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.260s	user 0.020s	sys 0.006s
I20260709 13:11:31.688558 28655 raft_consensus.cc:2468] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:31.688745 29380 leader_election.cc:290] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.687849 28802 raft_consensus.cc:2468] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 2.
W20260709 13:11:31.689503 28622 leader_election.cc:336] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.690799 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff91a748d3f464ab00fc3e657057d73" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
W20260709 13:11:31.691098 28622 leader_election.cc:336] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.691761 28657 raft_consensus.cc:2393] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a1515f1138af4333a63996f5d0864d85 in current term 2: Already voted for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in this term.
I20260709 13:11:31.691468 28698 leader_election.cc:304] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:31.692600 29380 raft_consensus.cc:2804] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:31.693186 29380 raft_consensus.cc:697] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:31.694304 29380 consensus_queue.cc:237] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
W20260709 13:11:31.696162 28696 leader_election.cc:336] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.696866 28772 leader_election.cc:304] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
W20260709 13:11:31.697240 28696 leader_election.cc:336] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.689131 29331 raft_consensus.cc:359] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.698992 29331 raft_consensus.cc:740] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.697705 28887 raft_consensus.cc:2804] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.700069 28887 raft_consensus.cc:493] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.699885 29331 consensus_queue.cc:260] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.700706 28887 raft_consensus.cc:3060] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:31.701315 28622 leader_election.cc:336] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.703249 29331 ts_tablet_manager.cc:1434] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:11:31.704282 29331 tablet_bootstrap.cc:492] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:31.706705 29315 raft_consensus.cc:493] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.706990 28622 leader_election.cc:304] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:31.707260 29315 raft_consensus.cc:515] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.707720 29334 raft_consensus.cc:2749] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:31.708773 28622 leader_election.cc:304] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:31.709499 29334 raft_consensus.cc:2804] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.709896 29334 raft_consensus.cc:493] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.710258 29334 raft_consensus.cc:3060] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.710873 29315 leader_election.cc:290] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
W20260709 13:11:31.710806 28770 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:44075, user_credentials={real_user=slave}} blocked reactor thread for 45535.7us
I20260709 13:11:31.713569 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ee7ea2ffe41cf9ed43a455e52901f" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:31.715154 28657 raft_consensus.cc:2468] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:31.716786 28698 leader_election.cc:304] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:31.717708 29315 raft_consensus.cc:2804] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:31.714331 29390 log.cc:927] Time spent T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:11:31.663708 28656 raft_consensus.cc:2468] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:31.718161 29315 raft_consensus.cc:493] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.722122 29315 raft_consensus.cc:3060] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.722533 29334 raft_consensus.cc:515] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.720098 28698 leader_election.cc:304] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:31.725725 29156 raft_consensus.cc:2804] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:31.726344 29156 raft_consensus.cc:697] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:31.724992 28622 leader_election.cc:304] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:31.735908 29333 raft_consensus.cc:2804] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:31.736572 29333 raft_consensus.cc:697] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 LEADER]: Becoming Leader. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
I20260709 13:11:31.737874 29333 consensus_queue.cc:237] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.745501 28887 raft_consensus.cc:515] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.748057 28887 leader_election.cc:290] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
W20260709 13:11:31.748292 28622 leader_election.cc:336] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
W20260709 13:11:31.753134 28622 leader_election.cc:336] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.751895 29156 consensus_queue.cc:237] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.765328 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40bb461a5034123ab09d156bd22ebbf" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:31.776029 29381 raft_consensus.cc:493] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.776648 29381 raft_consensus.cc:515] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.779559 29381 leader_election.cc:290] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.783528 29334 leader_election.cc:290] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
W20260709 13:11:31.785621 28770 leader_election.cc:336] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.787345 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bc5681208146d19bff2322d4c254dd" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
W20260709 13:11:31.787564 28770 leader_election.cc:336] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.790690 29385 raft_consensus.cc:515] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.788156 28730 raft_consensus.cc:2393] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b8d512840fb74aaf82ac80c433d8dc2d in current term 2: Already voted for candidate a1515f1138af4333a63996f5d0864d85 in this term.
I20260709 13:11:31.791596 28770 leader_election.cc:304] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:31.718757 29377 raft_consensus.cc:515] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.792296 29314 raft_consensus.cc:2749] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:31.792393 28656 raft_consensus.cc:2393] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b8d512840fb74aaf82ac80c433d8dc2d in current term 2: Already voted for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in this term.
I20260709 13:11:31.793059 29385 leader_election.cc:290] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.793851 29377 leader_election.cc:290] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:31.789678 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9519acd190ba4590a2eaa1fcb1e9a60f" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:31.817090 28729 raft_consensus.cc:3060] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:31.831333 28772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:43021, user_credentials={real_user=slave}} blocked reactor thread for 76999.9us
I20260709 13:11:31.852277 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07d8385470b4fc285eb6703e6fa42b9" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:31.857482 28731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47110731ce12413ab60b16f034fdceb3" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:31.858327 28622 leader_election.cc:336] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
W20260709 13:11:31.866539 28622 leader_election.cc:336] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.866196 28731 raft_consensus.cc:2468] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 1.
I20260709 13:11:31.869103 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d12b4ce21794192969d6609d0ea4d69" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:31.869647 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf9ce9ce3ac4f848ae7f5b584711f3e" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:31.870350 28652 raft_consensus.cc:3060] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.852516 28802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e876ee31f15e4349b3086338a4d5f288" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:31.871076 28802 raft_consensus.cc:3060] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.874105 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40bb461a5034123ab09d156bd22ebbf" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:31.873983 29315 raft_consensus.cc:515] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.874991 28806 raft_consensus.cc:2393] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bfd745f89b014f7b85fbf7d909fe2fb0 in current term 2: Already voted for candidate b8d512840fb74aaf82ac80c433d8dc2d in this term.
I20260709 13:11:31.874827 28655 raft_consensus.cc:2468] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 1.
I20260709 13:11:31.876382 29315 leader_election.cc:290] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.879549 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ee7ea2ffe41cf9ed43a455e52901f" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:31.881608 28655 raft_consensus.cc:3060] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:31.884865 28770 leader_election.cc:336] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.887225 28770 leader_election.cc:304] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:31.887727 28729 raft_consensus.cc:2468] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 2.
W20260709 13:11:31.888316 28770 leader_election.cc:336] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.880741 28652 raft_consensus.cc:2468] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 2.
W20260709 13:11:31.889467 28770 leader_election.cc:336] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.886006 28479 catalog_manager.cc:5697] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 reported cstate change: term changed from 1 to 2, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:31.890914 28770 leader_election.cc:304] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:31.892925 29401 raft_consensus.cc:2749] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:31.893074 29403 raft_consensus.cc:2749] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:31.893087 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff91a748d3f464ab00fc3e657057d73" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
W20260709 13:11:31.897722 28770 leader_election.cc:336] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.898310 28729 raft_consensus.cc:2393] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bfd745f89b014f7b85fbf7d909fe2fb0 in current term 2: Already voted for candidate a1515f1138af4333a63996f5d0864d85 in this term.
I20260709 13:11:31.901620 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "857ee7ea2ffe41cf9ed43a455e52901f" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:31.902143 28655 raft_consensus.cc:2468] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:31.902518 28729 raft_consensus.cc:2393] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bfd745f89b014f7b85fbf7d909fe2fb0 in current term 2: Already voted for candidate a1515f1138af4333a63996f5d0864d85 in this term.
I20260709 13:11:31.903524 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34233c4c336b444996374b970ddd2822" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:31.904222 28730 raft_consensus.cc:2468] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 1.
I20260709 13:11:31.904392 28698 leader_election.cc:304] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:31.905366 29399 raft_consensus.cc:2804] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:31.906735 29399 raft_consensus.cc:697] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:31.907629 29399 consensus_queue.cc:237] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.909751 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19240a871550411aafbc885984ade97d" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:31.910081 28622 leader_election.cc:304] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:31.910405 28805 raft_consensus.cc:2468] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:31.911052 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f828b4ae5c2846c5a49f1212f73186f0" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:31.911626 28806 raft_consensus.cc:3060] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.911772 29333 raft_consensus.cc:2749] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:11:31.915711 28770 leader_election.cc:336] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
W20260709 13:11:31.916364 28770 leader_election.cc:336] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.920156 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bc5681208146d19bff2322d4c254dd" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:31.920948 28805 raft_consensus.cc:2393] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a1515f1138af4333a63996f5d0864d85 in current term 2: Already voted for candidate b8d512840fb74aaf82ac80c433d8dc2d in this term.
I20260709 13:11:31.920938 28478 catalog_manager.cc:5697] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 1 to 2, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 2 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:31.917515 28770 leader_election.cc:304] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:31.924150 28478 catalog_manager.cc:5697] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 1 to 2, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 2 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:31.925096 29403 raft_consensus.cc:2804] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:31.925611 29403 raft_consensus.cc:697] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [term 2 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:31.926496 29403 consensus_queue.cc:237] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.925817 28806 raft_consensus.cc:2468] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:31.930207 29331 tablet_bootstrap.cc:492] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:11:31.931538 28696 leader_election.cc:336] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.931949 28802 raft_consensus.cc:2468] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 2.
I20260709 13:11:31.934504 28772 leader_election.cc:304] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:31.937891 29331 tablet_bootstrap.cc:492] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:31.939188 29331 ts_tablet_manager.cc:1403] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.235s	user 0.014s	sys 0.010s
I20260709 13:11:31.942499 28772 leader_election.cc:304] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:31.943586 28887 raft_consensus.cc:2804] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:31.944223 28887 raft_consensus.cc:697] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 2 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:31.945253 28887 consensus_queue.cc:237] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.942373 29377 raft_consensus.cc:2804] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.948807 29377 raft_consensus.cc:493] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.949206 29377 raft_consensus.cc:3060] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:31.943262 28696 leader_election.cc:336] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.951416 28622 leader_election.cc:304] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
W20260709 13:11:31.954604 28696 leader_election.cc:336] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
W20260709 13:11:31.959801 28696 leader_election.cc:336] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:31.963546 29333 raft_consensus.cc:2804] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:31.964135 29333 raft_consensus.cc:697] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 LEADER]: Becoming Leader. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
I20260709 13:11:31.965046 29333 consensus_queue.cc:237] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.967581 28622 leader_election.cc:304] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:31.969592 28622 leader_election.cc:304] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:31.972244 29385 raft_consensus.cc:2804] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.972921 29385 raft_consensus.cc:493] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.973415 29385 raft_consensus.cc:3060] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.976068 28622 leader_election.cc:304] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:31.977568 29131 raft_consensus.cc:2749] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:31.977041 29334 raft_consensus.cc:2749] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:31.980340 28622 leader_election.cc:304] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:31.981194 28622 leader_election.cc:304] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:31.981772 29315 raft_consensus.cc:493] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.982399 29307 raft_consensus.cc:2804] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.982601 29315 raft_consensus.cc:515] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:31.983049 29307 raft_consensus.cc:493] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.983644 29307 raft_consensus.cc:3060] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.984884 29315 leader_election.cc:290] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:31.984738 28696 leader_election.cc:304] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:31.987356 28696 leader_election.cc:304] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:31.986034 29334 raft_consensus.cc:2749] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:31.991408 29315 raft_consensus.cc:2764] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:11:31.992511 29377 raft_consensus.cc:515] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:31.994123 29315 raft_consensus.cc:2804] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:31.994544 29315 raft_consensus.cc:493] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:31.993556 29331 raft_consensus.cc:359] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:31.994966 29315 raft_consensus.cc:3060] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:31.996414 29331 raft_consensus.cc:740] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:31.997370 29331 consensus_queue.cc:260] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:32.000239 29331 ts_tablet_manager.cc:1434] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.061s	user 0.003s	sys 0.003s
I20260709 13:11:32.002636 29331 tablet_bootstrap.cc:492] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
W20260709 13:11:32.004944 28770 leader_election.cc:336] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:32.007355 29307 raft_consensus.cc:515] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:32.008584 29315 raft_consensus.cc:515] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:32.012048 28696 leader_election.cc:304] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:32.016887 28696 leader_election.cc:304] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:32.022116 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b07d8385470b4fc285eb6703e6fa42b9" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
W20260709 13:11:32.023975 28622 leader_election.cc:336] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:32.024448 28656 raft_consensus.cc:3060] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.026284 29380 raft_consensus.cc:2804] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.011814 29315 leader_election.cc:290] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:32.033390 28656 raft_consensus.cc:2468] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 2.
I20260709 13:11:32.026458 29307 leader_election.cc:290] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:32.037788 28772 leader_election.cc:304] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:32.029726 29380 raft_consensus.cc:697] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:32.038717 28887 raft_consensus.cc:2804] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.039144 28887 raft_consensus.cc:697] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:32.038991 29380 consensus_queue.cc:237] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:32.040030 28887 consensus_queue.cc:237] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:32.012673 29377 leader_election.cc:290] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 2 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:32.016413 29341 raft_consensus.cc:2804] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:32.042626 29341 raft_consensus.cc:493] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:32.043041 29341 raft_consensus.cc:3060] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.054391 29341 raft_consensus.cc:515] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:32.042366 29385 raft_consensus.cc:515] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:32.057686 29385 leader_election.cc:290] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
W20260709 13:11:32.060860 28696 leader_election.cc:336] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
W20260709 13:11:32.061774 28696 leader_election.cc:336] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
W20260709 13:11:32.062530 28696 leader_election.cc:336] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
W20260709 13:11:32.063247 28696 leader_election.cc:336] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
W20260709 13:11:32.063977 28696 leader_election.cc:336] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
W20260709 13:11:32.064770 28696 leader_election.cc:336] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
W20260709 13:11:32.065706 28696 leader_election.cc:336] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:32.063439 28477 catalog_manager.cc:5697] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 1 to 2, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 2 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:32.066756 28696 leader_election.cc:336] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
W20260709 13:11:32.068022 28696 leader_election.cc:336] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:32.067895 28478 catalog_manager.cc:5697] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 reported cstate change: term changed from 1 to 2, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:32.069006 28696 leader_election.cc:336] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:32.070178 29341 leader_election.cc:290] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
W20260709 13:11:32.077353 28622 leader_election.cc:336] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:32.069416 28696 leader_election.cc:304] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1515f1138af4333a63996f5d0864d85; no voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:32.079083 29315 raft_consensus.cc:2749] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:11:32.080329 28696 leader_election.cc:336] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:32.084934 29331 tablet_bootstrap.cc:492] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:32.086194 29331 tablet_bootstrap.cc:492] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:32.071872 28477 catalog_manager.cc:5697] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 1 to 2, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 2 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.086890 29331 ts_tablet_manager.cc:1403] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.085s	user 0.014s	sys 0.009s
I20260709 13:11:32.090255 29331 raft_consensus.cc:359] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:32.091017 29331 raft_consensus.cc:740] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
W20260709 13:11:32.087356 28696 leader_election.cc:336] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:32.093462 28696 leader_election.cc:304] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1515f1138af4333a63996f5d0864d85; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:32.094383 29315 raft_consensus.cc:2749] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:11:32.095003 28655 raft_consensus.cc:1275] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:32.095278 28696 leader_election.cc:336] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:32.096925 29380 consensus_queue.cc:1048] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.103061 29331 consensus_queue.cc:260] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:32.105417 29331 ts_tablet_manager.cc:1434] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 13:11:32.106515 29331 tablet_bootstrap.cc:492] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:32.107780 28804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7ab1eff7a5409cb84e6bb33393456e" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:32.108652 28804 raft_consensus.cc:3060] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.104887 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f041b85d184414b3939425b35e4a1c" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:32.109921 28806 raft_consensus.cc:2468] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 1.
I20260709 13:11:32.112437 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34233c4c336b444996374b970ddd2822" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:32.112933 28730 raft_consensus.cc:3060] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.128572 28477 catalog_manager.cc:5697] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 1 to 2, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 2 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.132362 29336 raft_consensus.cc:493] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.133234 29336 raft_consensus.cc:515] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:32.134245 28730 raft_consensus.cc:2468] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 2.
I20260709 13:11:32.136058 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47110731ce12413ab60b16f034fdceb3" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:32.136626 28729 raft_consensus.cc:3060] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:32.136759 28696 leader_election.cc:336] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:32.146260 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19240a871550411aafbc885984ade97d" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:32.180601 28805 raft_consensus.cc:3060] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.150453 28656 raft_consensus.cc:1275] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.186959 29341 consensus_queue.cc:1048] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.171777 28622 leader_election.cc:304] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:32.172468 28655 raft_consensus.cc:1275] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.194288 29333 raft_consensus.cc:2804] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.195063 29333 raft_consensus.cc:697] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 LEADER]: Becoming Leader. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
I20260709 13:11:32.195670 29341 consensus_queue.cc:1048] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:11:32.161144 28770 consensus_peers.cc:597] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:32.196327 29333 consensus_queue.cc:237] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:32.154186 29336 leader_election.cc:290] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:32.174523 28696 leader_election.cc:304] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:32.210914 29399 raft_consensus.cc:2804] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:32.211340 29399 raft_consensus.cc:493] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:32.211714 29399 raft_consensus.cc:3060] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:32.212278 28696 leader_election.cc:336] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
W20260709 13:11:32.213132 28696 leader_election.cc:336] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
W20260709 13:11:32.215255 28696 leader_election.cc:336] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
W20260709 13:11:32.215723 28696 consensus_peers.cc:597] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:32.145784 28729 raft_consensus.cc:2468] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 2.
I20260709 13:11:32.220399 29399 raft_consensus.cc:515] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:32.222705 29399 leader_election.cc:290] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:32.228485 28806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1f041b85d184414b3939425b35e4a1c" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:32.229393 28806 raft_consensus.cc:3060] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.232246 28478 catalog_manager.cc:5697] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 reported cstate change: term changed from 1 to 2, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 2 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } }
I20260709 13:11:32.233189 28622 leader_election.cc:304] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:32.236539 29385 raft_consensus.cc:2804] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.237128 29385 raft_consensus.cc:697] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 LEADER]: Becoming Leader. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
I20260709 13:11:32.238176 29385 consensus_queue.cc:237] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:32.248459 28805 raft_consensus.cc:2468] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:32.255424 28806 raft_consensus.cc:2468] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:32.257699 28804 raft_consensus.cc:2468] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:32.261615 28696 leader_election.cc:304] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:32.262763 28696 leader_election.cc:304] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:32.262977 29399 raft_consensus.cc:2804] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.263664 28696 leader_election.cc:304] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:32.263830 29341 raft_consensus.cc:2804] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.264477 29341 raft_consensus.cc:697] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:32.264602 29378 raft_consensus.cc:2804] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:32.265491 29341 consensus_queue.cc:237] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:32.265177 29378 raft_consensus.cc:697] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:32.263659 29399 raft_consensus.cc:697] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:32.270210 29399 consensus_queue.cc:237] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
W20260709 13:11:32.271770 28696 consensus_peers.cc:597] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:32.272315 28696 leader_election.cc:336] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111)
I20260709 13:11:32.269034 29378 consensus_queue.cc:237] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:32.279501 28655 raft_consensus.cc:1275] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.279182 28479 catalog_manager.cc:5697] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 1 to 2, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 2 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.281255 29380 consensus_queue.cc:1048] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:32.280928 28479 catalog_manager.cc:5697] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 1 to 2, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 2 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.282788 28479 catalog_manager.cc:5697] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 1 to 2, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 2 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.284621 28479 catalog_manager.cc:5697] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 1 to 2, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 2 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:32.286075 28696 consensus_peers.cc:597] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:32.292148 28730 raft_consensus.cc:1275] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Refusing update from remote peer b8d512840fb74aaf82ac80c433d8dc2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:32.287608 28696 consensus_peers.cc:597] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:32.287184 28479 catalog_manager.cc:5697] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 1 to 2, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 2 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.302893 28655 raft_consensus.cc:1275] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.305033 29378 consensus_queue.cc:1048] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:32.305938 28655 raft_consensus.cc:1275] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.307479 29378 consensus_queue.cc:1048] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.312739 29336 raft_consensus.cc:493] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.313392 29336 raft_consensus.cc:515] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
W20260709 13:11:32.316329 28696 consensus_peers.cc:597] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:32.317750 29336 leader_election.cc:290] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
W20260709 13:11:32.325331 28696 consensus_peers.cc:597] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:32.340711 28656 raft_consensus.cc:1275] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.342172 29341 consensus_queue.cc:1048] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.344878 28887 consensus_queue.cc:1048] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.346963 29336 raft_consensus.cc:493] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.347594 29336 raft_consensus.cc:515] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:32.349500 29331 tablet_bootstrap.cc:492] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:32.350565 29331 tablet_bootstrap.cc:492] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:32.350791 29336 leader_election.cc:290] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:32.351243 29331 ts_tablet_manager.cc:1403] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.245s	user 0.034s	sys 0.015s
I20260709 13:11:32.354269 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47110731ce12413ab60b16f034fdceb3" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:32.355185 28730 raft_consensus.cc:2393] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44a14c00fc3d41bea8db00310408905a in current term 2: Already voted for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in this term.
I20260709 13:11:32.357087 28730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659cd3cf76964c27b1dfdccebc357594" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:32.359267 28478 catalog_manager.cc:5697] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 reported cstate change: term changed from 1 to 2, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.361421 28478 catalog_manager.cc:5697] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 reported cstate change: term changed from 1 to 2, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.364099 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb1e7780b6c42649546108a0bd97d7a" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:32.367503 28804 raft_consensus.cc:1275] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Refusing update from remote peer bfd745f89b014f7b85fbf7d909fe2fb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:32.372574 28622 consensus_peers.cc:597] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:32.373970 29385 consensus_queue.cc:1048] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.375999 29331 raft_consensus.cc:359] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:32.376847 29331 raft_consensus.cc:740] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.387650 29447 raft_consensus.cc:493] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.388286 29447 raft_consensus.cc:515] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:32.391528 29447 leader_election.cc:290] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:32.392216 29447 raft_consensus.cc:493] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.377662 29331 consensus_queue.cc:260] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:32.378126 29336 raft_consensus.cc:493] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.392832 29447 raft_consensus.cc:515] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:32.431442 29331 ts_tablet_manager.cc:1434] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.080s	user 0.005s	sys 0.004s
I20260709 13:11:32.432735 29331 tablet_bootstrap.cc:492] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:32.396873 29336 raft_consensus.cc:515] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:32.484869 29336 leader_election.cc:290] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
W20260709 13:11:32.507187 28770 consensus_peers.cc:597] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:32.538944 28479 catalog_manager.cc:5697] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 1 to 2, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 2 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.544461 28479 catalog_manager.cc:5697] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 1 to 2, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 2 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.550462 28479 catalog_manager.cc:5697] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 1 to 2, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 2 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:32.555750 29448 raft_consensus.cc:493] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.556438 29448 raft_consensus.cc:515] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
W20260709 13:11:32.558219 28696 consensus_peers.cc:597] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:32.509230 29336 raft_consensus.cc:493] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.571782 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ba7b5c67b14fcba09e4e6cd16fa09b" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:32.578667 29453 raft_consensus.cc:493] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.579226 29453 raft_consensus.cc:515] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
W20260709 13:11:32.581768 28622 consensus_peers.cc:597] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:32.581295 29453 leader_election.cc:290] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:32.599421 29448 leader_election.cc:290] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:32.600063 29448 raft_consensus.cc:493] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.600621 29448 raft_consensus.cc:515] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:32.569128 29336 raft_consensus.cc:515] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:32.602308 28731 raft_consensus.cc:1275] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Refusing update from remote peer b8d512840fb74aaf82ac80c433d8dc2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.602993 29336 leader_election.cc:290] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:32.589306 29447 leader_election.cc:290] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:32.604796 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bc5681208146d19bff2322d4c254dd" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:32.605834 28726 raft_consensus.cc:2393] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44a14c00fc3d41bea8db00310408905a in current term 2: Already voted for candidate a1515f1138af4333a63996f5d0864d85 in this term.
I20260709 13:11:32.607976 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "659cd3cf76964c27b1dfdccebc357594" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:32.609649 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bc5681208146d19bff2322d4c254dd" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:32.610378 28805 raft_consensus.cc:2393] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44a14c00fc3d41bea8db00310408905a in current term 2: Already voted for candidate b8d512840fb74aaf82ac80c433d8dc2d in this term.
I20260709 13:11:32.610790 28802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb1e7780b6c42649546108a0bd97d7a" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:32.611076 29448 leader_election.cc:290] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:32.611474 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a726976321d04177a6d77e9ef0041f3f" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:32.612120 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c6993be42044c3b7dbb095971f7c88" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:32.613561 28770 consensus_peers.cc:597] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:32.615306 28805 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf9ce9ce3ac4f848ae7f5b584711f3e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
W20260709 13:11:32.616698 28770 consensus_peers.cc:597] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:32.617244 28770 consensus_peers.cc:597] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:32.622575 28887 consensus_queue.cc:1048] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:32.628794 29448 raft_consensus.cc:493] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.629472 29448 raft_consensus.cc:515] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:32.629983 28726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452914c1abfd43389431daaf7ebee1c0" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:32.632084 29448 leader_election.cc:290] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:32.636169 28805 raft_consensus.cc:1275] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Refusing update from remote peer bfd745f89b014f7b85fbf7d909fe2fb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:32.637348 28696 consensus_peers.cc:597] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:32.639603 28696 consensus_peers.cc:597] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:32.635975 28802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45c6993be42044c3b7dbb095971f7c88" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:32.643862 28657 raft_consensus.cc:1275] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Refusing update from remote peer b8d512840fb74aaf82ac80c433d8dc2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.645606 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ba7b5c67b14fcba09e4e6cd16fa09b" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:32.644991 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47110731ce12413ab60b16f034fdceb3" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:32.648849 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a726976321d04177a6d77e9ef0041f3f" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:32.652247 29328 leader_election.cc:304] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:32.658639 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb853da5b7ff48d9a188d40610160f6c" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:32.661247 29455 raft_consensus.cc:2749] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:32.662817 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51806e14724e4433b368faa0c997a11e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:32.657747 29328 leader_election.cc:304] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:32.672981 28656 raft_consensus.cc:1275] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Refusing update from remote peer b8d512840fb74aaf82ac80c433d8dc2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.674018 29455 raft_consensus.cc:493] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.674599 29448 raft_consensus.cc:3060] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.675084 29455 raft_consensus.cc:515] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
W20260709 13:11:32.678642 28770 consensus_peers.cc:597] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:32.678994 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51806e14724e4433b368faa0c997a11e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:32.682535 28802 raft_consensus.cc:1275] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.674324 29326 leader_election.cc:304] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:32.683589 29453 raft_consensus.cc:2749] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:32.684048 29326 leader_election.cc:304] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:32.678661 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf9ce9ce3ac4f848ae7f5b584711f3e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:32.684916 29453 raft_consensus.cc:3060] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.685081 28657 raft_consensus.cc:2393] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 44a14c00fc3d41bea8db00310408905a in current term 2: Already voted for candidate b8d512840fb74aaf82ac80c433d8dc2d in this term.
I20260709 13:11:32.678668 28654 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb853da5b7ff48d9a188d40610160f6c" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:32.690714 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "452914c1abfd43389431daaf7ebee1c0" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:32.677222 29455 leader_election.cc:290] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:32.692703 29315 consensus_queue.cc:1048] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:32.705458 29331 tablet_bootstrap.cc:492] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:32.710148 29331 tablet_bootstrap.cc:492] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:32.710894 29331 ts_tablet_manager.cc:1403] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.278s	user 0.033s	sys 0.024s
W20260709 13:11:32.706308 28770 consensus_peers.cc:597] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:32.711372 29377 consensus_queue.cc:1048] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:32.714143 28770 consensus_peers.cc:597] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:32.717373 29453 raft_consensus.cc:2749] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:32.718724 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e29bffebb804a5bbb9935518c059b2a" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:32.719619 28806 raft_consensus.cc:1275] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.721099 29331 raft_consensus.cc:359] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:32.723129 29331 raft_consensus.cc:740] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:32.724450 29331 consensus_queue.cc:260] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:32.716487 29377 consensus_queue.cc:1048] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
W20260709 13:11:32.726092 28770 consensus_peers.cc:597] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:32.726533 28729 raft_consensus.cc:1275] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Refusing update from remote peer bfd745f89b014f7b85fbf7d909fe2fb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.685357 29326 leader_election.cc:304] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:32.728706 29331 ts_tablet_manager.cc:1434] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:11:32.729794 29331 tablet_bootstrap.cc:492] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
W20260709 13:11:32.736085 29326 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.4:43597, user_credentials={real_user=slave}} blocked reactor thread for 50813.5us
I20260709 13:11:32.736936 29326 leader_election.cc:304] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:32.737736 29455 raft_consensus.cc:2749] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:32.738150 29326 leader_election.cc:304] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:32.738360 29455 raft_consensus.cc:2749] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:32.739110 29455 raft_consensus.cc:3060] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:32.739400 29326 leader_election.cc:304] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:32.739524 29341 consensus_queue.cc:1048] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.740339 29447 raft_consensus.cc:2749] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:32.741983 29334 consensus_queue.cc:1048] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:32.742405 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e29bffebb804a5bbb9935518c059b2a" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:32.724452 29448 raft_consensus.cc:2749] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:32.749087 29455 raft_consensus.cc:2749] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:32.751158 29326 leader_election.cc:304] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:32.752017 29455 raft_consensus.cc:2749] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:32.758546 28622 consensus_peers.cc:597] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:32.783993 29307 consensus_queue.cc:1048] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:32.790412 28804 raft_consensus.cc:1275] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.797578 29455 raft_consensus.cc:493] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.798204 29455 raft_consensus.cc:515] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:32.800352 29455 leader_election.cc:290] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:32.802675 29326 leader_election.cc:304] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:32.809036 29455 raft_consensus.cc:2749] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:32.818996 28732 raft_consensus.cc:1275] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Refusing update from remote peer bfd745f89b014f7b85fbf7d909fe2fb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:32.809801 29326 leader_election.cc:304] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:32.821344 29326 leader_election.cc:304] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:32.824018 29455 raft_consensus.cc:2749] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:32.826947 29455 raft_consensus.cc:2749] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:32.828498 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7ab1eff7a5409cb84e6bb33393456e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:32.829185 28696 consensus_peers.cc:597] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:32.827368 28622 consensus_peers.cc:597] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:32.831139 29378 consensus_queue.cc:1048] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:11:32.841219 28802 raft_consensus.cc:1275] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:11:32.859630 28698 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:43021, user_credentials={real_user=slave}} blocked reactor thread for 47023.9us
I20260709 13:11:32.846079 29378 consensus_queue.cc:1048] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:11:32.857862 29334 consensus_queue.cc:1048] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:11:32.873363 28804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c7ab1eff7a5409cb84e6bb33393456e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:32.877017 29455 raft_consensus.cc:493] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.899737 29455 raft_consensus.cc:515] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
W20260709 13:11:32.904064 28770 consensus_peers.cc:597] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:32.917315 28770 consensus_peers.cc:597] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:32.907691 29326 leader_election.cc:304] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:32.929178 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d51007007a4252908beaaaa3ee8374" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:32.915988 29455 leader_election.cc:290] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
W20260709 13:11:32.938606 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:41711, user_credentials={real_user=slave}} blocked reactor thread for 57572.6us
W20260709 13:11:32.940757 28622 consensus_peers.cc:597] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:32.941238 28622 consensus_peers.cc:597] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:32.943599 28622 consensus_peers.cc:597] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:32.945325 28622 consensus_peers.cc:597] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:32.935009 29455 raft_consensus.cc:2749] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:32.949254 29331 tablet_bootstrap.cc:492] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:32.959254 29331 tablet_bootstrap.cc:492] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:32.960477 29455 raft_consensus.cc:493] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.961050 29455 raft_consensus.cc:515] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:32.963943 28804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5d51007007a4252908beaaaa3ee8374" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
W20260709 13:11:32.965605 28696 consensus_peers.cc:597] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:32.966598 29331 ts_tablet_manager.cc:1403] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.231s	user 0.033s	sys 0.010s
I20260709 13:11:32.976962 29326 leader_election.cc:304] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:32.984139 29448 raft_consensus.cc:2749] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:32.998284 28696 consensus_peers.cc:597] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:32.998850 28696 consensus_peers.cc:597] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:33.002254 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9519acd190ba4590a2eaa1fcb1e9a60f" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
W20260709 13:11:33.003906 28622 consensus_peers.cc:597] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:33.015748 29468 log.cc:927] Time spent T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d: Append to log took a long time: real 0.144s	user 0.004s	sys 0.000s
W20260709 13:11:33.021853 28622 consensus_peers.cc:597] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:33.039084 28770 consensus_peers.cc:597] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:33.039873 29455 leader_election.cc:290] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:33.040521 29331 raft_consensus.cc:359] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:33.041222 29331 raft_consensus.cc:740] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.042261 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9519acd190ba4590a2eaa1fcb1e9a60f" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:33.042106 29331 consensus_queue.cc:260] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:33.043823 29326 leader_election.cc:304] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d
I20260709 13:11:33.044654 29331 ts_tablet_manager.cc:1434] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.000s
W20260709 13:11:33.048415 28622 consensus_peers.cc:597] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:33.057860 29455 raft_consensus.cc:2749] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:11:33.059230 29474 log.cc:927] Time spent T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:11:33.085223 29331 tablet_bootstrap.cc:492] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
W20260709 13:11:33.100255 28770 consensus_peers.cc:597] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:33.102475 28622 consensus_peers.cc:597] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:33.142881 28696 consensus_peers.cc:597] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:33.179780 29331 tablet_bootstrap.cc:492] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:33.180740 29331 tablet_bootstrap.cc:492] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:33.181383 29331 ts_tablet_manager.cc:1403] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.096s	user 0.017s	sys 0.000s
I20260709 13:11:33.183954 29331 raft_consensus.cc:359] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:33.184547 29331 raft_consensus.cc:740] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.185189 29331 consensus_queue.cc:260] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:33.187309 29331 ts_tablet_manager.cc:1434] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:11:33.188292 29331 tablet_bootstrap.cc:492] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
W20260709 13:11:33.201061 28696 consensus_peers.cc:597] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:33.215956 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.1:44075
I20260709 13:11:33.216144 29492 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.1:44075 every 8 connection(s)
I20260709 13:11:33.218698 29331 tablet_bootstrap.cc:492] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:33.219748 29331 tablet_bootstrap.cc:492] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:33.220564 29331 ts_tablet_manager.cc:1403] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.007s
I20260709 13:11:33.223165 29331 raft_consensus.cc:359] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:33.223752 29331 raft_consensus.cc:740] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.224411 29331 consensus_queue.cc:260] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:33.225750 29331 ts_tablet_manager.cc:1434] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:11:33.226545 29331 tablet_bootstrap.cc:492] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:33.298197 29331 tablet_bootstrap.cc:492] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:11:33.300041 28770 consensus_peers.cc:597] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:33.301090 29331 tablet_bootstrap.cc:492] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:33.301863 29331 ts_tablet_manager.cc:1403] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.076s	user 0.024s	sys 0.028s
I20260709 13:11:33.304453 29331 raft_consensus.cc:359] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
W20260709 13:11:33.304963 28696 consensus_peers.cc:597] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:33.305334 29331 raft_consensus.cc:740] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.306095 29331 consensus_queue.cc:260] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:33.308225 29331 ts_tablet_manager.cc:1434] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:33.308991 29331 tablet_bootstrap.cc:492] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:33.320163 29493 heartbeater.cc:344] Connected to a master server at 127.20.40.62:37793
I20260709 13:11:33.320803 29493 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:33.321956 29493 heartbeater.cc:507] Master 127.20.40.62:37793 requested a full tablet report, sending...
I20260709 13:11:33.328840 29331 tablet_bootstrap.cc:492] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:33.330781 29331 tablet_bootstrap.cc:492] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:33.331552 29331 ts_tablet_manager.cc:1403] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.004s
I20260709 13:11:33.334694 29331 raft_consensus.cc:359] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:33.335470 29331 raft_consensus.cc:740] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.336108 29331 consensus_queue.cc:260] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:33.337788 29331 ts_tablet_manager.cc:1434] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:11:33.338831 29455 raft_consensus.cc:493] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.338990 29331 tablet_bootstrap.cc:492] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:33.339381 29455 raft_consensus.cc:515] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:33.346709 29455 leader_election.cc:290] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:33.348184 28802 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a388b79acd4a278496df6d65fd7a44" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" is_pre_election: true
I20260709 13:11:33.348184 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a388b79acd4a278496df6d65fd7a44" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:33.350426 29328 leader_election.cc:304] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:33.351357 29455 raft_consensus.cc:2749] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:33.355773 29331 tablet_bootstrap.cc:492] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:33.356745 28478 ts_manager.cc:194] Re-registered known tserver with Master: 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:33.357105 29331 tablet_bootstrap.cc:492] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:33.357805 29331 ts_tablet_manager.cc:1403] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 13:11:33.360441 29331 raft_consensus.cc:359] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:33.361092 29331 raft_consensus.cc:740] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.361747 29331 consensus_queue.cc:260] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:33.363854 29331 ts_tablet_manager.cc:1434] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:11:33.364732 29331 tablet_bootstrap.cc:492] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:33.380125 29331 tablet_bootstrap.cc:492] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:33.380908 29331 tablet_bootstrap.cc:492] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:33.381531 29331 ts_tablet_manager.cc:1403] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.017s	user 0.017s	sys 0.000s
I20260709 13:11:33.383339 29331 raft_consensus.cc:359] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:33.383925 29331 raft_consensus.cc:740] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.384619 29331 consensus_queue.cc:260] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:33.386376 29331 ts_tablet_manager.cc:1434] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:33.387290 29331 tablet_bootstrap.cc:492] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:33.398474 28478 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34290
I20260709 13:11:33.398628 29409 raft_consensus.cc:3060] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.399788 29331 tablet_bootstrap.cc:492] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:33.400739 29331 tablet_bootstrap.cc:492] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:33.401367 29331 ts_tablet_manager.cc:1403] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:11:33.403985 29331 raft_consensus.cc:359] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:33.404565 29493 heartbeater.cc:499] Master 127.20.40.62:37793 was elected leader, sending a full tablet report...
I20260709 13:11:33.404632 29331 raft_consensus.cc:740] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.405875 29331 consensus_queue.cc:260] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:33.408380 29331 ts_tablet_manager.cc:1434] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:33.409626 29331 tablet_bootstrap.cc:492] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:33.421780 29377 raft_consensus.cc:493] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.422374 29377 raft_consensus.cc:515] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:33.424360 29377 leader_election.cc:290] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:33.425799 29331 tablet_bootstrap.cc:492] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:33.425946 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40bb461a5034123ab09d156bd22ebbf" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:33.426594 28656 raft_consensus.cc:2468] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 2.
I20260709 13:11:33.426817 29331 tablet_bootstrap.cc:492] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:33.427493 29331 ts_tablet_manager.cc:1403] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.007s
I20260709 13:11:33.427634 29409 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40bb461a5034123ab09d156bd22ebbf" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:33.428169 28772 leader_election.cc:304] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
W20260709 13:11:33.428974 28770 leader_election.cc:343] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:33.430022 29331 raft_consensus.cc:359] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:33.430413 29377 raft_consensus.cc:2804] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:33.430742 29331 raft_consensus.cc:740] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.430809 29377 raft_consensus.cc:493] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.431245 29377 raft_consensus.cc:3060] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:33.431536 29331 consensus_queue.cc:260] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:33.433809 29331 ts_tablet_manager.cc:1434] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:11:33.434584 29331 tablet_bootstrap.cc:492] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:33.436493 29409 raft_consensus.cc:3060] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.440382 29377 raft_consensus.cc:515] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:33.442983 29377 leader_election.cc:290] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:33.444028 29406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40bb461a5034123ab09d156bd22ebbf" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
W20260709 13:11:33.445940 28770 leader_election.cc:343] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:33.445910 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d40bb461a5034123ab09d156bd22ebbf" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:33.446836 28656 raft_consensus.cc:3060] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:33.452775 29455 raft_consensus.cc:493] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.453328 29455 raft_consensus.cc:515] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:33.455359 29455 leader_election.cc:290] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:33.456892 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0093a1dad264ec1b3d9d3f896262ff7" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:33.462376 28656 raft_consensus.cc:2468] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 3.
I20260709 13:11:33.467922 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0093a1dad264ec1b3d9d3f896262ff7" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:33.469718 29388 raft_consensus.cc:3060] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.494184 29409 raft_consensus.cc:3060] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.496790 29391 raft_consensus.cc:3060] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.498848 28772 leader_election.cc:304] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:33.500080 29403 raft_consensus.cc:2804] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:33.500789 29403 raft_consensus.cc:697] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 3 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:33.502012 29403 consensus_queue.cc:237] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:33.505566 29406 raft_consensus.cc:3060] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.513407 29389 raft_consensus.cc:3060] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.520846 29392 raft_consensus.cc:3060] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:33.553951 28772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:43021, user_credentials={real_user=slave}} blocked reactor thread for 55211.1us
I20260709 13:11:33.560438 29326 leader_election.cc:304] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a; no voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:33.562831 29455 raft_consensus.cc:2749] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:33.582870 29389 raft_consensus.cc:3060] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.597019 29391 raft_consensus.cc:3060] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:33.624042 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:41711, user_credentials={real_user=slave}} blocked reactor thread for 51219.7us
I20260709 13:11:33.625903 29341 raft_consensus.cc:493] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.626389 29341 raft_consensus.cc:515] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:33.627293 29384 raft_consensus.cc:3060] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.630940 28655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff91a748d3f464ab00fc3e657057d73" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" is_pre_election: true
I20260709 13:11:33.631650 28655 raft_consensus.cc:2468] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:33.632881 28698 leader_election.cc:304] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:33.633811 29467 raft_consensus.cc:2804] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:33.634248 29467 raft_consensus.cc:493] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.634560 29467 raft_consensus.cc:3060] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:33.641036 29467 raft_consensus.cc:515] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:33.643292 29341 leader_election.cc:290] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:33.644073 29383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff91a748d3f464ab00fc3e657057d73" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
W20260709 13:11:33.649501 28696 leader_election.cc:343] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:33.658998 29382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff91a748d3f464ab00fc3e657057d73" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
W20260709 13:11:33.661245 28696 leader_election.cc:343] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:33.671985 28478 catalog_manager.cc:5697] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 1 to 3, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 3 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:33.715068 29467 leader_election.cc:290] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 3 election: Requested vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
W20260709 13:11:33.735508 28622 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:44075, user_credentials={real_user=slave}} blocked reactor thread for 62373.7us
I20260709 13:11:33.829815 28652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ff91a748d3f464ab00fc3e657057d73" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:33.830505 28652 raft_consensus.cc:3060] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:33.838271 29331 tablet_bootstrap.cc:492] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:33.848632 29391 raft_consensus.cc:3060] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:33.875648 29331 tablet_bootstrap.cc:492] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:33.876768 29331 ts_tablet_manager.cc:1403] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.442s	user 0.090s	sys 0.128s
W20260709 13:11:33.917760 28772 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:43021, user_credentials={real_user=slave}} blocked reactor thread for 133239us
I20260709 13:11:33.952957 29331 raft_consensus.cc:359] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:33.953974 29331 raft_consensus.cc:740] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:33.954932 29331 consensus_queue.cc:260] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:33.964344 29331 ts_tablet_manager.cc:1434] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.087s	user 0.004s	sys 0.004s
W20260709 13:11:33.966537 29532 log.cc:927] Time spent T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:11:33.989223 29331 tablet_bootstrap.cc:492] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:34.005563 28652 raft_consensus.cc:2468] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 3.
W20260709 13:11:34.026167 28770 consensus_peers.cc:597] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.080648 28698 leader_election.cc:304] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:34.085691 29542 raft_consensus.cc:2804] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:34.086283 29542 raft_consensus.cc:697] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 3 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:34.087242 29542 consensus_queue.cc:237] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:34.146004 29545 raft_consensus.cc:493] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.146536 29545 raft_consensus.cc:515] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:34.159798 29545 leader_election.cc:290] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:34.169382 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bc5681208146d19bff2322d4c254dd" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85" is_pre_election: true
I20260709 13:11:34.170188 28729 raft_consensus.cc:2468] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 2.
I20260709 13:11:34.172879 28770 leader_election.cc:304] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:34.176805 29392 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bc5681208146d19bff2322d4c254dd" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a" is_pre_election: true
I20260709 13:11:34.177563 29392 raft_consensus.cc:2468] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 2.
I20260709 13:11:34.183837 29516 raft_consensus.cc:2804] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:34.184299 29516 raft_consensus.cc:493] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.184657 29516 raft_consensus.cc:3060] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:34.196566 28657 raft_consensus.cc:1275] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Refusing update from remote peer b8d512840fb74aaf82ac80c433d8dc2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:34.217418 29516 raft_consensus.cc:515] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:34.223834 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bc5681208146d19bff2322d4c254dd" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:34.224483 28727 raft_consensus.cc:3060] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:34.229717 29529 consensus_queue.cc:1048] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:34.231859 28727 raft_consensus.cc:2468] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 3.
I20260709 13:11:34.233124 29516 leader_election.cc:290] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:34.233094 28770 leader_election.cc:304] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:34.234735 29516 raft_consensus.cc:2804] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:34.235280 29391 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66bc5681208146d19bff2322d4c254dd" candidate_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "44a14c00fc3d41bea8db00310408905a"
I20260709 13:11:34.235494 29516 raft_consensus.cc:697] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 3 LEADER]: Becoming Leader. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:34.236057 29391 raft_consensus.cc:3060] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:34.237798 29516 consensus_queue.cc:237] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:34.259663 29391 raft_consensus.cc:2468] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8d512840fb74aaf82ac80c433d8dc2d in term 3.
I20260709 13:11:34.269639 29331 tablet_bootstrap.cc:492] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:34.263659 28479 catalog_manager.cc:5697] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 1 to 3, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 3 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:34.270761 29331 tablet_bootstrap.cc:492] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:34.271437 29331 ts_tablet_manager.cc:1403] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.282s	user 0.014s	sys 0.004s
I20260709 13:11:34.282124 29331 raft_consensus.cc:359] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:34.282898 29331 raft_consensus.cc:740] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.283571 29331 consensus_queue.cc:260] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:34.285753 29331 ts_tablet_manager.cc:1434] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 13:11:34.286625 29331 tablet_bootstrap.cc:492] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:34.322329 28479 catalog_manager.cc:5697] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d reported cstate change: term changed from 1 to 3, leader changed from 44a14c00fc3d41bea8db00310408905a (127.20.40.1) to b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4). New cstate: current_term: 3 leader_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:34.348435 29331 tablet_bootstrap.cc:492] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:34.349898 29331 tablet_bootstrap.cc:492] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:34.350551 29331 ts_tablet_manager.cc:1403] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.005s
I20260709 13:11:34.353046 29331 raft_consensus.cc:359] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:34.353787 29331 raft_consensus.cc:740] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.354638 29331 consensus_queue.cc:260] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:34.356866 29331 ts_tablet_manager.cc:1434] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260709 13:11:34.358770 29331 tablet_bootstrap.cc:492] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:34.373812 29331 tablet_bootstrap.cc:492] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:34.374624 29331 tablet_bootstrap.cc:492] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:34.375316 29331 ts_tablet_manager.cc:1403] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:11:34.377202 29331 raft_consensus.cc:359] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:34.378064 29331 raft_consensus.cc:740] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.378813 29331 consensus_queue.cc:260] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:34.381050 29331 ts_tablet_manager.cc:1434] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:11:34.382639 29331 tablet_bootstrap.cc:492] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:34.398808 29331 tablet_bootstrap.cc:492] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:34.399755 29331 tablet_bootstrap.cc:492] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:34.400456 29331 ts_tablet_manager.cc:1403] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.008s
I20260709 13:11:34.402906 29331 raft_consensus.cc:359] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:34.403605 29331 raft_consensus.cc:740] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.404214 29331 consensus_queue.cc:260] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:34.406319 29331 ts_tablet_manager.cc:1434] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:11:34.408107 29331 tablet_bootstrap.cc:492] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:34.423451 29331 tablet_bootstrap.cc:492] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:34.424371 29331 tablet_bootstrap.cc:492] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:34.425038 29331 ts_tablet_manager.cc:1403] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.002s
I20260709 13:11:34.427631 29331 raft_consensus.cc:359] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:34.428350 29331 raft_consensus.cc:740] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.429073 29331 consensus_queue.cc:260] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:34.430909 29331 ts_tablet_manager.cc:1434] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:11:34.431841 29331 tablet_bootstrap.cc:492] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:34.448860 29331 tablet_bootstrap.cc:492] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:34.449988 29331 tablet_bootstrap.cc:492] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:34.450729 29331 ts_tablet_manager.cc:1403] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:11:34.454265 29331 raft_consensus.cc:359] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:34.455185 29331 raft_consensus.cc:740] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.456032 29331 consensus_queue.cc:260] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:34.458217 29331 ts_tablet_manager.cc:1434] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:34.459609 29331 tablet_bootstrap.cc:492] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:34.479462 29331 tablet_bootstrap.cc:492] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:34.480482 29331 tablet_bootstrap.cc:492] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:34.481220 29331 ts_tablet_manager.cc:1403] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 13:11:34.483589 29331 raft_consensus.cc:359] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:34.484295 29331 raft_consensus.cc:740] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.484972 29331 consensus_queue.cc:260] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:34.486965 29331 ts_tablet_manager.cc:1434] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:11:34.488031 29331 tablet_bootstrap.cc:492] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:34.505007 29331 tablet_bootstrap.cc:492] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:34.505932 29331 tablet_bootstrap.cc:492] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:34.506526 29331 ts_tablet_manager.cc:1403] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.008s
I20260709 13:11:34.508670 29331 raft_consensus.cc:359] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:34.509431 29331 raft_consensus.cc:740] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.510146 29331 consensus_queue.cc:260] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:34.512210 29331 ts_tablet_manager.cc:1434] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:34.513664 29331 tablet_bootstrap.cc:492] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:34.530375 29331 tablet_bootstrap.cc:492] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:34.531301 29331 tablet_bootstrap.cc:492] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:34.531950 29331 ts_tablet_manager.cc:1403] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 13:11:34.534526 29331 raft_consensus.cc:359] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:34.535207 29331 raft_consensus.cc:740] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.535976 29331 consensus_queue.cc:260] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:34.537619 29331 ts_tablet_manager.cc:1434] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:11:34.538374 29331 tablet_bootstrap.cc:492] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:34.556680 28653 raft_consensus.cc:1275] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:34.560122 29542 consensus_queue.cc:1048] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:34.596046 29331 tablet_bootstrap.cc:492] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:34.602725 29331 tablet_bootstrap.cc:492] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:34.603411 29331 ts_tablet_manager.cc:1403] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.007s
I20260709 13:11:34.612149 29331 raft_consensus.cc:359] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:34.612931 29331 raft_consensus.cc:740] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.613955 29331 consensus_queue.cc:260] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
W20260709 13:11:34.615675 28696 consensus_peers.cc:597] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:34.616443 29331 ts_tablet_manager.cc:1434] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:11:34.617620 29331 tablet_bootstrap.cc:492] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:34.639510 29331 tablet_bootstrap.cc:492] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:34.639575 29409 raft_consensus.cc:3060] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:34.640580 29331 tablet_bootstrap.cc:492] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:34.641306 29331 ts_tablet_manager.cc:1403] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.000s
I20260709 13:11:34.644469 29331 raft_consensus.cc:359] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:34.645195 29331 raft_consensus.cc:740] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.645892 29331 consensus_queue.cc:260] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:34.648589 29331 ts_tablet_manager.cc:1434] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:34.650810 29331 tablet_bootstrap.cc:492] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:34.695636 29331 tablet_bootstrap.cc:492] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:34.697075 29331 tablet_bootstrap.cc:492] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:34.697990 29331 ts_tablet_manager.cc:1403] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.023s
I20260709 13:11:34.710537 29331 raft_consensus.cc:359] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:34.711297 29331 raft_consensus.cc:740] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.711973 29331 consensus_queue.cc:260] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:34.714293 29331 ts_tablet_manager.cc:1434] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:11:34.715154 29331 tablet_bootstrap.cc:492] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:34.733736 29409 raft_consensus.cc:1275] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Refusing update from remote peer b8d512840fb74aaf82ac80c433d8dc2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:34.734673 29331 tablet_bootstrap.cc:492] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:34.735764 29331 tablet_bootstrap.cc:492] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:34.736480 29331 ts_tablet_manager.cc:1403] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.006s
I20260709 13:11:34.737100 29534 consensus_queue.cc:1048] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:34.739394 29384 raft_consensus.cc:3060] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:34.739172 29331 raft_consensus.cc:359] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:34.739977 29331 raft_consensus.cc:740] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.740716 29331 consensus_queue.cc:260] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:34.742973 29331 ts_tablet_manager.cc:1434] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:11:34.743806 29331 tablet_bootstrap.cc:492] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:34.761008 28727 raft_consensus.cc:1275] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Refusing update from remote peer b8d512840fb74aaf82ac80c433d8dc2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:11:34.763360 29534 consensus_queue.cc:1048] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:34.775563 29331 tablet_bootstrap.cc:492] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:34.776917 29331 tablet_bootstrap.cc:492] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:34.778036 29331 ts_tablet_manager.cc:1403] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.012s
I20260709 13:11:34.781767 29331 raft_consensus.cc:359] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:34.782804 29331 raft_consensus.cc:740] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.783262 29391 raft_consensus.cc:3060] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:34.783941 29331 consensus_queue.cc:260] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:34.787534 29331 ts_tablet_manager.cc:1434] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:11:34.788700 29331 tablet_bootstrap.cc:492] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a: Bootstrap starting.
I20260709 13:11:34.793303 29388 raft_consensus.cc:3060] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:34.858554 29331 tablet_bootstrap.cc:492] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:34.866029 29331 tablet_bootstrap.cc:492] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a: Bootstrap complete.
I20260709 13:11:34.866827 29331 ts_tablet_manager.cc:1403] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.018s
I20260709 13:11:34.876699 29331 raft_consensus.cc:359] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:34.877662 29331 raft_consensus.cc:740] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Initialized, Role: FOLLOWER
I20260709 13:11:34.878443 29331 consensus_queue.cc:260] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:34.881477 29331 ts_tablet_manager.cc:1434] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:11:34.884791 29382 raft_consensus.cc:3060] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:34.920753 29384 raft_consensus.cc:3060] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:35.187014 29382 raft_consensus.cc:3060] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.223021 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:43.302983 28732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19240a871550411aafbc885984ade97d"
dest_uuid: "a1515f1138af4333a63996f5d0864d85"
mode: GRACEFUL
new_leader_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:53986
I20260709 13:11:43.304085 28732 raft_consensus.cc:606] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Received request to transfer leadership to TS 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:43.307428 28732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ee04ccf18954bae9d40f7a5c460f71b"
dest_uuid: "a1515f1138af4333a63996f5d0864d85"
mode: GRACEFUL
new_leader_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:53986
I20260709 13:11:43.307935 28732 raft_consensus.cc:606] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Received request to transfer leadership to TS 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:43.321254 28803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57c146089a3249eea0254717e75c14c8"
dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
mode: GRACEFUL
new_leader_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:39488
I20260709 13:11:43.321835 28803 raft_consensus.cc:606] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 LEADER]: Received request to transfer leadership to TS 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:43.324419 28732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ea260fc2f384cd7a7f947d2bf8cb49b"
dest_uuid: "a1515f1138af4333a63996f5d0864d85"
mode: GRACEFUL
new_leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
 from {username='slave'} at 127.0.0.1:53986
I20260709 13:11:43.324896 28732 raft_consensus.cc:606] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Received request to transfer leadership to TS bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:43.327417 28732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bb1e7780b6c42649546108a0bd97d7a"
dest_uuid: "a1515f1138af4333a63996f5d0864d85"
mode: GRACEFUL
new_leader_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:53986
I20260709 13:11:43.327909 28732 raft_consensus.cc:606] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Received request to transfer leadership to TS 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:43.331780 28732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0093a1dad264ec1b3d9d3f896262ff7"
dest_uuid: "a1515f1138af4333a63996f5d0864d85"
mode: GRACEFUL
new_leader_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:53986
I20260709 13:11:43.332417 28732 raft_consensus.cc:606] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Received request to transfer leadership to TS 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:43.333663 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:43.335434 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:43.426862 29592 raft_consensus.cc:993] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85: : Instructing follower 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:43.427464 29600 raft_consensus.cc:1081] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Signalling peer 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:43.428906 29384 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ee04ccf18954bae9d40f7a5c460f71b"
dest_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:52552
I20260709 13:11:43.429399 29384 raft_consensus.cc:493] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:43.429771 29384 raft_consensus.cc:3060] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.435248 29384 raft_consensus.cc:515] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:43.437007 29384 leader_election.cc:290] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:43.438283 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee04ccf18954bae9d40f7a5c460f71b" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:43.438103 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee04ccf18954bae9d40f7a5c460f71b" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:43.438948 28803 raft_consensus.cc:3060] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.439118 28732 raft_consensus.cc:3055] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:43.439579 28732 raft_consensus.cc:740] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:43.440431 28732 consensus_queue.cc:260] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:43.441804 28732 raft_consensus.cc:3060] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.444571 28803 raft_consensus.cc:2468] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 2.
I20260709 13:11:43.445907 29326 leader_election.cc:304] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:43.449093 28732 raft_consensus.cc:2468] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 2.
I20260709 13:11:43.450953 29612 raft_consensus.cc:2804] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.453910 29612 raft_consensus.cc:697] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [term 2 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:43.454943 29612 consensus_queue.cc:237] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:43.548106 28479 catalog_manager.cc:5697] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 1 to 2, leader changed from a1515f1138af4333a63996f5d0864d85 (127.20.40.3) to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 2 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:43.599362 29618 raft_consensus.cc:993] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85: : Instructing follower 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:43.599905 29600 raft_consensus.cc:1081] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Signalling peer 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:43.601665 29392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0093a1dad264ec1b3d9d3f896262ff7"
dest_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:52552
I20260709 13:11:43.602233 29392 raft_consensus.cc:493] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:43.602540 29392 raft_consensus.cc:3060] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.610165 29392 raft_consensus.cc:515] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:43.612159 29392 leader_election.cc:290] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:43.613057 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0093a1dad264ec1b3d9d3f896262ff7" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:43.613154 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0093a1dad264ec1b3d9d3f896262ff7" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:43.613776 28732 raft_consensus.cc:3055] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:43.613838 28656 raft_consensus.cc:3060] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.614207 28732 raft_consensus.cc:740] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:43.615166 28732 consensus_queue.cc:260] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:43.618044 28732 raft_consensus.cc:3060] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.620659 28656 raft_consensus.cc:2468] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 2.
I20260709 13:11:43.622249 29328 leader_election.cc:304] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:43.623114 29612 raft_consensus.cc:2804] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.623577 29612 raft_consensus.cc:697] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 2 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:43.624033 28732 raft_consensus.cc:2468] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 2.
I20260709 13:11:43.624315 29612 consensus_queue.cc:237] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:43.632640 29600 raft_consensus.cc:993] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85: : Instructing follower 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:43.633127 29618 raft_consensus.cc:1081] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Signalling peer 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:43.634529 29392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bb1e7780b6c42649546108a0bd97d7a"
dest_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:52552
I20260709 13:11:43.635098 29392 raft_consensus.cc:493] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:43.635391 29392 raft_consensus.cc:3060] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.635893 28478 catalog_manager.cc:5697] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 1 to 2, leader changed from a1515f1138af4333a63996f5d0864d85 (127.20.40.3) to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 2 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.639218 29616 raft_consensus.cc:993] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d: : Instructing follower 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:43.639880 29608 raft_consensus.cc:1081] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 LEADER]: Signalling peer 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:43.642552 29382 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57c146089a3249eea0254717e75c14c8"
dest_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:52578
I20260709 13:11:43.643049 29382 raft_consensus.cc:493] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:43.642953 29392 raft_consensus.cc:515] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:43.643534 29382 raft_consensus.cc:3060] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.646868 28804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb1e7780b6c42649546108a0bd97d7a" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:43.647156 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bb1e7780b6c42649546108a0bd97d7a" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:43.647470 28804 raft_consensus.cc:3060] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.647768 28732 raft_consensus.cc:3055] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:43.648063 28732 raft_consensus.cc:740] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:43.649032 28732 consensus_queue.cc:260] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:43.650156 28732 raft_consensus.cc:3060] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.651275 29382 raft_consensus.cc:515] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:43.652714 29382 leader_election.cc:290] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 3 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:43.653630 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c146089a3249eea0254717e75c14c8" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:43.653788 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57c146089a3249eea0254717e75c14c8" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:43.654225 28729 raft_consensus.cc:3060] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.654385 28803 raft_consensus.cc:3055] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:43.654791 28803 raft_consensus.cc:740] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:43.655539 28803 consensus_queue.cc:260] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:43.656916 28803 raft_consensus.cc:3060] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.660420 28804 raft_consensus.cc:2468] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 2.
I20260709 13:11:43.660964 29392 leader_election.cc:290] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:43.662302 29326 leader_election.cc:304] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:43.663100 29612 raft_consensus.cc:2804] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.663558 29612 raft_consensus.cc:697] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [term 2 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:43.664459 28729 raft_consensus.cc:2468] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 3.
I20260709 13:11:43.664438 29612 consensus_queue.cc:237] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:43.666605 28803 raft_consensus.cc:2468] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 3.
I20260709 13:11:43.668088 29326 leader_election.cc:304] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85; no voters: 
I20260709 13:11:43.669025 29613 raft_consensus.cc:2804] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:43.671728 28732 raft_consensus.cc:2468] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 2.
I20260709 13:11:43.674854 29613 raft_consensus.cc:697] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 3 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:43.675896 29613 consensus_queue.cc:237] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:43.684374 28478 catalog_manager.cc:5697] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 1 to 2, leader changed from a1515f1138af4333a63996f5d0864d85 (127.20.40.3) to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 2 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:43.698649 28478 catalog_manager.cc:5697] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 2 to 3, leader changed from b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4) to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 3 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:43.781178 29618 raft_consensus.cc:993] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85: : Instructing follower bfd745f89b014f7b85fbf7d909fe2fb0 to start an election
I20260709 13:11:43.781716 29600 raft_consensus.cc:1081] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Signalling peer bfd745f89b014f7b85fbf7d909fe2fb0 to start an election
I20260709 13:11:43.783223 28656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ea260fc2f384cd7a7f947d2bf8cb49b"
dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
 from {username='slave'} at 127.0.0.1:44506
I20260709 13:11:43.783793 28656 raft_consensus.cc:493] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:43.784215 28656 raft_consensus.cc:3060] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.791630 28656 raft_consensus.cc:515] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:43.794279 28656 leader_election.cc:290] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:43.794958 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea260fc2f384cd7a7f947d2bf8cb49b" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:43.795616 28732 raft_consensus.cc:3055] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:43.795715 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ea260fc2f384cd7a7f947d2bf8cb49b" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:43.795991 28732 raft_consensus.cc:740] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:43.809583 28803 raft_consensus.cc:3060] T 6ea260fc2f384cd7a7f947d2bf8cb49b P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.816263 28732 consensus_queue.cc:260] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:43.817526 28732 raft_consensus.cc:3060] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:43.825059 29592 raft_consensus.cc:993] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85: : Instructing follower 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:43.825603 29592 raft_consensus.cc:1081] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Signalling peer 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:43.827224 28732 raft_consensus.cc:2468] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 2.
I20260709 13:11:43.829567 28622 leader_election.cc:304] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:43.830871 29604 raft_consensus.cc:2804] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:43.831344 29604 raft_consensus.cc:697] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 LEADER]: Becoming Leader. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
I20260709 13:11:43.832069 29392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19240a871550411aafbc885984ade97d"
dest_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:52552
I20260709 13:11:43.832726 29392 raft_consensus.cc:493] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:43.833191 29392 raft_consensus.cc:3060] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.833362 29604 consensus_queue.cc:237] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:43.841727 28803 raft_consensus.cc:2468] T 6ea260fc2f384cd7a7f947d2bf8cb49b P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 2.
I20260709 13:11:43.852032 29392 raft_consensus.cc:515] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:43.854039 29392 leader_election.cc:290] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 3 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:43.854696 28732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19240a871550411aafbc885984ade97d" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:43.855376 28732 raft_consensus.cc:3055] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:43.855667 28732 raft_consensus.cc:740] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:43.856441 28732 consensus_queue.cc:260] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:43.856875 28803 raft_consensus.cc:1275] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:43.857766 28732 raft_consensus.cc:3060] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.858884 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19240a871550411aafbc885984ade97d" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:43.859462 28803 raft_consensus.cc:3060] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:43.858660 28478 catalog_manager.cc:5697] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 reported cstate change: term changed from 1 to 2, leader changed from a1515f1138af4333a63996f5d0864d85 (127.20.40.3) to bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.865687 28732 raft_consensus.cc:2468] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 3.
I20260709 13:11:43.868088 29326 leader_election.cc:304] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85; no voters: 
I20260709 13:11:43.868643 28803 raft_consensus.cc:2468] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 3.
I20260709 13:11:43.868939 29613 raft_consensus.cc:2804] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:43.869657 29613 raft_consensus.cc:697] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 3 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:43.869597 29612 consensus_queue.cc:1048] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:43.870833 29613 consensus_queue.cc:237] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:43.882649 28729 raft_consensus.cc:1275] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:43.884249 29625 consensus_queue.cc:1048] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:43.899636 28478 catalog_manager.cc:5697] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 2 to 3, leader changed from a1515f1138af4333a63996f5d0864d85 (127.20.40.3) to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 3 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:44.023958 28653 raft_consensus.cc:1275] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.025363 29625 consensus_queue.cc:1048] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:44.036275 28732 raft_consensus.cc:1275] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.038455 29637 consensus_queue.cc:1048] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:44.072441 28804 raft_consensus.cc:1275] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.073693 29637 consensus_queue.cc:1048] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:44.086216 28804 raft_consensus.cc:1275] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:44.092765 29625 consensus_queue.cc:1048] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:44.093802 28732 raft_consensus.cc:1275] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.096282 29625 consensus_queue.cc:1048] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:44.127718 28729 raft_consensus.cc:1275] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:44.136041 29637 consensus_queue.cc:1048] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:44.241605 28729 raft_consensus.cc:1275] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Refusing update from remote peer bfd745f89b014f7b85fbf7d909fe2fb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.243300 29605 consensus_queue.cc:1048] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:44.256407 28804 raft_consensus.cc:1275] T 6ea260fc2f384cd7a7f947d2bf8cb49b P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Refusing update from remote peer bfd745f89b014f7b85fbf7d909fe2fb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.261394 29605 consensus_queue.cc:1048] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:44.336436 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:44.377619 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:44.388054 28729 raft_consensus.cc:1275] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:44.390471 29612 consensus_queue.cc:1048] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:44.392000 28804 raft_consensus.cc:1275] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:44.393602 29612 consensus_queue.cc:1048] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:44.438918 28804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b32b6e56ce549b98fca9ad5f3798f2b"
dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
mode: GRACEFUL
new_leader_uuid: "a1515f1138af4333a63996f5d0864d85"
 from {username='slave'} at 127.0.0.1:39488
I20260709 13:11:44.439570 28804 raft_consensus.cc:606] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Received request to transfer leadership to TS a1515f1138af4333a63996f5d0864d85
I20260709 13:11:44.442946 28804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47ba06e13a9740d9b4ba185990852ada"
dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
mode: GRACEFUL
new_leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
 from {username='slave'} at 127.0.0.1:39488
I20260709 13:11:44.443607 28804 raft_consensus.cc:606] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Received request to transfer leadership to TS bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:44.446785 28729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51806e14724e4433b368faa0c997a11e"
dest_uuid: "a1515f1138af4333a63996f5d0864d85"
mode: GRACEFUL
new_leader_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:53986
I20260709 13:11:44.447372 28729 raft_consensus.cc:606] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Received request to transfer leadership to TS 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:44.449972 28729 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce8eab4cd5b64393b62a304011e5b22d"
dest_uuid: "a1515f1138af4333a63996f5d0864d85"
mode: GRACEFUL
new_leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
 from {username='slave'} at 127.0.0.1:53986
I20260709 13:11:44.450527 28729 raft_consensus.cc:606] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Received request to transfer leadership to TS bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:44.455778 28804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d69a0e6ca32e4d8080aed2fe4405d7f5"
dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
mode: GRACEFUL
new_leader_uuid: "a1515f1138af4333a63996f5d0864d85"
 from {username='slave'} at 127.0.0.1:39488
I20260709 13:11:44.456899 28804 raft_consensus.cc:606] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Received request to transfer leadership to TS a1515f1138af4333a63996f5d0864d85
I20260709 13:11:44.458175 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:44.459391 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:44.475617 29608 raft_consensus.cc:993] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d: : Instructing follower a1515f1138af4333a63996f5d0864d85 to start an election
I20260709 13:11:44.476331 29616 raft_consensus.cc:1081] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Signalling peer a1515f1138af4333a63996f5d0864d85 to start an election
I20260709 13:11:44.478005 28729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d69a0e6ca32e4d8080aed2fe4405d7f5"
dest_uuid: "a1515f1138af4333a63996f5d0864d85"
 from {username='slave'} at 127.0.0.1:44040
I20260709 13:11:44.478590 28729 raft_consensus.cc:493] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:44.478937 28729 raft_consensus.cc:3060] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.483958 28729 raft_consensus.cc:515] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:44.485991 28729 leader_election.cc:290] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:44.486810 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d69a0e6ca32e4d8080aed2fe4405d7f5" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:44.486992 28804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d69a0e6ca32e4d8080aed2fe4405d7f5" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:44.487522 28656 raft_consensus.cc:3060] T d69a0e6ca32e4d8080aed2fe4405d7f5 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.487638 28804 raft_consensus.cc:3055] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:44.488122 28804 raft_consensus.cc:740] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:44.489004 28804 consensus_queue.cc:260] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:44.490267 28804 raft_consensus.cc:3060] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.494232 28656 raft_consensus.cc:2468] T d69a0e6ca32e4d8080aed2fe4405d7f5 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:44.495445 28698 leader_election.cc:304] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:44.496155 29627 raft_consensus.cc:2804] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:44.496645 29627 raft_consensus.cc:697] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:44.496713 28804 raft_consensus.cc:2468] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:44.497586 29627 consensus_queue.cc:237] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:44.507856 28478 catalog_manager.cc:5697] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 1 to 2, leader changed from b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4) to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 2 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:44.636541 29608 raft_consensus.cc:993] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d: : Instructing follower a1515f1138af4333a63996f5d0864d85 to start an election
I20260709 13:11:44.637040 29616 raft_consensus.cc:1081] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Signalling peer a1515f1138af4333a63996f5d0864d85 to start an election
I20260709 13:11:44.638633 28729 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b32b6e56ce549b98fca9ad5f3798f2b"
dest_uuid: "a1515f1138af4333a63996f5d0864d85"
 from {username='slave'} at 127.0.0.1:44040
I20260709 13:11:44.639266 28729 raft_consensus.cc:493] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:44.639580 28729 raft_consensus.cc:3060] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.644621 28729 raft_consensus.cc:515] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:44.646147 28729 leader_election.cc:290] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:44.646917 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b32b6e56ce549b98fca9ad5f3798f2b" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:44.647140 28804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b32b6e56ce549b98fca9ad5f3798f2b" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:44.647650 28656 raft_consensus.cc:3060] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.647710 28804 raft_consensus.cc:3055] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:44.648128 28804 raft_consensus.cc:740] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:44.648808 28804 consensus_queue.cc:260] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:44.649750 28804 raft_consensus.cc:3060] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.653247 28656 raft_consensus.cc:2468] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:44.654605 28698 leader_election.cc:304] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:44.655424 29600 raft_consensus.cc:2804] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:44.655678 28804 raft_consensus.cc:2468] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:44.656222 29600 raft_consensus.cc:697] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:44.657202 29600 consensus_queue.cc:237] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:44.669938 28478 catalog_manager.cc:5697] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 1 to 2, leader changed from b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4) to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 2 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:44.798609 29600 raft_consensus.cc:993] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85: : Instructing follower bfd745f89b014f7b85fbf7d909fe2fb0 to start an election
I20260709 13:11:44.799146 29627 raft_consensus.cc:1081] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Signalling peer bfd745f89b014f7b85fbf7d909fe2fb0 to start an election
I20260709 13:11:44.800700 28656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce8eab4cd5b64393b62a304011e5b22d"
dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
 from {username='slave'} at 127.0.0.1:44506
I20260709 13:11:44.801272 28656 raft_consensus.cc:493] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:44.801661 28656 raft_consensus.cc:3060] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.806843 28656 raft_consensus.cc:515] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:44.808382 28656 leader_election.cc:290] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:44.809118 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8eab4cd5b64393b62a304011e5b22d" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:44.809242 28804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce8eab4cd5b64393b62a304011e5b22d" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:44.809911 28729 raft_consensus.cc:3055] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:44.809930 28804 raft_consensus.cc:3060] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.810355 28729 raft_consensus.cc:740] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:44.811129 28729 consensus_queue.cc:260] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:44.812258 28729 raft_consensus.cc:3060] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.816676 28804 raft_consensus.cc:2468] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 2.
I20260709 13:11:44.817906 28622 leader_election.cc:304] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:44.818598 28729 raft_consensus.cc:2468] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 2.
I20260709 13:11:44.818653 29605 raft_consensus.cc:2804] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:44.819242 29605 raft_consensus.cc:697] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 LEADER]: Becoming Leader. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
I20260709 13:11:44.820048 29605 consensus_queue.cc:237] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:44.834929 29616 raft_consensus.cc:993] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d: : Instructing follower bfd745f89b014f7b85fbf7d909fe2fb0 to start an election
I20260709 13:11:44.835436 29608 raft_consensus.cc:1081] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Signalling peer bfd745f89b014f7b85fbf7d909fe2fb0 to start an election
I20260709 13:11:44.836943 28653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47ba06e13a9740d9b4ba185990852ada"
dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
 from {username='slave'} at 127.0.0.1:44514
I20260709 13:11:44.837494 28653 raft_consensus.cc:493] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:44.837832 28653 raft_consensus.cc:3060] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.837831 28478 catalog_manager.cc:5697] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 reported cstate change: term changed from 1 to 2, leader changed from a1515f1138af4333a63996f5d0864d85 (127.20.40.3) to bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:44.845981 28653 raft_consensus.cc:515] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:44.849877 28653 leader_election.cc:290] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:44.850499 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ba06e13a9740d9b4ba185990852ada" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:44.850659 28804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47ba06e13a9740d9b4ba185990852ada" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:44.851186 28729 raft_consensus.cc:3060] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.851235 28804 raft_consensus.cc:3055] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:44.851629 28804 raft_consensus.cc:740] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:44.852429 28804 consensus_queue.cc:260] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:44.853580 28804 raft_consensus.cc:3060] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:44.858151 28729 raft_consensus.cc:2468] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 2.
I20260709 13:11:44.860857 28804 raft_consensus.cc:2468] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 2.
I20260709 13:11:44.861764 28622 leader_election.cc:304] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:44.862541 29645 raft_consensus.cc:2804] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:44.863911 29645 raft_consensus.cc:697] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 LEADER]: Becoming Leader. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
I20260709 13:11:44.864691 29645 consensus_queue.cc:237] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:44.874406 28478 catalog_manager.cc:5697] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 reported cstate change: term changed from 1 to 2, leader changed from b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4) to bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:44.983135 28656 raft_consensus.cc:1275] T d69a0e6ca32e4d8080aed2fe4405d7f5 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.984531 29627 consensus_queue.cc:1048] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:44.997807 28804 raft_consensus.cc:1275] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:44.999317 29627 consensus_queue.cc:1048] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:45.010977 29627 raft_consensus.cc:993] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85: : Instructing follower 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:45.011475 29600 raft_consensus.cc:1081] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Signalling peer 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:45.013034 29392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51806e14724e4433b368faa0c997a11e"
dest_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:52552
I20260709 13:11:45.013604 29392 raft_consensus.cc:493] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:45.013935 29392 raft_consensus.cc:3060] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.021525 29392 raft_consensus.cc:515] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:45.024134 29392 leader_election.cc:290] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:45.025099 28656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51806e14724e4433b368faa0c997a11e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:45.026121 28656 raft_consensus.cc:3060] T 51806e14724e4433b368faa0c997a11e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.025465 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51806e14724e4433b368faa0c997a11e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:45.027779 28729 raft_consensus.cc:3055] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:45.028226 28729 raft_consensus.cc:740] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:45.033588 28729 consensus_queue.cc:260] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:45.038936 28729 raft_consensus.cc:3060] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.046029 28656 raft_consensus.cc:2468] T 51806e14724e4433b368faa0c997a11e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 2.
I20260709 13:11:45.065260 29328 leader_election.cc:304] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:45.066295 29612 raft_consensus.cc:2804] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:45.066905 29612 raft_consensus.cc:697] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 2 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:45.067795 29612 consensus_queue.cc:237] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:45.078961 28729 raft_consensus.cc:2468] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 2.
I20260709 13:11:45.081324 28478 catalog_manager.cc:5697] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 1 to 2, leader changed from a1515f1138af4333a63996f5d0864d85 (127.20.40.3) to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 2 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:45.106777 28653 raft_consensus.cc:1275] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:45.108058 29627 consensus_queue.cc:1048] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:45.118182 28803 raft_consensus.cc:1275] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:45.120239 29627 consensus_queue.cc:1048] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:45.275446 28732 raft_consensus.cc:1275] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Refusing update from remote peer bfd745f89b014f7b85fbf7d909fe2fb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:45.276711 29655 consensus_queue.cc:1048] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:45.286105 28804 raft_consensus.cc:1275] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Refusing update from remote peer bfd745f89b014f7b85fbf7d909fe2fb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:45.289752 29645 consensus_queue.cc:1048] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:45.433537 28804 raft_consensus.cc:1275] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Refusing update from remote peer bfd745f89b014f7b85fbf7d909fe2fb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:45.434811 29645 consensus_queue.cc:1048] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:45.441939 28732 raft_consensus.cc:1275] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Refusing update from remote peer bfd745f89b014f7b85fbf7d909fe2fb0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:45.446852 29655 consensus_queue.cc:1048] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:45.461908 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:45.502167 28732 raft_consensus.cc:1275] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:45.503477 29637 consensus_queue.cc:1048] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:45.513321 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:45.516889 28653 raft_consensus.cc:1275] T 51806e14724e4433b368faa0c997a11e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:45.521401 29674 consensus_queue.cc:1048] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:11:45.573947 28727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b32b6e56ce549b98fca9ad5f3798f2b"
dest_uuid: "a1515f1138af4333a63996f5d0864d85"
mode: GRACEFUL
new_leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
 from {username='slave'} at 127.0.0.1:53986
I20260709 13:11:45.574429 28727 raft_consensus.cc:606] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Received request to transfer leadership to TS bfd745f89b014f7b85fbf7d909fe2fb0
I20260709 13:11:45.576896 28804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "550aaae95149430d8f95525d197894f6"
dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
mode: GRACEFUL
new_leader_uuid: "a1515f1138af4333a63996f5d0864d85"
 from {username='slave'} at 127.0.0.1:39488
I20260709 13:11:45.577489 28804 raft_consensus.cc:606] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Received request to transfer leadership to TS a1515f1138af4333a63996f5d0864d85
I20260709 13:11:45.579977 28727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e29bffebb804a5bbb9935518c059b2a"
dest_uuid: "a1515f1138af4333a63996f5d0864d85"
mode: GRACEFUL
new_leader_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:53986
I20260709 13:11:45.580392 28727 raft_consensus.cc:606] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Received request to transfer leadership to TS 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:45.582757 28804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1a388b79acd4a278496df6d65fd7a44"
dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
mode: GRACEFUL
new_leader_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:39488
I20260709 13:11:45.583295 28804 raft_consensus.cc:606] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Received request to transfer leadership to TS 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:45.597210 28653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f52ad167603d40ada7680f844e2e59c8"
dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
mode: GRACEFUL
new_leader_uuid: "a1515f1138af4333a63996f5d0864d85"
 from {username='slave'} at 127.0.0.1:52826
I20260709 13:11:45.597884 28653 raft_consensus.cc:606] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Received request to transfer leadership to TS a1515f1138af4333a63996f5d0864d85
I20260709 13:11:45.600262 28804 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fcf9ce9ce3ac4f848ae7f5b584711f3e"
dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
mode: GRACEFUL
new_leader_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:39488
I20260709 13:11:45.600816 28804 raft_consensus.cc:606] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 2 LEADER]: Received request to transfer leadership to TS 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:45.602126 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:11:45.603762 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:45.702459 29666 raft_consensus.cc:993] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85: : Instructing follower bfd745f89b014f7b85fbf7d909fe2fb0 to start an election
I20260709 13:11:45.703027 29627 raft_consensus.cc:1081] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Signalling peer bfd745f89b014f7b85fbf7d909fe2fb0 to start an election
I20260709 13:11:45.704478 28653 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b32b6e56ce549b98fca9ad5f3798f2b"
dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
 from {username='slave'} at 127.0.0.1:44506
I20260709 13:11:45.705062 28653 raft_consensus.cc:493] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:45.705381 28653 raft_consensus.cc:3060] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.710216 28653 raft_consensus.cc:515] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:45.712098 28653 leader_election.cc:290] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 3 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:45.713522 28804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b32b6e56ce549b98fca9ad5f3798f2b" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:45.714178 28804 raft_consensus.cc:3060] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.718144 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b32b6e56ce549b98fca9ad5f3798f2b" candidate_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:45.718852 28729 raft_consensus.cc:3055] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:45.719200 28729 raft_consensus.cc:740] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:45.719971 28729 consensus_queue.cc:260] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:45.721676 28804 raft_consensus.cc:2468] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 3.
I20260709 13:11:45.721848 28729 raft_consensus.cc:3060] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.722834 28622 leader_election.cc:304] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:45.723742 29645 raft_consensus.cc:2804] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:45.724243 29645 raft_consensus.cc:697] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 LEADER]: Becoming Leader. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
I20260709 13:11:45.725131 29645 consensus_queue.cc:237] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:45.728509 28729 raft_consensus.cc:2468] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bfd745f89b014f7b85fbf7d909fe2fb0 in term 3.
I20260709 13:11:45.734994 28478 catalog_manager.cc:5697] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 reported cstate change: term changed from 2 to 3, leader changed from a1515f1138af4333a63996f5d0864d85 (127.20.40.3) to bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2). New cstate: current_term: 3 leader_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:45.808272 29666 raft_consensus.cc:993] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85: : Instructing follower 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:45.808768 29627 raft_consensus.cc:1081] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Signalling peer 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:45.810439 29392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e29bffebb804a5bbb9935518c059b2a"
dest_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:52552
I20260709 13:11:45.811245 29392 raft_consensus.cc:493] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:45.811646 29392 raft_consensus.cc:3060] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.820977 29392 raft_consensus.cc:515] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:45.823289 29392 leader_election.cc:290] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 3 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:45.824143 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e29bffebb804a5bbb9935518c059b2a" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:45.824143 28729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e29bffebb804a5bbb9935518c059b2a" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:45.824959 28653 raft_consensus.cc:3060] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.825124 28729 raft_consensus.cc:3055] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:45.825603 28729 raft_consensus.cc:740] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:45.826303 28729 consensus_queue.cc:260] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:45.827608 28729 raft_consensus.cc:3060] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:45.830142 29605 raft_consensus.cc:993] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0: : Instructing follower a1515f1138af4333a63996f5d0864d85 to start an election
I20260709 13:11:45.830681 29645 raft_consensus.cc:1081] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Signalling peer a1515f1138af4333a63996f5d0864d85 to start an election
I20260709 13:11:45.831218 28653 raft_consensus.cc:2468] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 3.
I20260709 13:11:45.832420 29328 leader_election.cc:304] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:45.832429 28727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f52ad167603d40ada7680f844e2e59c8"
dest_uuid: "a1515f1138af4333a63996f5d0864d85"
 from {username='slave'} at 127.0.0.1:44018
I20260709 13:11:45.833182 28727 raft_consensus.cc:493] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:45.833397 29612 raft_consensus.cc:2804] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:45.833606 28727 raft_consensus.cc:3060] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.833959 29612 raft_consensus.cc:697] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 3 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:45.834957 29612 consensus_queue.cc:237] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:45.835960 28729 raft_consensus.cc:2468] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 3.
I20260709 13:11:45.843783 28727 raft_consensus.cc:515] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:45.846379 28727 leader_election.cc:290] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:45.847973 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52ad167603d40ada7680f844e2e59c8" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:45.848532 28803 raft_consensus.cc:3060] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.849777 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f52ad167603d40ada7680f844e2e59c8" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:45.850368 28653 raft_consensus.cc:3055] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:45.850620 28653 raft_consensus.cc:740] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
I20260709 13:11:45.851310 28653 consensus_queue.cc:260] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:45.852252 28653 raft_consensus.cc:3060] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.854784 28478 catalog_manager.cc:5697] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 2 to 3, leader changed from a1515f1138af4333a63996f5d0864d85 (127.20.40.3) to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 3 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:45.856151 28803 raft_consensus.cc:2468] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:45.857692 28696 leader_election.cc:304] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:45.858657 29627 raft_consensus.cc:2804] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:45.858803 28653 raft_consensus.cc:2468] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:45.859184 29627 raft_consensus.cc:697] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:45.860818 29627 consensus_queue.cc:237] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:45.873416 29679 raft_consensus.cc:993] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d: : Instructing follower 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:45.874027 29679 raft_consensus.cc:1081] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Signalling peer 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:45.876324 29392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1a388b79acd4a278496df6d65fd7a44"
dest_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:52578
I20260709 13:11:45.877015 29392 raft_consensus.cc:493] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:45.877317 29392 raft_consensus.cc:3060] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.876271 28478 catalog_manager.cc:5697] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 1 to 2, leader changed from bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2) to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 2 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:45.884505 29392 raft_consensus.cc:515] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:45.886754 29392 leader_election.cc:290] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:45.886987 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a388b79acd4a278496df6d65fd7a44" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:45.887261 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1a388b79acd4a278496df6d65fd7a44" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:45.887830 28653 raft_consensus.cc:3060] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.887830 28803 raft_consensus.cc:3055] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:45.888463 28803 raft_consensus.cc:740] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:45.889276 28803 consensus_queue.cc:260] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:45.890730 28803 raft_consensus.cc:3060] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.895360 28653 raft_consensus.cc:2468] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 2.
I20260709 13:11:45.896567 29328 leader_election.cc:304] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:45.897300 29612 raft_consensus.cc:2804] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:45.897764 28803 raft_consensus.cc:2468] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 2.
I20260709 13:11:45.897840 29612 raft_consensus.cc:697] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 2 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:45.898908 29612 consensus_queue.cc:237] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:45.909488 28478 catalog_manager.cc:5697] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 1 to 2, leader changed from b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4) to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 2 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:45.937139 29679 raft_consensus.cc:993] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d: : Instructing follower a1515f1138af4333a63996f5d0864d85 to start an election
I20260709 13:11:45.937821 29663 raft_consensus.cc:1081] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Signalling peer a1515f1138af4333a63996f5d0864d85 to start an election
I20260709 13:11:45.940727 28727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "550aaae95149430d8f95525d197894f6"
dest_uuid: "a1515f1138af4333a63996f5d0864d85"
 from {username='slave'} at 127.0.0.1:44040
I20260709 13:11:45.941352 28727 raft_consensus.cc:493] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:45.941787 28727 raft_consensus.cc:3060] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.948956 28727 raft_consensus.cc:515] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:45.951328 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550aaae95149430d8f95525d197894f6" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:45.951820 28727 leader_election.cc:290] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:45.952310 28804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550aaae95149430d8f95525d197894f6" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:45.952565 28653 raft_consensus.cc:3060] T 550aaae95149430d8f95525d197894f6 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.952941 28804 raft_consensus.cc:3055] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:45.953375 28804 raft_consensus.cc:740] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:45.954228 28804 consensus_queue.cc:260] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:45.955716 28804 raft_consensus.cc:3060] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:45.961341 28653 raft_consensus.cc:2468] T 550aaae95149430d8f95525d197894f6 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:45.962921 28804 raft_consensus.cc:2468] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:45.963049 28698 leader_election.cc:304] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:45.964102 29627 raft_consensus.cc:2804] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:45.964584 29627 raft_consensus.cc:697] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:45.965480 29627 consensus_queue.cc:237] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:45.974542 28478 catalog_manager.cc:5697] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 1 to 2, leader changed from b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4) to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 2 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:46.051045 29679 raft_consensus.cc:993] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d: : Instructing follower 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:46.051626 29663 raft_consensus.cc:1081] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 2 LEADER]: Signalling peer 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:46.053325 29392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fcf9ce9ce3ac4f848ae7f5b584711f3e"
dest_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:52578
I20260709 13:11:46.053938 29392 raft_consensus.cc:493] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:46.054263 29392 raft_consensus.cc:3060] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.059168 29392 raft_consensus.cc:515] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:46.061317 29392 leader_election.cc:290] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 3 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:46.061977 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf9ce9ce3ac4f848ae7f5b584711f3e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:46.062615 28653 raft_consensus.cc:3060] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.064957 28804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcf9ce9ce3ac4f848ae7f5b584711f3e" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:46.065598 28804 raft_consensus.cc:3055] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:46.065939 28804 raft_consensus.cc:740] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:46.066605 28804 consensus_queue.cc:260] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:46.067544 28804 raft_consensus.cc:3060] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.069413 28653 raft_consensus.cc:2468] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 3.
I20260709 13:11:46.070616 29328 leader_election.cc:304] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:46.071498 29612 raft_consensus.cc:2804] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:46.071961 29612 raft_consensus.cc:697] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 3 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:46.072814 29612 consensus_queue.cc:237] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:46.073312 28804 raft_consensus.cc:2468] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 3.
I20260709 13:11:46.083665 28478 catalog_manager.cc:5697] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 2 to 3, leader changed from b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4) to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 3 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:46.180326 28804 raft_consensus.cc:1275] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Refusing update from remote peer bfd745f89b014f7b85fbf7d909fe2fb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:46.181761 29605 consensus_queue.cc:1048] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:46.191910 28727 raft_consensus.cc:1275] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Refusing update from remote peer bfd745f89b014f7b85fbf7d909fe2fb0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:46.193503 29605 consensus_queue.cc:1048] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:46.218150 28729 raft_consensus.cc:1275] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:46.219650 29688 consensus_queue.cc:1048] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:46.234076 28653 raft_consensus.cc:1275] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:46.235500 29688 consensus_queue.cc:1048] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:46.287026 28804 raft_consensus.cc:1275] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:46.288371 29688 consensus_queue.cc:1048] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:46.298827 28653 raft_consensus.cc:1275] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:46.300235 29674 consensus_queue.cc:1048] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:46.316356 28804 raft_consensus.cc:1275] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:46.318161 29627 consensus_queue.cc:1048] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:46.335575 28657 raft_consensus.cc:1275] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:46.336975 29701 consensus_queue.cc:1048] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:11:46.465502 28803 raft_consensus.cc:1275] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:46.466674 29701 consensus_queue.cc:1048] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:46.484108 28657 raft_consensus.cc:1275] T 550aaae95149430d8f95525d197894f6 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:46.484884 28804 raft_consensus.cc:1275] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:46.485581 29627 consensus_queue.cc:1048] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:46.486325 29698 consensus_queue.cc:1048] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:46.535140 28653 raft_consensus.cc:1275] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:46.538194 29612 consensus_queue.cc:1048] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:46.604566 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:46.653460 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:46.691722 28803 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19e262f061cd4055b2b8c365deb5bf74"
dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
mode: GRACEFUL
new_leader_uuid: "a1515f1138af4333a63996f5d0864d85"
 from {username='slave'} at 127.0.0.1:39488
I20260709 13:11:46.692340 28803 raft_consensus.cc:606] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Received request to transfer leadership to TS a1515f1138af4333a63996f5d0864d85
I20260709 13:11:46.695274 28653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2988b7e9dc0942a69ce7dcb8db26ca27"
dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
mode: GRACEFUL
new_leader_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:52826
I20260709 13:11:46.695781 28653 raft_consensus.cc:606] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Received request to transfer leadership to TS 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:46.698216 28727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d860d29a21a423cbbf0d8d9480d56ef"
dest_uuid: "a1515f1138af4333a63996f5d0864d85"
mode: GRACEFUL
new_leader_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:53986
I20260709 13:11:46.698621 28727 raft_consensus.cc:606] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Received request to transfer leadership to TS 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:46.700901 28727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0b02d1b7bd040599900df6d42e82e19"
dest_uuid: "a1515f1138af4333a63996f5d0864d85"
mode: GRACEFUL
new_leader_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:53986
I20260709 13:11:46.701289 28727 raft_consensus.cc:606] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Received request to transfer leadership to TS 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:46.703497 28653 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d706fb62a0a7423ca484455f75a16592"
dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
mode: GRACEFUL
new_leader_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:52826
I20260709 13:11:46.704108 28653 raft_consensus.cc:606] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 LEADER]: Received request to transfer leadership to TS 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:46.705389 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:46.706916 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:46.757356 29655 raft_consensus.cc:993] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0: : Instructing follower 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:46.757953 29655 raft_consensus.cc:1081] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Signalling peer 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:46.763211 29392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2988b7e9dc0942a69ce7dcb8db26ca27"
dest_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:52566
I20260709 13:11:46.763769 29392 raft_consensus.cc:493] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:46.764117 29392 raft_consensus.cc:3060] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.772030 29392 raft_consensus.cc:515] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:46.775058 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2988b7e9dc0942a69ce7dcb8db26ca27" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:46.775664 28657 raft_consensus.cc:3055] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:46.775933 28657 raft_consensus.cc:740] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
I20260709 13:11:46.776538 29392 leader_election.cc:290] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:46.776686 28657 consensus_queue.cc:260] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:46.777911 28657 raft_consensus.cc:3060] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.778844 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2988b7e9dc0942a69ce7dcb8db26ca27" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:46.779394 28803 raft_consensus.cc:3060] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:46.781040 29701 raft_consensus.cc:993] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85: : Instructing follower 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:46.781524 29627 raft_consensus.cc:1081] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Signalling peer 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:46.783483 29392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0b02d1b7bd040599900df6d42e82e19"
dest_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:52552
I20260709 13:11:46.783978 29392 raft_consensus.cc:493] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:46.784303 29392 raft_consensus.cc:3060] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.786213 28657 raft_consensus.cc:2468] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 2.
I20260709 13:11:46.786270 28803 raft_consensus.cc:2468] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 2.
I20260709 13:11:46.787770 29326 leader_election.cc:304] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:46.788532 29698 raft_consensus.cc:2804] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:46.788995 29698 raft_consensus.cc:697] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [term 2 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:46.789844 29698 consensus_queue.cc:237] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:46.790310 29392 raft_consensus.cc:515] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:46.791806 29392 leader_election.cc:290] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 3 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:46.792665 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b02d1b7bd040599900df6d42e82e19" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:46.792932 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b02d1b7bd040599900df6d42e82e19" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:46.793227 28657 raft_consensus.cc:3060] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.793463 28727 raft_consensus.cc:3055] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:46.793787 28727 raft_consensus.cc:740] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:46.794531 28727 consensus_queue.cc:260] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:46.795754 28727 raft_consensus.cc:3060] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.800123 28657 raft_consensus.cc:2468] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 3.
I20260709 13:11:46.802320 29328 leader_election.cc:304] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0; no voters: 
I20260709 13:11:46.801651 28477 catalog_manager.cc:5697] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 1 to 2, leader changed from bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2) to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 2 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:46.803429 29688 raft_consensus.cc:2804] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:46.803910 29688 raft_consensus.cc:697] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 3 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:46.804762 29688 consensus_queue.cc:237] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:46.806651 28727 raft_consensus.cc:2468] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 3.
I20260709 13:11:46.828780 29655 raft_consensus.cc:993] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0: : Instructing follower 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:46.829336 29712 raft_consensus.cc:1081] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 LEADER]: Signalling peer 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:46.831558 29392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d706fb62a0a7423ca484455f75a16592"
dest_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:52566
I20260709 13:11:46.832029 29392 raft_consensus.cc:493] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:46.832325 29392 raft_consensus.cc:3060] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.838449 29392 raft_consensus.cc:515] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:46.838502 28477 catalog_manager.cc:5697] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 2 to 3, leader changed from a1515f1138af4333a63996f5d0864d85 (127.20.40.3) to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 3 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:46.841277 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706fb62a0a7423ca484455f75a16592" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:46.841864 28803 raft_consensus.cc:3060] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.848501 28803 raft_consensus.cc:2468] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 3.
I20260709 13:11:46.849740 29326 leader_election.cc:304] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:46.849961 29392 leader_election.cc:290] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 3 election: Requested vote from peers b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:46.850586 29688 raft_consensus.cc:2804] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:46.850469 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d706fb62a0a7423ca484455f75a16592" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:46.851186 29688 raft_consensus.cc:697] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 3 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:46.851233 28653 raft_consensus.cc:3055] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:46.851722 28653 raft_consensus.cc:740] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bfd745f89b014f7b85fbf7d909fe2fb0, State: Running, Role: LEADER
I20260709 13:11:46.852283 29688 consensus_queue.cc:237] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:46.852521 28653 consensus_queue.cc:260] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:46.853596 28653 raft_consensus.cc:3060] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:46.860710 28653 raft_consensus.cc:2468] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 3.
I20260709 13:11:46.864065 28477 catalog_manager.cc:5697] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 2 to 3, leader changed from bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2) to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 3 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:47.001600 29663 raft_consensus.cc:993] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d: : Instructing follower a1515f1138af4333a63996f5d0864d85 to start an election
I20260709 13:11:47.002195 29679 raft_consensus.cc:1081] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Signalling peer a1515f1138af4333a63996f5d0864d85 to start an election
I20260709 13:11:47.003675 28727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19e262f061cd4055b2b8c365deb5bf74"
dest_uuid: "a1515f1138af4333a63996f5d0864d85"
 from {username='slave'} at 127.0.0.1:44040
I20260709 13:11:47.004129 28727 raft_consensus.cc:493] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:47.004384 28727 raft_consensus.cc:3060] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.009852 28727 raft_consensus.cc:515] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:47.011471 28727 leader_election.cc:290] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:47.012252 28653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e262f061cd4055b2b8c365deb5bf74" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:47.012457 28803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e262f061cd4055b2b8c365deb5bf74" candidate_uuid: "a1515f1138af4333a63996f5d0864d85" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:47.012955 28653 raft_consensus.cc:3060] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.013074 28803 raft_consensus.cc:3055] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:47.013499 28803 raft_consensus.cc:740] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8d512840fb74aaf82ac80c433d8dc2d, State: Running, Role: LEADER
I20260709 13:11:47.014230 28803 consensus_queue.cc:260] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:47.015324 28803 raft_consensus.cc:3060] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.022794 28803 raft_consensus.cc:2468] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:47.023125 28653 raft_consensus.cc:2468] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1515f1138af4333a63996f5d0864d85 in term 2.
I20260709 13:11:47.023808 28696 leader_election.cc:304] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1515f1138af4333a63996f5d0864d85, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:47.024606 29666 raft_consensus.cc:2804] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:47.025120 29666 raft_consensus.cc:697] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Leader. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:47.025981 29666 consensus_queue.cc:237] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } }
I20260709 13:11:47.039121 28477 catalog_manager.cc:5697] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 reported cstate change: term changed from 1 to 2, leader changed from b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4) to a1515f1138af4333a63996f5d0864d85 (127.20.40.3). New cstate: current_term: 2 leader_uuid: "a1515f1138af4333a63996f5d0864d85" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:47.134972 29701 raft_consensus.cc:993] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85: : Instructing follower 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:47.135442 29627 raft_consensus.cc:1081] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Signalling peer 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:47.136663 29392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d860d29a21a423cbbf0d8d9480d56ef"
dest_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:52552
I20260709 13:11:47.137137 29392 raft_consensus.cc:493] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:47.137454 29392 raft_consensus.cc:3060] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.143054 29392 raft_consensus.cc:515] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:47.144783 29392 leader_election.cc:290] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 election: Requested vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), b8d512840fb74aaf82ac80c433d8dc2d (127.20.40.4:43597)
I20260709 13:11:47.145578 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d860d29a21a423cbbf0d8d9480d56ef" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:47.145959 28804 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d860d29a21a423cbbf0d8d9480d56ef" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8d512840fb74aaf82ac80c433d8dc2d"
I20260709 13:11:47.146134 28727 raft_consensus.cc:3055] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:11:47.146502 28727 raft_consensus.cc:740] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:47.146556 28804 raft_consensus.cc:3060] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.147197 28727 consensus_queue.cc:260] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:47.148121 28727 raft_consensus.cc:3060] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:47.151435 28804 raft_consensus.cc:2468] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 2.
I20260709 13:11:47.152657 28727 raft_consensus.cc:2468] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 2.
I20260709 13:11:47.152582 29326 leader_election.cc:304] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, b8d512840fb74aaf82ac80c433d8dc2d; no voters: 
I20260709 13:11:47.153997 29688 raft_consensus.cc:2804] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:47.154507 29688 raft_consensus.cc:697] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [term 2 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:47.155402 29688 consensus_queue.cc:237] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:47.165480 28478 catalog_manager.cc:5697] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 1 to 2, leader changed from a1515f1138af4333a63996f5d0864d85 (127.20.40.3) to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 2 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.213204 28727 raft_consensus.cc:1275] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:47.214356 29688 consensus_queue.cc:1048] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:47.227695 28653 raft_consensus.cc:1275] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:47.229414 29688 consensus_queue.cc:1048] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:47.232160 28804 raft_consensus.cc:1275] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:47.237577 29612 consensus_queue.cc:1048] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:47.257920 28653 raft_consensus.cc:1275] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:47.266248 29688 consensus_queue.cc:1048] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:47.279666 28804 raft_consensus.cc:1275] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:47.284649 29688 consensus_queue.cc:1048] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:47.298514 28653 raft_consensus.cc:1275] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:47.300860 29688 consensus_queue.cc:1048] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:47.467998 28653 raft_consensus.cc:1275] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:47.469295 29627 consensus_queue.cc:1048] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:47.484998 28803 raft_consensus.cc:1275] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Refusing update from remote peer a1515f1138af4333a63996f5d0864d85: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:47.486943 29627 consensus_queue.cc:1048] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:47.572541 28804 raft_consensus.cc:1275] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:47.573858 29725 consensus_queue.cc:1048] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:47.587241 28727 raft_consensus.cc:1275] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:47.589125 29612 consensus_queue.cc:1048] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:47.707816 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:47.758443 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:47.795534 28727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "217202c939974f80b0c84019f3acfcaf"
dest_uuid: "a1515f1138af4333a63996f5d0864d85"
mode: GRACEFUL
new_leader_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:53986
I20260709 13:11:47.796159 28727 raft_consensus.cc:606] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Received request to transfer leadership to TS 44a14c00fc3d41bea8db00310408905a
I20260709 13:11:47.797343 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:11:47.798645 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:48.063130 29716 raft_consensus.cc:993] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85: : Instructing follower 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:48.063629 29627 raft_consensus.cc:1081] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Signalling peer 44a14c00fc3d41bea8db00310408905a to start an election
I20260709 13:11:48.064965 29392 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "217202c939974f80b0c84019f3acfcaf"
dest_uuid: "44a14c00fc3d41bea8db00310408905a"
 from {username='slave'} at 127.0.0.1:52552
I20260709 13:11:48.065388 29392 raft_consensus.cc:493] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:48.065747 29392 raft_consensus.cc:3060] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:48.071362 29392 raft_consensus.cc:515] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:48.073104 29392 leader_election.cc:290] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 3 election: Requested vote from peers bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021), a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711)
I20260709 13:11:48.074024 28727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217202c939974f80b0c84019f3acfcaf" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1515f1138af4333a63996f5d0864d85"
I20260709 13:11:48.073896 28657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "217202c939974f80b0c84019f3acfcaf" candidate_uuid: "44a14c00fc3d41bea8db00310408905a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0"
I20260709 13:11:48.074579 28727 raft_consensus.cc:3055] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:48.074632 28657 raft_consensus.cc:3060] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:48.075014 28727 raft_consensus.cc:740] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1515f1138af4333a63996f5d0864d85, State: Running, Role: LEADER
I20260709 13:11:48.075685 28727 consensus_queue.cc:260] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:48.076542 28727 raft_consensus.cc:3060] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:48.082605 28727 raft_consensus.cc:2468] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 3.
I20260709 13:11:48.083552 29326 leader_election.cc:304] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85; no voters: 
I20260709 13:11:48.083894 28657 raft_consensus.cc:2468] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 44a14c00fc3d41bea8db00310408905a in term 3.
I20260709 13:11:48.084249 29688 raft_consensus.cc:2804] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:48.084821 29688 raft_consensus.cc:697] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 3 LEADER]: Becoming Leader. State: Replica: 44a14c00fc3d41bea8db00310408905a, State: Running, Role: LEADER
I20260709 13:11:48.085801 29688 consensus_queue.cc:237] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } }
I20260709 13:11:48.099282 28477 catalog_manager.cc:5697] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a reported cstate change: term changed from 2 to 3, leader changed from a1515f1138af4333a63996f5d0864d85 (127.20.40.3) to 44a14c00fc3d41bea8db00310408905a (127.20.40.1). New cstate: current_term: 3 leader_uuid: "44a14c00fc3d41bea8db00310408905a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:48.569103 28657 raft_consensus.cc:1275] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:48.570295 29612 consensus_queue.cc:1048] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:48.573583 28727 raft_consensus.cc:1275] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Refusing update from remote peer 44a14c00fc3d41bea8db00310408905a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:48.575469 29688 consensus_queue.cc:1048] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:48.799485 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:48.837086 20640 tablet_server.cc:179] TabletServer@127.20.40.1:44075 shutting down...
W20260709 13:11:48.854010 28622 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 246 similar messages]
W20260709 13:11:48.860363 28622 consensus_peers.cc:597] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:48.875556 28770 consensus_peers.cc:597] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:48.876238 28696 consensus_peers.cc:597] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:48.877254 28770 consensus_peers.cc:597] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:48.878602 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:48.879667 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.881110 20640 raft_consensus.cc:2243] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.881954 20640 raft_consensus.cc:2272] T 4d860d29a21a423cbbf0d8d9480d56ef P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.884033 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.884931 20640 raft_consensus.cc:2243] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.885413 20640 raft_consensus.cc:2272] T 0ed785ccac6a425f83665ef8e365bfc1 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.888280 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.888973 20640 raft_consensus.cc:2243] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.889496 20640 raft_consensus.cc:2272] T 5ff91a748d3f464ab00fc3e657057d73 P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.892364 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.893236 20640 raft_consensus.cc:2243] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.893843 20640 raft_consensus.cc:2272] T e876ee31f15e4349b3086338a4d5f288 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.896291 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.896886 20640 raft_consensus.cc:2243] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.897289 20640 raft_consensus.cc:2272] T b939cf3aa04842b1adacdee8818495fd P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.899829 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.900480 20640 raft_consensus.cc:2243] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.901299 20640 raft_consensus.cc:2272] T 2988b7e9dc0942a69ce7dcb8db26ca27 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.903563 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.904155 20640 raft_consensus.cc:2243] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.904584 20640 raft_consensus.cc:2272] T cf7befe583fe4534bdd8e703ee341d3e P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.907213 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.908070 20640 raft_consensus.cc:2243] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.908571 20640 raft_consensus.cc:2272] T 1e4d79b8251f445ba4ee93c33bb13df3 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.911765 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.912398 20640 raft_consensus.cc:2243] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.913204 20640 raft_consensus.cc:2272] T 57c146089a3249eea0254717e75c14c8 P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.915305 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.916128 20640 raft_consensus.cc:2243] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.916955 20640 raft_consensus.cc:2272] T 2ee04ccf18954bae9d40f7a5c460f71b P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:48.919006 28696 consensus_peers.cc:597] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:48.919626 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.920419 20640 raft_consensus.cc:2243] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.920945 20640 raft_consensus.cc:2272] T eb534ab2fc824a7abb24883eb39d17dc P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.923975 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.924777 20640 raft_consensus.cc:2243] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.925295 20640 raft_consensus.cc:2272] T 0d12b4ce21794192969d6609d0ea4d69 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:48.926168 28770 consensus_peers.cc:597] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:48.928009 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.928954 20640 raft_consensus.cc:2243] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.929517 20640 raft_consensus.cc:2272] T 857ee7ea2ffe41cf9ed43a455e52901f P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.932294 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.933079 20640 raft_consensus.cc:2243] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.934000 20640 raft_consensus.cc:2272] T 217202c939974f80b0c84019f3acfcaf P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.936986 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.937832 20640 raft_consensus.cc:2243] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.938347 20640 raft_consensus.cc:2272] T 9a4abbb5e8f04c8388c1642217e7dbcb P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.940750 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.941597 20640 raft_consensus.cc:2243] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.942028 20640 raft_consensus.cc:2272] T b07d8385470b4fc285eb6703e6fa42b9 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.944334 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.944869 20640 raft_consensus.cc:2243] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.945297 20640 raft_consensus.cc:2272] T f828b4ae5c2846c5a49f1212f73186f0 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.947711 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.948391 20640 raft_consensus.cc:2243] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.949193 20640 raft_consensus.cc:2272] T a0b02d1b7bd040599900df6d42e82e19 P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.951200 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.951704 20640 raft_consensus.cc:2243] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.952119 20640 raft_consensus.cc:2272] T d1f041b85d184414b3939425b35e4a1c P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.953956 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.954532 20640 raft_consensus.cc:2243] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.955304 20640 raft_consensus.cc:2272] T c0093a1dad264ec1b3d9d3f896262ff7 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.957376 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.957962 20640 raft_consensus.cc:2243] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.958663 20640 raft_consensus.cc:2272] T 8e29bffebb804a5bbb9935518c059b2a P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:48.958768 28770 consensus_peers.cc:597] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:48.961021 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.961910 20640 raft_consensus.cc:2243] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.962370 20640 raft_consensus.cc:2272] T 586415758fd245b49bd0a4e20a2b11d8 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.964680 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.965274 20640 raft_consensus.cc:2243] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.966018 20640 raft_consensus.cc:2272] T 8bb1e7780b6c42649546108a0bd97d7a P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.968104 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.968803 20640 raft_consensus.cc:2243] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.969688 20640 raft_consensus.cc:2272] T 19240a871550411aafbc885984ade97d P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.972092 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.972661 20640 raft_consensus.cc:2243] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.973044 20640 raft_consensus.cc:2272] T 59ba7b5c67b14fcba09e4e6cd16fa09b P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.975085 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.975644 20640 raft_consensus.cc:2243] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.976083 20640 raft_consensus.cc:2272] T d40bb461a5034123ab09d156bd22ebbf P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.978323 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.978899 20640 raft_consensus.cc:2243] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.979301 20640 raft_consensus.cc:2272] T 45c6993be42044c3b7dbb095971f7c88 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.981213 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.981840 20640 raft_consensus.cc:2243] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.982241 20640 raft_consensus.cc:2272] T 452914c1abfd43389431daaf7ebee1c0 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.984225 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.984761 20640 raft_consensus.cc:2243] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.985198 20640 raft_consensus.cc:2272] T 7c7ab1eff7a5409cb84e6bb33393456e P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.987223 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.987777 20640 raft_consensus.cc:2243] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.988425 20640 raft_consensus.cc:2272] T 66bc5681208146d19bff2322d4c254dd P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.990796 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.991384 20640 raft_consensus.cc:2243] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.991853 20640 raft_consensus.cc:2272] T 12cea3a9ab394674a67119867b34ce5a P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.994343 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.995020 20640 raft_consensus.cc:2243] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:48.996177 20640 raft_consensus.cc:2272] T fcf9ce9ce3ac4f848ae7f5b584711f3e P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:48.998674 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:48.999238 20640 raft_consensus.cc:2243] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:48.999784 20640 raft_consensus.cc:2272] T 659cd3cf76964c27b1dfdccebc357594 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.001960 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:49.002493 20640 raft_consensus.cc:2243] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.003376 20640 raft_consensus.cc:2272] T b1a388b79acd4a278496df6d65fd7a44 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.005802 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:49.006469 20640 raft_consensus.cc:2243] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.006942 20640 raft_consensus.cc:2272] T 47110731ce12413ab60b16f034fdceb3 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.009151 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:49.009717 20640 raft_consensus.cc:2243] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.010190 20640 raft_consensus.cc:2272] T a1185c8b14ea4fd88ccfccb31e19dfd8 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.012076 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:49.012523 20640 raft_consensus.cc:2243] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.012856 20640 raft_consensus.cc:2272] T a726976321d04177a6d77e9ef0041f3f P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.014851 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:49.015379 20640 raft_consensus.cc:2243] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.015797 20640 raft_consensus.cc:2272] T 34233c4c336b444996374b970ddd2822 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.018110 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:49.018826 20640 raft_consensus.cc:2243] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.019273 20640 raft_consensus.cc:2272] T 28856e9437484cbdae4f48bf4ca6aaa1 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.020730 28770 consensus_peers.cc:597] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.021852 20640 tablet_replica.cc:333] stopping tablet replica
W20260709 13:11:49.022466 28622 consensus_peers.cc:597] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.022668 20640 raft_consensus.cc:2243] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.023200 20640 raft_consensus.cc:2272] T 9519acd190ba4590a2eaa1fcb1e9a60f P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.025475 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:49.026027 20640 raft_consensus.cc:2243] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.026862 20640 raft_consensus.cc:2272] T d706fb62a0a7423ca484455f75a16592 P 44a14c00fc3d41bea8db00310408905a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.029246 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:49.029772 20640 raft_consensus.cc:2243] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.030323 20640 raft_consensus.cc:2272] T bb853da5b7ff48d9a188d40610160f6c P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.032436 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:49.032994 20640 raft_consensus.cc:2243] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.033450 20640 raft_consensus.cc:2272] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P 44a14c00fc3d41bea8db00310408905a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.035821 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:49.036350 20640 raft_consensus.cc:2243] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.037547 20640 raft_consensus.cc:2272] T 51806e14724e4433b368faa0c997a11e P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.040409 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:11:49.041008 20640 raft_consensus.cc:2243] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.041565 20640 raft_consensus.cc:2272] T f5d51007007a4252908beaaaa3ee8374 P 44a14c00fc3d41bea8db00310408905a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.063643 28696 consensus_peers.cc:597] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.105587 28770 consensus_peers.cc:597] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.108973 28622 consensus_peers.cc:597] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.112732 28770 consensus_peers.cc:597] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.117547 20640 tablet_server.cc:196] TabletServer@127.20.40.1:44075 shutdown complete.
W20260709 13:11:49.122892 28696 consensus_peers.cc:597] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.131011 28770 consensus_peers.cc:597] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.143687 28770 consensus_peers.cc:597] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.173810 28770 consensus_peers.cc:597] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.174628 28622 consensus_peers.cc:597] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.195596 28622 consensus_peers.cc:597] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.204720 20640 tablet_server.cc:179] TabletServer@127.20.40.2:0 shutting down...
W20260709 13:11:49.208989 28622 consensus_peers.cc:597] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.220520 28696 consensus_peers.cc:597] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.221218 28696 consensus_peers.cc:597] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.224090 28696 consensus_peers.cc:597] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.228603 28770 consensus_peers.cc:597] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.231029 28772 consensus_peers.cc:597] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Couldn't send request to peer bfd745f89b014f7b85fbf7d909fe2fb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.234081 28770 consensus_peers.cc:597] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.233601 28772 consensus_peers.cc:597] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Couldn't send request to peer bfd745f89b014f7b85fbf7d909fe2fb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.237811 28698 consensus_peers.cc:597] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 -> Peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Couldn't send request to peer bfd745f89b014f7b85fbf7d909fe2fb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.256436 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:49.257489 20640 tablet_replica.cc:333] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.258417 20640 raft_consensus.cc:2243] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.259045 20640 raft_consensus.cc:2272] T a0b02d1b7bd040599900df6d42e82e19 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.261986 28772 consensus_peers.cc:597] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Couldn't send request to peer bfd745f89b014f7b85fbf7d909fe2fb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.262308 20640 tablet_replica.cc:333] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.263227 20640 raft_consensus.cc:2243] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.263764 20640 raft_consensus.cc:2272] T a1185c8b14ea4fd88ccfccb31e19dfd8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.264447 28698 consensus_peers.cc:597] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 -> Peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Couldn't send request to peer bfd745f89b014f7b85fbf7d909fe2fb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.266510 20640 tablet_replica.cc:333] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.267362 20640 raft_consensus.cc:2243] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.267939 20640 raft_consensus.cc:2272] T b1a388b79acd4a278496df6d65fd7a44 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.269204 28622 consensus_peers.cc:597] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.270424 20640 tablet_replica.cc:333] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.270998 20640 raft_consensus.cc:2243] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.271724 20640 raft_consensus.cc:2272] T 28856e9437484cbdae4f48bf4ca6aaa1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.274303 20640 tablet_replica.cc:333] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.275172 20640 raft_consensus.cc:2243] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.275727 20640 raft_consensus.cc:2272] T 92fb36508a8840ea8e84f00da15700a1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.278538 20640 tablet_replica.cc:333] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.279388 20640 raft_consensus.cc:2243] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.279826 20640 raft_consensus.cc:2272] T 0ed785ccac6a425f83665ef8e365bfc1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.281890 20640 tablet_replica.cc:333] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.282572 20640 raft_consensus.cc:2243] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.283447 20640 raft_consensus.cc:2272] T b939cf3aa04842b1adacdee8818495fd P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.285531 20640 tablet_replica.cc:333] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.286089 20640 raft_consensus.cc:2243] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.286657 20640 raft_consensus.cc:2272] T 19e262f061cd4055b2b8c365deb5bf74 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.287823 28696 consensus_peers.cc:597] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.288551 20640 tablet_replica.cc:333] T 550aaae95149430d8f95525d197894f6 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.289355 20640 raft_consensus.cc:2243] T 550aaae95149430d8f95525d197894f6 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.289829 20640 raft_consensus.cc:2272] T 550aaae95149430d8f95525d197894f6 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.292018 20640 tablet_replica.cc:333] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.292554 20640 raft_consensus.cc:2243] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.292908 20640 raft_consensus.cc:2272] T 5e2ea288ac6c435eb4e1fd15b459a3ff P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.294888 20640 tablet_replica.cc:333] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.295454 20640 raft_consensus.cc:2243] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.295931 20640 raft_consensus.cc:2272] T d40bb461a5034123ab09d156bd22ebbf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.297865 20640 tablet_replica.cc:333] T cf7befe583fe4534bdd8e703ee341d3e P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.298432 20640 raft_consensus.cc:2243] T cf7befe583fe4534bdd8e703ee341d3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.298862 20640 raft_consensus.cc:2272] T cf7befe583fe4534bdd8e703ee341d3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.300640 20640 tablet_replica.cc:333] T 1e4d79b8251f445ba4ee93c33bb13df3 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.301209 20640 raft_consensus.cc:2243] T 1e4d79b8251f445ba4ee93c33bb13df3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.301671 20640 raft_consensus.cc:2272] T 1e4d79b8251f445ba4ee93c33bb13df3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.303638 20640 tablet_replica.cc:333] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.304181 20640 raft_consensus.cc:2243] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.304636 20640 raft_consensus.cc:2272] T 217202c939974f80b0c84019f3acfcaf P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.307224 20640 tablet_replica.cc:333] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.307859 20640 raft_consensus.cc:2243] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.308269 20640 raft_consensus.cc:2272] T 46835248ab9d4f43908a6c6a42642ba1 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.310297 20640 tablet_replica.cc:333] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.310851 20640 raft_consensus.cc:2243] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.311811 20640 raft_consensus.cc:2272] T a726976321d04177a6d77e9ef0041f3f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.314407 20640 tablet_replica.cc:333] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.315133 20640 raft_consensus.cc:2243] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.315742 20640 raft_consensus.cc:2272] T fcf9ce9ce3ac4f848ae7f5b584711f3e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.316473 28622 consensus_peers.cc:597] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.317819 28698 consensus_peers.cc:597] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 -> Peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Couldn't send request to peer bfd745f89b014f7b85fbf7d909fe2fb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.318236 20640 tablet_replica.cc:333] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.318881 20640 raft_consensus.cc:2243] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.319651 20640 raft_consensus.cc:2272] T 452914c1abfd43389431daaf7ebee1c0 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.321729 20640 tablet_replica.cc:333] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.322336 20640 raft_consensus.cc:2243] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.323117 20640 raft_consensus.cc:2272] T 47110731ce12413ab60b16f034fdceb3 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.325096 20640 tablet_replica.cc:333] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.325749 20640 raft_consensus.cc:2243] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.326679 20640 raft_consensus.cc:2272] T 586415758fd245b49bd0a4e20a2b11d8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.328785 20640 tablet_replica.cc:333] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.329571 20640 raft_consensus.cc:2243] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.330583 20640 raft_consensus.cc:2272] T 59ba7b5c67b14fcba09e4e6cd16fa09b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.333501 20640 tablet_replica.cc:333] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.334362 20640 raft_consensus.cc:2243] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.335398 20640 raft_consensus.cc:2272] T 841b18d7f11c485bba96eda7dce0c27e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.336440 28698 consensus_peers.cc:597] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 -> Peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Couldn't send request to peer bfd745f89b014f7b85fbf7d909fe2fb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.337503 28770 consensus_peers.cc:597] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Couldn't send request to peer 44a14c00fc3d41bea8db00310408905a. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.338323 20640 tablet_replica.cc:333] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.339123 20640 raft_consensus.cc:2243] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.339928 20640 raft_consensus.cc:2272] T f5d51007007a4252908beaaaa3ee8374 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.342090 20640 tablet_replica.cc:333] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.342944 20640 raft_consensus.cc:2243] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.343458 20640 raft_consensus.cc:2272] T 0d12b4ce21794192969d6609d0ea4d69 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.345667 20640 tablet_replica.cc:333] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
W20260709 13:11:49.345948 28698 consensus_peers.cc:597] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 -> Peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Couldn't send request to peer bfd745f89b014f7b85fbf7d909fe2fb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.346187 20640 raft_consensus.cc:2243] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.347023 20640 raft_consensus.cc:2272] T 2b32b6e56ce549b98fca9ad5f3798f2b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.348853 20640 tablet_replica.cc:333] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.349390 20640 raft_consensus.cc:2243] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.350150 20640 raft_consensus.cc:2272] T e876ee31f15e4349b3086338a4d5f288 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.352455 20640 tablet_replica.cc:333] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.353217 20640 raft_consensus.cc:2243] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.353744 20640 raft_consensus.cc:2272] T b572160c667242bfbd4ece3e3f26f505 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.354265 28772 consensus_peers.cc:597] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d -> Peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Couldn't send request to peer bfd745f89b014f7b85fbf7d909fe2fb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.356297 20640 tablet_replica.cc:333] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.357010 20640 raft_consensus.cc:2243] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.357496 20640 raft_consensus.cc:2272] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.360244 20640 tablet_replica.cc:333] T 51806e14724e4433b368faa0c997a11e P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.361039 20640 raft_consensus.cc:2243] T 51806e14724e4433b368faa0c997a11e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.361542 20640 raft_consensus.cc:2272] T 51806e14724e4433b368faa0c997a11e P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.364207 20640 tablet_replica.cc:333] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.364863 20640 raft_consensus.cc:2243] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.366021 20640 raft_consensus.cc:2272] T 34233c4c336b444996374b970ddd2822 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.368525 20640 tablet_replica.cc:333] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.369236 20640 raft_consensus.cc:2243] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.370147 20640 raft_consensus.cc:2272] T 6ea260fc2f384cd7a7f947d2bf8cb49b P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.372030 20640 tablet_replica.cc:333] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.372473 20640 raft_consensus.cc:2243] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.372890 20640 raft_consensus.cc:2272] T 857ee7ea2ffe41cf9ed43a455e52901f P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.375118 20640 tablet_replica.cc:333] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.375721 20640 raft_consensus.cc:2243] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.376528 20640 raft_consensus.cc:2272] T 47ba06e13a9740d9b4ba185990852ada P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.378664 20640 tablet_replica.cc:333] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.379233 20640 raft_consensus.cc:2243] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.379710 20640 raft_consensus.cc:2272] T c0093a1dad264ec1b3d9d3f896262ff7 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.381804 20640 tablet_replica.cc:333] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.382555 20640 raft_consensus.cc:2243] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.383108 20640 raft_consensus.cc:2272] T bb853da5b7ff48d9a188d40610160f6c P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.385962 20640 tablet_replica.cc:333] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.386765 20640 raft_consensus.cc:2243] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.387323 20640 raft_consensus.cc:2272] T d706fb62a0a7423ca484455f75a16592 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.389879 20640 tablet_replica.cc:333] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.390651 20640 raft_consensus.cc:2243] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.391650 20640 raft_consensus.cc:2272] T ce8eab4cd5b64393b62a304011e5b22d P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.393947 20640 tablet_replica.cc:333] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.394518 20640 raft_consensus.cc:2243] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.395031 20640 raft_consensus.cc:2272] T 5ff91a748d3f464ab00fc3e657057d73 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.396987 20640 tablet_replica.cc:333] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.397611 20640 raft_consensus.cc:2243] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.398074 20640 raft_consensus.cc:2272] T b07d8385470b4fc285eb6703e6fa42b9 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.400146 20640 tablet_replica.cc:333] T d69a0e6ca32e4d8080aed2fe4405d7f5 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.400647 20640 raft_consensus.cc:2243] T d69a0e6ca32e4d8080aed2fe4405d7f5 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.401042 20640 raft_consensus.cc:2272] T d69a0e6ca32e4d8080aed2fe4405d7f5 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.403148 20640 tablet_replica.cc:333] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.403720 20640 raft_consensus.cc:2243] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.404139 20640 raft_consensus.cc:2272] T f52ad167603d40ada7680f844e2e59c8 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.406330 20640 tablet_replica.cc:333] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.406778 20640 raft_consensus.cc:2243] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.407140 20640 raft_consensus.cc:2272] T 2988b7e9dc0942a69ce7dcb8db26ca27 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.409315 20640 tablet_replica.cc:333] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.409849 20640 raft_consensus.cc:2243] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.410311 20640 raft_consensus.cc:2272] T 8e29bffebb804a5bbb9935518c059b2a P bfd745f89b014f7b85fbf7d909fe2fb0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.411986 20640 tablet_replica.cc:333] T 5951a1590104426cae727db543f49a83 P bfd745f89b014f7b85fbf7d909fe2fb0: stopping tablet replica
I20260709 13:11:49.412524 20640 raft_consensus.cc:2243] T 5951a1590104426cae727db543f49a83 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.412931 20640 raft_consensus.cc:2272] T 5951a1590104426cae727db543f49a83 P bfd745f89b014f7b85fbf7d909fe2fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.450229 28772 consensus_peers.cc:597] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Couldn't send request to peer bfd745f89b014f7b85fbf7d909fe2fb0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.491842 20640 tablet_server.cc:196] TabletServer@127.20.40.2:0 shutdown complete.
W20260709 13:11:49.507965 28698 consensus_peers.cc:597] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 -> Peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Couldn't send request to peer bfd745f89b014f7b85fbf7d909fe2fb0. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:43021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.510823 28698 consensus_peers.cc:597] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 -> Peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Couldn't send request to peer bfd745f89b014f7b85fbf7d909fe2fb0. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:43021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.511571 28772 consensus_peers.cc:597] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Couldn't send request to peer bfd745f89b014f7b85fbf7d909fe2fb0. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:43021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.535085 28698 consensus_peers.cc:597] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 -> Peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Couldn't send request to peer bfd745f89b014f7b85fbf7d909fe2fb0. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:43021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.569998 28698 consensus_peers.cc:597] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 -> Peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Couldn't send request to peer bfd745f89b014f7b85fbf7d909fe2fb0. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:43021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.578562 20640 tablet_server.cc:179] TabletServer@127.20.40.3:0 shutting down...
I20260709 13:11:49.637146 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:49.638067 20640 tablet_replica.cc:333] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.638911 20640 raft_consensus.cc:2243] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.639410 20640 raft_consensus.cc:2272] T a0b02d1b7bd040599900df6d42e82e19 P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.642046 20640 tablet_replica.cc:333] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.642815 20640 raft_consensus.cc:2243] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.643798 20640 raft_consensus.cc:2272] T bb853da5b7ff48d9a188d40610160f6c P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.646148 20640 tablet_replica.cc:333] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.646896 20640 raft_consensus.cc:2243] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.647351 20640 raft_consensus.cc:2272] T 66bc5681208146d19bff2322d4c254dd P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.649919 20640 tablet_replica.cc:333] T 92fb36508a8840ea8e84f00da15700a1 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.650640 20640 raft_consensus.cc:2243] T 92fb36508a8840ea8e84f00da15700a1 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.651213 20640 raft_consensus.cc:2272] T 92fb36508a8840ea8e84f00da15700a1 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.653769 20640 tablet_replica.cc:333] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.654559 20640 raft_consensus.cc:2243] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.655826 20640 raft_consensus.cc:2272] T 0ed785ccac6a425f83665ef8e365bfc1 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.657792 20640 tablet_replica.cc:333] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.658357 20640 raft_consensus.cc:2243] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.658776 20640 raft_consensus.cc:2272] T 9519acd190ba4590a2eaa1fcb1e9a60f P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.660701 20640 tablet_replica.cc:333] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.661242 20640 raft_consensus.cc:2243] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.661969 20640 raft_consensus.cc:2272] T 19e262f061cd4055b2b8c365deb5bf74 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.663856 20640 tablet_replica.cc:333] T 12cea3a9ab394674a67119867b34ce5a P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.664443 20640 raft_consensus.cc:2243] T 12cea3a9ab394674a67119867b34ce5a P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.664893 20640 raft_consensus.cc:2272] T 12cea3a9ab394674a67119867b34ce5a P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.666887 20640 tablet_replica.cc:333] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.667448 20640 raft_consensus.cc:2243] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.668213 20640 raft_consensus.cc:2272] T 550aaae95149430d8f95525d197894f6 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.670395 20640 tablet_replica.cc:333] T 9a4abbb5e8f04c8388c1642217e7dbcb P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.670951 20640 raft_consensus.cc:2243] T 9a4abbb5e8f04c8388c1642217e7dbcb P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.671361 20640 raft_consensus.cc:2272] T 9a4abbb5e8f04c8388c1642217e7dbcb P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.673208 20640 tablet_replica.cc:333] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.673842 20640 raft_consensus.cc:2243] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.674631 20640 raft_consensus.cc:2272] T 5e2ea288ac6c435eb4e1fd15b459a3ff P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.676515 20640 tablet_replica.cc:333] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.677048 20640 raft_consensus.cc:2243] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.677477 20640 raft_consensus.cc:2272] T 47110731ce12413ab60b16f034fdceb3 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.679951 20640 tablet_replica.cc:333] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.680578 20640 raft_consensus.cc:2243] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.681030 20640 raft_consensus.cc:2272] T 217202c939974f80b0c84019f3acfcaf P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.683605 20640 tablet_replica.cc:333] T 46835248ab9d4f43908a6c6a42642ba1 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.684122 20640 raft_consensus.cc:2243] T 46835248ab9d4f43908a6c6a42642ba1 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.684517 20640 raft_consensus.cc:2272] T 46835248ab9d4f43908a6c6a42642ba1 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.686606 20640 tablet_replica.cc:333] T 659cd3cf76964c27b1dfdccebc357594 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.687284 20640 raft_consensus.cc:2243] T 659cd3cf76964c27b1dfdccebc357594 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.687755 20640 raft_consensus.cc:2272] T 659cd3cf76964c27b1dfdccebc357594 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.690407 20640 tablet_replica.cc:333] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.691056 20640 raft_consensus.cc:2243] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.691988 20640 raft_consensus.cc:2272] T 7c7ab1eff7a5409cb84e6bb33393456e P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.694691 20640 tablet_replica.cc:333] T 452914c1abfd43389431daaf7ebee1c0 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.695456 20640 raft_consensus.cc:2243] T 452914c1abfd43389431daaf7ebee1c0 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.695978 20640 raft_consensus.cc:2272] T 452914c1abfd43389431daaf7ebee1c0 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.698581 20640 tablet_replica.cc:333] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.699277 20640 raft_consensus.cc:2243] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.699802 20640 raft_consensus.cc:2272] T 47ba06e13a9740d9b4ba185990852ada P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.702483 20640 tablet_replica.cc:333] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.703356 20640 raft_consensus.cc:2243] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.704265 20640 raft_consensus.cc:2272] T d1f041b85d184414b3939425b35e4a1c P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.706622 28772 consensus_peers.cc:597] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Couldn't send request to peer bfd745f89b014f7b85fbf7d909fe2fb0. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:43021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.706892 20640 tablet_replica.cc:333] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.707715 20640 raft_consensus.cc:2243] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.708199 20640 raft_consensus.cc:2272] T c0093a1dad264ec1b3d9d3f896262ff7 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.710309 20640 tablet_replica.cc:333] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.710881 20640 raft_consensus.cc:2243] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.711297 20640 raft_consensus.cc:2272] T 4d860d29a21a423cbbf0d8d9480d56ef P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.713918 20640 tablet_replica.cc:333] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.714484 20640 raft_consensus.cc:2243] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.715206 20640 raft_consensus.cc:2272] T f52ad167603d40ada7680f844e2e59c8 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.715426 28772 consensus_peers.cc:597] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d -> Peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Couldn't send request to peer bfd745f89b014f7b85fbf7d909fe2fb0. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:43021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.717161 20640 tablet_replica.cc:333] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.717828 20640 raft_consensus.cc:2243] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.718228 20640 raft_consensus.cc:2272] T 51806e14724e4433b368faa0c997a11e P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.719966 20640 tablet_replica.cc:333] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.720501 20640 raft_consensus.cc:2243] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.721271 20640 raft_consensus.cc:2272] T b572160c667242bfbd4ece3e3f26f505 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.723199 20640 tablet_replica.cc:333] T 45c6993be42044c3b7dbb095971f7c88 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.723723 20640 raft_consensus.cc:2243] T 45c6993be42044c3b7dbb095971f7c88 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.724201 20640 raft_consensus.cc:2272] T 45c6993be42044c3b7dbb095971f7c88 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.726416 20640 tablet_replica.cc:333] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.727015 20640 raft_consensus.cc:2243] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.727458 20640 raft_consensus.cc:2272] T 8bb1e7780b6c42649546108a0bd97d7a P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.728005 28770 consensus_peers.cc:597] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d -> Peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Couldn't send request to peer a1515f1138af4333a63996f5d0864d85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.729763 20640 tablet_replica.cc:333] T 586415758fd245b49bd0a4e20a2b11d8 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.730361 20640 raft_consensus.cc:2243] T 586415758fd245b49bd0a4e20a2b11d8 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.730798 20640 raft_consensus.cc:2272] T 586415758fd245b49bd0a4e20a2b11d8 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.732894 20640 tablet_replica.cc:333] T 59ba7b5c67b14fcba09e4e6cd16fa09b P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.733412 20640 raft_consensus.cc:2243] T 59ba7b5c67b14fcba09e4e6cd16fa09b P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.734061 20640 raft_consensus.cc:2272] T 59ba7b5c67b14fcba09e4e6cd16fa09b P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.736172 20640 tablet_replica.cc:333] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.736829 20640 raft_consensus.cc:2243] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.737313 20640 raft_consensus.cc:2272] T 19240a871550411aafbc885984ade97d P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.740079 20640 tablet_replica.cc:333] T 841b18d7f11c485bba96eda7dce0c27e P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
W20260709 13:11:49.740011 28770 consensus_peers.cc:597] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Couldn't send request to peer a1515f1138af4333a63996f5d0864d85. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.740872 20640 raft_consensus.cc:2243] T 841b18d7f11c485bba96eda7dce0c27e P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.741242 20640 raft_consensus.cc:2272] T 841b18d7f11c485bba96eda7dce0c27e P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.743034 20640 tablet_replica.cc:333] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.743477 20640 raft_consensus.cc:2243] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.744149 20640 raft_consensus.cc:2272] T 857ee7ea2ffe41cf9ed43a455e52901f P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.745914 20640 tablet_replica.cc:333] T eb534ab2fc824a7abb24883eb39d17dc P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.746475 20640 raft_consensus.cc:2243] T eb534ab2fc824a7abb24883eb39d17dc P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.746889 20640 raft_consensus.cc:2272] T eb534ab2fc824a7abb24883eb39d17dc P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.748750 20640 tablet_replica.cc:333] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.749220 20640 raft_consensus.cc:2243] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.749660 20640 raft_consensus.cc:2272] T 34233c4c336b444996374b970ddd2822 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.752178 20640 tablet_replica.cc:333] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.752853 20640 raft_consensus.cc:2243] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.753340 20640 raft_consensus.cc:2272] T 6ea260fc2f384cd7a7f947d2bf8cb49b P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.754964 28698 consensus_peers.cc:597] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 -> Peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Couldn't send request to peer bfd745f89b014f7b85fbf7d909fe2fb0. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:43021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.755448 28698 consensus_peers.cc:597] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 -> Peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Couldn't send request to peer bfd745f89b014f7b85fbf7d909fe2fb0. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:43021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.755854 20640 tablet_replica.cc:333] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.756417 20640 raft_consensus.cc:2243] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.757059 20640 raft_consensus.cc:2272] T f828b4ae5c2846c5a49f1212f73186f0 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.758881 20640 tablet_replica.cc:333] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.759379 20640 raft_consensus.cc:2243] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.760035 20640 raft_consensus.cc:2272] T d69a0e6ca32e4d8080aed2fe4405d7f5 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.761866 20640 tablet_replica.cc:333] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.762313 20640 raft_consensus.cc:2243] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.762631 20640 raft_consensus.cc:2272] T 2ee04ccf18954bae9d40f7a5c460f71b P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.764303 20640 tablet_replica.cc:333] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.764734 20640 raft_consensus.cc:2243] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.765077 20640 raft_consensus.cc:2272] T 57c146089a3249eea0254717e75c14c8 P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.766768 20640 tablet_replica.cc:333] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.767215 20640 raft_consensus.cc:2243] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.767537 20640 raft_consensus.cc:2272] T ce8eab4cd5b64393b62a304011e5b22d P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.769330 20640 tablet_replica.cc:333] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.769915 20640 raft_consensus.cc:2243] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.770850 20640 raft_consensus.cc:2272] T 5ff91a748d3f464ab00fc3e657057d73 P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.772614 20640 tablet_replica.cc:333] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.773181 20640 raft_consensus.cc:2243] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.773607 20640 raft_consensus.cc:2272] T 2b32b6e56ce549b98fca9ad5f3798f2b P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.775336 20640 tablet_replica.cc:333] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.775949 20640 raft_consensus.cc:2243] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.776798 20640 raft_consensus.cc:2272] T 0d12b4ce21794192969d6609d0ea4d69 P a1515f1138af4333a63996f5d0864d85 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.778806 20640 tablet_replica.cc:333] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.779244 20640 raft_consensus.cc:2243] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:49.779585 20640 raft_consensus.cc:2272] T 8e29bffebb804a5bbb9935518c059b2a P a1515f1138af4333a63996f5d0864d85 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:49.781247 20640 tablet_replica.cc:333] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85: stopping tablet replica
I20260709 13:11:49.781733 20640 raft_consensus.cc:2243] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:49.782418 20640 raft_consensus.cc:2272] T 5951a1590104426cae727db543f49a83 P a1515f1138af4333a63996f5d0864d85 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:49.841933 28770 consensus_peers.cc:597] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Couldn't send request to peer a1515f1138af4333a63996f5d0864d85. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.3:41711: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.847486 20640 tablet_server.cc:196] TabletServer@127.20.40.3:0 shutdown complete.
I20260709 13:11:49.848032 29755 raft_consensus.cc:493] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:49.848562 29755 raft_consensus.cc:515] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:49.850973 29755 leader_election.cc:290] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
W20260709 13:11:49.854624 28772 leader_election.cc:336] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Network error: Client connection negotiation failed: client connection to 127.20.40.2:43021: connect: Connection refused (error 111)
W20260709 13:11:49.881806 28770 consensus_peers.cc:597] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Couldn't send request to peer a1515f1138af4333a63996f5d0864d85. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.3:41711: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.932792 28770 consensus_peers.cc:597] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d -> Peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Couldn't send request to peer a1515f1138af4333a63996f5d0864d85. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.3:41711: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:49.936040 28770 consensus_peers.cc:597] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d -> Peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Couldn't send request to peer a1515f1138af4333a63996f5d0864d85. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.3:41711: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.952603 29679 raft_consensus.cc:493] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:49.954339 29679 raft_consensus.cc:515] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:49.958977 29679 leader_election.cc:290] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
W20260709 13:11:49.965381 28772 leader_election.cc:336] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Network error: Client connection negotiation failed: client connection to 127.20.40.2:43021: connect: Connection refused (error 111)
I20260709 13:11:49.981942 29679 raft_consensus.cc:493] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:49.982892 29679 raft_consensus.cc:515] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
W20260709 13:11:49.985003 28770 consensus_peers.cc:597] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d -> Peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Couldn't send request to peer a1515f1138af4333a63996f5d0864d85. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.3:41711: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:49.986263 29679 leader_election.cc:290] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
W20260709 13:11:49.991971 28770 leader_election.cc:336] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Network error: Client connection negotiation failed: client connection to 127.20.40.3:41711: connect: Connection refused (error 111)
I20260709 13:11:50.006605 20640 tablet_server.cc:179] TabletServer@127.20.40.4:0 shutting down...
W20260709 13:11:50.034766 28770 consensus_peers.cc:597] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d -> Peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Couldn't send request to peer a1515f1138af4333a63996f5d0864d85. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.3:41711: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:50.051255 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:50.052178 20640 tablet_replica.cc:333] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.053367 20640 raft_consensus.cc:2243] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.054373 20640 raft_consensus.cc:2272] T a1185c8b14ea4fd88ccfccb31e19dfd8 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.055989 29679 raft_consensus.cc:493] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:50.056597 29679 raft_consensus.cc:515] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:50.057593 20640 tablet_replica.cc:333] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.058717 20640 raft_consensus.cc:2243] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.058844 29679 leader_election.cc:290] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:50.060766 20640 raft_consensus.cc:2272] T 92fb36508a8840ea8e84f00da15700a1 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:50.062681 28770 leader_election.cc:336] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Network error: Client connection negotiation failed: client connection to 127.20.40.3:41711: connect: Connection refused (error 111)
I20260709 13:11:50.063746 20640 tablet_replica.cc:333] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.064512 20640 raft_consensus.cc:2243] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.065361 20640 raft_consensus.cc:2272] T 66bc5681208146d19bff2322d4c254dd P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.067730 20640 tablet_replica.cc:333] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.068651 20640 raft_consensus.cc:2243] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.069381 20640 raft_consensus.cc:2272] T 19e262f061cd4055b2b8c365deb5bf74 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.071821 20640 tablet_replica.cc:333] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.072460 20640 raft_consensus.cc:2243] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.073088 20640 raft_consensus.cc:2272] T 2b32b6e56ce549b98fca9ad5f3798f2b P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.075568 20640 tablet_replica.cc:333] T 5e2ea288ac6c435eb4e1fd15b459a3ff P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.076185 20640 raft_consensus.cc:2243] T 5e2ea288ac6c435eb4e1fd15b459a3ff P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.076834 20640 raft_consensus.cc:2272] T 5e2ea288ac6c435eb4e1fd15b459a3ff P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.079269 20640 tablet_replica.cc:333] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.079922 20640 raft_consensus.cc:2243] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.081128 20640 raft_consensus.cc:2272] T 9a4abbb5e8f04c8388c1642217e7dbcb P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.083515 20640 tablet_replica.cc:333] T 28856e9437484cbdae4f48bf4ca6aaa1 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.084141 20640 raft_consensus.cc:2243] T 28856e9437484cbdae4f48bf4ca6aaa1 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.084693 20640 raft_consensus.cc:2272] T 28856e9437484cbdae4f48bf4ca6aaa1 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.087299 20640 tablet_replica.cc:333] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.087922 20640 raft_consensus.cc:2243] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.089010 20640 raft_consensus.cc:2272] T 9519acd190ba4590a2eaa1fcb1e9a60f P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.091305 20640 tablet_replica.cc:333] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.091944 20640 raft_consensus.cc:2243] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.092577 20640 raft_consensus.cc:2272] T 550aaae95149430d8f95525d197894f6 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.094996 20640 tablet_replica.cc:333] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.095753 20640 raft_consensus.cc:2243] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.096287 20640 raft_consensus.cc:2272] T b939cf3aa04842b1adacdee8818495fd P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.098572 20640 tablet_replica.cc:333] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.099169 20640 raft_consensus.cc:2243] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.100538 20640 raft_consensus.cc:2272] T 46835248ab9d4f43908a6c6a42642ba1 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.102789 20640 tablet_replica.cc:333] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.103389 20640 raft_consensus.cc:2243] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.103943 20640 raft_consensus.cc:2272] T 2ee04ccf18954bae9d40f7a5c460f71b P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.106408 20640 tablet_replica.cc:333] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.106985 20640 raft_consensus.cc:2243] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.107565 20640 raft_consensus.cc:2272] T ce8eab4cd5b64393b62a304011e5b22d P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.109622 20640 tablet_replica.cc:333] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.110209 20640 raft_consensus.cc:2243] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.110713 20640 raft_consensus.cc:2272] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.112825 20640 tablet_replica.cc:333] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.113492 20640 raft_consensus.cc:2243] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.114313 20640 raft_consensus.cc:2272] T 12cea3a9ab394674a67119867b34ce5a P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.116508 20640 tablet_replica.cc:333] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.117066 20640 raft_consensus.cc:2243] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.117578 20640 raft_consensus.cc:2272] T fcf9ce9ce3ac4f848ae7f5b584711f3e P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:50.118091 28770 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:50.119807 20640 tablet_replica.cc:333] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.120525 20640 raft_consensus.cc:2243] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.121043 20640 raft_consensus.cc:2272] T e876ee31f15e4349b3086338a4d5f288 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.123238 20640 tablet_replica.cc:333] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.123795 20640 raft_consensus.cc:2243] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.124303 20640 raft_consensus.cc:2272] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.126190 29679 raft_consensus.cc:493] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:50.127089 20640 tablet_replica.cc:333] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.126767 29679 raft_consensus.cc:515] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1515f1138af4333a63996f5d0864d85" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 41711 } } peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } }
I20260709 13:11:50.128022 20640 raft_consensus.cc:2243] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.128888 20640 raft_consensus.cc:2272] T 19240a871550411aafbc885984ade97d P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.129089 29679 leader_election.cc:290] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711), 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075)
I20260709 13:11:50.131726 20640 tablet_replica.cc:333] T 841b18d7f11c485bba96eda7dce0c27e P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.132424 20640 raft_consensus.cc:2243] T 841b18d7f11c485bba96eda7dce0c27e P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:50.132751 28770 leader_election.cc:336] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a1515f1138af4333a63996f5d0864d85 (127.20.40.3:41711): Network error: Client connection negotiation failed: client connection to 127.20.40.3:41711: connect: Connection refused (error 111)
I20260709 13:11:50.133052 20640 raft_consensus.cc:2272] T 841b18d7f11c485bba96eda7dce0c27e P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.136461 20640 tablet_replica.cc:333] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.136998 20640 raft_consensus.cc:2243] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.137722 20640 raft_consensus.cc:2272] T 7c7ab1eff7a5409cb84e6bb33393456e P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.140038 20640 tablet_replica.cc:333] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.140667 20640 raft_consensus.cc:2243] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.141209 20640 raft_consensus.cc:2272] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.141209 29679 raft_consensus.cc:493] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 44a14c00fc3d41bea8db00310408905a)
I20260709 13:11:50.141891 29679 raft_consensus.cc:515] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8d512840fb74aaf82ac80c433d8dc2d" member_type: VOTER last_known_addr { host: "127.20.40.4" port: 43597 } } peers { permanent_uuid: "44a14c00fc3d41bea8db00310408905a" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44075 } } peers { permanent_uuid: "bfd745f89b014f7b85fbf7d909fe2fb0" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 43021 } }
I20260709 13:11:50.144054 29679 leader_election.cc:290] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075), bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021)
I20260709 13:11:50.144913 20640 tablet_replica.cc:333] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.145820 20640 raft_consensus.cc:2243] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.146843 20640 raft_consensus.cc:2272] T f0c32a52cb724ba28e6fc6c8cf8e9a88 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:50.148432 28772 leader_election.cc:336] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer bfd745f89b014f7b85fbf7d909fe2fb0 (127.20.40.2:43021): Network error: Client connection negotiation failed: client connection to 127.20.40.2:43021: connect: Connection refused (error 111)
I20260709 13:11:50.149757 20640 tablet_replica.cc:333] T b572160c667242bfbd4ece3e3f26f505 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.150439 20640 raft_consensus.cc:2243] T b572160c667242bfbd4ece3e3f26f505 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.150928 20640 raft_consensus.cc:2272] T b572160c667242bfbd4ece3e3f26f505 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.153105 20640 tablet_replica.cc:333] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.153760 20640 raft_consensus.cc:2243] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.154340 20640 raft_consensus.cc:2272] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.156594 20640 tablet_replica.cc:333] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.157212 20640 raft_consensus.cc:2243] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.157817 20640 raft_consensus.cc:2272] T f52ad167603d40ada7680f844e2e59c8 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.159793 20640 tablet_replica.cc:333] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.160408 20640 raft_consensus.cc:2243] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.161340 20640 raft_consensus.cc:2272] T d40bb461a5034123ab09d156bd22ebbf P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.163480 20640 tablet_replica.cc:333] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.164016 20640 raft_consensus.cc:2243] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.164885 20640 raft_consensus.cc:2272] T 45c6993be42044c3b7dbb095971f7c88 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.167009 20640 tablet_replica.cc:333] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.167557 20640 raft_consensus.cc:2243] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.168066 20640 raft_consensus.cc:2272] T f828b4ae5c2846c5a49f1212f73186f0 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.170246 20640 tablet_replica.cc:333] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.170812 20640 raft_consensus.cc:2243] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.171615 20640 raft_consensus.cc:2272] T b07d8385470b4fc285eb6703e6fa42b9 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.173797 20640 tablet_replica.cc:333] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.174352 20640 raft_consensus.cc:2243] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.175328 20640 raft_consensus.cc:2272] T eb534ab2fc824a7abb24883eb39d17dc P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.177500 20640 tablet_replica.cc:333] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.178131 20640 raft_consensus.cc:2243] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.178624 20640 raft_consensus.cc:2272] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.180716 20640 tablet_replica.cc:333] T 5951a1590104426cae727db543f49a83 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.181252 20640 raft_consensus.cc:2243] T 5951a1590104426cae727db543f49a83 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.181774 20640 raft_consensus.cc:2272] T 5951a1590104426cae727db543f49a83 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.183840 20640 tablet_replica.cc:333] T 6ea260fc2f384cd7a7f947d2bf8cb49b P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.184351 20640 raft_consensus.cc:2243] T 6ea260fc2f384cd7a7f947d2bf8cb49b P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.184875 20640 raft_consensus.cc:2272] T 6ea260fc2f384cd7a7f947d2bf8cb49b P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.187053 20640 tablet_replica.cc:333] T a726976321d04177a6d77e9ef0041f3f P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.187588 20640 raft_consensus.cc:2243] T a726976321d04177a6d77e9ef0041f3f P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.188130 20640 raft_consensus.cc:2272] T a726976321d04177a6d77e9ef0041f3f P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.190253 20640 tablet_replica.cc:333] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.190762 20640 raft_consensus.cc:2243] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.191210 20640 raft_consensus.cc:2272] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.193214 20640 tablet_replica.cc:333] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.193734 20640 raft_consensus.cc:2243] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.194465 20640 raft_consensus.cc:2272] T 659cd3cf76964c27b1dfdccebc357594 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.196595 20640 tablet_replica.cc:333] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.197108 20640 raft_consensus.cc:2243] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.197624 20640 raft_consensus.cc:2272] T f5d51007007a4252908beaaaa3ee8374 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.199520 20640 tablet_replica.cc:333] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.200028 20640 raft_consensus.cc:2243] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.200500 20640 raft_consensus.cc:2272] T d69a0e6ca32e4d8080aed2fe4405d7f5 P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.202440 20640 tablet_replica.cc:333] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.202956 20640 raft_consensus.cc:2243] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.203850 20640 raft_consensus.cc:2272] T cf7befe583fe4534bdd8e703ee341d3e P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.205978 20640 tablet_replica.cc:333] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.206501 20640 raft_consensus.cc:2243] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.207372 20640 raft_consensus.cc:2272] T 1e4d79b8251f445ba4ee93c33bb13df3 P b8d512840fb74aaf82ac80c433d8dc2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.209442 20640 tablet_replica.cc:333] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.209929 20640 raft_consensus.cc:2243] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.210439 20640 raft_consensus.cc:2272] T 47ba06e13a9740d9b4ba185990852ada P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.212453 20640 tablet_replica.cc:333] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d: stopping tablet replica
I20260709 13:11:50.212952 20640 raft_consensus.cc:2243] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:50.213508 20640 raft_consensus.cc:2272] T d1f041b85d184414b3939425b35e4a1c P b8d512840fb74aaf82ac80c433d8dc2d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:50.292068 28769 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.319810 28771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.364351 28772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.377302 28769 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.403132 28771 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.505725 28769 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.539816 28772 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:50.568004 29748 leader_election.cc:336] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Service unavailable: reactor is shutting down (error 108)
I20260709 13:11:50.568580 29748 leader_election.cc:304] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
W20260709 13:11:50.569221 29748 raft_consensus.cc:2686] T 4d860d29a21a423cbbf0d8d9480d56ef P b8d512840fb74aaf82ac80c433d8dc2d: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:11:50.571462 29748 leader_election.cc:336] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Service unavailable: reactor is shutting down (error 108)
W20260709 13:11:50.571516 20640 leader_election.cc:336] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Aborted: reactor is shutting down (error 108)
I20260709 13:11:50.571918 29748 leader_election.cc:304] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
I20260709 13:11:50.571974 20640 leader_election.cc:304] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
W20260709 13:11:50.572635 29748 raft_consensus.cc:2686] T 57c146089a3249eea0254717e75c14c8 P b8d512840fb74aaf82ac80c433d8dc2d: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:11:50.572656 20640 raft_consensus.cc:2686] T d706fb62a0a7423ca484455f75a16592 P b8d512840fb74aaf82ac80c433d8dc2d: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:11:50.575131 29748 leader_election.cc:336] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Service unavailable: reactor is shutting down (error 108)
I20260709 13:11:50.575619 29748 leader_election.cc:304] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, a1515f1138af4333a63996f5d0864d85
W20260709 13:11:50.576308 29748 raft_consensus.cc:2686] T 8bb1e7780b6c42649546108a0bd97d7a P b8d512840fb74aaf82ac80c433d8dc2d: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:11:50.578608 29748 leader_election.cc:336] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Service unavailable: reactor is shutting down (error 108)
I20260709 13:11:50.578990 29748 leader_election.cc:304] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
W20260709 13:11:50.579452 29748 raft_consensus.cc:2686] T b1a388b79acd4a278496df6d65fd7a44 P b8d512840fb74aaf82ac80c433d8dc2d: unable to run election callback: Service unavailable: The pool has been shut down.
W20260709 13:11:50.581763 29748 leader_election.cc:336] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 44a14c00fc3d41bea8db00310408905a (127.20.40.1:44075): Service unavailable: reactor is shutting down (error 108)
I20260709 13:11:50.582115 29748 leader_election.cc:304] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8d512840fb74aaf82ac80c433d8dc2d; no voters: 44a14c00fc3d41bea8db00310408905a, bfd745f89b014f7b85fbf7d909fe2fb0
W20260709 13:11:50.582603 29748 raft_consensus.cc:2686] T 2988b7e9dc0942a69ce7dcb8db26ca27 P b8d512840fb74aaf82ac80c433d8dc2d: unable to run election callback: Service unavailable: The pool has been shut down.
I20260709 13:11:50.591588 20640 tablet_server.cc:196] TabletServer@127.20.40.4:0 shutdown complete.
I20260709 13:11:50.662431 20640 master.cc:562] Master@127.20.40.62:37793 shutting down...
W20260709 13:11:50.701303 28528 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:11:50.702453 20640 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:50.703006 20640 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:50.703282 20640 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7b75aaa61fbe45d7bb4ff584eac755ae: stopping tablet replica
I20260709 13:11:50.726372 20640 master.cc:584] Master@127.20.40.62:37793 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (32614 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:11:50.827018 20640 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.40.62:43027
I20260709 13:11:50.828104 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:50.833966 29761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:50.834396 29760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:50.835547 29763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:50.836861 20640 server_base.cc:1061] running on GCE node
I20260709 13:11:50.838001 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:50.838181 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:50.838364 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602710838332 us; error 0 us; skew 500 ppm
I20260709 13:11:50.838948 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:50.841689 20640 webserver.cc:533] Webserver started at http://127.20.40.62:45629/ using document root <none> and password file <none>
I20260709 13:11:50.842190 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:50.842371 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:50.842657 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:50.843891 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/master-0-root/instance:
uuid: "101d7371537744d69873145cb2ac92b1"
format_stamp: "Formatted at 2026-07-09 13:11:50 on dist-test-slave-rnv4"
I20260709 13:11:50.848647 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:11:50.852604 29768 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:50.853961 20640 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:11:50.854360 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/master-0-root
uuid: "101d7371537744d69873145cb2ac92b1"
format_stamp: "Formatted at 2026-07-09 13:11:50 on dist-test-slave-rnv4"
I20260709 13:11:50.854687 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:50.875861 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:50.877370 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:50.920198 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.62:43027
I20260709 13:11:50.920325 29819 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.62:43027 every 8 connection(s)
I20260709 13:11:50.924568 29820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:50.935779 29820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1: Bootstrap starting.
I20260709 13:11:50.940747 29820 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:50.945122 29820 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1: No bootstrap required, opened a new log
I20260709 13:11:50.947419 29820 raft_consensus.cc:359] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101d7371537744d69873145cb2ac92b1" member_type: VOTER }
I20260709 13:11:50.947818 29820 raft_consensus.cc:385] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:50.947992 29820 raft_consensus.cc:740] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 101d7371537744d69873145cb2ac92b1, State: Initialized, Role: FOLLOWER
I20260709 13:11:50.948565 29820 consensus_queue.cc:260] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101d7371537744d69873145cb2ac92b1" member_type: VOTER }
I20260709 13:11:50.948992 29820 raft_consensus.cc:399] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:11:50.949185 29820 raft_consensus.cc:493] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:11:50.949414 29820 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:50.953940 29820 raft_consensus.cc:515] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101d7371537744d69873145cb2ac92b1" member_type: VOTER }
I20260709 13:11:50.954396 29820 leader_election.cc:304] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 101d7371537744d69873145cb2ac92b1; no voters: 
I20260709 13:11:50.955468 29820 leader_election.cc:290] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:11:50.955955 29823 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:50.957459 29823 raft_consensus.cc:697] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1 [term 1 LEADER]: Becoming Leader. State: Replica: 101d7371537744d69873145cb2ac92b1, State: Running, Role: LEADER
I20260709 13:11:50.958177 29823 consensus_queue.cc:237] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101d7371537744d69873145cb2ac92b1" member_type: VOTER }
I20260709 13:11:50.958519 29820 sys_catalog.cc:565] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:11:50.967880 29825 sys_catalog.cc:455] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 101d7371537744d69873145cb2ac92b1. Latest consensus state: current_term: 1 leader_uuid: "101d7371537744d69873145cb2ac92b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101d7371537744d69873145cb2ac92b1" member_type: VOTER } }
I20260709 13:11:50.968566 29825 sys_catalog.cc:458] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:50.969324 29824 sys_catalog.cc:455] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "101d7371537744d69873145cb2ac92b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "101d7371537744d69873145cb2ac92b1" member_type: VOTER } }
I20260709 13:11:50.970289 29824 sys_catalog.cc:458] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:11:50.971503 29831 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:11:50.977169 29831 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:11:50.979604 20640 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:11:50.986706 29831 catalog_manager.cc:1383] Generated new cluster ID: c4246bb857514d5c8ca2bc91867cd777
I20260709 13:11:50.986996 29831 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:11:51.002810 29831 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:11:51.004138 29831 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:11:51.020279 29831 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1: Generated new TSK 0
I20260709 13:11:51.021004 29831 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:11:51.046243 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:51.053220 29841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:51.054204 29842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:51.057703 29844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:51.058665 20640 server_base.cc:1061] running on GCE node
I20260709 13:11:51.060305 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:51.060529 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:51.060685 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602711060673 us; error 0 us; skew 500 ppm
I20260709 13:11:51.061164 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:51.063830 20640 webserver.cc:533] Webserver started at http://127.20.40.1:33011/ using document root <none> and password file <none>
I20260709 13:11:51.064318 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:51.064489 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:51.064740 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:51.066035 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/ts-0-root/instance:
uuid: "b7dd1621ce9245288cc3d7889c7c4aba"
format_stamp: "Formatted at 2026-07-09 13:11:51 on dist-test-slave-rnv4"
I20260709 13:11:51.071055 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:11:51.075127 29849 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:51.075963 20640 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:11:51.076293 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/ts-0-root
uuid: "b7dd1621ce9245288cc3d7889c7c4aba"
format_stamp: "Formatted at 2026-07-09 13:11:51 on dist-test-slave-rnv4"
I20260709 13:11:51.076570 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:51.098099 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:51.099506 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:51.101154 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:51.103672 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:51.103858 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:51.104151 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:51.104338 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:51.147883 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.1:36241
I20260709 13:11:51.148018 29911 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.1:36241 every 8 connection(s)
I20260709 13:11:51.153680 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:51.161939 29916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:51.166308 29917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:51.172714 29919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:51.173062 20640 server_base.cc:1061] running on GCE node
I20260709 13:11:51.173939 29912 heartbeater.cc:344] Connected to a master server at 127.20.40.62:43027
I20260709 13:11:51.174379 29912 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:51.174448 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:51.174801 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:51.175002 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602711174963 us; error 0 us; skew 500 ppm
I20260709 13:11:51.175304 29912 heartbeater.cc:507] Master 127.20.40.62:43027 requested a full tablet report, sending...
I20260709 13:11:51.175730 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:51.177762 29785 ts_manager.cc:194] Registered new tserver with Master: b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241)
I20260709 13:11:51.179090 20640 webserver.cc:533] Webserver started at http://127.20.40.2:44243/ using document root <none> and password file <none>
I20260709 13:11:51.179708 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:51.179935 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:51.180013 29785 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40300
I20260709 13:11:51.180238 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:51.181914 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/ts-1-root/instance:
uuid: "0bdc55fd89784396b2426f8b21ca85e6"
format_stamp: "Formatted at 2026-07-09 13:11:51 on dist-test-slave-rnv4"
I20260709 13:11:51.186691 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:11:51.190744 29924 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:51.191641 20640 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 13:11:51.192000 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/ts-1-root
uuid: "0bdc55fd89784396b2426f8b21ca85e6"
format_stamp: "Formatted at 2026-07-09 13:11:51 on dist-test-slave-rnv4"
I20260709 13:11:51.192330 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:51.219974 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:51.221263 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:51.222781 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:51.225018 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:51.225240 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:51.225519 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:51.225708 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:51.269485 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.2:46513
I20260709 13:11:51.269584 29986 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.2:46513 every 8 connection(s)
I20260709 13:11:51.274556 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:51.282506 29991 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:51.284116 29990 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:51.284215 29993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:51.286440 20640 server_base.cc:1061] running on GCE node
I20260709 13:11:51.287451 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:51.287681 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:51.287870 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602711287854 us; error 0 us; skew 500 ppm
I20260709 13:11:51.288066 29987 heartbeater.cc:344] Connected to a master server at 127.20.40.62:43027
I20260709 13:11:51.288473 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:51.288509 29987 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:51.289570 29987 heartbeater.cc:507] Master 127.20.40.62:43027 requested a full tablet report, sending...
I20260709 13:11:51.291534 20640 webserver.cc:533] Webserver started at http://127.20.40.3:41155/ using document root <none> and password file <none>
I20260709 13:11:51.291540 29785 ts_manager.cc:194] Registered new tserver with Master: 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:11:51.292167 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:51.292411 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:11:51.292673 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:11:51.293656 29785 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40310
I20260709 13:11:51.294026 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/ts-2-root/instance:
uuid: "59961b872d794a10973133cd9e9b175c"
format_stamp: "Formatted at 2026-07-09 13:11:51 on dist-test-slave-rnv4"
I20260709 13:11:51.298790 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:11:51.302348 29998 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:51.303315 20640 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:11:51.303695 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/ts-2-root
uuid: "59961b872d794a10973133cd9e9b175c"
format_stamp: "Formatted at 2026-07-09 13:11:51 on dist-test-slave-rnv4"
I20260709 13:11:51.304100 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:51.320380 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:51.321820 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:51.323412 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:51.325906 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:11:51.326164 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:51.326428 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:11:51.326594 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:51.375535 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.3:35469
I20260709 13:11:51.375625 30060 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.3:35469 every 8 connection(s)
I20260709 13:11:51.390712 30061 heartbeater.cc:344] Connected to a master server at 127.20.40.62:43027
I20260709 13:11:51.391170 30061 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:51.391904 30061 heartbeater.cc:507] Master 127.20.40.62:43027 requested a full tablet report, sending...
I20260709 13:11:51.393954 29785 ts_manager.cc:194] Registered new tserver with Master: 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:51.394086 20640 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01521639s
I20260709 13:11:51.395334 29785 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40312
I20260709 13:11:51.422639 29785 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40314:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:11:51.426007 29785 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:11:51.513266 30026 tablet_service.cc:1511] Processing CreateTablet for tablet a5e2fa1a8c9c43cd80229ffcab41ddf5 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:11:51.515036 30026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e2fa1a8c9c43cd80229ffcab41ddf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.517056 30025 tablet_service.cc:1511] Processing CreateTablet for tablet 2afcae80938b4e4d8cc5e34c18a8e90b (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:11:51.518772 30025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2afcae80938b4e4d8cc5e34c18a8e90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.520506 30024 tablet_service.cc:1511] Processing CreateTablet for tablet 451ea5ec3bad4c7f931345023c402184 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:11:51.522307 30024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 451ea5ec3bad4c7f931345023c402184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.523363 30023 tablet_service.cc:1511] Processing CreateTablet for tablet 83b41c54dcc4471baf2f679730bfadd3 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:11:51.525080 30023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83b41c54dcc4471baf2f679730bfadd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.528859 29877 tablet_service.cc:1511] Processing CreateTablet for tablet a5e2fa1a8c9c43cd80229ffcab41ddf5 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:11:51.529378 29875 tablet_service.cc:1511] Processing CreateTablet for tablet 451ea5ec3bad4c7f931345023c402184 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:11:51.530301 29877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e2fa1a8c9c43cd80229ffcab41ddf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.531692 29874 tablet_service.cc:1511] Processing CreateTablet for tablet 83b41c54dcc4471baf2f679730bfadd3 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:11:51.533154 29874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83b41c54dcc4471baf2f679730bfadd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.534646 29873 tablet_service.cc:1511] Processing CreateTablet for tablet 46dbf557381f4433b6140e94368854c6 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:11:51.535882 30022 tablet_service.cc:1511] Processing CreateTablet for tablet 46dbf557381f4433b6140e94368854c6 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:11:51.537264 30022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46dbf557381f4433b6140e94368854c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.538633 30021 tablet_service.cc:1511] Processing CreateTablet for tablet c79fd06a98564834a22f607ce3330fc8 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:11:51.540076 30021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c79fd06a98564834a22f607ce3330fc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.540345 29871 tablet_service.cc:1511] Processing CreateTablet for tablet 1bcd87cdf9784c6bb2c80e13f7ded4b0 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:11:51.534662 29876 tablet_service.cc:1511] Processing CreateTablet for tablet 2afcae80938b4e4d8cc5e34c18a8e90b (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:11:51.537513 29872 tablet_service.cc:1511] Processing CreateTablet for tablet c79fd06a98564834a22f607ce3330fc8 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:11:51.542088 30020 tablet_service.cc:1511] Processing CreateTablet for tablet 1bcd87cdf9784c6bb2c80e13f7ded4b0 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:11:51.542671 29871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bcd87cdf9784c6bb2c80e13f7ded4b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.543401 29872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c79fd06a98564834a22f607ce3330fc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.543479 30020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bcd87cdf9784c6bb2c80e13f7ded4b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.545326 29876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2afcae80938b4e4d8cc5e34c18a8e90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.545996 29875 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 451ea5ec3bad4c7f931345023c402184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.547163 29873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46dbf557381f4433b6140e94368854c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.581274 30076 tablet_bootstrap.cc:492] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap starting.
I20260709 13:11:51.599622 29871 tablet_service.cc:1511] Processing CreateTablet for tablet 6453b7b7a07e4d5996046c4e600fe521 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:11:51.601663 29871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6453b7b7a07e4d5996046c4e600fe521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.603106 30076 tablet_bootstrap.cc:654] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.610530 30077 tablet_bootstrap.cc:492] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c: Bootstrap starting.
I20260709 13:11:51.621699 30076 tablet_bootstrap.cc:492] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba: No bootstrap required, opened a new log
I20260709 13:11:51.622364 30076 ts_tablet_manager.cc:1403] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.010s
I20260709 13:11:51.625787 30076 raft_consensus.cc:359] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.626634 30076 raft_consensus.cc:385] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.626997 30076 raft_consensus.cc:740] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.627967 30076 consensus_queue.cc:260] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.628903 30077 tablet_bootstrap.cc:654] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.633217 30021 tablet_service.cc:1511] Processing CreateTablet for tablet 6453b7b7a07e4d5996046c4e600fe521 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:11:51.634677 30021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6453b7b7a07e4d5996046c4e600fe521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.635270 29945 tablet_service.cc:1511] Processing CreateTablet for tablet 6453b7b7a07e4d5996046c4e600fe521 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:11:51.636801 29945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6453b7b7a07e4d5996046c4e600fe521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.636504 29947 tablet_service.cc:1511] Processing CreateTablet for tablet c79fd06a98564834a22f607ce3330fc8 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:11:51.638108 29947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c79fd06a98564834a22f607ce3330fc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.641104 29870 tablet_service.cc:1511] Processing CreateTablet for tablet c31ade6968c5458ca21ba8d950f01883 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:11:51.635285 29948 tablet_service.cc:1511] Processing CreateTablet for tablet 46dbf557381f4433b6140e94368854c6 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:11:51.642279 29946 tablet_service.cc:1511] Processing CreateTablet for tablet 1bcd87cdf9784c6bb2c80e13f7ded4b0 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:11:51.642797 29870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c31ade6968c5458ca21ba8d950f01883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.643164 29948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46dbf557381f4433b6140e94368854c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.644882 29951 tablet_service.cc:1511] Processing CreateTablet for tablet 2afcae80938b4e4d8cc5e34c18a8e90b (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:11:51.646399 29951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2afcae80938b4e4d8cc5e34c18a8e90b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.648869 29949 tablet_service.cc:1511] Processing CreateTablet for tablet 83b41c54dcc4471baf2f679730bfadd3 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:11:51.650079 30020 tablet_service.cc:1511] Processing CreateTablet for tablet c31ade6968c5458ca21ba8d950f01883 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:11:51.651850 30020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c31ade6968c5458ca21ba8d950f01883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.652205 29950 tablet_service.cc:1511] Processing CreateTablet for tablet 451ea5ec3bad4c7f931345023c402184 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:11:51.654711 29952 tablet_service.cc:1511] Processing CreateTablet for tablet a5e2fa1a8c9c43cd80229ffcab41ddf5 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:11:51.659889 29869 tablet_service.cc:1511] Processing CreateTablet for tablet 2fd9b49df4f447879e0ca7e89ffccd52 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:11:51.661311 29869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fd9b49df4f447879e0ca7e89ffccd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.662084 29944 tablet_service.cc:1511] Processing CreateTablet for tablet c31ade6968c5458ca21ba8d950f01883 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:11:51.665395 29943 tablet_service.cc:1511] Processing CreateTablet for tablet 2fd9b49df4f447879e0ca7e89ffccd52 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:11:51.650681 29949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83b41c54dcc4471baf2f679730bfadd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.675523 29943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fd9b49df4f447879e0ca7e89ffccd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.678627 29944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c31ade6968c5458ca21ba8d950f01883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.690423 29950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 451ea5ec3bad4c7f931345023c402184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.692091 29946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bcd87cdf9784c6bb2c80e13f7ded4b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.701799 29952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5e2fa1a8c9c43cd80229ffcab41ddf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.712618 30023 tablet_service.cc:1511] Processing CreateTablet for tablet 2fd9b49df4f447879e0ca7e89ffccd52 (DEFAULT_TABLE table=test-workload [id=9e599833e08647c5ae13d44dae523db6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:11:51.714095 30023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fd9b49df4f447879e0ca7e89ffccd52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:51.721771 29912 heartbeater.cc:499] Master 127.20.40.62:43027 was elected leader, sending a full tablet report...
I20260709 13:11:51.724854 30076 ts_tablet_manager.cc:1434] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent starting tablet: real 0.102s	user 0.012s	sys 0.011s
I20260709 13:11:51.726118 30076 tablet_bootstrap.cc:492] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap starting.
I20260709 13:11:51.756232 30077 tablet_bootstrap.cc:492] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c: No bootstrap required, opened a new log
I20260709 13:11:51.756816 30077 ts_tablet_manager.cc:1403] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c: Time spent bootstrapping tablet: real 0.163s	user 0.011s	sys 0.012s
I20260709 13:11:51.759740 30077 raft_consensus.cc:359] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.760576 30077 raft_consensus.cc:385] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.760887 30077 raft_consensus.cc:740] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.761157 30081 tablet_bootstrap.cc:492] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6: Bootstrap starting.
I20260709 13:11:51.766981 30076 tablet_bootstrap.cc:654] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.766664 30077 consensus_queue.cc:260] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.773208 30077 ts_tablet_manager.cc:1434] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.010s
I20260709 13:11:51.774145 30061 heartbeater.cc:499] Master 127.20.40.62:43027 was elected leader, sending a full tablet report...
I20260709 13:11:51.779119 30077 tablet_bootstrap.cc:492] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c: Bootstrap starting.
I20260709 13:11:51.790096 30077 tablet_bootstrap.cc:654] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.792388 30076 tablet_bootstrap.cc:492] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba: No bootstrap required, opened a new log
I20260709 13:11:51.793057 30076 ts_tablet_manager.cc:1403] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.006s
I20260709 13:11:51.797582 30076 raft_consensus.cc:359] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.798684 30076 raft_consensus.cc:385] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.799052 30076 raft_consensus.cc:740] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.799989 30076 consensus_queue.cc:260] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.802948 30076 ts_tablet_manager.cc:1434] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:11:51.804075 30076 tablet_bootstrap.cc:492] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap starting.
I20260709 13:11:51.806044 30081 tablet_bootstrap.cc:654] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.812467 30079 raft_consensus.cc:493] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:51.813017 30079 raft_consensus.cc:515] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.817097 30079 leader_election.cc:290] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:51.817907 30076 tablet_bootstrap.cc:654] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.848722 29962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dbf557381f4433b6140e94368854c6" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6" is_pre_election: true
W20260709 13:11:51.851089 29850 leader_election.cc:343] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:51.852744 30077 tablet_bootstrap.cc:492] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c: No bootstrap required, opened a new log
I20260709 13:11:51.853513 30077 ts_tablet_manager.cc:1403] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c: Time spent bootstrapping tablet: real 0.075s	user 0.014s	sys 0.020s
I20260709 13:11:51.855559 30076 tablet_bootstrap.cc:492] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba: No bootstrap required, opened a new log
I20260709 13:11:51.855561 30081 tablet_bootstrap.cc:492] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6: No bootstrap required, opened a new log
I20260709 13:11:51.856525 30076 ts_tablet_manager.cc:1403] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent bootstrapping tablet: real 0.053s	user 0.030s	sys 0.021s
I20260709 13:11:51.856525 30081 ts_tablet_manager.cc:1403] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6: Time spent bootstrapping tablet: real 0.096s	user 0.014s	sys 0.000s
I20260709 13:11:51.857556 30077 raft_consensus.cc:359] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.858312 30077 raft_consensus.cc:385] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.858608 30077 raft_consensus.cc:740] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.859509 30077 consensus_queue.cc:260] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.860148 30076 raft_consensus.cc:359] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } }
I20260709 13:11:51.861007 30076 raft_consensus.cc:385] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.861390 30076 raft_consensus.cc:740] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.862295 30076 consensus_queue.cc:260] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } }
I20260709 13:11:51.862929 30077 ts_tablet_manager.cc:1434] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:11:51.860055 30081 raft_consensus.cc:359] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.863776 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dbf557381f4433b6140e94368854c6" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c" is_pre_election: true
I20260709 13:11:51.866029 30077 tablet_bootstrap.cc:492] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c: Bootstrap starting.
I20260709 13:11:51.866475 30081 raft_consensus.cc:385] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:11:51.866647 29852 leader_election.cc:343] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:51.866873 30081 raft_consensus.cc:740] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.864583 30076 ts_tablet_manager.cc:1434] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:11:51.867465 29852 leader_election.cc:304] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b7dd1621ce9245288cc3d7889c7c4aba; no voters: 0bdc55fd89784396b2426f8b21ca85e6, 59961b872d794a10973133cd9e9b175c
I20260709 13:11:51.868393 30079 raft_consensus.cc:2749] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:51.868624 30076 tablet_bootstrap.cc:492] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap starting.
I20260709 13:11:51.870980 30081 consensus_queue.cc:260] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.873106 30077 tablet_bootstrap.cc:654] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.876770 30076 tablet_bootstrap.cc:654] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:51.880051 30062 tablet.cc:2406] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:11:51.886861 29987 heartbeater.cc:499] Master 127.20.40.62:43027 was elected leader, sending a full tablet report...
I20260709 13:11:51.887777 30081 ts_tablet_manager.cc:1434] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.007s
I20260709 13:11:51.889024 30081 tablet_bootstrap.cc:492] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6: Bootstrap starting.
I20260709 13:11:51.889480 30077 tablet_bootstrap.cc:492] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c: No bootstrap required, opened a new log
I20260709 13:11:51.889510 30076 tablet_bootstrap.cc:492] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba: No bootstrap required, opened a new log
I20260709 13:11:51.890163 30077 ts_tablet_manager.cc:1403] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.015s
I20260709 13:11:51.890353 30076 ts_tablet_manager.cc:1403] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.004s
I20260709 13:11:51.893416 30077 raft_consensus.cc:359] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.894305 30077 raft_consensus.cc:385] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.893870 30076 raft_consensus.cc:359] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.894757 30077 raft_consensus.cc:740] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.895015 30076 raft_consensus.cc:385] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.895504 30076 raft_consensus.cc:740] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.895754 30077 consensus_queue.cc:260] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.896288 30081 tablet_bootstrap.cc:654] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.896348 30076 consensus_queue.cc:260] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.901330 30077 ts_tablet_manager.cc:1434] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:11:51.901813 30076 ts_tablet_manager.cc:1434] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:11:51.902359 30077 tablet_bootstrap.cc:492] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c: Bootstrap starting.
I20260709 13:11:51.905773 30076 tablet_bootstrap.cc:492] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap starting.
I20260709 13:11:51.909801 30077 tablet_bootstrap.cc:654] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.915819 30076 tablet_bootstrap.cc:654] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.916465 30081 tablet_bootstrap.cc:492] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6: No bootstrap required, opened a new log
I20260709 13:11:51.917030 30081 ts_tablet_manager.cc:1403] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.017s
I20260709 13:11:51.920810 30081 raft_consensus.cc:359] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.921809 30081 raft_consensus.cc:385] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.922187 30081 raft_consensus.cc:740] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.923419 30081 consensus_queue.cc:260] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.926813 30081 ts_tablet_manager.cc:1434] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.006s
I20260709 13:11:51.928180 30081 tablet_bootstrap.cc:492] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6: Bootstrap starting.
I20260709 13:11:51.938789 30081 tablet_bootstrap.cc:654] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.951759 30077 tablet_bootstrap.cc:492] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c: No bootstrap required, opened a new log
I20260709 13:11:51.951799 30081 tablet_bootstrap.cc:492] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6: No bootstrap required, opened a new log
I20260709 13:11:51.952304 30077 ts_tablet_manager.cc:1403] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c: Time spent bootstrapping tablet: real 0.050s	user 0.024s	sys 0.022s
I20260709 13:11:51.952425 30081 ts_tablet_manager.cc:1403] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.004s
I20260709 13:11:51.952658 30076 tablet_bootstrap.cc:492] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba: No bootstrap required, opened a new log
I20260709 13:11:51.953162 30076 ts_tablet_manager.cc:1403] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.025s
I20260709 13:11:51.954972 30077 raft_consensus.cc:359] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } }
I20260709 13:11:51.955621 30077 raft_consensus.cc:385] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.955616 30081 raft_consensus.cc:359] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.956207 30077 raft_consensus.cc:740] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.956499 30081 raft_consensus.cc:385] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.956382 30076 raft_consensus.cc:359] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.956998 30081 raft_consensus.cc:740] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.957367 30076 raft_consensus.cc:385] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.957013 30077 consensus_queue.cc:260] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } }
I20260709 13:11:51.957734 30076 raft_consensus.cc:740] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.958094 30081 consensus_queue.cc:260] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.958626 30076 consensus_queue.cc:260] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.959537 30077 ts_tablet_manager.cc:1434] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:11:51.960638 30077 tablet_bootstrap.cc:492] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c: Bootstrap starting.
I20260709 13:11:51.962809 30081 ts_tablet_manager.cc:1434] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:11:51.963060 30076 ts_tablet_manager.cc:1434] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:11:51.963881 30081 tablet_bootstrap.cc:492] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6: Bootstrap starting.
I20260709 13:11:51.964074 30076 tablet_bootstrap.cc:492] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap starting.
I20260709 13:11:51.966990 30077 tablet_bootstrap.cc:654] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.970935 30081 tablet_bootstrap.cc:654] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6: Neither blocks nor log segments found. Creating new log.
W20260709 13:11:51.974706 29833 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:11:51.975718 30076 tablet_bootstrap.cc:654] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:51.979732 30077 tablet_bootstrap.cc:492] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c: No bootstrap required, opened a new log
I20260709 13:11:51.980537 30077 ts_tablet_manager.cc:1403] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.002s
I20260709 13:11:51.984804 30077 raft_consensus.cc:359] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.985569 30077 raft_consensus.cc:385] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.985862 30077 raft_consensus.cc:740] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.986953 30077 consensus_queue.cc:260] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.989697 30077 ts_tablet_manager.cc:1434] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:11:51.990638 30076 tablet_bootstrap.cc:492] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba: No bootstrap required, opened a new log
I20260709 13:11:51.990738 30077 tablet_bootstrap.cc:492] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c: Bootstrap starting.
I20260709 13:11:51.991088 30076 ts_tablet_manager.cc:1403] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.001s
I20260709 13:11:51.993391 30076 raft_consensus.cc:359] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.994314 30076 raft_consensus.cc:385] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:51.994648 30076 raft_consensus.cc:740] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Initialized, Role: FOLLOWER
I20260709 13:11:51.995505 30076 consensus_queue.cc:260] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:51.996101 30081 tablet_bootstrap.cc:492] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6: No bootstrap required, opened a new log
I20260709 13:11:51.996672 30081 ts_tablet_manager.cc:1403] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.010s
I20260709 13:11:51.997527 30077 tablet_bootstrap.cc:654] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.000298 30076 ts_tablet_manager.cc:1434] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:11:52.000197 30081 raft_consensus.cc:359] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.001492 30081 raft_consensus.cc:385] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.001911 30081 raft_consensus.cc:740] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.001996 30076 tablet_bootstrap.cc:492] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap starting.
I20260709 13:11:52.003222 30081 consensus_queue.cc:260] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.009250 30077 tablet_bootstrap.cc:492] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c: No bootstrap required, opened a new log
I20260709 13:11:52.010210 30077 ts_tablet_manager.cc:1403] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.010s
I20260709 13:11:52.010429 30076 tablet_bootstrap.cc:654] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.014034 30077 raft_consensus.cc:359] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.014918 30077 raft_consensus.cc:385] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.015264 30077 raft_consensus.cc:740] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.016258 30077 consensus_queue.cc:260] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.018803 30081 ts_tablet_manager.cc:1434] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:11:52.019248 30077 ts_tablet_manager.cc:1434] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:11:52.020040 30081 tablet_bootstrap.cc:492] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6: Bootstrap starting.
I20260709 13:11:52.020457 30077 tablet_bootstrap.cc:492] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c: Bootstrap starting.
I20260709 13:11:52.021862 30076 tablet_bootstrap.cc:492] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba: No bootstrap required, opened a new log
I20260709 13:11:52.022395 30076 ts_tablet_manager.cc:1403] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.001s
I20260709 13:11:52.027678 30081 tablet_bootstrap.cc:654] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.027235 30076 raft_consensus.cc:359] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.028115 30077 tablet_bootstrap.cc:654] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.028160 30076 raft_consensus.cc:385] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.031463 30076 raft_consensus.cc:740] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.032672 30076 consensus_queue.cc:260] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.036773 30079 raft_consensus.cc:493] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.037331 30079 raft_consensus.cc:515] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.039534 30079 leader_election.cc:290] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:52.042165 29962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6453b7b7a07e4d5996046c4e600fe521" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6" is_pre_election: true
I20260709 13:11:52.042883 29962 raft_consensus.cc:2468] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7dd1621ce9245288cc3d7889c7c4aba in term 0.
I20260709 13:11:52.043092 30077 tablet_bootstrap.cc:492] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c: No bootstrap required, opened a new log
I20260709 13:11:52.043174 30081 tablet_bootstrap.cc:492] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6: No bootstrap required, opened a new log
I20260709 13:11:52.043671 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6453b7b7a07e4d5996046c4e600fe521" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c" is_pre_election: true
I20260709 13:11:52.043920 30077 ts_tablet_manager.cc:1403] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.013s
I20260709 13:11:52.036252 30076 ts_tablet_manager.cc:1434] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
W20260709 13:11:52.045269 29852 leader_election.cc:343] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:52.045522 30076 tablet_bootstrap.cc:492] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap starting.
I20260709 13:11:52.047132 29850 leader_election.cc:304] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 59961b872d794a10973133cd9e9b175c
I20260709 13:11:52.047570 30077 raft_consensus.cc:359] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.048302 30079 raft_consensus.cc:2804] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:52.048488 30077 raft_consensus.cc:385] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.048849 30079 raft_consensus.cc:493] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.048978 30077 raft_consensus.cc:740] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.049369 30079 raft_consensus.cc:3060] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.043993 30081 ts_tablet_manager.cc:1403] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.009s
I20260709 13:11:52.052569 30076 tablet_bootstrap.cc:654] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.053151 30081 raft_consensus.cc:359] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.054071 30081 raft_consensus.cc:385] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.054419 30081 raft_consensus.cc:740] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.055425 30081 consensus_queue.cc:260] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.058164 30081 ts_tablet_manager.cc:1434] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:52.058454 30076 tablet_bootstrap.cc:492] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba: No bootstrap required, opened a new log
I20260709 13:11:52.058961 30076 ts_tablet_manager.cc:1403] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba: Time spent bootstrapping tablet: real 0.014s	user 0.003s	sys 0.008s
I20260709 13:11:52.059274 30081 tablet_bootstrap.cc:492] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6: Bootstrap starting.
I20260709 13:11:52.060791 30079 raft_consensus.cc:515] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.061785 30076 raft_consensus.cc:359] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.062470 30076 raft_consensus.cc:385] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.062731 30076 raft_consensus.cc:740] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.063647 29962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6453b7b7a07e4d5996046c4e600fe521" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
I20260709 13:11:52.063493 30076 consensus_queue.cc:260] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.064224 29962 raft_consensus.cc:3060] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.065400 30082 raft_consensus.cc:493] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.065997 30082 raft_consensus.cc:515] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.060544 30077 consensus_queue.cc:260] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.070290 30082 leader_election.cc:290] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:11:52.075927 30082 raft_consensus.cc:493] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.076781 30082 raft_consensus.cc:515] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.078147 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6453b7b7a07e4d5996046c4e600fe521" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c"
W20260709 13:11:52.081248 29852 leader_election.cc:343] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:52.085454 30082 leader_election.cc:290] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:11:52.075896 30079 leader_election.cc:290] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 election: Requested vote from peers 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:52.086732 30079 raft_consensus.cc:493] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.087250 30079 raft_consensus.cc:515] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } }
I20260709 13:11:52.090415 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e2fa1a8c9c43cd80229ffcab41ddf5" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c" is_pre_election: true
I20260709 13:11:52.091156 30036 raft_consensus.cc:2468] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7dd1621ce9245288cc3d7889c7c4aba in term 0.
I20260709 13:11:52.092543 29852 leader_election.cc:304] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59961b872d794a10973133cd9e9b175c, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:11:52.095752 29961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e2fa1a8c9c43cd80229ffcab41ddf5" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6" is_pre_election: true
W20260709 13:11:52.097949 29850 leader_election.cc:343] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:52.098874 30082 raft_consensus.cc:493] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.100337 30081 tablet_bootstrap.cc:654] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.099701 30082 raft_consensus.cc:515] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.103073 30082 leader_election.cc:290] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:11:52.104430 30079 leader_election.cc:290] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:11:52.105746 30079 raft_consensus.cc:2804] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:52.106297 30079 raft_consensus.cc:493] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.106784 30079 raft_consensus.cc:3060] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.112170 29962 raft_consensus.cc:2468] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7dd1621ce9245288cc3d7889c7c4aba in term 1.
I20260709 13:11:52.114017 29850 leader_election.cc:304] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 59961b872d794a10973133cd9e9b175c
I20260709 13:11:52.114264 30109 raft_consensus.cc:493] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.115775 30104 raft_consensus.cc:2804] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:52.115684 30109 raft_consensus.cc:515] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.116492 30076 ts_tablet_manager.cc:1434] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba: Time spent starting tablet: real 0.057s	user 0.029s	sys 0.023s
I20260709 13:11:52.119045 29962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6" is_pre_election: true
W20260709 13:11:52.120453 29850 leader_election.cc:343] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:52.120731 30076 tablet_bootstrap.cc:492] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap starting.
I20260709 13:11:52.121553 30109 leader_election.cc:290] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:52.122691 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c" is_pre_election: true
I20260709 13:11:52.123445 30036 raft_consensus.cc:2468] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7dd1621ce9245288cc3d7889c7c4aba in term 0.
I20260709 13:11:52.124830 29852 leader_election.cc:304] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59961b872d794a10973133cd9e9b175c, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 0bdc55fd89784396b2426f8b21ca85e6
I20260709 13:11:52.126904 30077 ts_tablet_manager.cc:1434] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.009s
I20260709 13:11:52.126104 30109 raft_consensus.cc:2804] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:52.127835 30109 raft_consensus.cc:493] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.128054 30077 tablet_bootstrap.cc:492] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c: Bootstrap starting.
I20260709 13:11:52.128258 30109 raft_consensus.cc:3060] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.128540 30076 tablet_bootstrap.cc:654] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.138669 30104 raft_consensus.cc:697] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 LEADER]: Becoming Leader. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Running, Role: LEADER
I20260709 13:11:52.139856 30104 consensus_queue.cc:237] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.142815 30079 raft_consensus.cc:515] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } }
I20260709 13:11:52.144795 30076 tablet_bootstrap.cc:492] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba: No bootstrap required, opened a new log
I20260709 13:11:52.145380 30076 ts_tablet_manager.cc:1403] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.007s
I20260709 13:11:52.145892 30081 tablet_bootstrap.cc:492] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6: No bootstrap required, opened a new log
I20260709 13:11:52.146620 30081 ts_tablet_manager.cc:1403] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6: Time spent bootstrapping tablet: real 0.088s	user 0.006s	sys 0.009s
I20260709 13:11:52.147493 30077 tablet_bootstrap.cc:654] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.147822 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e2fa1a8c9c43cd80229ffcab41ddf5" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c"
I20260709 13:11:52.148445 30036 raft_consensus.cc:3060] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.148307 30076 raft_consensus.cc:359] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.149170 30076 raft_consensus.cc:385] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.149536 30076 raft_consensus.cc:740] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.150537 30076 consensus_queue.cc:260] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.151995 30081 raft_consensus.cc:359] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.155464 30081 raft_consensus.cc:385] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.152258 29962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e2fa1a8c9c43cd80229ffcab41ddf5" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
I20260709 13:11:52.155937 30081 raft_consensus.cc:740] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.152777 30076 ts_tablet_manager.cc:1434] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:11:52.157508 30076 tablet_bootstrap.cc:492] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap starting.
I20260709 13:11:52.157166 30081 consensus_queue.cc:260] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.158407 30036 raft_consensus.cc:2468] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7dd1621ce9245288cc3d7889c7c4aba in term 1.
W20260709 13:11:52.159441 29850 leader_election.cc:343] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:52.160085 29852 leader_election.cc:304] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59961b872d794a10973133cd9e9b175c, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 0bdc55fd89784396b2426f8b21ca85e6
I20260709 13:11:52.152760 30079 leader_election.cc:290] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 election: Requested vote from peers 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:11:52.154402 30110 raft_consensus.cc:493] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.161212 30110 raft_consensus.cc:515] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.161576 30079 raft_consensus.cc:2804] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:52.162146 30079 raft_consensus.cc:697] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 LEADER]: Becoming Leader. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Running, Role: LEADER
I20260709 13:11:52.163046 30079 consensus_queue.cc:237] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } }
I20260709 13:11:52.164132 29962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b41c54dcc4471baf2f679730bfadd3" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6" is_pre_election: true
I20260709 13:11:52.164470 30076 tablet_bootstrap.cc:654] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.164804 29962 raft_consensus.cc:2468] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7dd1621ce9245288cc3d7889c7c4aba in term 0.
I20260709 13:11:52.166196 29850 leader_election.cc:304] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:11:52.167336 30081 ts_tablet_manager.cc:1434] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:11:52.167541 30110 leader_election.cc:290] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:52.169359 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b41c54dcc4471baf2f679730bfadd3" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c" is_pre_election: true
I20260709 13:11:52.170281 30035 raft_consensus.cc:2468] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7dd1621ce9245288cc3d7889c7c4aba in term 0.
I20260709 13:11:52.171132 30089 raft_consensus.cc:493] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.167145 30115 raft_consensus.cc:2804] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:52.171684 30089 raft_consensus.cc:515] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.172205 30115 raft_consensus.cc:493] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.172631 30115 raft_consensus.cc:3060] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.174503 30089 leader_election.cc:290] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:52.172871 30077 tablet_bootstrap.cc:492] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c: No bootstrap required, opened a new log
I20260709 13:11:52.178042 30077 ts_tablet_manager.cc:1403] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.006s
I20260709 13:11:52.182130 30077 raft_consensus.cc:359] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.183152 30077 raft_consensus.cc:385] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.183519 30077 raft_consensus.cc:740] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.154726 30109 raft_consensus.cc:515] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.187963 29887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" is_pre_election: true
I20260709 13:11:52.188349 30109 leader_election.cc:290] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 election: Requested vote from peers 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:52.188928 29887 raft_consensus.cc:2393] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59961b872d794a10973133cd9e9b175c in current term 1: Already voted for candidate b7dd1621ce9245288cc3d7889c7c4aba in this term.
I20260709 13:11:52.190188 29886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31ade6968c5458ca21ba8d950f01883" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" is_pre_election: true
I20260709 13:11:52.191922 29885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b41c54dcc4471baf2f679730bfadd3" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" is_pre_election: true
I20260709 13:11:52.193758 29962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
I20260709 13:11:52.194339 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c"
I20260709 13:11:52.195290 30036 raft_consensus.cc:3060] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:11:52.195860 29850 leader_election.cc:343] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:11:52.197372 30001 leader_election.cc:343] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:52.190251 29785 catalog_manager.cc:5697] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba reported cstate change: term changed from 0 to 1, leader changed from <none> to b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1). New cstate: current_term: 1 leader_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.201624 30081 tablet_bootstrap.cc:492] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6: Bootstrap starting.
I20260709 13:11:52.203848 30077 consensus_queue.cc:260] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.215615 30089 raft_consensus.cc:493] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.216303 30089 raft_consensus.cc:515] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.218750 30089 leader_election.cc:290] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:52.219473 30106 raft_consensus.cc:493] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.220263 30106 raft_consensus.cc:515] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.224119 29886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afcae80938b4e4d8cc5e34c18a8e90b" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" is_pre_election: true
I20260709 13:11:52.224611 30077 ts_tablet_manager.cc:1434] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.002s
I20260709 13:11:52.224822 29886 raft_consensus.cc:2468] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 0.
I20260709 13:11:52.226894 30077 tablet_bootstrap.cc:492] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c: Bootstrap starting.
I20260709 13:11:52.225942 30106 leader_election.cc:290] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:11:52.227828 30001 leader_election.cc:304] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59961b872d794a10973133cd9e9b175c, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:11:52.228796 30106 raft_consensus.cc:2804] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:52.229063 30036 raft_consensus.cc:2468] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7dd1621ce9245288cc3d7889c7c4aba in term 1.
I20260709 13:11:52.229152 30106 raft_consensus.cc:493] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.229779 30106 raft_consensus.cc:3060] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.230520 29852 leader_election.cc:304] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59961b872d794a10973133cd9e9b175c, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 0bdc55fd89784396b2426f8b21ca85e6
I20260709 13:11:52.231743 30079 raft_consensus.cc:2804] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:52.232292 30079 raft_consensus.cc:697] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 LEADER]: Becoming Leader. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Running, Role: LEADER
I20260709 13:11:52.225948 30115 raft_consensus.cc:515] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.233278 29885 raft_consensus.cc:2393] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59961b872d794a10973133cd9e9b175c in current term 1: Already voted for candidate b7dd1621ce9245288cc3d7889c7c4aba in this term.
I20260709 13:11:52.233125 30079 consensus_queue.cc:237] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.234375 30115 leader_election.cc:290] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 election: Requested vote from peers 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:52.231845 30081 tablet_bootstrap.cc:654] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.237597 29962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b41c54dcc4471baf2f679730bfadd3" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
I20260709 13:11:52.237727 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b41c54dcc4471baf2f679730bfadd3" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c"
I20260709 13:11:52.240721 29962 raft_consensus.cc:3060] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.242930 30076 tablet_bootstrap.cc:492] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba: No bootstrap required, opened a new log
I20260709 13:11:52.243464 30076 ts_tablet_manager.cc:1403] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent bootstrapping tablet: real 0.086s	user 0.039s	sys 0.026s
I20260709 13:11:52.246408 30076 raft_consensus.cc:359] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.247192 30076 raft_consensus.cc:385] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.247524 30076 raft_consensus.cc:740] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.240855 30036 raft_consensus.cc:3060] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.252506 30106 raft_consensus.cc:515] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.253640 30076 consensus_queue.cc:260] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.259735 30076 ts_tablet_manager.cc:1434] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:11:52.264600 30106 leader_election.cc:290] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 1 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:11:52.266167 29961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6" is_pre_election: true
I20260709 13:11:52.268520 29959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b41c54dcc4471baf2f679730bfadd3" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6" is_pre_election: true
I20260709 13:11:52.268682 29960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31ade6968c5458ca21ba8d950f01883" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6" is_pre_election: true
W20260709 13:11:52.269116 29999 leader_election.cc:343] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:52.269706 29999 leader_election.cc:304] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59961b872d794a10973133cd9e9b175c; no voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba
I20260709 13:11:52.270304 29958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afcae80938b4e4d8cc5e34c18a8e90b" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
I20260709 13:11:52.266363 29885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afcae80938b4e4d8cc5e34c18a8e90b" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba"
I20260709 13:11:52.266744 30036 raft_consensus.cc:2468] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7dd1621ce9245288cc3d7889c7c4aba in term 1.
I20260709 13:11:52.272166 29958 raft_consensus.cc:3060] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.271000 30082 raft_consensus.cc:2749] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:52.273896 30082 raft_consensus.cc:493] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.274451 30082 raft_consensus.cc:515] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.263844 29962 raft_consensus.cc:2468] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7dd1621ce9245288cc3d7889c7c4aba in term 1.
I20260709 13:11:52.278056 29961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afcae80938b4e4d8cc5e34c18a8e90b" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6" is_pre_election: true
I20260709 13:11:52.278739 29850 leader_election.cc:304] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:11:52.279057 29999 leader_election.cc:304] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59961b872d794a10973133cd9e9b175c; no voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba
I20260709 13:11:52.279338 29885 raft_consensus.cc:3060] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.279737 30079 raft_consensus.cc:2804] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:52.280225 30079 raft_consensus.cc:697] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 LEADER]: Becoming Leader. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Running, Role: LEADER
W20260709 13:11:52.280448 29999 leader_election.cc:343] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:11:52.280992 29999 leader_election.cc:304] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59961b872d794a10973133cd9e9b175c; no voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba
I20260709 13:11:52.281072 30079 consensus_queue.cc:237] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.283483 30077 tablet_bootstrap.cc:654] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.283581 29886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79fd06a98564834a22f607ce3330fc8" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" is_pre_election: true
I20260709 13:11:52.284374 29886 raft_consensus.cc:2468] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 0.
I20260709 13:11:52.285619 30082 leader_election.cc:290] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:11:52.286177 30001 leader_election.cc:304] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59961b872d794a10973133cd9e9b175c, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:11:52.286211 30082 raft_consensus.cc:2749] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:52.287235 30106 raft_consensus.cc:2749] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:52.294422 30082 raft_consensus.cc:2804] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:52.294914 30082 raft_consensus.cc:493] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.295408 30082 raft_consensus.cc:3060] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.296149 29962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79fd06a98564834a22f607ce3330fc8" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6" is_pre_election: true
I20260709 13:11:52.299346 29962 raft_consensus.cc:2468] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 0.
I20260709 13:11:52.302817 29958 raft_consensus.cc:2468] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 1.
I20260709 13:11:52.302963 29886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79fd06a98564834a22f607ce3330fc8" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" is_pre_election: true
I20260709 13:11:52.303647 29886 raft_consensus.cc:2468] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 0.
I20260709 13:11:52.305553 29886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dbf557381f4433b6140e94368854c6" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" is_pre_election: true
I20260709 13:11:52.306253 29886 raft_consensus.cc:2468] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 0.
I20260709 13:11:52.307842 29999 leader_election.cc:304] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, 59961b872d794a10973133cd9e9b175c; no voters: 
I20260709 13:11:52.305648 29885 raft_consensus.cc:2468] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 1.
I20260709 13:11:52.308743 30082 raft_consensus.cc:515] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.309218 29927 leader_election.cc:304] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:11:52.315109 30089 raft_consensus.cc:2804] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:52.315855 30089 raft_consensus.cc:493] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.316203 30089 raft_consensus.cc:3060] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.320441 29885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79fd06a98564834a22f607ce3330fc8" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba"
I20260709 13:11:52.321101 29885 raft_consensus.cc:3060] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.324680 30089 raft_consensus.cc:515] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.311316 30106 raft_consensus.cc:2804] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:52.326619 30106 raft_consensus.cc:697] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [term 1 LEADER]: Becoming Leader. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Running, Role: LEADER
I20260709 13:11:52.326855 30089 leader_election.cc:290] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 1 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:52.327543 30106 consensus_queue.cc:237] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.326803 29785 catalog_manager.cc:5697] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba reported cstate change: term changed from 0 to 1, leader changed from <none> to b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1). New cstate: current_term: 1 leader_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.318758 30082 leader_election.cc:290] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 1 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:11:52.330252 29785 catalog_manager.cc:5697] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba reported cstate change: term changed from 0 to 1, leader changed from <none> to b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1). New cstate: current_term: 1 leader_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.333218 30081 tablet_bootstrap.cc:492] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6: No bootstrap required, opened a new log
I20260709 13:11:52.332867 29785 catalog_manager.cc:5697] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba reported cstate change: term changed from 0 to 1, leader changed from <none> to b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1). New cstate: current_term: 1 leader_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.333778 30081 ts_tablet_manager.cc:1403] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6: Time spent bootstrapping tablet: real 0.132s	user 0.019s	sys 0.000s
I20260709 13:11:52.334281 29885 raft_consensus.cc:2468] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 1.
I20260709 13:11:52.335191 29927 leader_election.cc:304] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:11:52.335789 30001 leader_election.cc:304] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59961b872d794a10973133cd9e9b175c, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:11:52.337070 30089 raft_consensus.cc:2804] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:52.337515 30089 raft_consensus.cc:493] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.337492 29885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79fd06a98564834a22f607ce3330fc8" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba"
I20260709 13:11:52.338078 30089 raft_consensus.cc:3060] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.338418 29885 raft_consensus.cc:2393] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0bdc55fd89784396b2426f8b21ca85e6 in current term 1: Already voted for candidate 59961b872d794a10973133cd9e9b175c in this term.
I20260709 13:11:52.338228 30125 raft_consensus.cc:2804] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:52.340483 30125 raft_consensus.cc:697] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [term 1 LEADER]: Becoming Leader. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Running, Role: LEADER
I20260709 13:11:52.341154 30077 tablet_bootstrap.cc:492] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c: No bootstrap required, opened a new log
I20260709 13:11:52.341688 30077 ts_tablet_manager.cc:1403] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c: Time spent bootstrapping tablet: real 0.115s	user 0.023s	sys 0.008s
I20260709 13:11:52.341398 30125 consensus_queue.cc:237] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.347864 30077 raft_consensus.cc:359] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.348819 30077 raft_consensus.cc:385] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.349067 30077 raft_consensus.cc:740] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.349738 30077 consensus_queue.cc:260] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.353830 30077 ts_tablet_manager.cc:1434] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:11:52.339672 30081 raft_consensus.cc:359] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } }
I20260709 13:11:52.355014 30077 tablet_bootstrap.cc:492] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c: Bootstrap starting.
I20260709 13:11:52.356389 30089 raft_consensus.cc:515] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.356834 29962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79fd06a98564834a22f607ce3330fc8" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
I20260709 13:11:52.355376 30081 raft_consensus.cc:385] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.359236 29784 catalog_manager.cc:5697] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c reported cstate change: term changed from 0 to 1, leader changed from <none> to 59961b872d794a10973133cd9e9b175c (127.20.40.3). New cstate: current_term: 1 leader_uuid: "59961b872d794a10973133cd9e9b175c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:52.360193 30089 leader_election.cc:290] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 1 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:52.360761 30089 raft_consensus.cc:493] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.361001 29962 raft_consensus.cc:2393] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 59961b872d794a10973133cd9e9b175c in current term 1: Already voted for candidate 0bdc55fd89784396b2426f8b21ca85e6 in this term.
I20260709 13:11:52.361169 30089 raft_consensus.cc:515] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.362011 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dbf557381f4433b6140e94368854c6" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c" is_pre_election: true
I20260709 13:11:52.359004 30081 raft_consensus.cc:740] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.363927 30034 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79fd06a98564834a22f607ce3330fc8" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c"
I20260709 13:11:52.363046 30035 raft_consensus.cc:2468] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 0.
I20260709 13:11:52.363963 30081 consensus_queue.cc:260] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } }
I20260709 13:11:52.372843 30081 ts_tablet_manager.cc:1434] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.002s
I20260709 13:11:52.361145 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79fd06a98564834a22f607ce3330fc8" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c" is_pre_election: true
I20260709 13:11:52.375362 30077 tablet_bootstrap.cc:654] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.380335 30081 tablet_bootstrap.cc:492] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6: Bootstrap starting.
I20260709 13:11:52.382829 29885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dbf557381f4433b6140e94368854c6" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba"
I20260709 13:11:52.383571 29885 raft_consensus.cc:3060] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.384418 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dbf557381f4433b6140e94368854c6" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c"
I20260709 13:11:52.385114 30036 raft_consensus.cc:3060] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.384476 29886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451ea5ec3bad4c7f931345023c402184" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" is_pre_election: true
I20260709 13:11:52.391289 29927 leader_election.cc:304] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6; no voters: 59961b872d794a10973133cd9e9b175c, b7dd1621ce9245288cc3d7889c7c4aba
I20260709 13:11:52.391727 29886 raft_consensus.cc:2468] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 0.
I20260709 13:11:52.392652 30130 raft_consensus.cc:2749] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:11:52.395987 30089 leader_election.cc:290] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:52.396119 29885 raft_consensus.cc:2468] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 1.
I20260709 13:11:52.397190 29927 leader_election.cc:304] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:11:52.398885 30089 raft_consensus.cc:2804] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:52.399408 30089 raft_consensus.cc:493] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.399842 30089 raft_consensus.cc:3060] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.406863 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451ea5ec3bad4c7f931345023c402184" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c" is_pre_election: true
I20260709 13:11:52.407871 30035 raft_consensus.cc:2468] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 0.
I20260709 13:11:52.409474 29927 leader_election.cc:304] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:11:52.410562 30130 raft_consensus.cc:2804] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:52.415608 30081 tablet_bootstrap.cc:654] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.415910 30077 tablet_bootstrap.cc:492] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c: No bootstrap required, opened a new log
I20260709 13:11:52.416435 30077 ts_tablet_manager.cc:1403] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.024s
I20260709 13:11:52.419332 30036 raft_consensus.cc:2468] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 1.
I20260709 13:11:52.420709 30130 raft_consensus.cc:697] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Running, Role: LEADER
I20260709 13:11:52.421175 30077 raft_consensus.cc:359] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.421909 30077 raft_consensus.cc:385] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.421622 30130 consensus_queue.cc:237] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.422166 30077 raft_consensus.cc:740] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.422863 30077 consensus_queue.cc:260] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.424855 30077 ts_tablet_manager.cc:1434] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:52.424435 29785 catalog_manager.cc:5697] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c reported cstate change: term changed from 0 to 1, leader changed from <none> to 59961b872d794a10973133cd9e9b175c (127.20.40.3). New cstate: current_term: 1 leader_uuid: "59961b872d794a10973133cd9e9b175c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:52.431250 30089 raft_consensus.cc:515] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.433324 30089 leader_election.cc:290] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 1 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:52.434885 30081 tablet_bootstrap.cc:492] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6: No bootstrap required, opened a new log
I20260709 13:11:52.435173 29885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451ea5ec3bad4c7f931345023c402184" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba"
I20260709 13:11:52.435506 30081 ts_tablet_manager.cc:1403] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.009s
I20260709 13:11:52.435854 29885 raft_consensus.cc:3060] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.436699 29784 catalog_manager.cc:5697] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2). New cstate: current_term: 1 leader_uuid: "0bdc55fd89784396b2426f8b21ca85e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.438861 30081 raft_consensus.cc:359] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.439656 30081 raft_consensus.cc:385] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.439760 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451ea5ec3bad4c7f931345023c402184" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c"
I20260709 13:11:52.440014 30081 raft_consensus.cc:740] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.440459 30036 raft_consensus.cc:3060] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.440797 30081 consensus_queue.cc:260] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.443195 30081 ts_tablet_manager.cc:1434] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:52.444150 30081 tablet_bootstrap.cc:492] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6: Bootstrap starting.
I20260709 13:11:52.448411 30036 raft_consensus.cc:2468] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 1.
I20260709 13:11:52.450161 30081 tablet_bootstrap.cc:654] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.449867 29927 leader_election.cc:304] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, 59961b872d794a10973133cd9e9b175c; no voters: 
I20260709 13:11:52.451427 30089 raft_consensus.cc:2804] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:52.451941 30089 raft_consensus.cc:697] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 LEADER]: Becoming Leader. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Running, Role: LEADER
I20260709 13:11:52.452804 30089 consensus_queue.cc:237] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.455139 30081 tablet_bootstrap.cc:492] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6: No bootstrap required, opened a new log
I20260709 13:11:52.455276 29885 raft_consensus.cc:2468] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 1.
I20260709 13:11:52.455721 30081 ts_tablet_manager.cc:1403] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.001s
I20260709 13:11:52.458196 30081 raft_consensus.cc:359] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.458818 30081 raft_consensus.cc:385] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.459082 30081 raft_consensus.cc:740] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.459717 30081 consensus_queue.cc:260] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.461313 30081 ts_tablet_manager.cc:1434] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:11:52.462193 30081 tablet_bootstrap.cc:492] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6: Bootstrap starting.
I20260709 13:11:52.464589 29784 catalog_manager.cc:5697] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2). New cstate: current_term: 1 leader_uuid: "0bdc55fd89784396b2426f8b21ca85e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.466212 30081 tablet_bootstrap.cc:654] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6: Neither blocks nor log segments found. Creating new log.
I20260709 13:11:52.468900 30079 raft_consensus.cc:493] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.472501 30079 raft_consensus.cc:515] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.475724 30081 tablet_bootstrap.cc:492] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6: No bootstrap required, opened a new log
I20260709 13:11:52.476341 30081 ts_tablet_manager.cc:1403] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.005s
I20260709 13:11:52.479739 30081 raft_consensus.cc:359] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.480463 30081 raft_consensus.cc:385] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:11:52.480796 30081 raft_consensus.cc:740] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Initialized, Role: FOLLOWER
I20260709 13:11:52.480726 29962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd9b49df4f447879e0ca7e89ffccd52" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6" is_pre_election: true
I20260709 13:11:52.482029 30081 consensus_queue.cc:260] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.482167 29962 raft_consensus.cc:2468] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7dd1621ce9245288cc3d7889c7c4aba in term 0.
I20260709 13:11:52.484272 29850 leader_election.cc:304] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:11:52.484542 30081 ts_tablet_manager.cc:1434] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:52.485419 30109 raft_consensus.cc:2804] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:52.482174 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd9b49df4f447879e0ca7e89ffccd52" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c" is_pre_election: true
I20260709 13:11:52.485999 30109 raft_consensus.cc:493] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.486063 30079 leader_election.cc:290] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:52.486260 30036 raft_consensus.cc:2468] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7dd1621ce9245288cc3d7889c7c4aba in term 0.
I20260709 13:11:52.486467 30109 raft_consensus.cc:3060] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.497399 30109 raft_consensus.cc:515] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.499552 30109 leader_election.cc:290] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 election: Requested vote from peers 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:52.500764 29962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd9b49df4f447879e0ca7e89ffccd52" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
I20260709 13:11:52.500870 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd9b49df4f447879e0ca7e89ffccd52" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c"
I20260709 13:11:52.501669 29962 raft_consensus.cc:3060] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.501751 30036 raft_consensus.cc:3060] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.509135 30036 raft_consensus.cc:2468] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7dd1621ce9245288cc3d7889c7c4aba in term 1.
I20260709 13:11:52.509157 29962 raft_consensus.cc:2468] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7dd1621ce9245288cc3d7889c7c4aba in term 1.
I20260709 13:11:52.510412 29852 leader_election.cc:304] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59961b872d794a10973133cd9e9b175c, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:11:52.511240 30109 raft_consensus.cc:2804] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:52.511663 30109 raft_consensus.cc:697] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 LEADER]: Becoming Leader. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Running, Role: LEADER
I20260709 13:11:52.512465 30109 consensus_queue.cc:237] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.520624 29784 catalog_manager.cc:5697] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba reported cstate change: term changed from 0 to 1, leader changed from <none> to b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1). New cstate: current_term: 1 leader_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.631903 30109 raft_consensus.cc:493] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.632493 30109 raft_consensus.cc:515] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.634349 30109 leader_election.cc:290] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:52.635183 29962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31ade6968c5458ca21ba8d950f01883" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6" is_pre_election: true
I20260709 13:11:52.635412 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31ade6968c5458ca21ba8d950f01883" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c" is_pre_election: true
I20260709 13:11:52.635922 29962 raft_consensus.cc:2468] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7dd1621ce9245288cc3d7889c7c4aba in term 0.
I20260709 13:11:52.636082 30036 raft_consensus.cc:2468] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b7dd1621ce9245288cc3d7889c7c4aba in term 0.
I20260709 13:11:52.637027 29850 leader_election.cc:304] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:11:52.637962 30109 raft_consensus.cc:2804] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:11:52.638283 30109 raft_consensus.cc:493] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:52.638563 30109 raft_consensus.cc:3060] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.643865 30109 raft_consensus.cc:515] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.644292 30079 consensus_queue.cc:1048] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.645509 30109 leader_election.cc:290] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 election: Requested vote from peers 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:52.646409 29962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31ade6968c5458ca21ba8d950f01883" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
I20260709 13:11:52.646530 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31ade6968c5458ca21ba8d950f01883" candidate_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c"
I20260709 13:11:52.647066 29962 raft_consensus.cc:3060] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.647154 30036 raft_consensus.cc:3060] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.651299 30125 raft_consensus.cc:493] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:52.651829 30125 raft_consensus.cc:515] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.654098 30125 leader_election.cc:290] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:11:52.656143 29885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6453b7b7a07e4d5996046c4e600fe521" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" is_pre_election: true
I20260709 13:11:52.657814 29958 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6453b7b7a07e4d5996046c4e600fe521" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6" is_pre_election: true
I20260709 13:11:52.658810 29958 raft_consensus.cc:2393] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59961b872d794a10973133cd9e9b175c in current term 1: Already voted for candidate b7dd1621ce9245288cc3d7889c7c4aba in this term.
I20260709 13:11:52.659999 29999 leader_election.cc:304] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59961b872d794a10973133cd9e9b175c; no voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba
I20260709 13:11:52.661366 30125 raft_consensus.cc:3060] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.663439 30036 raft_consensus.cc:2468] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7dd1621ce9245288cc3d7889c7c4aba in term 1.
I20260709 13:11:52.664996 29852 leader_election.cc:304] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59961b872d794a10973133cd9e9b175c, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:11:52.666491 30109 raft_consensus.cc:2804] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:11:52.667279 30109 raft_consensus.cc:697] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 LEADER]: Becoming Leader. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Running, Role: LEADER
I20260709 13:11:52.668221 30109 consensus_queue.cc:237] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:52.670399 30125 raft_consensus.cc:2749] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:11:52.676072 29962 raft_consensus.cc:2468] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b7dd1621ce9245288cc3d7889c7c4aba in term 1.
I20260709 13:11:52.681905 30115 consensus_queue.cc:1048] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.689129 29784 catalog_manager.cc:5697] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba reported cstate change: term changed from 0 to 1, leader changed from <none> to b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1). New cstate: current_term: 1 leader_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:52.713513 29962 raft_consensus.cc:3060] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.715070 30104 consensus_queue.cc:1048] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.722712 30104 consensus_queue.cc:1048] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.735718 30104 consensus_queue.cc:1048] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.736863 30125 consensus_queue.cc:1048] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.756146 29961 raft_consensus.cc:3060] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:11:52.763833 30082 consensus_queue.cc:1048] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:52.768620 30115 consensus_queue.cc:1048] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:52.806104 30082 consensus_queue.cc:1048] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.813602 30089 consensus_queue.cc:1048] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.818540 30082 consensus_queue.cc:1048] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.828752 30133 consensus_queue.cc:1048] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.849709 30133 consensus_queue.cc:1048] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.853112 30115 consensus_queue.cc:1048] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.863294 30133 consensus_queue.cc:1048] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:11:52.866930 30109 consensus_queue.cc:1048] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [LEADER]: Connected to new peer: Peer: permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:52.901897 20640 ts_manager.cc:295] Set tserver state for b7dd1621ce9245288cc3d7889c7c4aba to MAINTENANCE_MODE
I20260709 13:11:52.902760 20640 tablet_server.cc:179] TabletServer@127.20.40.1:0 shutting down...
I20260709 13:11:52.925187 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:52.925984 20640 tablet_replica.cc:333] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba: stopping tablet replica
I20260709 13:11:52.926859 20640 raft_consensus.cc:2243] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:52.927330 20640 raft_consensus.cc:2272] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:52.929596 20640 tablet_replica.cc:333] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba: stopping tablet replica
I20260709 13:11:52.930176 20640 raft_consensus.cc:2243] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:52.930575 20640 raft_consensus.cc:2272] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:52.932636 20640 tablet_replica.cc:333] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba: stopping tablet replica
I20260709 13:11:52.933174 20640 raft_consensus.cc:2243] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:52.933862 20640 pending_rounds.cc:70] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba: Trying to abort 1 pending ops.
I20260709 13:11:52.934078 20640 pending_rounds.cc:77] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636710458974208 op_type: NO_OP noop_request { }
I20260709 13:11:52.934386 20640 raft_consensus.cc:2889] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:52.934675 20640 raft_consensus.cc:2272] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:52.936569 20640 tablet_replica.cc:333] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba: stopping tablet replica
I20260709 13:11:52.937114 20640 raft_consensus.cc:2243] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:52.937764 20640 pending_rounds.cc:70] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba: Trying to abort 1 pending ops.
I20260709 13:11:52.937953 20640 pending_rounds.cc:77] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636711099822080 op_type: NO_OP noop_request { }
I20260709 13:11:52.938241 20640 raft_consensus.cc:2889] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:52.938503 20640 raft_consensus.cc:2272] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:52.940418 20640 tablet_replica.cc:333] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba: stopping tablet replica
I20260709 13:11:52.940963 20640 raft_consensus.cc:2243] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:52.941820 20640 raft_consensus.cc:2272] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:52.943835 20640 tablet_replica.cc:333] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba: stopping tablet replica
I20260709 13:11:52.944373 20640 raft_consensus.cc:2243] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:52.945109 20640 raft_consensus.cc:2272] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:52.947175 20640 tablet_replica.cc:333] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba: stopping tablet replica
I20260709 13:11:52.947708 20640 raft_consensus.cc:2243] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:52.948139 20640 raft_consensus.cc:2272] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:52.950438 20640 tablet_replica.cc:333] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba: stopping tablet replica
I20260709 13:11:52.950942 20640 raft_consensus.cc:2243] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:52.951691 20640 raft_consensus.cc:2272] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:52.953714 20640 tablet_replica.cc:333] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba: stopping tablet replica
I20260709 13:11:52.954286 20640 raft_consensus.cc:2243] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:52.954704 20640 raft_consensus.cc:2272] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:52.956661 20640 tablet_replica.cc:333] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba: stopping tablet replica
I20260709 13:11:52.957134 20640 raft_consensus.cc:2243] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:11:52.957922 20640 raft_consensus.cc:2272] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:52.976858 29833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:52.989005 20640 tablet_server.cc:196] TabletServer@127.20.40.1:0 shutdown complete.
W20260709 13:11:53.197521 30001 consensus_peers.cc:597] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.375455 30001 consensus_peers.cc:597] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.385834 29927 consensus_peers.cc:597] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.462348 29927 consensus_peers.cc:597] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:53.880455 30001 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111) [suppressed 101 similar messages]
W20260709 13:11:53.978118 29833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:54.180130 30082 raft_consensus.cc:493] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7dd1621ce9245288cc3d7889c7c4aba)
I20260709 13:11:54.180754 30082 raft_consensus.cc:515] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } }
I20260709 13:11:54.182682 30082 leader_election.cc:290] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:11:54.183925 29961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e2fa1a8c9c43cd80229ffcab41ddf5" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6" is_pre_election: true
W20260709 13:11:54.186391 30001 leader_election.cc:336] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111)
I20260709 13:11:54.186764 30001 leader_election.cc:304] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59961b872d794a10973133cd9e9b175c; no voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba
I20260709 13:11:54.187405 30082 raft_consensus.cc:2749] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:54.199368 30082 raft_consensus.cc:493] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7dd1621ce9245288cc3d7889c7c4aba)
I20260709 13:11:54.199863 30082 raft_consensus.cc:515] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:54.201536 30082 leader_election.cc:290] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:11:54.202625 29961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6453b7b7a07e4d5996046c4e600fe521" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6" is_pre_election: true
W20260709 13:11:54.204876 30001 leader_election.cc:336] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111)
I20260709 13:11:54.205302 30001 leader_election.cc:304] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59961b872d794a10973133cd9e9b175c; no voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba
I20260709 13:11:54.205928 30082 raft_consensus.cc:2749] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:54.222648 30133 raft_consensus.cc:493] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7dd1621ce9245288cc3d7889c7c4aba)
I20260709 13:11:54.223156 30133 raft_consensus.cc:515] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:54.224896 30133 leader_election.cc:290] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:54.226460 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6453b7b7a07e4d5996046c4e600fe521" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c" is_pre_election: true
I20260709 13:11:54.226876 30133 raft_consensus.cc:493] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7dd1621ce9245288cc3d7889c7c4aba)
I20260709 13:11:54.227218 30035 raft_consensus.cc:2468] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 1.
I20260709 13:11:54.227492 30133 raft_consensus.cc:515] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } }
I20260709 13:11:54.228598 29927 leader_election.cc:304] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, 59961b872d794a10973133cd9e9b175c; no voters: 
I20260709 13:11:54.229399 30168 raft_consensus.cc:2804] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:54.229399 29927 leader_election.cc:336] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111)
I20260709 13:11:54.229588 30133 leader_election.cc:290] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469), b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241)
I20260709 13:11:54.229921 30168 raft_consensus.cc:493] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7dd1621ce9245288cc3d7889c7c4aba)
I20260709 13:11:54.230427 30168 raft_consensus.cc:3060] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.231645 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e2fa1a8c9c43cd80229ffcab41ddf5" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c" is_pre_election: true
I20260709 13:11:54.232322 30035 raft_consensus.cc:2468] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 1.
I20260709 13:11:54.233366 29927 leader_election.cc:304] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, 59961b872d794a10973133cd9e9b175c; no voters: 
I20260709 13:11:54.234129 30133 raft_consensus.cc:2804] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:11:54.234455 30133 raft_consensus.cc:493] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7dd1621ce9245288cc3d7889c7c4aba)
I20260709 13:11:54.234809 30133 raft_consensus.cc:3060] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:54.235853 29927 leader_election.cc:336] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111)
I20260709 13:11:54.237905 30168 raft_consensus.cc:515] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:54.239763 30168 leader_election.cc:290] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:54.240180 30133 raft_consensus.cc:515] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } }
I20260709 13:11:54.241174 30035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6453b7b7a07e4d5996046c4e600fe521" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c"
I20260709 13:11:54.241762 30035 raft_consensus.cc:3060] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.242389 30133 leader_election.cc:290] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 election: Requested vote from peers 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469), b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241)
I20260709 13:11:54.243909 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e2fa1a8c9c43cd80229ffcab41ddf5" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c"
W20260709 13:11:54.244035 29927 leader_election.cc:336] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111)
I20260709 13:11:54.244539 30036 raft_consensus.cc:3060] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:54.246100 29927 leader_election.cc:336] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111)
I20260709 13:11:54.249135 30035 raft_consensus.cc:2468] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 2.
I20260709 13:11:54.250381 29927 leader_election.cc:304] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, 59961b872d794a10973133cd9e9b175c; no voters: b7dd1621ce9245288cc3d7889c7c4aba
I20260709 13:11:54.251076 30133 raft_consensus.cc:2804] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:54.251423 30036 raft_consensus.cc:2468] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 2.
I20260709 13:11:54.251588 30133 raft_consensus.cc:697] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Running, Role: LEADER
I20260709 13:11:54.252502 29927 leader_election.cc:304] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, 59961b872d794a10973133cd9e9b175c; no voters: b7dd1621ce9245288cc3d7889c7c4aba
I20260709 13:11:54.252578 30133 consensus_queue.cc:237] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:54.253224 30168 raft_consensus.cc:2804] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:54.253741 30168 raft_consensus.cc:697] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Running, Role: LEADER
I20260709 13:11:54.254542 30168 consensus_queue.cc:237] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } }
I20260709 13:11:54.256809 30082 raft_consensus.cc:493] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7dd1621ce9245288cc3d7889c7c4aba)
I20260709 13:11:54.257333 30082 raft_consensus.cc:515] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:54.259610 30082 leader_election.cc:290] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:11:54.260999 29784 catalog_manager.cc:5697] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 reported cstate change: term changed from 1 to 2, leader changed from b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1) to 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "0bdc55fd89784396b2426f8b21ca85e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:54.262084 29961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6" is_pre_election: true
W20260709 13:11:54.263968 30001 leader_election.cc:336] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111)
I20260709 13:11:54.264317 30001 leader_election.cc:304] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59961b872d794a10973133cd9e9b175c; no voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba
I20260709 13:11:54.264919 30082 raft_consensus.cc:2749] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:54.279126 30168 raft_consensus.cc:493] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7dd1621ce9245288cc3d7889c7c4aba)
I20260709 13:11:54.279826 30168 raft_consensus.cc:515] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:54.281541 30168 leader_election.cc:290] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:54.281379 29784 catalog_manager.cc:5697] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 reported cstate change: term changed from 1 to 2, leader changed from b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1) to 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "0bdc55fd89784396b2426f8b21ca85e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:54.283278 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c" is_pre_election: true
I20260709 13:11:54.283934 30036 raft_consensus.cc:2468] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 1.
I20260709 13:11:54.285032 29927 leader_election.cc:304] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, 59961b872d794a10973133cd9e9b175c; no voters: 
I20260709 13:11:54.285880 30168 raft_consensus.cc:2804] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:54.285966 29927 leader_election.cc:336] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111)
I20260709 13:11:54.286211 30168 raft_consensus.cc:493] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7dd1621ce9245288cc3d7889c7c4aba)
I20260709 13:11:54.286573 30168 raft_consensus.cc:3060] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.292375 30168 raft_consensus.cc:515] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:54.293954 30168 leader_election.cc:290] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:54.295432 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c"
I20260709 13:11:54.296092 30036 raft_consensus.cc:3060] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:54.297564 29927 leader_election.cc:336] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111)
I20260709 13:11:54.301798 30036 raft_consensus.cc:2468] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 2.
I20260709 13:11:54.302980 29927 leader_election.cc:304] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, 59961b872d794a10973133cd9e9b175c; no voters: b7dd1621ce9245288cc3d7889c7c4aba
I20260709 13:11:54.305662 30168 raft_consensus.cc:2804] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:54.306195 30168 raft_consensus.cc:697] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Running, Role: LEADER
I20260709 13:11:54.307083 30168 consensus_queue.cc:237] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:54.311770 30168 raft_consensus.cc:493] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.312242 30168 raft_consensus.cc:515] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:54.314106 30168 leader_election.cc:290] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:54.315686 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd9b49df4f447879e0ca7e89ffccd52" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c" is_pre_election: true
I20260709 13:11:54.315291 29784 catalog_manager.cc:5697] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 reported cstate change: term changed from 1 to 2, leader changed from b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1) to 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "0bdc55fd89784396b2426f8b21ca85e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:54.316385 30036 raft_consensus.cc:2468] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 1.
I20260709 13:11:54.317508 29927 leader_election.cc:304] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, 59961b872d794a10973133cd9e9b175c; no voters: 
I20260709 13:11:54.318244 30168 raft_consensus.cc:2804] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:54.318308 29927 leader_election.cc:336] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111)
I20260709 13:11:54.318650 30168 raft_consensus.cc:493] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.319006 30168 raft_consensus.cc:3060] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.324958 30168 raft_consensus.cc:515] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:54.326658 30168 leader_election.cc:290] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:54.328153 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd9b49df4f447879e0ca7e89ffccd52" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c"
I20260709 13:11:54.328742 30036 raft_consensus.cc:3060] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:54.330152 29927 leader_election.cc:336] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111)
I20260709 13:11:54.334101 30036 raft_consensus.cc:2468] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 2.
I20260709 13:11:54.335074 29927 leader_election.cc:304] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, 59961b872d794a10973133cd9e9b175c; no voters: b7dd1621ce9245288cc3d7889c7c4aba
I20260709 13:11:54.335698 30168 raft_consensus.cc:2804] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:54.336103 30168 raft_consensus.cc:697] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Running, Role: LEADER
I20260709 13:11:54.336709 30168 consensus_queue.cc:237] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:54.343627 29784 catalog_manager.cc:5697] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 reported cstate change: term changed from 1 to 2, leader changed from b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1) to 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "0bdc55fd89784396b2426f8b21ca85e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:54.376046 30168 raft_consensus.cc:493] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7dd1621ce9245288cc3d7889c7c4aba)
I20260709 13:11:54.376636 30168 raft_consensus.cc:515] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:54.378674 30168 leader_election.cc:290] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:54.380383 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b41c54dcc4471baf2f679730bfadd3" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c" is_pre_election: true
W20260709 13:11:54.382233 29927 leader_election.cc:336] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111)
I20260709 13:11:54.382606 29927 leader_election.cc:304] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6; no voters: 59961b872d794a10973133cd9e9b175c, b7dd1621ce9245288cc3d7889c7c4aba
I20260709 13:11:54.383289 30168 raft_consensus.cc:2749] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:11:54.387022 30082 raft_consensus.cc:493] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b7dd1621ce9245288cc3d7889c7c4aba)
I20260709 13:11:54.387482 30082 raft_consensus.cc:515] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:54.389050 30082 leader_election.cc:290] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:11:54.390106 29961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b41c54dcc4471baf2f679730bfadd3" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6" is_pre_election: true
I20260709 13:11:54.390718 29961 raft_consensus.cc:2468] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 1.
I20260709 13:11:54.391615 29999 leader_election.cc:304] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, 59961b872d794a10973133cd9e9b175c; no voters: 
I20260709 13:11:54.392362 30082 raft_consensus.cc:2804] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:54.392594 30001 leader_election.cc:336] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111)
I20260709 13:11:54.392726 30082 raft_consensus.cc:493] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b7dd1621ce9245288cc3d7889c7c4aba)
I20260709 13:11:54.393146 30082 raft_consensus.cc:3060] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.398079 30082 raft_consensus.cc:515] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:54.399770 30082 leader_election.cc:290] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 2 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:11:54.400837 29961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83b41c54dcc4471baf2f679730bfadd3" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
I20260709 13:11:54.401486 29961 raft_consensus.cc:3060] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:54.403292 30001 leader_election.cc:336] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111)
I20260709 13:11:54.406777 29961 raft_consensus.cc:2468] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 2.
I20260709 13:11:54.407719 29999 leader_election.cc:304] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, 59961b872d794a10973133cd9e9b175c; no voters: b7dd1621ce9245288cc3d7889c7c4aba
I20260709 13:11:54.408483 30082 raft_consensus.cc:2804] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:54.409403 30082 raft_consensus.cc:697] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [term 2 LEADER]: Becoming Leader. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Running, Role: LEADER
I20260709 13:11:54.410161 30082 consensus_queue.cc:237] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:54.416766 29784 catalog_manager.cc:5697] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c reported cstate change: term changed from 1 to 2, leader changed from b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1) to 59961b872d794a10973133cd9e9b175c (127.20.40.3). New cstate: current_term: 2 leader_uuid: "59961b872d794a10973133cd9e9b175c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:54.538748 30168 raft_consensus.cc:493] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:54.539280 30168 raft_consensus.cc:515] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:54.541320 30168 leader_election.cc:290] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:54.542960 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31ade6968c5458ca21ba8d950f01883" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c" is_pre_election: true
I20260709 13:11:54.543691 30036 raft_consensus.cc:2468] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 1.
I20260709 13:11:54.544677 29927 leader_election.cc:304] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, 59961b872d794a10973133cd9e9b175c; no voters: 
I20260709 13:11:54.545408 30168 raft_consensus.cc:2804] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:11:54.545517 29927 leader_election.cc:336] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111)
I20260709 13:11:54.545918 30168 raft_consensus.cc:493] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:54.546320 30168 raft_consensus.cc:3060] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:54.551723 30168 raft_consensus.cc:515] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:54.553589 30168 leader_election.cc:290] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:54.555114 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c31ade6968c5458ca21ba8d950f01883" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59961b872d794a10973133cd9e9b175c"
I20260709 13:11:54.555775 30036 raft_consensus.cc:3060] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:54.557204 29927 leader_election.cc:336] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111)
I20260709 13:11:54.561121 30036 raft_consensus.cc:2468] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 2.
I20260709 13:11:54.562184 29927 leader_election.cc:304] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, 59961b872d794a10973133cd9e9b175c; no voters: b7dd1621ce9245288cc3d7889c7c4aba
I20260709 13:11:54.562840 30168 raft_consensus.cc:2804] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:11:54.563244 30168 raft_consensus.cc:697] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Running, Role: LEADER
I20260709 13:11:54.564002 30168 consensus_queue.cc:237] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:54.570737 29784 catalog_manager.cc:5697] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 reported cstate change: term changed from 1 to 2, leader changed from b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1) to 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "0bdc55fd89784396b2426f8b21ca85e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:54.711042 29927 consensus_peers.cc:597] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.799790 29927 consensus_peers.cc:597] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:54.824983 30036 raft_consensus.cc:1275] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Refusing update from remote peer 0bdc55fd89784396b2426f8b21ca85e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:54.826253 30168 consensus_queue.cc:1048] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:11:54.836984 30035 raft_consensus.cc:1275] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Refusing update from remote peer 0bdc55fd89784396b2426f8b21ca85e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:54.839270 30168 consensus_queue.cc:1048] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:54.842375 29927 consensus_peers.cc:597] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:54.866216 30036 raft_consensus.cc:1275] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Refusing update from remote peer 0bdc55fd89784396b2426f8b21ca85e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:54.867753 30184 consensus_queue.cc:1048] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:54.874275 29927 consensus_peers.cc:597] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:54.881299 30036 raft_consensus.cc:1275] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Refusing update from remote peer 0bdc55fd89784396b2426f8b21ca85e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:54.884156 30168 consensus_queue.cc:1048] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:54.979148 29833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:54.991256 29961 raft_consensus.cc:1275] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Refusing update from remote peer 59961b872d794a10973133cd9e9b175c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:11:54.992627 30082 consensus_queue.cc:1048] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:11:55.007772 30001 consensus_peers.cc:597] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:55.023864 29927 consensus_peers.cc:597] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:55.055074 30036 raft_consensus.cc:1275] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Refusing update from remote peer 0bdc55fd89784396b2426f8b21ca85e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:11:55.056525 30184 consensus_queue.cc:1048] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:11:55.637303 30001 consensus_peers.cc:597] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:55.974653 30001 consensus_peers.cc:597] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:55.979992 29833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:11:56.127844 29927 consensus_peers.cc:597] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.317512 29983 debug-util.cc:398] Leaking SignalData structure 0x7b08000f7c60 after lost signal to thread 20643
W20260709 13:11:56.318655 29983 debug-util.cc:398] Leaking SignalData structure 0x7b08001e5380 after lost signal to thread 29819
W20260709 13:11:56.319705 29983 debug-util.cc:398] Leaking SignalData structure 0x7b08003aac60 after lost signal to thread 29986
W20260709 13:11:56.320637 29983 debug-util.cc:398] Leaking SignalData structure 0x7b0800048e60 after lost signal to thread 30060
W20260709 13:11:56.345062 29927 consensus_peers.cc:597] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.981029 29833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:11:57.215135 29927 consensus_peers.cc:597] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:57.381780 30001 consensus_peers.cc:597] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:57.389544 29927 consensus_peers.cc:597] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:57.444420 29927 consensus_peers.cc:597] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:57.512972 29927 consensus_peers.cc:597] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:57.707018 29927 consensus_peers.cc:597] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:57.982173 29833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:58.114769 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:11:58.122045 30196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:58.123148 30197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:11:58.126433 30199 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:11:58.131023 20640 server_base.cc:1061] running on GCE node
I20260709 13:11:58.132789 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:11:58.133100 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:11:58.133335 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602718133317 us; error 0 us; skew 500 ppm
I20260709 13:11:58.134169 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:11:58.137300 20640 webserver.cc:533] Webserver started at http://127.20.40.1:33011/ using document root <none> and password file <none>
I20260709 13:11:58.138025 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:11:58.138286 20640 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:11:58.143422 20640 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:11:58.148679 30204 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:11:58.149641 20640 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:11:58.150027 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/ts-0-root
uuid: "b7dd1621ce9245288cc3d7889c7c4aba"
format_stamp: "Formatted at 2026-07-09 13:11:51 on dist-test-slave-rnv4"
I20260709 13:11:58.150431 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602420111825-20640-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:11:58.180054 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:11:58.181409 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:11:58.183347 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:11:58.188292 30211 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:11:58.238399 30001 consensus_peers.cc:597] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:58.243845 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:11:58.244324 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.057s	user 0.003s	sys 0.000s
I20260709 13:11:58.244673 20640 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:11:58.252561 30211 tablet_bootstrap.cc:492] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap starting.
I20260709 13:11:58.264957 30211 tablet_bootstrap.cc:492] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:58.265865 30211 tablet_bootstrap.cc:492] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap complete.
I20260709 13:11:58.266422 30211 ts_tablet_manager.cc:1403] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:11:58.268338 30211 raft_consensus.cc:359] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.268910 30211 raft_consensus.cc:740] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Initialized, Role: FOLLOWER
I20260709 13:11:58.269670 30211 consensus_queue.cc:260] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.272276 30211 ts_tablet_manager.cc:1434] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:11:58.273168 30211 tablet_bootstrap.cc:492] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap starting.
I20260709 13:11:58.285245 30211 tablet_bootstrap.cc:492] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:11:58.286077 30211 tablet_bootstrap.cc:492] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap complete.
I20260709 13:11:58.286687 30211 ts_tablet_manager.cc:1403] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:11:58.288564 30211 raft_consensus.cc:359] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.289248 30211 raft_consensus.cc:740] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Initialized, Role: FOLLOWER
I20260709 13:11:58.289983 30211 consensus_queue.cc:260] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.291636 30211 ts_tablet_manager.cc:1434] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:11:58.292394 30211 tablet_bootstrap.cc:492] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap starting.
I20260709 13:11:58.306677 30211 tablet_bootstrap.cc:492] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:58.307535 30211 tablet_bootstrap.cc:492] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap complete.
I20260709 13:11:58.308154 30211 ts_tablet_manager.cc:1403] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.006s
I20260709 13:11:58.310314 30211 raft_consensus.cc:359] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.310956 30211 raft_consensus.cc:740] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Initialized, Role: FOLLOWER
I20260709 13:11:58.311681 30211 consensus_queue.cc:260] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.313349 30211 ts_tablet_manager.cc:1434] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 13:11:58.314095 30211 tablet_bootstrap.cc:492] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap starting.
I20260709 13:11:58.314500 20640 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:11:58.314883 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.070s	user 0.063s	sys 0.003s
I20260709 13:11:58.327059 30211 tablet_bootstrap.cc:492] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:58.328301 30211 tablet_bootstrap.cc:492] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap complete.
I20260709 13:11:58.329138 30211 ts_tablet_manager.cc:1403] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:11:58.331934 30211 raft_consensus.cc:359] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.332823 30211 raft_consensus.cc:740] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Initialized, Role: FOLLOWER
I20260709 13:11:58.333817 30211 consensus_queue.cc:260] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.337808 30211 ts_tablet_manager.cc:1434] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:11:58.338559 30211 tablet_bootstrap.cc:492] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap starting.
I20260709 13:11:58.356016 30211 tablet_bootstrap.cc:492] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:58.357198 30211 tablet_bootstrap.cc:492] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap complete.
I20260709 13:11:58.358013 30211 ts_tablet_manager.cc:1403] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:11:58.360735 30211 raft_consensus.cc:359] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.361620 30211 raft_consensus.cc:740] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Initialized, Role: FOLLOWER
I20260709 13:11:58.362432 30211 consensus_queue.cc:260] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.364560 30211 ts_tablet_manager.cc:1434] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:11:58.365451 30211 tablet_bootstrap.cc:492] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap starting.
I20260709 13:11:58.383694 30211 tablet_bootstrap.cc:492] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:58.386114 30211 tablet_bootstrap.cc:492] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap complete.
W20260709 13:11:58.388028 30001 consensus_peers.cc:597] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:58.389053 30211 ts_tablet_manager.cc:1403] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.004s
I20260709 13:11:58.391786 30211 raft_consensus.cc:359] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.392536 30211 raft_consensus.cc:740] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Initialized, Role: FOLLOWER
I20260709 13:11:58.393368 30211 consensus_queue.cc:260] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.395133 30211 ts_tablet_manager.cc:1434] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:11:58.395818 30211 tablet_bootstrap.cc:492] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap starting.
I20260709 13:11:58.416263 30211 tablet_bootstrap.cc:492] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:58.417354 30211 tablet_bootstrap.cc:492] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap complete.
I20260709 13:11:58.417991 30211 ts_tablet_manager.cc:1403] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 13:11:58.419665 30211 raft_consensus.cc:359] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.420192 30211 raft_consensus.cc:740] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Initialized, Role: FOLLOWER
I20260709 13:11:58.421003 30211 consensus_queue.cc:260] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.422839 30211 ts_tablet_manager.cc:1434] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:11:58.423501 30211 tablet_bootstrap.cc:492] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap starting.
I20260709 13:11:58.430837 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.1:36241
I20260709 13:11:58.430974 30275 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.1:36241 every 8 connection(s)
I20260709 13:11:58.436514 30211 tablet_bootstrap.cc:492] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:58.437635 30211 tablet_bootstrap.cc:492] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap complete.
I20260709 13:11:58.438324 30211 ts_tablet_manager.cc:1403] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:11:58.441053 30211 raft_consensus.cc:359] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } }
I20260709 13:11:58.441937 30211 raft_consensus.cc:740] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Initialized, Role: FOLLOWER
I20260709 13:11:58.442732 30211 consensus_queue.cc:260] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } }
I20260709 13:11:58.445725 30211 ts_tablet_manager.cc:1434] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:11:58.446889 30211 tablet_bootstrap.cc:492] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap starting.
I20260709 13:11:58.450881 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:58.468070 30277 heartbeater.cc:344] Connected to a master server at 127.20.40.62:43027
I20260709 13:11:58.468748 30277 heartbeater.cc:461] Registering TS with master...
I20260709 13:11:58.469893 30277 heartbeater.cc:507] Master 127.20.40.62:43027 requested a full tablet report, sending...
I20260709 13:11:58.477265 29784 ts_manager.cc:194] Re-registered known tserver with Master: b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241)
I20260709 13:11:58.486552 30211 tablet_bootstrap.cc:492] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:11:58.490545 30249 raft_consensus.cc:3060] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.490886 29784 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52338
I20260709 13:11:58.495572 30277 heartbeater.cc:499] Master 127.20.40.62:43027 was elected leader, sending a full tablet report...
I20260709 13:11:58.496064 29961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0"
dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
mode: GRACEFUL
new_leader_uuid: "59961b872d794a10973133cd9e9b175c"
 from {username='slave'} at 127.0.0.1:55292
I20260709 13:11:58.496827 29961 raft_consensus.cc:606] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Received request to transfer leadership to TS 59961b872d794a10973133cd9e9b175c
I20260709 13:11:58.498584 30211 tablet_bootstrap.cc:492] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap complete.
I20260709 13:11:58.499363 30211 ts_tablet_manager.cc:1403] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.000s
I20260709 13:11:58.501773 30211 raft_consensus.cc:359] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.502131 29961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6453b7b7a07e4d5996046c4e600fe521"
dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
mode: GRACEFUL
new_leader_uuid: "59961b872d794a10973133cd9e9b175c"
 from {username='slave'} at 127.0.0.1:55292
I20260709 13:11:58.502883 29961 raft_consensus.cc:606] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Received request to transfer leadership to TS 59961b872d794a10973133cd9e9b175c
I20260709 13:11:58.502748 30211 raft_consensus.cc:740] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Initialized, Role: FOLLOWER
I20260709 13:11:58.503916 30211 consensus_queue.cc:260] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.506330 30211 ts_tablet_manager.cc:1434] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:11:58.506153 29961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5e2fa1a8c9c43cd80229ffcab41ddf5"
dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
mode: GRACEFUL
new_leader_uuid: "59961b872d794a10973133cd9e9b175c"
 from {username='slave'} at 127.0.0.1:55292
I20260709 13:11:58.506842 29961 raft_consensus.cc:606] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Received request to transfer leadership to TS 59961b872d794a10973133cd9e9b175c
I20260709 13:11:58.507217 30211 tablet_bootstrap.cc:492] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap starting.
I20260709 13:11:58.508002 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:11:58.508744 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:58.509584 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:58.525893 30286 raft_consensus.cc:993] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6: : Instructing follower 59961b872d794a10973133cd9e9b175c to start an election
I20260709 13:11:58.526787 30195 raft_consensus.cc:1081] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Signalling peer 59961b872d794a10973133cd9e9b175c to start an election
I20260709 13:11:58.530944 30036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6453b7b7a07e4d5996046c4e600fe521"
dest_uuid: "59961b872d794a10973133cd9e9b175c"
 from {username='slave'} at 127.0.0.1:40960
I20260709 13:11:58.531746 30036 raft_consensus.cc:493] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:58.532161 30036 raft_consensus.cc:3060] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:58.546391 30036 raft_consensus.cc:515] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.553782 30211 tablet_bootstrap.cc:492] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:58.554924 30211 tablet_bootstrap.cc:492] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba: Bootstrap complete.
I20260709 13:11:58.555688 30211 ts_tablet_manager.cc:1403] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent bootstrapping tablet: real 0.049s	user 0.024s	sys 0.020s
I20260709 13:11:58.558142 30211 raft_consensus.cc:359] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.558861 30211 raft_consensus.cc:740] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7dd1621ce9245288cc3d7889c7c4aba, State: Initialized, Role: FOLLOWER
I20260709 13:11:58.559552 30211 consensus_queue.cc:260] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.561908 30211 ts_tablet_manager.cc:1434] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:11:58.564491 30249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6453b7b7a07e4d5996046c4e600fe521" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba"
I20260709 13:11:58.565107 30036 leader_election.cc:290] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 3 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:11:58.565313 29961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6453b7b7a07e4d5996046c4e600fe521" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
I20260709 13:11:58.565933 29961 raft_consensus.cc:3055] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:58.566258 29961 raft_consensus.cc:740] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Running, Role: LEADER
I20260709 13:11:58.566835 30249 raft_consensus.cc:3060] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:11:58.567061 29961 consensus_queue.cc:260] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.568418 29961 raft_consensus.cc:3060] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:58.575387 30249 raft_consensus.cc:2468] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 3.
I20260709 13:11:58.576346 29961 raft_consensus.cc:2468] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 3.
I20260709 13:11:58.578991 29999 leader_election.cc:304] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, 59961b872d794a10973133cd9e9b175c; no voters: 
I20260709 13:11:58.579918 30082 raft_consensus.cc:2804] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:58.581580 30082 raft_consensus.cc:697] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 3 LEADER]: Becoming Leader. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Running, Role: LEADER
I20260709 13:11:58.582350 30082 consensus_queue.cc:237] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.591421 29785 catalog_manager.cc:5697] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c reported cstate change: term changed from 2 to 3, leader changed from 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2) to 59961b872d794a10973133cd9e9b175c (127.20.40.3). New cstate: current_term: 3 leader_uuid: "59961b872d794a10973133cd9e9b175c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:58.675231 30195 raft_consensus.cc:993] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6: : Instructing follower 59961b872d794a10973133cd9e9b175c to start an election
I20260709 13:11:58.675730 30286 raft_consensus.cc:1081] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Signalling peer 59961b872d794a10973133cd9e9b175c to start an election
I20260709 13:11:58.677311 30036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0"
dest_uuid: "59961b872d794a10973133cd9e9b175c"
 from {username='slave'} at 127.0.0.1:40960
I20260709 13:11:58.677924 30036 raft_consensus.cc:493] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:58.678261 30036 raft_consensus.cc:3060] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:58.685700 30036 raft_consensus.cc:515] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.687752 30036 leader_election.cc:290] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 3 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:11:58.688608 30249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba"
I20260709 13:11:58.689271 30249 raft_consensus.cc:3060] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:58.689936 29961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
I20260709 13:11:58.690610 29961 raft_consensus.cc:3055] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:58.690956 29961 raft_consensus.cc:740] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Running, Role: LEADER
I20260709 13:11:58.691815 29961 consensus_queue.cc:260] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.693209 29961 raft_consensus.cc:3060] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:58.695021 30249 raft_consensus.cc:2468] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 3.
I20260709 13:11:58.696188 30001 leader_election.cc:304] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59961b872d794a10973133cd9e9b175c, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:11:58.696899 30082 raft_consensus.cc:2804] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:58.697340 30082 raft_consensus.cc:697] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 3 LEADER]: Becoming Leader. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Running, Role: LEADER
I20260709 13:11:58.698155 30082 consensus_queue.cc:237] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:58.701009 29961 raft_consensus.cc:2468] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 3.
I20260709 13:11:58.706277 29785 catalog_manager.cc:5697] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c reported cstate change: term changed from 2 to 3, leader changed from 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2) to 59961b872d794a10973133cd9e9b175c (127.20.40.3). New cstate: current_term: 3 leader_uuid: "59961b872d794a10973133cd9e9b175c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:58.794305 30249 raft_consensus.cc:3060] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.802309 30249 pending_rounds.cc:85] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba: Aborting all ops after (but not including) 0
I20260709 13:11:58.802615 30249 pending_rounds.cc:107] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:11:58.802909 30249 raft_consensus.cc:2889] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:58.845146 30249 raft_consensus.cc:3060] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.872423 30249 raft_consensus.cc:3060] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:11:58.983273 29833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:11:58.988965 30249 raft_consensus.cc:3060] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:11:58.995134 30249 pending_rounds.cc:85] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba: Aborting all ops after (but not including) 0
I20260709 13:11:58.995476 30249 pending_rounds.cc:107] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:11:58.995797 30249 raft_consensus.cc:2889] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:59.021378 30249 raft_consensus.cc:1275] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 3 FOLLOWER]: Refusing update from remote peer 59961b872d794a10973133cd9e9b175c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:59.023032 30082 consensus_queue.cc:1048] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:11:59.036680 29961 raft_consensus.cc:1275] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 3 FOLLOWER]: Refusing update from remote peer 59961b872d794a10973133cd9e9b175c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:59.038766 30082 consensus_queue.cc:1048] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:59.055095 30195 raft_consensus.cc:993] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6: : Instructing follower 59961b872d794a10973133cd9e9b175c to start an election
I20260709 13:11:59.055629 30286 raft_consensus.cc:1081] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Signalling peer 59961b872d794a10973133cd9e9b175c to start an election
I20260709 13:11:59.057289 30036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5e2fa1a8c9c43cd80229ffcab41ddf5"
dest_uuid: "59961b872d794a10973133cd9e9b175c"
 from {username='slave'} at 127.0.0.1:40960
I20260709 13:11:59.057953 30036 raft_consensus.cc:493] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:59.058313 30036 raft_consensus.cc:3060] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:59.066407 30036 raft_consensus.cc:515] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } }
I20260709 13:11:59.068509 30036 leader_election.cc:290] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 3 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:11:59.069341 30249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e2fa1a8c9c43cd80229ffcab41ddf5" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba"
I20260709 13:11:59.070027 30249 raft_consensus.cc:3060] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:59.070086 29961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5e2fa1a8c9c43cd80229ffcab41ddf5" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
I20260709 13:11:59.070809 29961 raft_consensus.cc:3055] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:59.071143 29961 raft_consensus.cc:740] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Running, Role: LEADER
I20260709 13:11:59.071964 29961 consensus_queue.cc:260] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } }
I20260709 13:11:59.073215 29961 raft_consensus.cc:3060] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:59.079159 30249 raft_consensus.cc:2468] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 3.
I20260709 13:11:59.080586 30001 leader_election.cc:304] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59961b872d794a10973133cd9e9b175c, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:11:59.081274 29961 raft_consensus.cc:2468] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 3.
I20260709 13:11:59.081638 30082 raft_consensus.cc:2804] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:59.082238 30082 raft_consensus.cc:697] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [term 3 LEADER]: Becoming Leader. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Running, Role: LEADER
I20260709 13:11:59.083132 30082 consensus_queue.cc:237] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } }
I20260709 13:11:59.091655 29784 catalog_manager.cc:5697] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c reported cstate change: term changed from 2 to 3, leader changed from 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2) to 59961b872d794a10973133cd9e9b175c (127.20.40.3). New cstate: current_term: 3 leader_uuid: "59961b872d794a10973133cd9e9b175c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:59.167393 30249 raft_consensus.cc:1275] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 3 FOLLOWER]: Refusing update from remote peer 59961b872d794a10973133cd9e9b175c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:59.168568 30289 consensus_queue.cc:1048] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:59.181849 29961 raft_consensus.cc:1275] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 3 FOLLOWER]: Refusing update from remote peer 59961b872d794a10973133cd9e9b175c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:59.183384 30289 consensus_queue.cc:1048] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:59.497291 30249 raft_consensus.cc:1275] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 3 FOLLOWER]: Refusing update from remote peer 59961b872d794a10973133cd9e9b175c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:59.498816 30289 consensus_queue.cc:1048] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:59.506275 29961 raft_consensus.cc:1275] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 3 FOLLOWER]: Refusing update from remote peer 59961b872d794a10973133cd9e9b175c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:11:59.507786 30082 consensus_queue.cc:1048] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:59.520609 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:59.537708 30036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6453b7b7a07e4d5996046c4e600fe521"
dest_uuid: "59961b872d794a10973133cd9e9b175c"
mode: GRACEFUL
new_leader_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
 from {username='slave'} at 127.0.0.1:39010
I20260709 13:11:59.538267 30036 raft_consensus.cc:606] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 3 LEADER]: Received request to transfer leadership to TS 0bdc55fd89784396b2426f8b21ca85e6
I20260709 13:11:59.540861 30036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c79fd06a98564834a22f607ce3330fc8"
dest_uuid: "59961b872d794a10973133cd9e9b175c"
mode: GRACEFUL
new_leader_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
 from {username='slave'} at 127.0.0.1:39010
I20260709 13:11:59.541369 30036 raft_consensus.cc:606] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [term 1 LEADER]: Received request to transfer leadership to TS 0bdc55fd89784396b2426f8b21ca85e6
I20260709 13:11:59.542538 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:59.543154 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:59.543807 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:59.887365 30305 raft_consensus.cc:993] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c: : Instructing follower 0bdc55fd89784396b2426f8b21ca85e6 to start an election
I20260709 13:11:59.887871 30289 raft_consensus.cc:1081] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 3 LEADER]: Signalling peer 0bdc55fd89784396b2426f8b21ca85e6 to start an election
I20260709 13:11:59.889294 29961 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6453b7b7a07e4d5996046c4e600fe521"
dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
 from {username='slave'} at 127.0.0.1:37682
I20260709 13:11:59.889894 29961 raft_consensus.cc:493] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:59.890194 29961 raft_consensus.cc:3060] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:59.895812 29961 raft_consensus.cc:515] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:59.897650 29961 leader_election.cc:290] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 4 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:11:59.898538 30248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6453b7b7a07e4d5996046c4e600fe521" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba"
I20260709 13:11:59.898909 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6453b7b7a07e4d5996046c4e600fe521" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "59961b872d794a10973133cd9e9b175c"
I20260709 13:11:59.899179 30248 raft_consensus.cc:3060] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:59.899536 30036 raft_consensus.cc:3055] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:59.899830 30036 raft_consensus.cc:740] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Running, Role: LEADER
I20260709 13:11:59.900588 30036 consensus_queue.cc:260] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:59.901588 30036 raft_consensus.cc:3060] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:59.905383 30248 raft_consensus.cc:2468] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 4.
I20260709 13:11:59.906626 29927 leader_election.cc:304] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:11:59.907490 30307 raft_consensus.cc:2804] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:59.908070 30036 raft_consensus.cc:2468] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 4.
I20260709 13:11:59.908638 30307 raft_consensus.cc:697] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 4 LEADER]: Becoming Leader. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Running, Role: LEADER
I20260709 13:11:59.909689 30307 consensus_queue.cc:237] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:11:59.916556 29784 catalog_manager.cc:5697] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 reported cstate change: term changed from 3 to 4, leader changed from 59961b872d794a10973133cd9e9b175c (127.20.40.3) to 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2). New cstate: current_term: 4 leader_uuid: "0bdc55fd89784396b2426f8b21ca85e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:59.986231 29833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:00.011214 30289 raft_consensus.cc:993] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c: : Instructing follower 0bdc55fd89784396b2426f8b21ca85e6 to start an election
I20260709 13:12:00.012164 30082 raft_consensus.cc:1081] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [term 1 LEADER]: Signalling peer 0bdc55fd89784396b2426f8b21ca85e6 to start an election
I20260709 13:12:00.014271 29961 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c79fd06a98564834a22f607ce3330fc8"
dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
 from {username='slave'} at 127.0.0.1:37682
I20260709 13:12:00.015051 29961 raft_consensus.cc:493] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:00.015452 29961 raft_consensus.cc:3060] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:00.023842 29961 raft_consensus.cc:515] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:00.025815 29961 leader_election.cc:290] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:12:00.027146 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79fd06a98564834a22f607ce3330fc8" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59961b872d794a10973133cd9e9b175c"
I20260709 13:12:00.027176 30249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c79fd06a98564834a22f607ce3330fc8" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba"
I20260709 13:12:00.027900 30036 raft_consensus.cc:3055] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:00.028095 30249 raft_consensus.cc:3060] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:00.028223 30036 raft_consensus.cc:740] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Running, Role: LEADER
I20260709 13:12:00.029325 30036 consensus_queue.cc:260] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:00.030864 30036 raft_consensus.cc:3060] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:00.036514 30249 raft_consensus.cc:2468] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 2.
I20260709 13:12:00.038868 29927 leader_election.cc:304] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:12:00.040118 30312 raft_consensus.cc:2804] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:00.040143 30036 raft_consensus.cc:2468] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 2.
I20260709 13:12:00.040730 30312 raft_consensus.cc:697] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Running, Role: LEADER
I20260709 13:12:00.042162 30312 consensus_queue.cc:237] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:00.052835 29785 catalog_manager.cc:5697] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 reported cstate change: term changed from 1 to 2, leader changed from 59961b872d794a10973133cd9e9b175c (127.20.40.3) to 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "0bdc55fd89784396b2426f8b21ca85e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:00.441591 30249 raft_consensus.cc:1275] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Refusing update from remote peer 0bdc55fd89784396b2426f8b21ca85e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:00.442996 30312 consensus_queue.cc:1048] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:00.456506 30036 raft_consensus.cc:1275] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Refusing update from remote peer 0bdc55fd89784396b2426f8b21ca85e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:00.458364 30321 consensus_queue.cc:1048] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:00.522830 30036 raft_consensus.cc:1275] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 4 FOLLOWER]: Refusing update from remote peer 0bdc55fd89784396b2426f8b21ca85e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:00.523037 30249 raft_consensus.cc:1275] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 4 FOLLOWER]: Refusing update from remote peer 0bdc55fd89784396b2426f8b21ca85e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:00.524344 30321 consensus_queue.cc:1048] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:00.525111 30312 consensus_queue.cc:1048] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:00.551156 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:00.562752 29961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fd9b49df4f447879e0ca7e89ffccd52"
dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
mode: GRACEFUL
new_leader_uuid: "59961b872d794a10973133cd9e9b175c"
 from {username='slave'} at 127.0.0.1:55292
I20260709 13:12:00.563298 29961 raft_consensus.cc:606] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Received request to transfer leadership to TS 59961b872d794a10973133cd9e9b175c
I20260709 13:12:00.566052 29961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46dbf557381f4433b6140e94368854c6"
dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
mode: GRACEFUL
new_leader_uuid: "59961b872d794a10973133cd9e9b175c"
 from {username='slave'} at 127.0.0.1:55292
I20260709 13:12:00.566509 29961 raft_consensus.cc:606] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 LEADER]: Received request to transfer leadership to TS 59961b872d794a10973133cd9e9b175c
I20260709 13:12:00.567586 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:00.568091 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:00.568825 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:00.747411 30307 raft_consensus.cc:993] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6: : Instructing follower 59961b872d794a10973133cd9e9b175c to start an election
I20260709 13:12:00.748000 30321 raft_consensus.cc:1081] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Signalling peer 59961b872d794a10973133cd9e9b175c to start an election
I20260709 13:12:00.749388 30036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fd9b49df4f447879e0ca7e89ffccd52"
dest_uuid: "59961b872d794a10973133cd9e9b175c"
 from {username='slave'} at 127.0.0.1:40960
I20260709 13:12:00.749948 30036 raft_consensus.cc:493] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:00.750177 30036 raft_consensus.cc:3060] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:00.755241 30036 raft_consensus.cc:515] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:00.756636 30036 leader_election.cc:290] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 3 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:12:00.757704 30249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd9b49df4f447879e0ca7e89ffccd52" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba"
I20260709 13:12:00.757795 29961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fd9b49df4f447879e0ca7e89ffccd52" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
I20260709 13:12:00.758490 30249 raft_consensus.cc:3060] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:00.758526 29961 raft_consensus.cc:3055] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:00.758931 29961 raft_consensus.cc:740] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Running, Role: LEADER
I20260709 13:12:00.759727 29961 consensus_queue.cc:260] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:00.760661 29961 raft_consensus.cc:3060] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:00.765576 30249 raft_consensus.cc:2468] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 3.
I20260709 13:12:00.766764 30001 leader_election.cc:304] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59961b872d794a10973133cd9e9b175c, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:12:00.766933 29961 raft_consensus.cc:2468] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 3.
I20260709 13:12:00.767539 30082 raft_consensus.cc:2804] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:00.769526 30082 raft_consensus.cc:697] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [term 3 LEADER]: Becoming Leader. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Running, Role: LEADER
I20260709 13:12:00.770555 30082 consensus_queue.cc:237] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:00.777791 29784 catalog_manager.cc:5697] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c reported cstate change: term changed from 2 to 3, leader changed from 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2) to 59961b872d794a10973133cd9e9b175c (127.20.40.3). New cstate: current_term: 3 leader_uuid: "59961b872d794a10973133cd9e9b175c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:00.893998 30307 raft_consensus.cc:993] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6: : Instructing follower 59961b872d794a10973133cd9e9b175c to start an election
I20260709 13:12:00.894515 30321 raft_consensus.cc:1081] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 LEADER]: Signalling peer 59961b872d794a10973133cd9e9b175c to start an election
I20260709 13:12:00.896266 30036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46dbf557381f4433b6140e94368854c6"
dest_uuid: "59961b872d794a10973133cd9e9b175c"
 from {username='slave'} at 127.0.0.1:40960
I20260709 13:12:00.896751 30036 raft_consensus.cc:493] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:00.897087 30036 raft_consensus.cc:3060] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:00.902768 30036 raft_consensus.cc:515] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:00.904589 30036 leader_election.cc:290] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 2 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:12:00.905369 30249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dbf557381f4433b6140e94368854c6" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba"
I20260709 13:12:00.905732 29961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46dbf557381f4433b6140e94368854c6" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
I20260709 13:12:00.906170 30249 raft_consensus.cc:3060] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:00.906360 29961 raft_consensus.cc:3055] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:00.906795 29961 raft_consensus.cc:740] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Running, Role: LEADER
I20260709 13:12:00.907639 29961 consensus_queue.cc:260] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:00.908660 29961 raft_consensus.cc:3060] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:00.912108 30249 raft_consensus.cc:2468] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 2.
I20260709 13:12:00.913334 30001 leader_election.cc:304] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59961b872d794a10973133cd9e9b175c, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:12:00.913909 29961 raft_consensus.cc:2468] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 2.
I20260709 13:12:00.914060 30082 raft_consensus.cc:2804] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:00.914535 30082 raft_consensus.cc:697] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c [term 2 LEADER]: Becoming Leader. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Running, Role: LEADER
I20260709 13:12:00.915545 30082 consensus_queue.cc:237] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:00.922044 29784 catalog_manager.cc:5697] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c reported cstate change: term changed from 1 to 2, leader changed from 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2) to 59961b872d794a10973133cd9e9b175c (127.20.40.3). New cstate: current_term: 2 leader_uuid: "59961b872d794a10973133cd9e9b175c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:00.988165 29833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:01.185061 29961 raft_consensus.cc:1275] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 3 FOLLOWER]: Refusing update from remote peer 59961b872d794a10973133cd9e9b175c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:01.186405 30082 consensus_queue.cc:1048] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:01.195984 30249 raft_consensus.cc:1275] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 3 FOLLOWER]: Refusing update from remote peer 59961b872d794a10973133cd9e9b175c: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:01.197893 30328 consensus_queue.cc:1048] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:01.354215 29961 raft_consensus.cc:1275] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Refusing update from remote peer 59961b872d794a10973133cd9e9b175c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:01.355520 30328 consensus_queue.cc:1048] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:01.364686 30249 raft_consensus.cc:1275] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Refusing update from remote peer 59961b872d794a10973133cd9e9b175c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:01.366307 30082 consensus_queue.cc:1048] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:01.575686 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:01.583575 30036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0"
dest_uuid: "59961b872d794a10973133cd9e9b175c"
mode: GRACEFUL
new_leader_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
 from {username='slave'} at 127.0.0.1:39010
I20260709 13:12:01.584067 30036 raft_consensus.cc:606] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 3 LEADER]: Received request to transfer leadership to TS 0bdc55fd89784396b2426f8b21ca85e6
I20260709 13:12:01.586717 30036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2afcae80938b4e4d8cc5e34c18a8e90b"
dest_uuid: "59961b872d794a10973133cd9e9b175c"
mode: GRACEFUL
new_leader_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
 from {username='slave'} at 127.0.0.1:39010
I20260709 13:12:01.587184 30036 raft_consensus.cc:606] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [term 1 LEADER]: Received request to transfer leadership to TS 0bdc55fd89784396b2426f8b21ca85e6
I20260709 13:12:01.588207 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:01.588708 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:01.589339 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:01.602463 30328 raft_consensus.cc:993] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c: : Instructing follower 0bdc55fd89784396b2426f8b21ca85e6 to start an election
I20260709 13:12:01.603112 30082 raft_consensus.cc:1081] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 3 LEADER]: Signalling peer 0bdc55fd89784396b2426f8b21ca85e6 to start an election
I20260709 13:12:01.604717 29961 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0"
dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
 from {username='slave'} at 127.0.0.1:37682
I20260709 13:12:01.605362 29961 raft_consensus.cc:493] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:01.605719 29961 raft_consensus.cc:3060] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:01.612149 29961 raft_consensus.cc:515] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:01.613550 29961 leader_election.cc:290] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 4 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:12:01.614410 30249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba"
I20260709 13:12:01.614614 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "59961b872d794a10973133cd9e9b175c"
I20260709 13:12:01.614933 30249 raft_consensus.cc:3060] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:01.615259 30036 raft_consensus.cc:3055] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:01.615635 30036 raft_consensus.cc:740] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Running, Role: LEADER
I20260709 13:12:01.616367 30036 consensus_queue.cc:260] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:01.617151 30036 raft_consensus.cc:3060] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:01.620525 30249 raft_consensus.cc:2468] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 4.
I20260709 13:12:01.621766 30036 raft_consensus.cc:2468] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 4.
I20260709 13:12:01.621882 29927 leader_election.cc:304] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:12:01.622720 30321 raft_consensus.cc:2804] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:01.623646 30321 raft_consensus.cc:697] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 4 LEADER]: Becoming Leader. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Running, Role: LEADER
I20260709 13:12:01.624635 30321 consensus_queue.cc:237] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:01.631317 29783 catalog_manager.cc:5697] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 reported cstate change: term changed from 3 to 4, leader changed from 59961b872d794a10973133cd9e9b175c (127.20.40.3) to 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2). New cstate: current_term: 4 leader_uuid: "0bdc55fd89784396b2426f8b21ca85e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:01.668857 30328 raft_consensus.cc:993] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c: : Instructing follower 0bdc55fd89784396b2426f8b21ca85e6 to start an election
I20260709 13:12:01.669334 30328 raft_consensus.cc:1081] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [term 1 LEADER]: Signalling peer 0bdc55fd89784396b2426f8b21ca85e6 to start an election
I20260709 13:12:01.670804 29961 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2afcae80938b4e4d8cc5e34c18a8e90b"
dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
 from {username='slave'} at 127.0.0.1:37682
I20260709 13:12:01.671284 29961 raft_consensus.cc:493] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:01.671521 29961 raft_consensus.cc:3060] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:01.676457 29961 raft_consensus.cc:515] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:01.677886 29961 leader_election.cc:290] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 59961b872d794a10973133cd9e9b175c (127.20.40.3:35469)
I20260709 13:12:01.678766 30249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afcae80938b4e4d8cc5e34c18a8e90b" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba"
I20260709 13:12:01.678960 30036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2afcae80938b4e4d8cc5e34c18a8e90b" candidate_uuid: "0bdc55fd89784396b2426f8b21ca85e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59961b872d794a10973133cd9e9b175c"
I20260709 13:12:01.679603 30249 raft_consensus.cc:3060] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:01.679677 30036 raft_consensus.cc:3055] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:01.680089 30036 raft_consensus.cc:740] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Running, Role: LEADER
I20260709 13:12:01.680876 30036 consensus_queue.cc:260] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:01.681944 30036 raft_consensus.cc:3060] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:01.684747 30249 raft_consensus.cc:2468] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 2.
I20260709 13:12:01.685959 29927 leader_election.cc:304] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:12:01.686722 30321 raft_consensus.cc:2804] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:01.687198 30321 raft_consensus.cc:697] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Becoming Leader. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Running, Role: LEADER
I20260709 13:12:01.687685 30036 raft_consensus.cc:2468] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bdc55fd89784396b2426f8b21ca85e6 in term 2.
I20260709 13:12:01.688513 30321 consensus_queue.cc:237] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:01.696780 29783 catalog_manager.cc:5697] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6 reported cstate change: term changed from 1 to 2, leader changed from 59961b872d794a10973133cd9e9b175c (127.20.40.3) to 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "0bdc55fd89784396b2426f8b21ca85e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:01.989138 29833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:02.075769 30036 raft_consensus.cc:1275] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 4 FOLLOWER]: Refusing update from remote peer 0bdc55fd89784396b2426f8b21ca85e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:02.077121 30321 consensus_queue.cc:1048] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:02.087637 30249 raft_consensus.cc:1275] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 4 FOLLOWER]: Refusing update from remote peer 0bdc55fd89784396b2426f8b21ca85e6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:02.089336 30321 consensus_queue.cc:1048] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:02.241104 30036 raft_consensus.cc:1275] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Refusing update from remote peer 0bdc55fd89784396b2426f8b21ca85e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:02.242589 30321 consensus_queue.cc:1048] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:02.251986 30249 raft_consensus.cc:1275] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Refusing update from remote peer 0bdc55fd89784396b2426f8b21ca85e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:02.253706 30321 consensus_queue.cc:1048] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:02.596803 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:02.604252 29961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0"
dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
mode: GRACEFUL
new_leader_uuid: "59961b872d794a10973133cd9e9b175c"
 from {username='slave'} at 127.0.0.1:55292
I20260709 13:12:02.604786 29961 raft_consensus.cc:606] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 4 LEADER]: Received request to transfer leadership to TS 59961b872d794a10973133cd9e9b175c
I20260709 13:12:02.607525 29961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "451ea5ec3bad4c7f931345023c402184"
dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
mode: GRACEFUL
new_leader_uuid: "59961b872d794a10973133cd9e9b175c"
 from {username='slave'} at 127.0.0.1:55292
I20260709 13:12:02.608014 29961 raft_consensus.cc:606] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 LEADER]: Received request to transfer leadership to TS 59961b872d794a10973133cd9e9b175c
I20260709 13:12:02.609056 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:02.609612 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:02.610371 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:02.696363 30343 raft_consensus.cc:993] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6: : Instructing follower 59961b872d794a10973133cd9e9b175c to start an election
I20260709 13:12:02.696931 30321 raft_consensus.cc:1081] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 4 LEADER]: Signalling peer 59961b872d794a10973133cd9e9b175c to start an election
I20260709 13:12:02.698566 30036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0"
dest_uuid: "59961b872d794a10973133cd9e9b175c"
 from {username='slave'} at 127.0.0.1:40960
I20260709 13:12:02.699131 30036 raft_consensus.cc:493] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:02.699525 30036 raft_consensus.cc:3060] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.705153 30036 raft_consensus.cc:515] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:02.706881 30036 leader_election.cc:290] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 5 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:12:02.707855 29961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
I20260709 13:12:02.707923 30249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bcd87cdf9784c6bb2c80e13f7ded4b0" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba"
I20260709 13:12:02.708503 29961 raft_consensus.cc:3055] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:02.708616 30249 raft_consensus.cc:3060] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.708911 29961 raft_consensus.cc:740] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Running, Role: LEADER
I20260709 13:12:02.709735 29961 consensus_queue.cc:260] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:02.710809 29961 raft_consensus.cc:3060] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:02.714326 30249 raft_consensus.cc:2468] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 5.
I20260709 13:12:02.715195 29961 raft_consensus.cc:2468] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 5.
I20260709 13:12:02.715500 30001 leader_election.cc:304] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59961b872d794a10973133cd9e9b175c, b7dd1621ce9245288cc3d7889c7c4aba; no voters: 
I20260709 13:12:02.716344 30341 raft_consensus.cc:2804] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:02.716787 30341 raft_consensus.cc:697] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 5 LEADER]: Becoming Leader. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Running, Role: LEADER
I20260709 13:12:02.717608 30341 consensus_queue.cc:237] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:02.724443 29785 catalog_manager.cc:5697] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c reported cstate change: term changed from 4 to 5, leader changed from 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2) to 59961b872d794a10973133cd9e9b175c (127.20.40.3). New cstate: current_term: 5 leader_uuid: "59961b872d794a10973133cd9e9b175c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:02.818459 30343 raft_consensus.cc:993] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6: : Instructing follower 59961b872d794a10973133cd9e9b175c to start an election
I20260709 13:12:02.819056 30321 raft_consensus.cc:1081] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 LEADER]: Signalling peer 59961b872d794a10973133cd9e9b175c to start an election
I20260709 13:12:02.820935 30036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "451ea5ec3bad4c7f931345023c402184"
dest_uuid: "59961b872d794a10973133cd9e9b175c"
 from {username='slave'} at 127.0.0.1:40960
I20260709 13:12:02.821403 30036 raft_consensus.cc:493] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:02.821787 30036 raft_consensus.cc:3060] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:02.830349 30036 raft_consensus.cc:515] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:02.832229 30036 leader_election.cc:290] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 2 election: Requested vote from peers b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241), 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513)
I20260709 13:12:02.833042 30249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451ea5ec3bad4c7f931345023c402184" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b7dd1621ce9245288cc3d7889c7c4aba"
I20260709 13:12:02.833683 29961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "451ea5ec3bad4c7f931345023c402184" candidate_uuid: "59961b872d794a10973133cd9e9b175c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bdc55fd89784396b2426f8b21ca85e6"
I20260709 13:12:02.833748 30249 raft_consensus.cc:3060] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:02.834405 29961 raft_consensus.cc:3055] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:02.834734 29961 raft_consensus.cc:740] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bdc55fd89784396b2426f8b21ca85e6, State: Running, Role: LEADER
I20260709 13:12:02.835544 29961 consensus_queue.cc:260] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:02.836503 29961 raft_consensus.cc:3060] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:02.840672 29961 raft_consensus.cc:2468] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 2.
I20260709 13:12:02.840886 30249 raft_consensus.cc:2468] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59961b872d794a10973133cd9e9b175c in term 2.
I20260709 13:12:02.841741 29999 leader_election.cc:304] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bdc55fd89784396b2426f8b21ca85e6, 59961b872d794a10973133cd9e9b175c; no voters: 
I20260709 13:12:02.842603 30341 raft_consensus.cc:2804] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:02.843142 30341 raft_consensus.cc:697] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c [term 2 LEADER]: Becoming Leader. State: Replica: 59961b872d794a10973133cd9e9b175c, State: Running, Role: LEADER
I20260709 13:12:02.844221 30341 consensus_queue.cc:237] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } }
I20260709 13:12:02.852221 29785 catalog_manager.cc:5697] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c reported cstate change: term changed from 1 to 2, leader changed from 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2) to 59961b872d794a10973133cd9e9b175c (127.20.40.3). New cstate: current_term: 2 leader_uuid: "59961b872d794a10973133cd9e9b175c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59961b872d794a10973133cd9e9b175c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 35469 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:02.990164 29833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:03.165416 29961 raft_consensus.cc:1275] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 5 FOLLOWER]: Refusing update from remote peer 59961b872d794a10973133cd9e9b175c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:12:03.166698 30358 consensus_queue.cc:1048] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:03.178521 30249 raft_consensus.cc:1275] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 5 FOLLOWER]: Refusing update from remote peer 59961b872d794a10973133cd9e9b175c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:12:03.180640 30366 consensus_queue.cc:1048] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:12:03.327751 30249 raft_consensus.cc:1275] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Refusing update from remote peer 59961b872d794a10973133cd9e9b175c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:03.329066 30366 consensus_queue.cc:1048] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b7dd1621ce9245288cc3d7889c7c4aba" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 36241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:03.337882 29961 raft_consensus.cc:1275] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Refusing update from remote peer 59961b872d794a10973133cd9e9b175c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:03.339442 30358 consensus_queue.cc:1048] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bdc55fd89784396b2426f8b21ca85e6" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 46513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:03.616907 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:03.649147 20640 tablet_server.cc:179] TabletServer@127.20.40.1:36241 shutting down...
I20260709 13:12:03.678759 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:03.679474 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:03.680235 20640 raft_consensus.cc:2243] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.680684 20640 raft_consensus.cc:2272] T 451ea5ec3bad4c7f931345023c402184 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.684340 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:03.685014 20640 raft_consensus.cc:2243] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.685659 20640 raft_consensus.cc:2272] T 2fd9b49df4f447879e0ca7e89ffccd52 P b7dd1621ce9245288cc3d7889c7c4aba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.687912 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:03.688446 20640 raft_consensus.cc:2243] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.688831 20640 raft_consensus.cc:2272] T c79fd06a98564834a22f607ce3330fc8 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.690941 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:03.691464 20640 raft_consensus.cc:2243] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.691825 20640 raft_consensus.cc:2272] T 2afcae80938b4e4d8cc5e34c18a8e90b P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.694141 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:03.694765 20640 raft_consensus.cc:2243] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.695418 20640 raft_consensus.cc:2272] T c31ade6968c5458ca21ba8d950f01883 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:03.697160 30001 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 97 similar messages]
I20260709 13:12:03.698906 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:03.699652 20640 raft_consensus.cc:2243] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.700263 20640 raft_consensus.cc:2272] T 6453b7b7a07e4d5996046c4e600fe521 P b7dd1621ce9245288cc3d7889c7c4aba [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:03.700341 30001 consensus_peers.cc:597] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.702715 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:03.703315 20640 raft_consensus.cc:2243] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.704046 20640 raft_consensus.cc:2272] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P b7dd1621ce9245288cc3d7889c7c4aba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.707104 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:03.707683 20640 raft_consensus.cc:2243] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.708211 20640 raft_consensus.cc:2272] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P b7dd1621ce9245288cc3d7889c7c4aba [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:03.708972 29927 consensus_peers.cc:597] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.711007 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:03.711715 20640 raft_consensus.cc:2243] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.712155 20640 raft_consensus.cc:2272] T 46dbf557381f4433b6140e94368854c6 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.714285 20640 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:03.714811 20640 raft_consensus.cc:2243] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.715250 20640 raft_consensus.cc:2272] T 83b41c54dcc4471baf2f679730bfadd3 P b7dd1621ce9245288cc3d7889c7c4aba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.737071 20640 tablet_server.cc:196] TabletServer@127.20.40.1:36241 shutdown complete.
W20260709 13:12:03.739984 29927 consensus_peers.cc:597] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6 -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.744532 30001 consensus_peers.cc:597] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.767181 20640 tablet_server.cc:179] TabletServer@127.20.40.2:0 shutting down...
W20260709 13:12:03.778071 29999 consensus_peers.cc:597] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c -> Peer 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513): Couldn't send request to peer 0bdc55fd89784396b2426f8b21ca85e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.795873 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:03.796620 20640 tablet_replica.cc:333] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6: stopping tablet replica
I20260709 13:12:03.797297 20640 raft_consensus.cc:2243] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.797834 20640 raft_consensus.cc:2272] T 2fd9b49df4f447879e0ca7e89ffccd52 P 0bdc55fd89784396b2426f8b21ca85e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.801370 20640 tablet_replica.cc:333] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6: stopping tablet replica
W20260709 13:12:03.802006 29999 consensus_peers.cc:597] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c -> Peer 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513): Couldn't send request to peer 0bdc55fd89784396b2426f8b21ca85e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.802210 20640 raft_consensus.cc:2243] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.802717 20640 raft_consensus.cc:2272] T 451ea5ec3bad4c7f931345023c402184 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.806059 20640 tablet_replica.cc:333] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6: stopping tablet replica
I20260709 13:12:03.806926 20640 raft_consensus.cc:2243] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:03.807782 20640 raft_consensus.cc:2272] T 2afcae80938b4e4d8cc5e34c18a8e90b P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.810012 20640 tablet_replica.cc:333] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6: stopping tablet replica
I20260709 13:12:03.810647 20640 raft_consensus.cc:2243] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.811110 20640 raft_consensus.cc:2272] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 0bdc55fd89784396b2426f8b21ca85e6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.814117 20640 tablet_replica.cc:333] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6: stopping tablet replica
I20260709 13:12:03.814668 20640 raft_consensus.cc:2243] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.815106 20640 raft_consensus.cc:2272] T 46dbf557381f4433b6140e94368854c6 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.817132 20640 tablet_replica.cc:333] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6: stopping tablet replica
I20260709 13:12:03.817847 20640 raft_consensus.cc:2243] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.818361 20640 raft_consensus.cc:2272] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 0bdc55fd89784396b2426f8b21ca85e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.820423 20640 tablet_replica.cc:333] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6: stopping tablet replica
I20260709 13:12:03.820935 20640 raft_consensus.cc:2243] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.821466 20640 raft_consensus.cc:2272] T 83b41c54dcc4471baf2f679730bfadd3 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.823535 20640 tablet_replica.cc:333] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6: stopping tablet replica
I20260709 13:12:03.824074 20640 raft_consensus.cc:2243] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:03.824976 20640 raft_consensus.cc:2272] T c31ade6968c5458ca21ba8d950f01883 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.827060 20640 tablet_replica.cc:333] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6: stopping tablet replica
I20260709 13:12:03.827598 20640 raft_consensus.cc:2243] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:03.828383 20640 raft_consensus.cc:2272] T 6453b7b7a07e4d5996046c4e600fe521 P 0bdc55fd89784396b2426f8b21ca85e6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.830564 20640 tablet_replica.cc:333] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6: stopping tablet replica
I20260709 13:12:03.831060 20640 raft_consensus.cc:2243] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:03.831840 20640 raft_consensus.cc:2272] T c79fd06a98564834a22f607ce3330fc8 P 0bdc55fd89784396b2426f8b21ca85e6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:03.867699 30001 consensus_peers.cc:597] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.869066 29999 consensus_peers.cc:597] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c -> Peer 0bdc55fd89784396b2426f8b21ca85e6 (127.20.40.2:46513): Couldn't send request to peer 0bdc55fd89784396b2426f8b21ca85e6. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:46513: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:03.872470 30001 consensus_peers.cc:597] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c -> Peer b7dd1621ce9245288cc3d7889c7c4aba (127.20.40.1:36241): Couldn't send request to peer b7dd1621ce9245288cc3d7889c7c4aba. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:36241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:03.885574 20640 tablet_server.cc:196] TabletServer@127.20.40.2:0 shutdown complete.
I20260709 13:12:03.911177 20640 tablet_server.cc:179] TabletServer@127.20.40.3:0 shutting down...
I20260709 13:12:03.940570 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:03.941198 20640 tablet_replica.cc:333] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c: stopping tablet replica
I20260709 13:12:03.941936 20640 raft_consensus.cc:2243] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:03.942695 20640 raft_consensus.cc:2272] T 2fd9b49df4f447879e0ca7e89ffccd52 P 59961b872d794a10973133cd9e9b175c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.944861 20640 tablet_replica.cc:333] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c: stopping tablet replica
I20260709 13:12:03.945416 20640 raft_consensus.cc:2243] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:03.946249 20640 raft_consensus.cc:2272] T 451ea5ec3bad4c7f931345023c402184 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.948959 20640 tablet_replica.cc:333] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c: stopping tablet replica
I20260709 13:12:03.949584 20640 raft_consensus.cc:2243] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.949977 20640 raft_consensus.cc:2272] T 6453b7b7a07e4d5996046c4e600fe521 P 59961b872d794a10973133cd9e9b175c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.951920 20640 tablet_replica.cc:333] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c: stopping tablet replica
I20260709 13:12:03.952421 20640 raft_consensus.cc:2243] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.952807 20640 raft_consensus.cc:2272] T c31ade6968c5458ca21ba8d950f01883 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.954905 20640 tablet_replica.cc:333] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c: stopping tablet replica
I20260709 13:12:03.955370 20640 raft_consensus.cc:2243] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:03.956071 20640 raft_consensus.cc:2272] T 46dbf557381f4433b6140e94368854c6 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.958330 20640 tablet_replica.cc:333] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c: stopping tablet replica
I20260709 13:12:03.958820 20640 raft_consensus.cc:2243] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:12:03.959548 20640 raft_consensus.cc:2272] T 1bcd87cdf9784c6bb2c80e13f7ded4b0 P 59961b872d794a10973133cd9e9b175c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.962090 20640 tablet_replica.cc:333] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c: stopping tablet replica
I20260709 13:12:03.962571 20640 raft_consensus.cc:2243] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:03.963303 20640 raft_consensus.cc:2272] T a5e2fa1a8c9c43cd80229ffcab41ddf5 P 59961b872d794a10973133cd9e9b175c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.965299 20640 tablet_replica.cc:333] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c: stopping tablet replica
I20260709 13:12:03.965813 20640 raft_consensus.cc:2243] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.966163 20640 raft_consensus.cc:2272] T 2afcae80938b4e4d8cc5e34c18a8e90b P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.968047 20640 tablet_replica.cc:333] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c: stopping tablet replica
I20260709 13:12:03.968482 20640 raft_consensus.cc:2243] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:03.968815 20640 raft_consensus.cc:2272] T c79fd06a98564834a22f607ce3330fc8 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:03.970736 20640 tablet_replica.cc:333] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c: stopping tablet replica
I20260709 13:12:03.971168 20640 raft_consensus.cc:2243] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:03.971895 20640 raft_consensus.cc:2272] T 83b41c54dcc4471baf2f679730bfadd3 P 59961b872d794a10973133cd9e9b175c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:03.991367 29833 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:04.006529 20640 tablet_server.cc:196] TabletServer@127.20.40.3:0 shutdown complete.
I20260709 13:12:04.034005 20640 master.cc:562] Master@127.20.40.62:43027 shutting down...
I20260709 13:12:04.057060 20640 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:04.057643 20640 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:04.057930 20640 tablet_replica.cc:333] T 00000000000000000000000000000000 P 101d7371537744d69873145cb2ac92b1: stopping tablet replica
I20260709 13:12:04.077368 20640 master.cc:584] Master@127.20.40.62:43027 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13297 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:12:04.124007 20640 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.40.62:32885
I20260709 13:12:04.125087 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:04.131052 30382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:04.131126 30383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:04.131901 30385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:04.133212 20640 server_base.cc:1061] running on GCE node
I20260709 13:12:04.134390 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:04.134625 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:04.134817 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602724134803 us; error 0 us; skew 500 ppm
I20260709 13:12:04.135458 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:04.138088 20640 webserver.cc:533] Webserver started at http://127.20.40.62:36675/ using document root <none> and password file <none>
I20260709 13:12:04.138590 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:04.138770 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:04.139048 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:04.140242 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602420111825-20640-0/minicluster-data/master-0-root/instance:
uuid: "681152332f0a48d492892f12ed8197ec"
format_stamp: "Formatted at 2026-07-09 13:12:04 on dist-test-slave-rnv4"
I20260709 13:12:04.144877 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:12:04.148173 30390 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:04.148931 20640 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:04.149245 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602420111825-20640-0/minicluster-data/master-0-root
uuid: "681152332f0a48d492892f12ed8197ec"
format_stamp: "Formatted at 2026-07-09 13:12:04 on dist-test-slave-rnv4"
I20260709 13:12:04.149593 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602420111825-20640-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602420111825-20640-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602420111825-20640-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:04.170415 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:04.171684 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:04.209859 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.62:32885
I20260709 13:12:04.209990 30441 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.62:32885 every 8 connection(s)
I20260709 13:12:04.213743 30442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.225211 30442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec: Bootstrap starting.
I20260709 13:12:04.230253 30442 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.235502 30442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec: No bootstrap required, opened a new log
I20260709 13:12:04.237939 30442 raft_consensus.cc:359] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681152332f0a48d492892f12ed8197ec" member_type: VOTER }
I20260709 13:12:04.238353 30442 raft_consensus.cc:385] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.238556 30442 raft_consensus.cc:740] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 681152332f0a48d492892f12ed8197ec, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.239084 30442 consensus_queue.cc:260] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681152332f0a48d492892f12ed8197ec" member_type: VOTER }
I20260709 13:12:04.239549 30442 raft_consensus.cc:399] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:04.239760 30442 raft_consensus.cc:493] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:04.239993 30442 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.245265 30442 raft_consensus.cc:515] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681152332f0a48d492892f12ed8197ec" member_type: VOTER }
I20260709 13:12:04.245944 30442 leader_election.cc:304] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 681152332f0a48d492892f12ed8197ec; no voters: 
I20260709 13:12:04.247128 30442 leader_election.cc:290] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:04.247524 30445 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:04.249086 30445 raft_consensus.cc:697] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec [term 1 LEADER]: Becoming Leader. State: Replica: 681152332f0a48d492892f12ed8197ec, State: Running, Role: LEADER
I20260709 13:12:04.249758 30445 consensus_queue.cc:237] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681152332f0a48d492892f12ed8197ec" member_type: VOTER }
I20260709 13:12:04.250470 30442 sys_catalog.cc:565] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:04.254931 30446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "681152332f0a48d492892f12ed8197ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681152332f0a48d492892f12ed8197ec" member_type: VOTER } }
I20260709 13:12:04.255247 30447 sys_catalog.cc:455] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 681152332f0a48d492892f12ed8197ec. Latest consensus state: current_term: 1 leader_uuid: "681152332f0a48d492892f12ed8197ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "681152332f0a48d492892f12ed8197ec" member_type: VOTER } }
I20260709 13:12:04.255774 30446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:04.256021 30447 sys_catalog.cc:458] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:04.259529 30452 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:04.264367 30452 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:04.268410 20640 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:04.273375 30452 catalog_manager.cc:1383] Generated new cluster ID: b912328021b14027b422f960f95d75d0
I20260709 13:12:04.273729 30452 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:04.302042 30452 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:04.303447 30452 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:04.319615 30452 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec: Generated new TSK 0
I20260709 13:12:04.320304 30452 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:04.334900 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:04.341049 30463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:04.342252 30464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:04.344056 30466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:04.344543 20640 server_base.cc:1061] running on GCE node
I20260709 13:12:04.345665 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:04.345878 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:04.346050 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602724346035 us; error 0 us; skew 500 ppm
I20260709 13:12:04.346661 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:04.349087 20640 webserver.cc:533] Webserver started at http://127.20.40.1:35849/ using document root <none> and password file <none>
I20260709 13:12:04.349651 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:04.349859 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:04.350142 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:04.351379 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602420111825-20640-0/minicluster-data/ts-0-root/instance:
uuid: "475ce84389a649898addbed4e97d91f4"
format_stamp: "Formatted at 2026-07-09 13:12:04 on dist-test-slave-rnv4"
I20260709 13:12:04.356547 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:12:04.360033 30471 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:04.360927 20640 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:12:04.361187 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602420111825-20640-0/minicluster-data/ts-0-root
uuid: "475ce84389a649898addbed4e97d91f4"
format_stamp: "Formatted at 2026-07-09 13:12:04 on dist-test-slave-rnv4"
I20260709 13:12:04.361490 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602420111825-20640-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602420111825-20640-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602420111825-20640-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:04.373160 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:04.374493 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:04.376021 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:04.378381 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:04.378602 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:04.378856 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:04.379058 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:04.421485 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.1:44241
I20260709 13:12:04.421609 30533 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.1:44241 every 8 connection(s)
I20260709 13:12:04.426637 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:04.433964 30538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:04.435367 30539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:04.438339 30541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:04.438874 20640 server_base.cc:1061] running on GCE node
I20260709 13:12:04.440179 30534 heartbeater.cc:344] Connected to a master server at 127.20.40.62:32885
I20260709 13:12:04.440209 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:04.440629 30534 heartbeater.cc:461] Registering TS with master...
W20260709 13:12:04.440716 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:04.441074 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602724441055 us; error 0 us; skew 500 ppm
I20260709 13:12:04.441618 30534 heartbeater.cc:507] Master 127.20.40.62:32885 requested a full tablet report, sending...
I20260709 13:12:04.441813 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:04.444522 30407 ts_manager.cc:194] Registered new tserver with Master: 475ce84389a649898addbed4e97d91f4 (127.20.40.1:44241)
I20260709 13:12:04.445330 20640 webserver.cc:533] Webserver started at http://127.20.40.2:45963/ using document root <none> and password file <none>
I20260709 13:12:04.446053 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:04.446296 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:04.446610 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:04.447201 30407 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39588
I20260709 13:12:04.448189 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602420111825-20640-0/minicluster-data/ts-1-root/instance:
uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25"
format_stamp: "Formatted at 2026-07-09 13:12:04 on dist-test-slave-rnv4"
I20260709 13:12:04.453022 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 13:12:04.456943 30546 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:04.457880 20640 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:12:04.458140 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602420111825-20640-0/minicluster-data/ts-1-root
uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25"
format_stamp: "Formatted at 2026-07-09 13:12:04 on dist-test-slave-rnv4"
I20260709 13:12:04.458372 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602420111825-20640-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602420111825-20640-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602420111825-20640-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:04.471035 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:04.472582 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:04.474578 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:04.477066 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:04.477280 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:04.477567 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:04.477734 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:04.520138 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.2:38451
I20260709 13:12:04.520264 30608 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.2:38451 every 8 connection(s)
I20260709 13:12:04.525110 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:04.531670 30612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:04.533037 30613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:04.536841 20640 server_base.cc:1061] running on GCE node
I20260709 13:12:04.538373 30609 heartbeater.cc:344] Connected to a master server at 127.20.40.62:32885
I20260709 13:12:04.538882 30609 heartbeater.cc:461] Registering TS with master...
W20260709 13:12:04.538923 30615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:04.539927 30609 heartbeater.cc:507] Master 127.20.40.62:32885 requested a full tablet report, sending...
I20260709 13:12:04.540097 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:04.540472 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:04.540671 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602724540653 us; error 0 us; skew 500 ppm
I20260709 13:12:04.541591 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:04.542320 30407 ts_manager.cc:194] Registered new tserver with Master: 8c9f3a7dfcea4f8d92313ce09ff2ca25 (127.20.40.2:38451)
I20260709 13:12:04.543967 30407 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39592
I20260709 13:12:04.544433 20640 webserver.cc:533] Webserver started at http://127.20.40.3:46245/ using document root <none> and password file <none>
I20260709 13:12:04.545188 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:04.545463 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:04.545775 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:04.547079 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602420111825-20640-0/minicluster-data/ts-2-root/instance:
uuid: "76f137b5c17b45578eb162c69d0e3b3f"
format_stamp: "Formatted at 2026-07-09 13:12:04 on dist-test-slave-rnv4"
I20260709 13:12:04.552012 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:04.555433 30620 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:04.556512 20640 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:12:04.556839 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602420111825-20640-0/minicluster-data/ts-2-root
uuid: "76f137b5c17b45578eb162c69d0e3b3f"
format_stamp: "Formatted at 2026-07-09 13:12:04 on dist-test-slave-rnv4"
I20260709 13:12:04.557098 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602420111825-20640-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602420111825-20640-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602420111825-20640-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:04.572364 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:04.573616 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:04.575179 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:04.577702 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:04.577893 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:04.578230 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:04.578390 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:04.622642 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.3:36157
I20260709 13:12:04.622749 30682 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.3:36157 every 8 connection(s)
I20260709 13:12:04.638571 30683 heartbeater.cc:344] Connected to a master server at 127.20.40.62:32885
I20260709 13:12:04.639031 30683 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:04.639775 30683 heartbeater.cc:507] Master 127.20.40.62:32885 requested a full tablet report, sending...
I20260709 13:12:04.641716 30407 ts_manager.cc:194] Registered new tserver with Master: 76f137b5c17b45578eb162c69d0e3b3f (127.20.40.3:36157)
I20260709 13:12:04.642457 20640 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016169531s
I20260709 13:12:04.643167 30407 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39602
I20260709 13:12:04.668011 30407 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39616:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:04.670496 30407 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:04.719730 30648 tablet_service.cc:1511] Processing CreateTablet for tablet da32e98eb08c4c1e90c4b0acd05f2109 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e485526056d6417bb9306d5e19a00165]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:04.719843 30647 tablet_service.cc:1511] Processing CreateTablet for tablet 0df6ac7fc8254ec5ae05da3124e6b930 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e485526056d6417bb9306d5e19a00165]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:04.721349 30648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da32e98eb08c4c1e90c4b0acd05f2109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.722123 30647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0df6ac7fc8254ec5ae05da3124e6b930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.725001 30499 tablet_service.cc:1511] Processing CreateTablet for tablet da32e98eb08c4c1e90c4b0acd05f2109 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e485526056d6417bb9306d5e19a00165]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:04.725226 30574 tablet_service.cc:1511] Processing CreateTablet for tablet da32e98eb08c4c1e90c4b0acd05f2109 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e485526056d6417bb9306d5e19a00165]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:04.725688 30573 tablet_service.cc:1511] Processing CreateTablet for tablet 0df6ac7fc8254ec5ae05da3124e6b930 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e485526056d6417bb9306d5e19a00165]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:04.726382 30499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da32e98eb08c4c1e90c4b0acd05f2109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.726771 30574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da32e98eb08c4c1e90c4b0acd05f2109. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.728789 30573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0df6ac7fc8254ec5ae05da3124e6b930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.731380 30498 tablet_service.cc:1511] Processing CreateTablet for tablet 0df6ac7fc8254ec5ae05da3124e6b930 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=e485526056d6417bb9306d5e19a00165]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:04.732686 30498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0df6ac7fc8254ec5ae05da3124e6b930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:04.760830 30698 tablet_bootstrap.cc:492] T da32e98eb08c4c1e90c4b0acd05f2109 P 8c9f3a7dfcea4f8d92313ce09ff2ca25: Bootstrap starting.
I20260709 13:12:04.766855 30699 tablet_bootstrap.cc:492] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f: Bootstrap starting.
I20260709 13:12:04.768064 30700 tablet_bootstrap.cc:492] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4: Bootstrap starting.
I20260709 13:12:04.769794 30698 tablet_bootstrap.cc:654] T da32e98eb08c4c1e90c4b0acd05f2109 P 8c9f3a7dfcea4f8d92313ce09ff2ca25: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.774832 30700 tablet_bootstrap.cc:654] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.775785 30699 tablet_bootstrap.cc:654] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.777544 30698 tablet_bootstrap.cc:492] T da32e98eb08c4c1e90c4b0acd05f2109 P 8c9f3a7dfcea4f8d92313ce09ff2ca25: No bootstrap required, opened a new log
I20260709 13:12:04.778275 30698 ts_tablet_manager.cc:1403] T da32e98eb08c4c1e90c4b0acd05f2109 P 8c9f3a7dfcea4f8d92313ce09ff2ca25: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.005s
I20260709 13:12:04.780104 30700 tablet_bootstrap.cc:492] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4: No bootstrap required, opened a new log
I20260709 13:12:04.780634 30700 ts_tablet_manager.cc:1403] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:12:04.782101 30699 tablet_bootstrap.cc:492] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f: No bootstrap required, opened a new log
I20260709 13:12:04.781667 30698 raft_consensus.cc:359] T da32e98eb08c4c1e90c4b0acd05f2109 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } } peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } }
I20260709 13:12:04.782577 30698 raft_consensus.cc:385] T da32e98eb08c4c1e90c4b0acd05f2109 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.782635 30699 ts_tablet_manager.cc:1403] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.005s
I20260709 13:12:04.782981 30700 raft_consensus.cc:359] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:04.782998 30698 raft_consensus.cc:740] T da32e98eb08c4c1e90c4b0acd05f2109 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9f3a7dfcea4f8d92313ce09ff2ca25, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.783695 30700 raft_consensus.cc:385] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.784013 30700 raft_consensus.cc:740] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475ce84389a649898addbed4e97d91f4, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.784205 30698 consensus_queue.cc:260] T da32e98eb08c4c1e90c4b0acd05f2109 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } } peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } }
I20260709 13:12:04.784768 30700 consensus_queue.cc:260] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:04.785804 30699 raft_consensus.cc:359] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:04.786727 30699 raft_consensus.cc:385] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.786875 30609 heartbeater.cc:499] Master 127.20.40.62:32885 was elected leader, sending a full tablet report...
I20260709 13:12:04.787163 30699 raft_consensus.cc:740] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f137b5c17b45578eb162c69d0e3b3f, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.787395 30698 ts_tablet_manager.cc:1434] T da32e98eb08c4c1e90c4b0acd05f2109 P 8c9f3a7dfcea4f8d92313ce09ff2ca25: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:12:04.788121 30699 consensus_queue.cc:260] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:04.788424 30698 tablet_bootstrap.cc:492] T 0df6ac7fc8254ec5ae05da3124e6b930 P 8c9f3a7dfcea4f8d92313ce09ff2ca25: Bootstrap starting.
I20260709 13:12:04.788921 30534 heartbeater.cc:499] Master 127.20.40.62:32885 was elected leader, sending a full tablet report...
I20260709 13:12:04.793886 30700 ts_tablet_manager.cc:1434] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:12:04.795089 30700 tablet_bootstrap.cc:492] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4: Bootstrap starting.
I20260709 13:12:04.796439 30683 heartbeater.cc:499] Master 127.20.40.62:32885 was elected leader, sending a full tablet report...
I20260709 13:12:04.797688 30698 tablet_bootstrap.cc:654] T 0df6ac7fc8254ec5ae05da3124e6b930 P 8c9f3a7dfcea4f8d92313ce09ff2ca25: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.801822 30700 tablet_bootstrap.cc:654] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.801859 30699 ts_tablet_manager.cc:1434] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.007s
I20260709 13:12:04.803522 30699 tablet_bootstrap.cc:492] T da32e98eb08c4c1e90c4b0acd05f2109 P 76f137b5c17b45578eb162c69d0e3b3f: Bootstrap starting.
I20260709 13:12:04.813894 30699 tablet_bootstrap.cc:654] T da32e98eb08c4c1e90c4b0acd05f2109 P 76f137b5c17b45578eb162c69d0e3b3f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:04.817319 30698 tablet_bootstrap.cc:492] T 0df6ac7fc8254ec5ae05da3124e6b930 P 8c9f3a7dfcea4f8d92313ce09ff2ca25: No bootstrap required, opened a new log
I20260709 13:12:04.818043 30698 ts_tablet_manager.cc:1403] T 0df6ac7fc8254ec5ae05da3124e6b930 P 8c9f3a7dfcea4f8d92313ce09ff2ca25: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.022s
I20260709 13:12:04.820441 30700 tablet_bootstrap.cc:492] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4: No bootstrap required, opened a new log
I20260709 13:12:04.821061 30700 ts_tablet_manager.cc:1403] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.004s
I20260709 13:12:04.822467 30698 raft_consensus.cc:359] T 0df6ac7fc8254ec5ae05da3124e6b930 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:04.823745 30698 raft_consensus.cc:385] T 0df6ac7fc8254ec5ae05da3124e6b930 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.824283 30698 raft_consensus.cc:740] T 0df6ac7fc8254ec5ae05da3124e6b930 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9f3a7dfcea4f8d92313ce09ff2ca25, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.824533 30700 raft_consensus.cc:359] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } } peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } }
I20260709 13:12:04.825412 30700 raft_consensus.cc:385] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.825842 30700 raft_consensus.cc:740] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475ce84389a649898addbed4e97d91f4, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.825482 30698 consensus_queue.cc:260] T 0df6ac7fc8254ec5ae05da3124e6b930 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:04.826563 30700 consensus_queue.cc:260] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } } peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } }
I20260709 13:12:04.827414 30699 tablet_bootstrap.cc:492] T da32e98eb08c4c1e90c4b0acd05f2109 P 76f137b5c17b45578eb162c69d0e3b3f: No bootstrap required, opened a new log
I20260709 13:12:04.828025 30699 ts_tablet_manager.cc:1403] T da32e98eb08c4c1e90c4b0acd05f2109 P 76f137b5c17b45578eb162c69d0e3b3f: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.010s
I20260709 13:12:04.828441 30698 ts_tablet_manager.cc:1434] T 0df6ac7fc8254ec5ae05da3124e6b930 P 8c9f3a7dfcea4f8d92313ce09ff2ca25: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.005s
I20260709 13:12:04.828713 30700 ts_tablet_manager.cc:1434] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:04.831140 30699 raft_consensus.cc:359] T da32e98eb08c4c1e90c4b0acd05f2109 P 76f137b5c17b45578eb162c69d0e3b3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } } peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } }
I20260709 13:12:04.831774 30699 raft_consensus.cc:385] T da32e98eb08c4c1e90c4b0acd05f2109 P 76f137b5c17b45578eb162c69d0e3b3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:04.832110 30699 raft_consensus.cc:740] T da32e98eb08c4c1e90c4b0acd05f2109 P 76f137b5c17b45578eb162c69d0e3b3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f137b5c17b45578eb162c69d0e3b3f, State: Initialized, Role: FOLLOWER
I20260709 13:12:04.832851 30699 consensus_queue.cc:260] T da32e98eb08c4c1e90c4b0acd05f2109 P 76f137b5c17b45578eb162c69d0e3b3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } } peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } }
I20260709 13:12:04.835769 30699 ts_tablet_manager.cc:1434] T da32e98eb08c4c1e90c4b0acd05f2109 P 76f137b5c17b45578eb162c69d0e3b3f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:04.893759 30705 raft_consensus.cc:493] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.894451 30705 raft_consensus.cc:515] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:04.896857 30705 leader_election.cc:290] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9f3a7dfcea4f8d92313ce09ff2ca25 (127.20.40.2:38451), 76f137b5c17b45578eb162c69d0e3b3f (127.20.40.3:36157)
I20260709 13:12:04.906476 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df6ac7fc8254ec5ae05da3124e6b930" candidate_uuid: "475ce84389a649898addbed4e97d91f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" is_pre_election: true
I20260709 13:12:04.907392 30584 raft_consensus.cc:2468] T 0df6ac7fc8254ec5ae05da3124e6b930 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 475ce84389a649898addbed4e97d91f4 in term 0.
I20260709 13:12:04.908615 30658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df6ac7fc8254ec5ae05da3124e6b930" candidate_uuid: "475ce84389a649898addbed4e97d91f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f137b5c17b45578eb162c69d0e3b3f" is_pre_election: true
I20260709 13:12:04.908818 30472 leader_election.cc:304] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 475ce84389a649898addbed4e97d91f4, 8c9f3a7dfcea4f8d92313ce09ff2ca25; no voters: 
I20260709 13:12:04.909535 30658 raft_consensus.cc:2468] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 475ce84389a649898addbed4e97d91f4 in term 0.
I20260709 13:12:04.909775 30705 raft_consensus.cc:2804] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:04.910280 30705 raft_consensus.cc:493] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.910686 30705 raft_consensus.cc:3060] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.917335 30705 raft_consensus.cc:515] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:04.919134 30705 leader_election.cc:290] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9f3a7dfcea4f8d92313ce09ff2ca25 (127.20.40.2:38451), 76f137b5c17b45578eb162c69d0e3b3f (127.20.40.3:36157)
I20260709 13:12:04.920096 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df6ac7fc8254ec5ae05da3124e6b930" candidate_uuid: "475ce84389a649898addbed4e97d91f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25"
I20260709 13:12:04.920307 30658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df6ac7fc8254ec5ae05da3124e6b930" candidate_uuid: "475ce84389a649898addbed4e97d91f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f137b5c17b45578eb162c69d0e3b3f"
I20260709 13:12:04.920653 30584 raft_consensus.cc:3060] T 0df6ac7fc8254ec5ae05da3124e6b930 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.921013 30658 raft_consensus.cc:3060] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.926213 30584 raft_consensus.cc:2468] T 0df6ac7fc8254ec5ae05da3124e6b930 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 475ce84389a649898addbed4e97d91f4 in term 1.
I20260709 13:12:04.926576 30658 raft_consensus.cc:2468] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 475ce84389a649898addbed4e97d91f4 in term 1.
I20260709 13:12:04.927548 30472 leader_election.cc:304] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 475ce84389a649898addbed4e97d91f4, 8c9f3a7dfcea4f8d92313ce09ff2ca25; no voters: 
I20260709 13:12:04.928301 30705 raft_consensus.cc:2804] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:04.929147 30705 raft_consensus.cc:697] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [term 1 LEADER]: Becoming Leader. State: Replica: 475ce84389a649898addbed4e97d91f4, State: Running, Role: LEADER
I20260709 13:12:04.929961 30705 consensus_queue.cc:237] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:04.936884 30405 catalog_manager.cc:5697] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 475ce84389a649898addbed4e97d91f4 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "475ce84389a649898addbed4e97d91f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:04.950001 30705 raft_consensus.cc:493] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:04.950502 30705 raft_consensus.cc:515] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } } peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } }
I20260709 13:12:04.952447 30705 leader_election.cc:290] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76f137b5c17b45578eb162c69d0e3b3f (127.20.40.3:36157), 8c9f3a7dfcea4f8d92313ce09ff2ca25 (127.20.40.2:38451)
I20260709 13:12:04.953119 30658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da32e98eb08c4c1e90c4b0acd05f2109" candidate_uuid: "475ce84389a649898addbed4e97d91f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f137b5c17b45578eb162c69d0e3b3f" is_pre_election: true
I20260709 13:12:04.953624 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da32e98eb08c4c1e90c4b0acd05f2109" candidate_uuid: "475ce84389a649898addbed4e97d91f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" is_pre_election: true
I20260709 13:12:04.953805 30658 raft_consensus.cc:2468] T da32e98eb08c4c1e90c4b0acd05f2109 P 76f137b5c17b45578eb162c69d0e3b3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 475ce84389a649898addbed4e97d91f4 in term 0.
I20260709 13:12:04.954293 30584 raft_consensus.cc:2468] T da32e98eb08c4c1e90c4b0acd05f2109 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 475ce84389a649898addbed4e97d91f4 in term 0.
I20260709 13:12:04.955008 30475 leader_election.cc:304] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 475ce84389a649898addbed4e97d91f4, 76f137b5c17b45578eb162c69d0e3b3f; no voters: 
I20260709 13:12:04.955924 30705 raft_consensus.cc:2804] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:04.956395 30705 raft_consensus.cc:493] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:04.956730 30705 raft_consensus.cc:3060] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.962772 30705 raft_consensus.cc:515] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } } peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } }
I20260709 13:12:04.964557 30705 leader_election.cc:290] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [CANDIDATE]: Term 1 election: Requested vote from peers 76f137b5c17b45578eb162c69d0e3b3f (127.20.40.3:36157), 8c9f3a7dfcea4f8d92313ce09ff2ca25 (127.20.40.2:38451)
I20260709 13:12:04.965294 30658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da32e98eb08c4c1e90c4b0acd05f2109" candidate_uuid: "475ce84389a649898addbed4e97d91f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f137b5c17b45578eb162c69d0e3b3f"
I20260709 13:12:04.965638 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da32e98eb08c4c1e90c4b0acd05f2109" candidate_uuid: "475ce84389a649898addbed4e97d91f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25"
I20260709 13:12:04.965970 30658 raft_consensus.cc:3060] T da32e98eb08c4c1e90c4b0acd05f2109 P 76f137b5c17b45578eb162c69d0e3b3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.966360 30584 raft_consensus.cc:3060] T da32e98eb08c4c1e90c4b0acd05f2109 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:04.971863 30658 raft_consensus.cc:2468] T da32e98eb08c4c1e90c4b0acd05f2109 P 76f137b5c17b45578eb162c69d0e3b3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 475ce84389a649898addbed4e97d91f4 in term 1.
I20260709 13:12:04.972020 30584 raft_consensus.cc:2468] T da32e98eb08c4c1e90c4b0acd05f2109 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 475ce84389a649898addbed4e97d91f4 in term 1.
I20260709 13:12:04.973208 30475 leader_election.cc:304] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 475ce84389a649898addbed4e97d91f4, 76f137b5c17b45578eb162c69d0e3b3f; no voters: 
I20260709 13:12:04.974035 30705 raft_consensus.cc:2804] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:04.974572 30705 raft_consensus.cc:697] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [term 1 LEADER]: Becoming Leader. State: Replica: 475ce84389a649898addbed4e97d91f4, State: Running, Role: LEADER
I20260709 13:12:04.975354 30705 consensus_queue.cc:237] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } } peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } }
I20260709 13:12:04.981681 30405 catalog_manager.cc:5697] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 475ce84389a649898addbed4e97d91f4 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "475ce84389a649898addbed4e97d91f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.044651 30405 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39626:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:05.046788 30405 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:05.072719 30498 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff35b9780b247ce8f14e1b8b32e92f0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=bedafec87dda4b2eb49b3362cf9db084]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:05.074064 30498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff35b9780b247ce8f14e1b8b32e92f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.074169 30573 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff35b9780b247ce8f14e1b8b32e92f0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=bedafec87dda4b2eb49b3362cf9db084]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:05.075583 30573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff35b9780b247ce8f14e1b8b32e92f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.075964 30647 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff35b9780b247ce8f14e1b8b32e92f0 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=bedafec87dda4b2eb49b3362cf9db084]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:05.077338 30647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff35b9780b247ce8f14e1b8b32e92f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.080463 30499 tablet_service.cc:1511] Processing CreateTablet for tablet 22113c0f51d849888f37a1fdb552fe1e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=bedafec87dda4b2eb49b3362cf9db084]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:05.081764 30499 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22113c0f51d849888f37a1fdb552fe1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.083025 30574 tablet_service.cc:1511] Processing CreateTablet for tablet 22113c0f51d849888f37a1fdb552fe1e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=bedafec87dda4b2eb49b3362cf9db084]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:05.084376 30574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22113c0f51d849888f37a1fdb552fe1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.090234 30700 tablet_bootstrap.cc:492] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4: Bootstrap starting.
I20260709 13:12:05.091475 30648 tablet_service.cc:1511] Processing CreateTablet for tablet 22113c0f51d849888f37a1fdb552fe1e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=bedafec87dda4b2eb49b3362cf9db084]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:05.092840 30648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22113c0f51d849888f37a1fdb552fe1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:05.094810 30698 tablet_bootstrap.cc:492] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25: Bootstrap starting.
I20260709 13:12:05.096901 30700 tablet_bootstrap.cc:654] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.101871 30698 tablet_bootstrap.cc:654] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.104012 30700 tablet_bootstrap.cc:492] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4: No bootstrap required, opened a new log
I20260709 13:12:05.104578 30700 ts_tablet_manager.cc:1403] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:12:05.107618 30700 raft_consensus.cc:359] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.108368 30700 raft_consensus.cc:385] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.108709 30700 raft_consensus.cc:740] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475ce84389a649898addbed4e97d91f4, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.109409 30700 consensus_queue.cc:260] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.111647 30700 ts_tablet_manager.cc:1434] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:12:05.112720 30700 tablet_bootstrap.cc:492] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4: Bootstrap starting.
I20260709 13:12:05.114218 30698 tablet_bootstrap.cc:492] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25: No bootstrap required, opened a new log
I20260709 13:12:05.114909 30698 ts_tablet_manager.cc:1403] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 13:12:05.117591 30699 tablet_bootstrap.cc:492] T 22113c0f51d849888f37a1fdb552fe1e P 76f137b5c17b45578eb162c69d0e3b3f: Bootstrap starting.
I20260709 13:12:05.118320 30698 raft_consensus.cc:359] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.119213 30698 raft_consensus.cc:385] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.119374 30700 tablet_bootstrap.cc:654] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.119547 30698 raft_consensus.cc:740] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9f3a7dfcea4f8d92313ce09ff2ca25, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.120615 30698 consensus_queue.cc:260] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.125792 30698 ts_tablet_manager.cc:1434] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:05.126329 30699 tablet_bootstrap.cc:654] T 22113c0f51d849888f37a1fdb552fe1e P 76f137b5c17b45578eb162c69d0e3b3f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.136170 30699 tablet_bootstrap.cc:492] T 22113c0f51d849888f37a1fdb552fe1e P 76f137b5c17b45578eb162c69d0e3b3f: No bootstrap required, opened a new log
I20260709 13:12:05.136580 30700 tablet_bootstrap.cc:492] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4: No bootstrap required, opened a new log
I20260709 13:12:05.136751 30699 ts_tablet_manager.cc:1403] T 22113c0f51d849888f37a1fdb552fe1e P 76f137b5c17b45578eb162c69d0e3b3f: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.002s
I20260709 13:12:05.137207 30700 ts_tablet_manager.cc:1403] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.004s
I20260709 13:12:05.138325 30698 tablet_bootstrap.cc:492] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25: Bootstrap starting.
I20260709 13:12:05.140012 30699 raft_consensus.cc:359] T 22113c0f51d849888f37a1fdb552fe1e P 76f137b5c17b45578eb162c69d0e3b3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.140849 30699 raft_consensus.cc:385] T 22113c0f51d849888f37a1fdb552fe1e P 76f137b5c17b45578eb162c69d0e3b3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.141201 30699 raft_consensus.cc:740] T 22113c0f51d849888f37a1fdb552fe1e P 76f137b5c17b45578eb162c69d0e3b3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f137b5c17b45578eb162c69d0e3b3f, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.141042 30700 raft_consensus.cc:359] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.142023 30700 raft_consensus.cc:385] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.142315 30700 raft_consensus.cc:740] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475ce84389a649898addbed4e97d91f4, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.142288 30699 consensus_queue.cc:260] T 22113c0f51d849888f37a1fdb552fe1e P 76f137b5c17b45578eb162c69d0e3b3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.143482 30700 consensus_queue.cc:260] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.144760 30699 ts_tablet_manager.cc:1434] T 22113c0f51d849888f37a1fdb552fe1e P 76f137b5c17b45578eb162c69d0e3b3f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:05.145941 30699 tablet_bootstrap.cc:492] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 76f137b5c17b45578eb162c69d0e3b3f: Bootstrap starting.
I20260709 13:12:05.146268 30700 ts_tablet_manager.cc:1434] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:12:05.150172 30698 tablet_bootstrap.cc:654] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.152489 30699 tablet_bootstrap.cc:654] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 76f137b5c17b45578eb162c69d0e3b3f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:05.164909 30699 tablet_bootstrap.cc:492] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 76f137b5c17b45578eb162c69d0e3b3f: No bootstrap required, opened a new log
I20260709 13:12:05.164909 30698 tablet_bootstrap.cc:492] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25: No bootstrap required, opened a new log
I20260709 13:12:05.166201 30698 ts_tablet_manager.cc:1403] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.000s
I20260709 13:12:05.165489 30699 ts_tablet_manager.cc:1403] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 76f137b5c17b45578eb162c69d0e3b3f: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.011s
I20260709 13:12:05.169229 30699 raft_consensus.cc:359] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 76f137b5c17b45578eb162c69d0e3b3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.169387 30698 raft_consensus.cc:359] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.169924 30699 raft_consensus.cc:385] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 76f137b5c17b45578eb162c69d0e3b3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.170126 30698 raft_consensus.cc:385] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:05.170312 30699 raft_consensus.cc:740] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 76f137b5c17b45578eb162c69d0e3b3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76f137b5c17b45578eb162c69d0e3b3f, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.170480 30698 raft_consensus.cc:740] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c9f3a7dfcea4f8d92313ce09ff2ca25, State: Initialized, Role: FOLLOWER
I20260709 13:12:05.171255 30699 consensus_queue.cc:260] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 76f137b5c17b45578eb162c69d0e3b3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.171264 30698 consensus_queue.cc:260] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.173684 30698 ts_tablet_manager.cc:1434] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:12:05.173785 30699 ts_tablet_manager.cc:1434] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 76f137b5c17b45578eb162c69d0e3b3f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:05.234935 30705 raft_consensus.cc:493] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.235749 30704 raft_consensus.cc:493] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:05.235668 30705 raft_consensus.cc:515] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.236317 30704 raft_consensus.cc:515] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.238139 30705 leader_election.cc:290] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8c9f3a7dfcea4f8d92313ce09ff2ca25 (127.20.40.2:38451), 76f137b5c17b45578eb162c69d0e3b3f (127.20.40.3:36157)
I20260709 13:12:05.239051 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff35b9780b247ce8f14e1b8b32e92f0" candidate_uuid: "475ce84389a649898addbed4e97d91f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" is_pre_election: true
I20260709 13:12:05.239513 30658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff35b9780b247ce8f14e1b8b32e92f0" candidate_uuid: "475ce84389a649898addbed4e97d91f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f137b5c17b45578eb162c69d0e3b3f" is_pre_election: true
I20260709 13:12:05.239856 30584 raft_consensus.cc:2468] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 475ce84389a649898addbed4e97d91f4 in term 0.
I20260709 13:12:05.240037 30704 leader_election.cc:290] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 475ce84389a649898addbed4e97d91f4 (127.20.40.1:44241), 76f137b5c17b45578eb162c69d0e3b3f (127.20.40.3:36157)
I20260709 13:12:05.240253 30658 raft_consensus.cc:2468] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 76f137b5c17b45578eb162c69d0e3b3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 475ce84389a649898addbed4e97d91f4 in term 0.
I20260709 13:12:05.241613 30472 leader_election.cc:304] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 475ce84389a649898addbed4e97d91f4, 8c9f3a7dfcea4f8d92313ce09ff2ca25; no voters: 
I20260709 13:12:05.243111 30705 raft_consensus.cc:2804] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.243602 30705 raft_consensus.cc:493] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.244076 30705 raft_consensus.cc:3060] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.252167 30705 raft_consensus.cc:515] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.252915 30658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22113c0f51d849888f37a1fdb552fe1e" candidate_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f137b5c17b45578eb162c69d0e3b3f" is_pre_election: true
I20260709 13:12:05.253763 30658 raft_consensus.cc:2468] T 22113c0f51d849888f37a1fdb552fe1e P 76f137b5c17b45578eb162c69d0e3b3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9f3a7dfcea4f8d92313ce09ff2ca25 in term 0.
I20260709 13:12:05.255136 30705 leader_election.cc:290] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [CANDIDATE]: Term 1 election: Requested vote from peers 8c9f3a7dfcea4f8d92313ce09ff2ca25 (127.20.40.2:38451), 76f137b5c17b45578eb162c69d0e3b3f (127.20.40.3:36157)
I20260709 13:12:05.255224 30509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22113c0f51d849888f37a1fdb552fe1e" candidate_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475ce84389a649898addbed4e97d91f4" is_pre_election: true
I20260709 13:12:05.255173 30550 leader_election.cc:304] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f137b5c17b45578eb162c69d0e3b3f, 8c9f3a7dfcea4f8d92313ce09ff2ca25; no voters: 
I20260709 13:12:05.255333 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff35b9780b247ce8f14e1b8b32e92f0" candidate_uuid: "475ce84389a649898addbed4e97d91f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25"
I20260709 13:12:05.256233 30509 raft_consensus.cc:2468] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c9f3a7dfcea4f8d92313ce09ff2ca25 in term 0.
I20260709 13:12:05.256376 30584 raft_consensus.cc:3060] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.256458 30704 raft_consensus.cc:2804] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:05.257072 30704 raft_consensus.cc:493] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:05.257387 30704 raft_consensus.cc:3060] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.257742 30658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff35b9780b247ce8f14e1b8b32e92f0" candidate_uuid: "475ce84389a649898addbed4e97d91f4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f137b5c17b45578eb162c69d0e3b3f"
I20260709 13:12:05.258368 30658 raft_consensus.cc:3060] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 76f137b5c17b45578eb162c69d0e3b3f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:05.262866 30455 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:05.264933 30584 raft_consensus.cc:2468] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 475ce84389a649898addbed4e97d91f4 in term 1.
I20260709 13:12:05.265060 30704 raft_consensus.cc:515] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.265846 30658 raft_consensus.cc:2468] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 76f137b5c17b45578eb162c69d0e3b3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 475ce84389a649898addbed4e97d91f4 in term 1.
I20260709 13:12:05.266350 30472 leader_election.cc:304] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 475ce84389a649898addbed4e97d91f4, 8c9f3a7dfcea4f8d92313ce09ff2ca25; no voters: 
I20260709 13:12:05.267176 30704 leader_election.cc:290] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [CANDIDATE]: Term 1 election: Requested vote from peers 475ce84389a649898addbed4e97d91f4 (127.20.40.1:44241), 76f137b5c17b45578eb162c69d0e3b3f (127.20.40.3:36157)
I20260709 13:12:05.267300 30705 raft_consensus.cc:2804] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.268159 30705 raft_consensus.cc:697] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [term 1 LEADER]: Becoming Leader. State: Replica: 475ce84389a649898addbed4e97d91f4, State: Running, Role: LEADER
I20260709 13:12:05.268247 30658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22113c0f51d849888f37a1fdb552fe1e" candidate_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76f137b5c17b45578eb162c69d0e3b3f"
I20260709 13:12:05.268307 30509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22113c0f51d849888f37a1fdb552fe1e" candidate_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475ce84389a649898addbed4e97d91f4"
I20260709 13:12:05.268929 30658 raft_consensus.cc:3060] T 22113c0f51d849888f37a1fdb552fe1e P 76f137b5c17b45578eb162c69d0e3b3f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.269091 30509 raft_consensus.cc:3060] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:05.269130 30705 consensus_queue.cc:237] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.276328 30658 raft_consensus.cc:2468] T 22113c0f51d849888f37a1fdb552fe1e P 76f137b5c17b45578eb162c69d0e3b3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9f3a7dfcea4f8d92313ce09ff2ca25 in term 1.
I20260709 13:12:05.277573 30509 raft_consensus.cc:2468] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9f3a7dfcea4f8d92313ce09ff2ca25 in term 1.
I20260709 13:12:05.277626 30550 leader_election.cc:304] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f137b5c17b45578eb162c69d0e3b3f, 8c9f3a7dfcea4f8d92313ce09ff2ca25; no voters: 
I20260709 13:12:05.278682 30704 raft_consensus.cc:2804] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:05.278473 30407 catalog_manager.cc:5697] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 475ce84389a649898addbed4e97d91f4 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "475ce84389a649898addbed4e97d91f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.279965 30704 raft_consensus.cc:697] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 1 LEADER]: Becoming Leader. State: Replica: 8c9f3a7dfcea4f8d92313ce09ff2ca25, State: Running, Role: LEADER
I20260709 13:12:05.280864 30704 consensus_queue.cc:237] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.288610 30403 catalog_manager.cc:5697] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c9f3a7dfcea4f8d92313ce09ff2ca25 (127.20.40.2). New cstate: current_term: 1 leader_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:05.345474 30509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0df6ac7fc8254ec5ae05da3124e6b930"
dest_uuid: "475ce84389a649898addbed4e97d91f4"
mode: GRACEFUL
new_leader_uuid: "76f137b5c17b45578eb162c69d0e3b3f"
 from {username='slave'} at 127.0.0.1:39182
I20260709 13:12:05.346001 30509 raft_consensus.cc:606] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [term 1 LEADER]: Received request to transfer leadership to TS 76f137b5c17b45578eb162c69d0e3b3f
I20260709 13:12:05.362701 30584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22113c0f51d849888f37a1fdb552fe1e"
dest_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25"
mode: GRACEFUL
new_leader_uuid: "475ce84389a649898addbed4e97d91f4"
 from {username='slave'} at 127.0.0.1:33154
I20260709 13:12:05.363251 30584 raft_consensus.cc:606] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 1 LEADER]: Received request to transfer leadership to TS 475ce84389a649898addbed4e97d91f4
I20260709 13:12:05.394743 30705 consensus_queue.cc:1048] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.408322 30705 consensus_queue.cc:1048] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:05.527275 30705 consensus_queue.cc:1048] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.534947 30711 raft_consensus.cc:993] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4: : Instructing follower 76f137b5c17b45578eb162c69d0e3b3f to start an election
I20260709 13:12:05.535706 30705 raft_consensus.cc:1081] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [term 1 LEADER]: Signalling peer 76f137b5c17b45578eb162c69d0e3b3f to start an election
I20260709 13:12:05.539897 30658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0df6ac7fc8254ec5ae05da3124e6b930"
dest_uuid: "76f137b5c17b45578eb162c69d0e3b3f"
 from {username='slave'} at 127.0.0.1:52190
I20260709 13:12:05.540588 30658 raft_consensus.cc:493] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:05.540985 30658 raft_consensus.cc:3060] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:05.541936 30705 consensus_queue.cc:1048] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.549955 30658 raft_consensus.cc:515] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.559084 30658 leader_election.cc:290] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f [CANDIDATE]: Term 2 election: Requested vote from peers 475ce84389a649898addbed4e97d91f4 (127.20.40.1:44241), 8c9f3a7dfcea4f8d92313ce09ff2ca25 (127.20.40.2:38451)
I20260709 13:12:05.566617 30509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df6ac7fc8254ec5ae05da3124e6b930" candidate_uuid: "76f137b5c17b45578eb162c69d0e3b3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "475ce84389a649898addbed4e97d91f4"
I20260709 13:12:05.567308 30509 raft_consensus.cc:3055] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:05.567373 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0df6ac7fc8254ec5ae05da3124e6b930" candidate_uuid: "76f137b5c17b45578eb162c69d0e3b3f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25"
I20260709 13:12:05.567727 30509 raft_consensus.cc:740] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 475ce84389a649898addbed4e97d91f4, State: Running, Role: LEADER
I20260709 13:12:05.568161 30584 raft_consensus.cc:3060] T 0df6ac7fc8254ec5ae05da3124e6b930 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:05.568668 30509 consensus_queue.cc:260] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.570276 30509 raft_consensus.cc:3060] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:05.574721 30584 raft_consensus.cc:2468] T 0df6ac7fc8254ec5ae05da3124e6b930 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76f137b5c17b45578eb162c69d0e3b3f in term 2.
I20260709 13:12:05.576053 30621 leader_election.cc:304] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f137b5c17b45578eb162c69d0e3b3f, 8c9f3a7dfcea4f8d92313ce09ff2ca25; no voters: 
I20260709 13:12:05.576687 30509 raft_consensus.cc:2468] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76f137b5c17b45578eb162c69d0e3b3f in term 2.
I20260709 13:12:05.576900 30706 raft_consensus.cc:2804] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:05.578521 30706 raft_consensus.cc:697] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f [term 2 LEADER]: Becoming Leader. State: Replica: 76f137b5c17b45578eb162c69d0e3b3f, State: Running, Role: LEADER
I20260709 13:12:05.579414 30706 consensus_queue.cc:237] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.586365 30403 catalog_manager.cc:5697] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f reported cstate change: term changed from 1 to 2, leader changed from 475ce84389a649898addbed4e97d91f4 (127.20.40.1) to 76f137b5c17b45578eb162c69d0e3b3f (127.20.40.3). New cstate: current_term: 2 leader_uuid: "76f137b5c17b45578eb162c69d0e3b3f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:05.711925 30705 consensus_queue.cc:1048] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.721966 30711 consensus_queue.cc:1048] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.812637 30745 consensus_queue.cc:1048] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:05.813584 30704 consensus_queue.cc:1048] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:05.823550 30704 raft_consensus.cc:993] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25: : Instructing follower 475ce84389a649898addbed4e97d91f4 to start an election
I20260709 13:12:05.829248 30745 raft_consensus.cc:1081] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 1 LEADER]: Signalling peer 475ce84389a649898addbed4e97d91f4 to start an election
I20260709 13:12:05.831919 30509 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22113c0f51d849888f37a1fdb552fe1e"
dest_uuid: "475ce84389a649898addbed4e97d91f4"
 from {username='slave'} at 127.0.0.1:39170
I20260709 13:12:05.833067 30509 raft_consensus.cc:493] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:05.835961 30509 raft_consensus.cc:3060] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:05.844712 30509 raft_consensus.cc:515] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.847631 30584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22113c0f51d849888f37a1fdb552fe1e" candidate_uuid: "475ce84389a649898addbed4e97d91f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25"
I20260709 13:12:05.847286 30509 leader_election.cc:290] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4 [CANDIDATE]: Term 2 election: Requested vote from peers 8c9f3a7dfcea4f8d92313ce09ff2ca25 (127.20.40.2:38451), 76f137b5c17b45578eb162c69d0e3b3f (127.20.40.3:36157)
I20260709 13:12:05.847942 30658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22113c0f51d849888f37a1fdb552fe1e" candidate_uuid: "475ce84389a649898addbed4e97d91f4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76f137b5c17b45578eb162c69d0e3b3f"
I20260709 13:12:05.848379 30584 raft_consensus.cc:3055] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:05.848730 30658 raft_consensus.cc:3060] T 22113c0f51d849888f37a1fdb552fe1e P 76f137b5c17b45578eb162c69d0e3b3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:05.848837 30584 raft_consensus.cc:740] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8c9f3a7dfcea4f8d92313ce09ff2ca25, State: Running, Role: LEADER
I20260709 13:12:05.849857 30584 consensus_queue.cc:260] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.851375 30584 raft_consensus.cc:3060] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:05.857012 30658 raft_consensus.cc:2468] T 22113c0f51d849888f37a1fdb552fe1e P 76f137b5c17b45578eb162c69d0e3b3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 475ce84389a649898addbed4e97d91f4 in term 2.
I20260709 13:12:05.858511 30475 leader_election.cc:304] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 475ce84389a649898addbed4e97d91f4, 76f137b5c17b45578eb162c69d0e3b3f; no voters: 
I20260709 13:12:05.859354 30584 raft_consensus.cc:2468] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 475ce84389a649898addbed4e97d91f4 in term 2.
I20260709 13:12:05.859473 30711 raft_consensus.cc:2804] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:05.860180 30711 raft_consensus.cc:697] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4 [term 2 LEADER]: Becoming Leader. State: Replica: 475ce84389a649898addbed4e97d91f4, State: Running, Role: LEADER
I20260709 13:12:05.861052 30711 consensus_queue.cc:237] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:05.867683 30405 catalog_manager.cc:5697] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4 reported cstate change: term changed from 1 to 2, leader changed from 8c9f3a7dfcea4f8d92313ce09ff2ca25 (127.20.40.2) to 475ce84389a649898addbed4e97d91f4 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "475ce84389a649898addbed4e97d91f4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:06.003458 30584 raft_consensus.cc:1275] T 0df6ac7fc8254ec5ae05da3124e6b930 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 2 FOLLOWER]: Refusing update from remote peer 76f137b5c17b45578eb162c69d0e3b3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:06.004752 30706 consensus_queue.cc:1048] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:06.013993 30509 raft_consensus.cc:1275] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [term 2 FOLLOWER]: Refusing update from remote peer 76f137b5c17b45578eb162c69d0e3b3f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:06.016086 30706 consensus_queue.cc:1048] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f [LEADER]: Connected to new peer: Peer: permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:06.121685 20640 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:12:06.123425 20640 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:12:06.123833 20640 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:12:06.135434 30509 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ff35b9780b247ce8f14e1b8b32e92f0"
dest_uuid: "475ce84389a649898addbed4e97d91f4"
mode: GRACEFUL
new_leader_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25"
 from {username='slave'} at 127.0.0.1:39198
I20260709 13:12:06.136008 30509 raft_consensus.cc:606] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [term 1 LEADER]: Received request to transfer leadership to TS 8c9f3a7dfcea4f8d92313ce09ff2ca25
I20260709 13:12:06.137127 20640 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:12:06.274891 30705 raft_consensus.cc:993] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4: : Instructing follower 8c9f3a7dfcea4f8d92313ce09ff2ca25 to start an election
I20260709 13:12:06.275425 30711 raft_consensus.cc:1081] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [term 1 LEADER]: Signalling peer 8c9f3a7dfcea4f8d92313ce09ff2ca25 to start an election
I20260709 13:12:06.276886 30584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ff35b9780b247ce8f14e1b8b32e92f0"
dest_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25"
 from {username='slave'} at 127.0.0.1:33148
I20260709 13:12:06.277478 30584 raft_consensus.cc:493] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:06.277797 30584 raft_consensus.cc:3060] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:06.282855 30584 raft_consensus.cc:515] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:06.284610 30584 leader_election.cc:290] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [CANDIDATE]: Term 2 election: Requested vote from peers 475ce84389a649898addbed4e97d91f4 (127.20.40.1:44241), 76f137b5c17b45578eb162c69d0e3b3f (127.20.40.3:36157)
I20260709 13:12:06.285307 30509 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff35b9780b247ce8f14e1b8b32e92f0" candidate_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "475ce84389a649898addbed4e97d91f4"
I20260709 13:12:06.285678 30658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff35b9780b247ce8f14e1b8b32e92f0" candidate_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76f137b5c17b45578eb162c69d0e3b3f"
I20260709 13:12:06.286036 30509 raft_consensus.cc:3055] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:06.286285 30658 raft_consensus.cc:3060] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 76f137b5c17b45578eb162c69d0e3b3f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:06.286403 30509 raft_consensus.cc:740] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 475ce84389a649898addbed4e97d91f4, State: Running, Role: LEADER
I20260709 13:12:06.287382 30509 consensus_queue.cc:260] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:06.288647 30509 raft_consensus.cc:3060] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:06.293747 30658 raft_consensus.cc:2468] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 76f137b5c17b45578eb162c69d0e3b3f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9f3a7dfcea4f8d92313ce09ff2ca25 in term 2.
I20260709 13:12:06.295219 30550 leader_election.cc:304] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76f137b5c17b45578eb162c69d0e3b3f, 8c9f3a7dfcea4f8d92313ce09ff2ca25; no voters: 
I20260709 13:12:06.295521 30509 raft_consensus.cc:2468] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c9f3a7dfcea4f8d92313ce09ff2ca25 in term 2.
I20260709 13:12:06.295941 30745 raft_consensus.cc:2804] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:06.296458 30745 raft_consensus.cc:697] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 2 LEADER]: Becoming Leader. State: Replica: 8c9f3a7dfcea4f8d92313ce09ff2ca25, State: Running, Role: LEADER
I20260709 13:12:06.297258 30745 consensus_queue.cc:237] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } }
I20260709 13:12:06.303279 30405 catalog_manager.cc:5697] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 reported cstate change: term changed from 1 to 2, leader changed from 475ce84389a649898addbed4e97d91f4 (127.20.40.1) to 8c9f3a7dfcea4f8d92313ce09ff2ca25 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "475ce84389a649898addbed4e97d91f4" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 44241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:06.326746 30584 raft_consensus.cc:1275] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 2 FOLLOWER]: Refusing update from remote peer 475ce84389a649898addbed4e97d91f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:06.328069 30711 consensus_queue.cc:1048] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c9f3a7dfcea4f8d92313ce09ff2ca25" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 38451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:06.335570 30658 raft_consensus.cc:1275] T 22113c0f51d849888f37a1fdb552fe1e P 76f137b5c17b45578eb162c69d0e3b3f [term 2 FOLLOWER]: Refusing update from remote peer 475ce84389a649898addbed4e97d91f4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:06.337419 30738 consensus_queue.cc:1048] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76f137b5c17b45578eb162c69d0e3b3f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 36157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:06.349939 20640 tablet_server.cc:179] TabletServer@127.20.40.1:0 shutting down...
I20260709 13:12:06.373549 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:06.374135 20640 tablet_replica.cc:333] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4: stopping tablet replica
I20260709 13:12:06.374718 20640 raft_consensus.cc:2243] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.375490 20640 raft_consensus.cc:2272] T 22113c0f51d849888f37a1fdb552fe1e P 475ce84389a649898addbed4e97d91f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.377966 20640 tablet_replica.cc:333] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4: stopping tablet replica
I20260709 13:12:06.378449 20640 raft_consensus.cc:2243] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.378784 20640 raft_consensus.cc:2272] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 475ce84389a649898addbed4e97d91f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.380700 20640 tablet_replica.cc:333] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4: stopping tablet replica
I20260709 13:12:06.381167 20640 raft_consensus.cc:2243] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.381918 20640 raft_consensus.cc:2272] T da32e98eb08c4c1e90c4b0acd05f2109 P 475ce84389a649898addbed4e97d91f4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.383968 20640 tablet_replica.cc:333] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4: stopping tablet replica
I20260709 13:12:06.384408 20640 raft_consensus.cc:2243] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.384840 20640 raft_consensus.cc:2272] T 0df6ac7fc8254ec5ae05da3124e6b930 P 475ce84389a649898addbed4e97d91f4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.407923 20640 tablet_server.cc:196] TabletServer@127.20.40.1:0 shutdown complete.
I20260709 13:12:06.421093 20640 tablet_server.cc:179] TabletServer@127.20.40.2:0 shutting down...
I20260709 13:12:06.439896 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:06.440547 20640 tablet_replica.cc:333] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25: stopping tablet replica
I20260709 13:12:06.441156 20640 raft_consensus.cc:2243] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.441782 20640 raft_consensus.cc:2272] T 22113c0f51d849888f37a1fdb552fe1e P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.444873 20640 tablet_replica.cc:333] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25: stopping tablet replica
I20260709 13:12:06.445986 20640 raft_consensus.cc:2243] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.446682 20640 pending_rounds.cc:70] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25: Trying to abort 1 pending ops.
I20260709 13:12:06.446966 20640 pending_rounds.cc:77] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636766920695808 op_type: NO_OP noop_request { }
I20260709 13:12:06.447353 20640 raft_consensus.cc:2889] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:06.447736 20640 raft_consensus.cc:2272] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:06.448556 30624 consensus_peers.cc:597] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f -> Peer 475ce84389a649898addbed4e97d91f4 (127.20.40.1:44241): Couldn't send request to peer 475ce84389a649898addbed4e97d91f4. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:44241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:06.451155 20640 tablet_replica.cc:333] T 0df6ac7fc8254ec5ae05da3124e6b930 P 8c9f3a7dfcea4f8d92313ce09ff2ca25: stopping tablet replica
I20260709 13:12:06.451788 20640 raft_consensus.cc:2243] T 0df6ac7fc8254ec5ae05da3124e6b930 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.452358 20640 raft_consensus.cc:2272] T 0df6ac7fc8254ec5ae05da3124e6b930 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.454653 20640 tablet_replica.cc:333] T da32e98eb08c4c1e90c4b0acd05f2109 P 8c9f3a7dfcea4f8d92313ce09ff2ca25: stopping tablet replica
I20260709 13:12:06.455127 20640 raft_consensus.cc:2243] T da32e98eb08c4c1e90c4b0acd05f2109 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.455533 20640 raft_consensus.cc:2272] T da32e98eb08c4c1e90c4b0acd05f2109 P 8c9f3a7dfcea4f8d92313ce09ff2ca25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.467254 20640 tablet_server.cc:196] TabletServer@127.20.40.2:0 shutdown complete.
I20260709 13:12:06.481140 20640 tablet_server.cc:179] TabletServer@127.20.40.3:0 shutting down...
I20260709 13:12:06.497937 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:06.498744 20640 tablet_replica.cc:333] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 76f137b5c17b45578eb162c69d0e3b3f: stopping tablet replica
I20260709 13:12:06.499430 20640 raft_consensus.cc:2243] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 76f137b5c17b45578eb162c69d0e3b3f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.499982 20640 raft_consensus.cc:2272] T 8ff35b9780b247ce8f14e1b8b32e92f0 P 76f137b5c17b45578eb162c69d0e3b3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.502445 20640 tablet_replica.cc:333] T 22113c0f51d849888f37a1fdb552fe1e P 76f137b5c17b45578eb162c69d0e3b3f: stopping tablet replica
I20260709 13:12:06.503029 20640 raft_consensus.cc:2243] T 22113c0f51d849888f37a1fdb552fe1e P 76f137b5c17b45578eb162c69d0e3b3f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.503499 20640 raft_consensus.cc:2272] T 22113c0f51d849888f37a1fdb552fe1e P 76f137b5c17b45578eb162c69d0e3b3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.505759 20640 tablet_replica.cc:333] T da32e98eb08c4c1e90c4b0acd05f2109 P 76f137b5c17b45578eb162c69d0e3b3f: stopping tablet replica
I20260709 13:12:06.506289 20640 raft_consensus.cc:2243] T da32e98eb08c4c1e90c4b0acd05f2109 P 76f137b5c17b45578eb162c69d0e3b3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:06.506702 20640 raft_consensus.cc:2272] T da32e98eb08c4c1e90c4b0acd05f2109 P 76f137b5c17b45578eb162c69d0e3b3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.508409 20640 tablet_replica.cc:333] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f: stopping tablet replica
I20260709 13:12:06.508864 20640 raft_consensus.cc:2243] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.509756 20640 raft_consensus.cc:2272] T 0df6ac7fc8254ec5ae05da3124e6b930 P 76f137b5c17b45578eb162c69d0e3b3f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.532609 20640 tablet_server.cc:196] TabletServer@127.20.40.3:0 shutdown complete.
I20260709 13:12:06.544217 20640 master.cc:562] Master@127.20.40.62:32885 shutting down...
I20260709 13:12:06.560686 20640 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.561163 20640 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.561414 20640 tablet_replica.cc:333] T 00000000000000000000000000000000 P 681152332f0a48d492892f12ed8197ec: stopping tablet replica
I20260709 13:12:06.580871 20640 master.cc:584] Master@127.20.40.62:32885 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2484 ms)
[----------] 6 tests from LeaderRebalancerTest (306330 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:12:06.609290 20640 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.40.62:37657
I20260709 13:12:06.610489 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:06.615892 30755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:06.616091 30756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:06.617273 30758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:06.617961 20640 server_base.cc:1061] running on GCE node
I20260709 13:12:06.618882 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:06.619081 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:06.619289 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602726619274 us; error 0 us; skew 500 ppm
I20260709 13:12:06.619953 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:06.622591 20640 webserver.cc:533] Webserver started at http://127.20.40.62:38555/ using document root <none> and password file <none>
I20260709 13:12:06.623116 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:06.623296 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:06.623582 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:06.624665 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602420111825-20640-0/minicluster-data/master-0-root/instance:
uuid: "a6cebc92fc684d0790a51f81ea43a1d1"
format_stamp: "Formatted at 2026-07-09 13:12:06 on dist-test-slave-rnv4"
I20260709 13:12:06.629573 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:12:06.633157 30763 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:06.634176 20640 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:12:06.634495 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602420111825-20640-0/minicluster-data/master-0-root
uuid: "a6cebc92fc684d0790a51f81ea43a1d1"
format_stamp: "Formatted at 2026-07-09 13:12:06 on dist-test-slave-rnv4"
I20260709 13:12:06.634797 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602420111825-20640-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602420111825-20640-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602420111825-20640-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:06.650247 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:06.651257 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:06.687160 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.62:37657
I20260709 13:12:06.687263 30814 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.62:37657 every 8 connection(s)
I20260709 13:12:06.690989 30815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:06.701462 30815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1: Bootstrap starting.
I20260709 13:12:06.705853 30815 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.709805 30815 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1: No bootstrap required, opened a new log
I20260709 13:12:06.711758 30815 raft_consensus.cc:359] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6cebc92fc684d0790a51f81ea43a1d1" member_type: VOTER }
I20260709 13:12:06.712146 30815 raft_consensus.cc:385] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.712319 30815 raft_consensus.cc:740] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6cebc92fc684d0790a51f81ea43a1d1, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.712791 30815 consensus_queue.cc:260] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6cebc92fc684d0790a51f81ea43a1d1" member_type: VOTER }
I20260709 13:12:06.713290 30815 raft_consensus.cc:399] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:06.713550 30815 raft_consensus.cc:493] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:06.713764 30815 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.718262 30815 raft_consensus.cc:515] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6cebc92fc684d0790a51f81ea43a1d1" member_type: VOTER }
I20260709 13:12:06.718716 30815 leader_election.cc:304] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6cebc92fc684d0790a51f81ea43a1d1; no voters: 
I20260709 13:12:06.719846 30815 leader_election.cc:290] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:06.720193 30818 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:06.721668 30818 raft_consensus.cc:697] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1 [term 1 LEADER]: Becoming Leader. State: Replica: a6cebc92fc684d0790a51f81ea43a1d1, State: Running, Role: LEADER
I20260709 13:12:06.722266 30818 consensus_queue.cc:237] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6cebc92fc684d0790a51f81ea43a1d1" member_type: VOTER }
I20260709 13:12:06.722847 30815 sys_catalog.cc:565] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:06.725137 30820 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a6cebc92fc684d0790a51f81ea43a1d1. Latest consensus state: current_term: 1 leader_uuid: "a6cebc92fc684d0790a51f81ea43a1d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6cebc92fc684d0790a51f81ea43a1d1" member_type: VOTER } }
I20260709 13:12:06.725107 30819 sys_catalog.cc:455] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a6cebc92fc684d0790a51f81ea43a1d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6cebc92fc684d0790a51f81ea43a1d1" member_type: VOTER } }
I20260709 13:12:06.725879 30820 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:06.726006 30819 sys_catalog.cc:458] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:06.729099 30823 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:06.733830 30823 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:06.738384 20640 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:06.743147 30823 catalog_manager.cc:1383] Generated new cluster ID: 5709201735484ad69bd4517a24e6bd01
I20260709 13:12:06.743453 30823 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:06.767225 30823 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:06.768543 30823 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:06.780123 30823 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1: Generated new TSK 0
I20260709 13:12:06.780755 30823 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:06.804823 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:06.810998 30836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:06.812032 30837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:06.814622 20640 server_base.cc:1061] running on GCE node
W20260709 13:12:06.814925 30839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:06.815889 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:06.816093 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:06.816299 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602726816265 us; error 0 us; skew 500 ppm
I20260709 13:12:06.816838 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:06.819177 20640 webserver.cc:533] Webserver started at http://127.20.40.1:46193/ using document root <none> and password file <none>
I20260709 13:12:06.819664 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:06.819842 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:06.820130 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:06.821226 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602420111825-20640-0/minicluster-data/ts-0-root/instance:
uuid: "7c72385cdf944f068bab65bd12579099"
format_stamp: "Formatted at 2026-07-09 13:12:06 on dist-test-slave-rnv4"
I20260709 13:12:06.825855 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:12:06.829231 30844 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:06.830013 20640 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:12:06.830372 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602420111825-20640-0/minicluster-data/ts-0-root
uuid: "7c72385cdf944f068bab65bd12579099"
format_stamp: "Formatted at 2026-07-09 13:12:06 on dist-test-slave-rnv4"
I20260709 13:12:06.830680 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602420111825-20640-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602420111825-20640-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602420111825-20640-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:06.850627 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:06.851806 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:06.853560 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:06.855942 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:06.856168 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:06.856438 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:06.856607 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:06.897753 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.1:33807
I20260709 13:12:06.897871 30906 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.1:33807 every 8 connection(s)
I20260709 13:12:06.902943 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:06.911072 30912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:06.911614 30911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:06.914041 30914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:06.914831 20640 server_base.cc:1061] running on GCE node
I20260709 13:12:06.915954 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:06.916255 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:06.916409 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602726916395 us; error 0 us; skew 500 ppm
I20260709 13:12:06.917102 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:06.917750 30907 heartbeater.cc:344] Connected to a master server at 127.20.40.62:37657
I20260709 13:12:06.918133 30907 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:06.918954 30907 heartbeater.cc:507] Master 127.20.40.62:37657 requested a full tablet report, sending...
I20260709 13:12:06.919715 20640 webserver.cc:533] Webserver started at http://127.20.40.2:38633/ using document root <none> and password file <none>
I20260709 13:12:06.920264 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:06.920506 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:06.920830 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:06.921070 30780 ts_manager.cc:194] Registered new tserver with Master: 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807)
I20260709 13:12:06.922289 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602420111825-20640-0/minicluster-data/ts-1-root/instance:
uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
format_stamp: "Formatted at 2026-07-09 13:12:06 on dist-test-slave-rnv4"
I20260709 13:12:06.923555 30780 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45390
I20260709 13:12:06.927491 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:06.931118 30919 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:06.932037 20640 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:12:06.932368 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602420111825-20640-0/minicluster-data/ts-1-root
uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
format_stamp: "Formatted at 2026-07-09 13:12:06 on dist-test-slave-rnv4"
I20260709 13:12:06.932659 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602420111825-20640-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602420111825-20640-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602420111825-20640-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:06.959975 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:06.960963 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:06.962646 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:06.964861 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:06.965034 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:06.965214 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:06.965339 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:07.005300 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.2:44251
I20260709 13:12:07.005517 30981 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.2:44251 every 8 connection(s)
I20260709 13:12:07.010982 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:07.018095 30985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:07.020428 30986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:07.022073 20640 server_base.cc:1061] running on GCE node
W20260709 13:12:07.022120 30988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:07.023663 30982 heartbeater.cc:344] Connected to a master server at 127.20.40.62:37657
I20260709 13:12:07.023938 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:07.024137 30982 heartbeater.cc:461] Registering TS with master...
W20260709 13:12:07.024241 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:07.024564 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602727024543 us; error 0 us; skew 500 ppm
I20260709 13:12:07.025184 30982 heartbeater.cc:507] Master 127.20.40.62:37657 requested a full tablet report, sending...
I20260709 13:12:07.025370 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:07.027720 30780 ts_manager.cc:194] Registered new tserver with Master: ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:07.028321 20640 webserver.cc:533] Webserver started at http://127.20.40.3:42455/ using document root <none> and password file <none>
I20260709 13:12:07.028823 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:07.028967 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:07.029165 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:07.029233 30780 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45404
I20260709 13:12:07.030288 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602420111825-20640-0/minicluster-data/ts-2-root/instance:
uuid: "cbd0857ed38947e2acd1f78e325fca7c"
format_stamp: "Formatted at 2026-07-09 13:12:07 on dist-test-slave-rnv4"
I20260709 13:12:07.035228 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:12:07.039072 30993 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:07.039919 20640 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:12:07.040232 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602420111825-20640-0/minicluster-data/ts-2-root
uuid: "cbd0857ed38947e2acd1f78e325fca7c"
format_stamp: "Formatted at 2026-07-09 13:12:07 on dist-test-slave-rnv4"
I20260709 13:12:07.040593 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602420111825-20640-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602420111825-20640-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602420111825-20640-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:07.057564 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:07.058732 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:07.060300 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:07.062953 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:07.063215 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:07.063496 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:07.063694 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:07.104805 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.3:40195
I20260709 13:12:07.104954 31055 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.3:40195 every 8 connection(s)
I20260709 13:12:07.119644 31056 heartbeater.cc:344] Connected to a master server at 127.20.40.62:37657
I20260709 13:12:07.120119 31056 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:07.120937 31056 heartbeater.cc:507] Master 127.20.40.62:37657 requested a full tablet report, sending...
I20260709 13:12:07.122990 30780 ts_manager.cc:194] Registered new tserver with Master: cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:07.123158 20640 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014937465s
I20260709 13:12:07.124497 30780 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45412
I20260709 13:12:07.150535 30780 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45414:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:07.153178 30780 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:07.222539 30946 tablet_service.cc:1511] Processing CreateTablet for tablet 7b7474304b754eec9588b2d66b213c90 (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:07.223969 30946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b7474304b754eec9588b2d66b213c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.225135 30947 tablet_service.cc:1511] Processing CreateTablet for tablet 81000064a6c74c8c971678afdd7314e1 (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:07.226526 30947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81000064a6c74c8c971678afdd7314e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.229842 30945 tablet_service.cc:1511] Processing CreateTablet for tablet ba7aed4b0dc3422bba7fd99d1a805fc5 (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:07.231276 30945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba7aed4b0dc3422bba7fd99d1a805fc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.233721 30872 tablet_service.cc:1511] Processing CreateTablet for tablet 81000064a6c74c8c971678afdd7314e1 (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:07.234534 30944 tablet_service.cc:1511] Processing CreateTablet for tablet 55736c0a193e4580936d3d55b3ecca68 (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:07.235265 30872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81000064a6c74c8c971678afdd7314e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.237743 30943 tablet_service.cc:1511] Processing CreateTablet for tablet 5d9859be47a646d28950376449d3bdab (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:07.238538 30871 tablet_service.cc:1511] Processing CreateTablet for tablet 7b7474304b754eec9588b2d66b213c90 (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:07.239156 30943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d9859be47a646d28950376449d3bdab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.239861 30871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b7474304b754eec9588b2d66b213c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.240736 30944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55736c0a193e4580936d3d55b3ecca68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.242730 30870 tablet_service.cc:1511] Processing CreateTablet for tablet ba7aed4b0dc3422bba7fd99d1a805fc5 (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:07.243705 30942 tablet_service.cc:1511] Processing CreateTablet for tablet 7bdce6875f9d4a59bb421b943fc196b6 (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:07.244526 30870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba7aed4b0dc3422bba7fd99d1a805fc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.247079 30869 tablet_service.cc:1511] Processing CreateTablet for tablet 55736c0a193e4580936d3d55b3ecca68 (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:07.248518 30942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bdce6875f9d4a59bb421b943fc196b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.248863 30869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55736c0a193e4580936d3d55b3ecca68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.255417 30868 tablet_service.cc:1511] Processing CreateTablet for tablet 5d9859be47a646d28950376449d3bdab (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:07.258953 30867 tablet_service.cc:1511] Processing CreateTablet for tablet 7bdce6875f9d4a59bb421b943fc196b6 (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:07.257354 30868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d9859be47a646d28950376449d3bdab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.262722 30867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bdce6875f9d4a59bb421b943fc196b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.270139 30866 tablet_service.cc:1511] Processing CreateTablet for tablet d9e3dcc2ae5a4949b0d985002d692506 (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:07.271750 30866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9e3dcc2ae5a4949b0d985002d692506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.272756 30941 tablet_service.cc:1511] Processing CreateTablet for tablet d9e3dcc2ae5a4949b0d985002d692506 (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:07.274133 30941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9e3dcc2ae5a4949b0d985002d692506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.278251 30865 tablet_service.cc:1511] Processing CreateTablet for tablet fb85cafe2b0641ce9a197ecde2048b6c (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:07.279843 30865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb85cafe2b0641ce9a197ecde2048b6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.291747 30864 tablet_service.cc:1511] Processing CreateTablet for tablet 8250ad52ada442dfbc123f7d34b71fac (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:07.293222 30864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8250ad52ada442dfbc123f7d34b71fac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.298385 30940 tablet_service.cc:1511] Processing CreateTablet for tablet fb85cafe2b0641ce9a197ecde2048b6c (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:07.299913 30940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb85cafe2b0641ce9a197ecde2048b6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.309027 30939 tablet_service.cc:1511] Processing CreateTablet for tablet 8250ad52ada442dfbc123f7d34b71fac (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:07.310597 30939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8250ad52ada442dfbc123f7d34b71fac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.327906 31071 tablet_bootstrap.cc:492] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255: Bootstrap starting.
I20260709 13:12:07.327535 31018 tablet_service.cc:1511] Processing CreateTablet for tablet 55736c0a193e4580936d3d55b3ecca68 (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:07.330873 31016 tablet_service.cc:1511] Processing CreateTablet for tablet 7bdce6875f9d4a59bb421b943fc196b6 (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:07.332305 31016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bdce6875f9d4a59bb421b943fc196b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.334303 31017 tablet_service.cc:1511] Processing CreateTablet for tablet 5d9859be47a646d28950376449d3bdab (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:07.335371 31071 tablet_bootstrap.cc:654] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.335744 31017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d9859be47a646d28950376449d3bdab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.338317 31020 tablet_service.cc:1511] Processing CreateTablet for tablet 7b7474304b754eec9588b2d66b213c90 (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:07.339705 31020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b7474304b754eec9588b2d66b213c90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.341746 31021 tablet_service.cc:1511] Processing CreateTablet for tablet 81000064a6c74c8c971678afdd7314e1 (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:07.343466 31021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81000064a6c74c8c971678afdd7314e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.327960 31019 tablet_service.cc:1511] Processing CreateTablet for tablet ba7aed4b0dc3422bba7fd99d1a805fc5 (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:07.346832 31019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba7aed4b0dc3422bba7fd99d1a805fc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.348654 31018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55736c0a193e4580936d3d55b3ecca68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.356451 31015 tablet_service.cc:1511] Processing CreateTablet for tablet d9e3dcc2ae5a4949b0d985002d692506 (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:07.357954 31015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9e3dcc2ae5a4949b0d985002d692506. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.391000 31014 tablet_service.cc:1511] Processing CreateTablet for tablet fb85cafe2b0641ce9a197ecde2048b6c (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:07.392493 31014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb85cafe2b0641ce9a197ecde2048b6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.394685 31013 tablet_service.cc:1511] Processing CreateTablet for tablet 8250ad52ada442dfbc123f7d34b71fac (DEFAULT_TABLE table=test-workload [id=c3ae07b335e2417485fa562d2a9ca994]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:07.396122 31013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8250ad52ada442dfbc123f7d34b71fac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.449625 31071 tablet_bootstrap.cc:492] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255: No bootstrap required, opened a new log
I20260709 13:12:07.451211 31071 ts_tablet_manager.cc:1403] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent bootstrapping tablet: real 0.124s	user 0.003s	sys 0.025s
I20260709 13:12:07.455039 31071 raft_consensus.cc:359] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.456013 31071 raft_consensus.cc:385] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.456399 31071 raft_consensus.cc:740] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.457365 31071 consensus_queue.cc:260] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.463500 31073 tablet_bootstrap.cc:492] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099: Bootstrap starting.
I20260709 13:12:07.475591 31074 tablet_bootstrap.cc:492] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c: Bootstrap starting.
I20260709 13:12:07.483611 30982 heartbeater.cc:499] Master 127.20.40.62:37657 was elected leader, sending a full tablet report...
I20260709 13:12:07.483994 31071 ts_tablet_manager.cc:1434] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent starting tablet: real 0.032s	user 0.011s	sys 0.019s
I20260709 13:12:07.484865 31073 tablet_bootstrap.cc:654] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.485116 31071 tablet_bootstrap.cc:492] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255: Bootstrap starting.
I20260709 13:12:07.488417 31074 tablet_bootstrap.cc:654] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.493259 31071 tablet_bootstrap.cc:654] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.500169 31073 tablet_bootstrap.cc:492] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099: No bootstrap required, opened a new log
I20260709 13:12:07.500711 31073 ts_tablet_manager.cc:1403] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.010s
I20260709 13:12:07.503448 31073 raft_consensus.cc:359] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } } peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } }
I20260709 13:12:07.504179 31073 raft_consensus.cc:385] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.504516 31073 raft_consensus.cc:740] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.505369 31073 consensus_queue.cc:260] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } } peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } }
I20260709 13:12:07.526003 30907 heartbeater.cc:499] Master 127.20.40.62:37657 was elected leader, sending a full tablet report...
I20260709 13:12:07.526564 31073 ts_tablet_manager.cc:1434] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.017s
I20260709 13:12:07.526747 31071 tablet_bootstrap.cc:492] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255: No bootstrap required, opened a new log
I20260709 13:12:07.527058 31074 tablet_bootstrap.cc:492] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c: No bootstrap required, opened a new log
I20260709 13:12:07.527415 31071 ts_tablet_manager.cc:1403] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent bootstrapping tablet: real 0.043s	user 0.020s	sys 0.018s
I20260709 13:12:07.527599 31074 ts_tablet_manager.cc:1403] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.028s
I20260709 13:12:07.527681 31073 tablet_bootstrap.cc:492] T 8250ad52ada442dfbc123f7d34b71fac P 7c72385cdf944f068bab65bd12579099: Bootstrap starting.
I20260709 13:12:07.530514 31071 raft_consensus.cc:359] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.530793 31074 raft_consensus.cc:359] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.531282 31071 raft_consensus.cc:385] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.531628 31074 raft_consensus.cc:385] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.531692 31071 raft_consensus.cc:740] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.532038 31074 raft_consensus.cc:740] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.532792 31071 consensus_queue.cc:260] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.534757 31073 tablet_bootstrap.cc:654] T 8250ad52ada442dfbc123f7d34b71fac P 7c72385cdf944f068bab65bd12579099: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.535511 31071 ts_tablet_manager.cc:1434] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:07.536615 31071 tablet_bootstrap.cc:492] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255: Bootstrap starting.
I20260709 13:12:07.533195 31074 consensus_queue.cc:260] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.542860 31071 tablet_bootstrap.cc:654] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.546856 31073 tablet_bootstrap.cc:492] T 8250ad52ada442dfbc123f7d34b71fac P 7c72385cdf944f068bab65bd12579099: No bootstrap required, opened a new log
I20260709 13:12:07.547559 31073 ts_tablet_manager.cc:1403] T 8250ad52ada442dfbc123f7d34b71fac P 7c72385cdf944f068bab65bd12579099: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.006s
I20260709 13:12:07.551293 31074 ts_tablet_manager.cc:1434] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c: Time spent starting tablet: real 0.023s	user 0.016s	sys 0.002s
I20260709 13:12:07.552870 31056 heartbeater.cc:499] Master 127.20.40.62:37657 was elected leader, sending a full tablet report...
I20260709 13:12:07.553372 31074 tablet_bootstrap.cc:492] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c: Bootstrap starting.
I20260709 13:12:07.559823 31074 tablet_bootstrap.cc:654] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.551903 31073 raft_consensus.cc:359] T 8250ad52ada442dfbc123f7d34b71fac P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.561173 31073 raft_consensus.cc:385] T 8250ad52ada442dfbc123f7d34b71fac P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.561558 31073 raft_consensus.cc:740] T 8250ad52ada442dfbc123f7d34b71fac P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.562616 31073 consensus_queue.cc:260] T 8250ad52ada442dfbc123f7d34b71fac P 7c72385cdf944f068bab65bd12579099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.565639 31073 ts_tablet_manager.cc:1434] T 8250ad52ada442dfbc123f7d34b71fac P 7c72385cdf944f068bab65bd12579099: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.000s
I20260709 13:12:07.566903 31073 tablet_bootstrap.cc:492] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099: Bootstrap starting.
I20260709 13:12:07.572585 31074 tablet_bootstrap.cc:492] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c: No bootstrap required, opened a new log
I20260709 13:12:07.573182 31074 ts_tablet_manager.cc:1403] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:12:07.573468 31071 tablet_bootstrap.cc:492] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255: No bootstrap required, opened a new log
I20260709 13:12:07.573467 31073 tablet_bootstrap.cc:654] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.574132 31071 ts_tablet_manager.cc:1403] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.018s
I20260709 13:12:07.576229 31074 raft_consensus.cc:359] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.577273 31074 raft_consensus.cc:385] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.577207 31071 raft_consensus.cc:359] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.578079 31071 raft_consensus.cc:385] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.577943 31074 raft_consensus.cc:740] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.578495 31071 raft_consensus.cc:740] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.579442 31071 consensus_queue.cc:260] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.579340 31074 consensus_queue.cc:260] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.582872 31074 ts_tablet_manager.cc:1434] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:12:07.584194 31074 tablet_bootstrap.cc:492] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c: Bootstrap starting.
I20260709 13:12:07.585069 31071 ts_tablet_manager.cc:1434] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:12:07.586201 31071 tablet_bootstrap.cc:492] T 8250ad52ada442dfbc123f7d34b71fac P ddba9ee70f214b45ad36ec0c2d4eb255: Bootstrap starting.
I20260709 13:12:07.587795 31079 raft_consensus.cc:493] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.588313 31079 raft_consensus.cc:515] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } } peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } }
I20260709 13:12:07.592166 31073 tablet_bootstrap.cc:492] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099: No bootstrap required, opened a new log
I20260709 13:12:07.592726 31073 ts_tablet_manager.cc:1403] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.011s
I20260709 13:12:07.592839 31074 tablet_bootstrap.cc:654] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.595564 31071 tablet_bootstrap.cc:654] T 8250ad52ada442dfbc123f7d34b71fac P ddba9ee70f214b45ad36ec0c2d4eb255: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.596474 31073 raft_consensus.cc:359] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.597736 31073 raft_consensus.cc:385] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.598171 31073 raft_consensus.cc:740] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.599192 31073 consensus_queue.cc:260] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.601642 31079 leader_election.cc:290] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:07.605371 31074 tablet_bootstrap.cc:492] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c: No bootstrap required, opened a new log
I20260709 13:12:07.606091 31074 ts_tablet_manager.cc:1403] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.010s
I20260709 13:12:07.607883 31071 tablet_bootstrap.cc:492] T 8250ad52ada442dfbc123f7d34b71fac P ddba9ee70f214b45ad36ec0c2d4eb255: No bootstrap required, opened a new log
I20260709 13:12:07.607916 31073 ts_tablet_manager.cc:1434] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099: Time spent starting tablet: real 0.015s	user 0.013s	sys 0.001s
I20260709 13:12:07.608704 31071 ts_tablet_manager.cc:1403] T 8250ad52ada442dfbc123f7d34b71fac P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:12:07.609181 31073 tablet_bootstrap.cc:492] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099: Bootstrap starting.
I20260709 13:12:07.609349 31074 raft_consensus.cc:359] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.610103 31074 raft_consensus.cc:385] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.610400 31074 raft_consensus.cc:740] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.611760 31074 consensus_queue.cc:260] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.612397 31071 raft_consensus.cc:359] T 8250ad52ada442dfbc123f7d34b71fac P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.613168 31071 raft_consensus.cc:385] T 8250ad52ada442dfbc123f7d34b71fac P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.613487 31071 raft_consensus.cc:740] T 8250ad52ada442dfbc123f7d34b71fac P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.614480 31074 ts_tablet_manager.cc:1434] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:12:07.614252 31071 consensus_queue.cc:260] T 8250ad52ada442dfbc123f7d34b71fac P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.615648 31074 tablet_bootstrap.cc:492] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c: Bootstrap starting.
I20260709 13:12:07.619467 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81000064a6c74c8c971678afdd7314e1" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
W20260709 13:12:07.621201 30848 leader_election.cc:343] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.616289 31073 tablet_bootstrap.cc:654] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.622555 31074 tablet_bootstrap.cc:654] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.630203 31071 ts_tablet_manager.cc:1434] T 8250ad52ada442dfbc123f7d34b71fac P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.000s
I20260709 13:12:07.631640 31071 tablet_bootstrap.cc:492] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255: Bootstrap starting.
I20260709 13:12:07.632220 31074 tablet_bootstrap.cc:492] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c: No bootstrap required, opened a new log
I20260709 13:12:07.633009 31074 ts_tablet_manager.cc:1403] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.001s
I20260709 13:12:07.638717 31071 tablet_bootstrap.cc:654] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.637152 31074 raft_consensus.cc:359] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.639421 31074 raft_consensus.cc:385] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.639751 31074 raft_consensus.cc:740] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.640348 31073 tablet_bootstrap.cc:492] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099: No bootstrap required, opened a new log
I20260709 13:12:07.640875 31073 ts_tablet_manager.cc:1403] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099: Time spent bootstrapping tablet: real 0.032s	user 0.004s	sys 0.019s
I20260709 13:12:07.640655 31074 consensus_queue.cc:260] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.643770 31074 ts_tablet_manager.cc:1434] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:12:07.644788 31074 tablet_bootstrap.cc:492] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c: Bootstrap starting.
I20260709 13:12:07.644398 31073 raft_consensus.cc:359] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.645165 31073 raft_consensus.cc:385] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.645481 31073 raft_consensus.cc:740] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.646312 31073 consensus_queue.cc:260] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.651037 31073 ts_tablet_manager.cc:1434] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:12:07.652122 31073 tablet_bootstrap.cc:492] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099: Bootstrap starting.
I20260709 13:12:07.653008 31074 tablet_bootstrap.cc:654] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.660655 31073 tablet_bootstrap.cc:654] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.665138 31074 tablet_bootstrap.cc:492] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c: No bootstrap required, opened a new log
I20260709 13:12:07.665979 31074 ts_tablet_manager.cc:1403] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20260709 13:12:07.670186 31074 raft_consensus.cc:359] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.670994 31074 raft_consensus.cc:385] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.671244 31074 raft_consensus.cc:740] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.671938 31074 consensus_queue.cc:260] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.674216 31073 tablet_bootstrap.cc:492] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099: No bootstrap required, opened a new log
I20260709 13:12:07.674516 31074 ts_tablet_manager.cc:1434] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:12:07.674959 31073 ts_tablet_manager.cc:1403] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.005s
I20260709 13:12:07.675668 31074 tablet_bootstrap.cc:492] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c: Bootstrap starting.
I20260709 13:12:07.678158 31073 raft_consensus.cc:359] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.679741 31079 raft_consensus.cc:493] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.681856 31073 raft_consensus.cc:385] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.681885 31079 raft_consensus.cc:515] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.682876 31074 tablet_bootstrap.cc:654] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.684331 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81000064a6c74c8c971678afdd7314e1" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
I20260709 13:12:07.685678 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7474304b754eec9588b2d66b213c90" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:07.682902 31073 raft_consensus.cc:740] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.686770 31073 consensus_queue.cc:260] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
W20260709 13:12:07.688464 30848 leader_election.cc:343] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.687213 31081 raft_consensus.cc:493] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.689155 31073 ts_tablet_manager.cc:1434] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
I20260709 13:12:07.690032 31074 tablet_bootstrap.cc:492] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c: No bootstrap required, opened a new log
I20260709 13:12:07.690320 31073 tablet_bootstrap.cc:492] T fb85cafe2b0641ce9a197ecde2048b6c P 7c72385cdf944f068bab65bd12579099: Bootstrap starting.
I20260709 13:12:07.690588 31074 ts_tablet_manager.cc:1403] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.002s
I20260709 13:12:07.689253 31081 raft_consensus.cc:515] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
W20260709 13:12:07.690205 30847 leader_election.cc:343] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.693681 30847 leader_election.cc:304] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c72385cdf944f068bab65bd12579099; no voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255
I20260709 13:12:07.694034 31074 raft_consensus.cc:359] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.694599 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7474304b754eec9588b2d66b213c90" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
I20260709 13:12:07.694926 31074 raft_consensus.cc:385] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.694977 31089 raft_consensus.cc:2749] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:07.695384 31074 raft_consensus.cc:740] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.696317 31074 consensus_queue.cc:260] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.698195 31073 tablet_bootstrap.cc:654] T fb85cafe2b0641ce9a197ecde2048b6c P 7c72385cdf944f068bab65bd12579099: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.698664 31071 tablet_bootstrap.cc:492] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255: No bootstrap required, opened a new log
I20260709 13:12:07.699354 31071 ts_tablet_manager.cc:1403] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent bootstrapping tablet: real 0.068s	user 0.028s	sys 0.017s
I20260709 13:12:07.703303 31071 raft_consensus.cc:359] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.704326 31071 raft_consensus.cc:385] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.704720 31071 raft_consensus.cc:740] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.705794 31071 consensus_queue.cc:260] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.706457 31074 ts_tablet_manager.cc:1434] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.011s
W20260709 13:12:07.706658 30847 leader_election.cc:343] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.707377 30847 leader_election.cc:304] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c72385cdf944f068bab65bd12579099; no voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255
I20260709 13:12:07.707732 31074 tablet_bootstrap.cc:492] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c: Bootstrap starting.
I20260709 13:12:07.708456 31089 raft_consensus.cc:2749] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:07.710201 31071 ts_tablet_manager.cc:1434] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 13:12:07.711493 31071 tablet_bootstrap.cc:492] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255: Bootstrap starting.
I20260709 13:12:07.714479 31081 leader_election.cc:290] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:07.684424 31079 leader_election.cc:290] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:07.718650 31071 tablet_bootstrap.cc:654] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.728261 31074 tablet_bootstrap.cc:654] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.736007 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55736c0a193e4580936d3d55b3ecca68" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:07.732972 31081 raft_consensus.cc:493] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.738067 31073 tablet_bootstrap.cc:492] T fb85cafe2b0641ce9a197ecde2048b6c P 7c72385cdf944f068bab65bd12579099: No bootstrap required, opened a new log
I20260709 13:12:07.737968 31081 raft_consensus.cc:515] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.738636 31073 ts_tablet_manager.cc:1403] T fb85cafe2b0641ce9a197ecde2048b6c P 7c72385cdf944f068bab65bd12579099: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.013s
I20260709 13:12:07.740283 31081 leader_election.cc:290] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
W20260709 13:12:07.735006 30828 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:07.741946 31073 raft_consensus.cc:359] T fb85cafe2b0641ce9a197ecde2048b6c P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.742447 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3dcc2ae5a4949b0d985002d692506" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:07.742842 31073 raft_consensus.cc:385] T fb85cafe2b0641ce9a197ecde2048b6c P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.743177 31073 raft_consensus.cc:740] T fb85cafe2b0641ce9a197ecde2048b6c P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Initialized, Role: FOLLOWER
W20260709 13:12:07.744194 30995 leader_election.cc:343] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.743947 31073 consensus_queue.cc:260] T fb85cafe2b0641ce9a197ecde2048b6c P 7c72385cdf944f068bab65bd12579099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
W20260709 13:12:07.745874 30995 leader_election.cc:343] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.750907 31073 ts_tablet_manager.cc:1434] T fb85cafe2b0641ce9a197ecde2048b6c P 7c72385cdf944f068bab65bd12579099: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:12:07.752103 31073 tablet_bootstrap.cc:492] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099: Bootstrap starting.
I20260709 13:12:07.752944 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55736c0a193e4580936d3d55b3ecca68" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:07.753921 30957 raft_consensus.cc:2468] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:07.755410 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3dcc2ae5a4949b0d985002d692506" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:07.756279 30956 raft_consensus.cc:2468] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:07.757912 30997 leader_election.cc:304] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 7c72385cdf944f068bab65bd12579099
I20260709 13:12:07.758931 31074 tablet_bootstrap.cc:492] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c: No bootstrap required, opened a new log
I20260709 13:12:07.759172 30997 leader_election.cc:304] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 7c72385cdf944f068bab65bd12579099
I20260709 13:12:07.759577 31073 tablet_bootstrap.cc:654] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.760684 31081 raft_consensus.cc:2804] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.760102 31096 raft_consensus.cc:2804] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.764874 31081 raft_consensus.cc:493] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.765074 31096 raft_consensus.cc:493] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.765353 31081 raft_consensus.cc:3060] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.765602 31096 raft_consensus.cc:3060] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.764063 31071 tablet_bootstrap.cc:492] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255: No bootstrap required, opened a new log
I20260709 13:12:07.759558 31074 ts_tablet_manager.cc:1403] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.010s
I20260709 13:12:07.768633 31071 ts_tablet_manager.cc:1403] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.016s
I20260709 13:12:07.771807 31071 raft_consensus.cc:359] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } } peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } }
I20260709 13:12:07.772573 31071 raft_consensus.cc:385] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.773020 31071 raft_consensus.cc:740] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.776391 31073 tablet_bootstrap.cc:492] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099: No bootstrap required, opened a new log
I20260709 13:12:07.772027 31074 raft_consensus.cc:359] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.776897 31073 ts_tablet_manager.cc:1403] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.005s
I20260709 13:12:07.777030 31074 raft_consensus.cc:385] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.777447 31074 raft_consensus.cc:740] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.777819 31071 consensus_queue.cc:260] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } } peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } }
I20260709 13:12:07.778326 31074 consensus_queue.cc:260] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.780449 31071 ts_tablet_manager.cc:1434] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:12:07.780138 31073 raft_consensus.cc:359] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.781162 31073 raft_consensus.cc:385] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.781076 31096 raft_consensus.cc:515] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.781654 31073 raft_consensus.cc:740] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.782145 31071 tablet_bootstrap.cc:492] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255: Bootstrap starting.
I20260709 13:12:07.782611 31073 consensus_queue.cc:260] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.784092 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55736c0a193e4580936d3d55b3ecca68" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:07.784811 30882 raft_consensus.cc:3060] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.788938 31073 ts_tablet_manager.cc:1434] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:12:07.790241 31073 tablet_bootstrap.cc:492] T d9e3dcc2ae5a4949b0d985002d692506 P 7c72385cdf944f068bab65bd12579099: Bootstrap starting.
I20260709 13:12:07.790813 31071 tablet_bootstrap.cc:654] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.792595 30882 raft_consensus.cc:2468] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:07.793781 30995 leader_election.cc:304] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: 
I20260709 13:12:07.798064 31081 raft_consensus.cc:515] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.802507 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3dcc2ae5a4949b0d985002d692506" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:07.803212 30956 raft_consensus.cc:3060] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.803563 31073 tablet_bootstrap.cc:654] T d9e3dcc2ae5a4949b0d985002d692506 P 7c72385cdf944f068bab65bd12579099: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.805275 31096 leader_election.cc:290] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:07.806728 31096 raft_consensus.cc:2804] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:07.807171 31096 raft_consensus.cc:697] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Leader. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:07.807994 31096 consensus_queue.cc:237] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.809849 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55736c0a193e4580936d3d55b3ecca68" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:07.814615 30957 raft_consensus.cc:3060] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.824653 31081 leader_election.cc:290] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:07.826227 30956 raft_consensus.cc:2468] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:07.829361 30997 leader_election.cc:304] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:07.830235 31081 raft_consensus.cc:2804] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:07.830369 31073 tablet_bootstrap.cc:492] T d9e3dcc2ae5a4949b0d985002d692506 P 7c72385cdf944f068bab65bd12579099: No bootstrap required, opened a new log
I20260709 13:12:07.830941 31081 raft_consensus.cc:697] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Leader. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:07.831084 31073 ts_tablet_manager.cc:1403] T d9e3dcc2ae5a4949b0d985002d692506 P 7c72385cdf944f068bab65bd12579099: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.017s
I20260709 13:12:07.832114 31071 tablet_bootstrap.cc:492] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255: No bootstrap required, opened a new log
I20260709 13:12:07.833019 31071 ts_tablet_manager.cc:1403] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent bootstrapping tablet: real 0.051s	user 0.029s	sys 0.015s
I20260709 13:12:07.832245 31081 consensus_queue.cc:237] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.834479 31073 raft_consensus.cc:359] T d9e3dcc2ae5a4949b0d985002d692506 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.835314 31073 raft_consensus.cc:385] T d9e3dcc2ae5a4949b0d985002d692506 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.835597 31073 raft_consensus.cc:740] T d9e3dcc2ae5a4949b0d985002d692506 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.836498 31073 consensus_queue.cc:260] T d9e3dcc2ae5a4949b0d985002d692506 P 7c72385cdf944f068bab65bd12579099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.836673 31071 raft_consensus.cc:359] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.837549 31071 raft_consensus.cc:385] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.837908 31071 raft_consensus.cc:740] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.839212 31073 ts_tablet_manager.cc:1434] T d9e3dcc2ae5a4949b0d985002d692506 P 7c72385cdf944f068bab65bd12579099: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:07.838869 31071 consensus_queue.cc:260] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.840241 31073 tablet_bootstrap.cc:492] T 7bdce6875f9d4a59bb421b943fc196b6 P 7c72385cdf944f068bab65bd12579099: Bootstrap starting.
I20260709 13:12:07.841199 31071 ts_tablet_manager.cc:1434] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:12:07.842495 31071 tablet_bootstrap.cc:492] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255: Bootstrap starting.
I20260709 13:12:07.846952 31073 tablet_bootstrap.cc:654] T 7bdce6875f9d4a59bb421b943fc196b6 P 7c72385cdf944f068bab65bd12579099: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.854076 31071 tablet_bootstrap.cc:654] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.858960 31073 tablet_bootstrap.cc:492] T 7bdce6875f9d4a59bb421b943fc196b6 P 7c72385cdf944f068bab65bd12579099: No bootstrap required, opened a new log
I20260709 13:12:07.859604 31073 ts_tablet_manager.cc:1403] T 7bdce6875f9d4a59bb421b943fc196b6 P 7c72385cdf944f068bab65bd12579099: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:12:07.863540 31073 raft_consensus.cc:359] T 7bdce6875f9d4a59bb421b943fc196b6 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.864509 31073 raft_consensus.cc:385] T 7bdce6875f9d4a59bb421b943fc196b6 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.864867 31073 raft_consensus.cc:740] T 7bdce6875f9d4a59bb421b943fc196b6 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.866192 31103 raft_consensus.cc:493] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.867126 31074 ts_tablet_manager.cc:1434] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c: Time spent starting tablet: real 0.098s	user 0.018s	sys 0.016s
I20260709 13:12:07.866389 31073 consensus_queue.cc:260] T 7bdce6875f9d4a59bb421b943fc196b6 P 7c72385cdf944f068bab65bd12579099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.868253 31074 tablet_bootstrap.cc:492] T fb85cafe2b0641ce9a197ecde2048b6c P cbd0857ed38947e2acd1f78e325fca7c: Bootstrap starting.
I20260709 13:12:07.870157 31073 ts_tablet_manager.cc:1434] T 7bdce6875f9d4a59bb421b943fc196b6 P 7c72385cdf944f068bab65bd12579099: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:12:07.866788 31103 raft_consensus.cc:515] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
W20260709 13:12:07.878454 30995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:33807, user_credentials={real_user=slave}} blocked reactor thread for 84755.6us
I20260709 13:12:07.879112 31071 tablet_bootstrap.cc:492] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255: No bootstrap required, opened a new log
I20260709 13:12:07.879683 31071 ts_tablet_manager.cc:1403] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.010s
I20260709 13:12:07.881142 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3dcc2ae5a4949b0d985002d692506" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:07.881839 30882 raft_consensus.cc:3060] T d9e3dcc2ae5a4949b0d985002d692506 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.890033 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8250ad52ada442dfbc123f7d34b71fac" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:07.891324 31074 tablet_bootstrap.cc:654] T fb85cafe2b0641ce9a197ecde2048b6c P cbd0857ed38947e2acd1f78e325fca7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.891505 30882 raft_consensus.cc:2468] T d9e3dcc2ae5a4949b0d985002d692506 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:07.890511 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8250ad52ada442dfbc123f7d34b71fac" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:07.891364 30881 raft_consensus.cc:2468] T 8250ad52ada442dfbc123f7d34b71fac P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:07.893340 30956 raft_consensus.cc:2468] T 8250ad52ada442dfbc123f7d34b71fac P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:07.894135 30957 raft_consensus.cc:2468] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:07.894831 30997 leader_election.cc:304] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:07.897964 31105 raft_consensus.cc:2804] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.898501 31105 raft_consensus.cc:493] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.898939 31105 raft_consensus.cc:3060] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.905567 31103 leader_election.cc:290] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:07.907235 31071 raft_consensus.cc:359] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.908964 31071 raft_consensus.cc:385] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.909257 31071 raft_consensus.cc:740] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.907238 31074 tablet_bootstrap.cc:492] T fb85cafe2b0641ce9a197ecde2048b6c P cbd0857ed38947e2acd1f78e325fca7c: No bootstrap required, opened a new log
I20260709 13:12:07.910097 31074 ts_tablet_manager.cc:1403] T fb85cafe2b0641ce9a197ecde2048b6c P cbd0857ed38947e2acd1f78e325fca7c: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.010s
I20260709 13:12:07.910072 31071 consensus_queue.cc:260] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.912871 30778 catalog_manager.cc:5697] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c reported cstate change: term changed from 0 to 1, leader changed from <none> to cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3). New cstate: current_term: 1 leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:07.913520 31074 raft_consensus.cc:359] T fb85cafe2b0641ce9a197ecde2048b6c P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.914425 31074 raft_consensus.cc:385] T fb85cafe2b0641ce9a197ecde2048b6c P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.914724 31074 raft_consensus.cc:740] T fb85cafe2b0641ce9a197ecde2048b6c P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.915539 31105 raft_consensus.cc:515] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.915680 31074 consensus_queue.cc:260] T fb85cafe2b0641ce9a197ecde2048b6c P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.914875 30778 catalog_manager.cc:5697] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c reported cstate change: term changed from 0 to 1, leader changed from <none> to cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3). New cstate: current_term: 1 leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:07.917762 31105 leader_election.cc:290] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:07.918020 31074 ts_tablet_manager.cc:1434] T fb85cafe2b0641ce9a197ecde2048b6c P cbd0857ed38947e2acd1f78e325fca7c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:12:07.919010 31074 tablet_bootstrap.cc:492] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c: Bootstrap starting.
I20260709 13:12:07.919881 31071 ts_tablet_manager.cc:1434] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.005s
I20260709 13:12:07.920040 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8250ad52ada442dfbc123f7d34b71fac" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:07.920852 31071 tablet_bootstrap.cc:492] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255: Bootstrap starting.
I20260709 13:12:07.920732 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8250ad52ada442dfbc123f7d34b71fac" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:07.921871 30882 raft_consensus.cc:3060] T 8250ad52ada442dfbc123f7d34b71fac P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.924943 31105 raft_consensus.cc:493] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.925480 31105 raft_consensus.cc:515] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.927163 31071 tablet_bootstrap.cc:654] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.920728 30957 raft_consensus.cc:3060] T 8250ad52ada442dfbc123f7d34b71fac P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.928365 31074 tablet_bootstrap.cc:654] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.931710 31105 leader_election.cc:290] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:07.932937 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdce6875f9d4a59bb421b943fc196b6" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:07.933676 30881 raft_consensus.cc:2468] T 7bdce6875f9d4a59bb421b943fc196b6 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:07.934990 30995 leader_election.cc:304] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: 
I20260709 13:12:07.935662 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdce6875f9d4a59bb421b943fc196b6" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:07.935947 31105 raft_consensus.cc:2804] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.936442 31105 raft_consensus.cc:493] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.936393 30956 raft_consensus.cc:2468] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:07.936992 31105 raft_consensus.cc:3060] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.944440 31103 raft_consensus.cc:493] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.945276 31103 raft_consensus.cc:515] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.948403 30957 raft_consensus.cc:2468] T 8250ad52ada442dfbc123f7d34b71fac P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:07.949740 30997 leader_election.cc:304] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:07.949957 31103 leader_election.cc:290] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:07.948403 30882 raft_consensus.cc:2468] T 8250ad52ada442dfbc123f7d34b71fac P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:07.950834 31103 raft_consensus.cc:2804] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:07.952834 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9859be47a646d28950376449d3bdab" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:07.953157 31103 raft_consensus.cc:697] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Leader. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:07.954063 31075 raft_consensus.cc:493] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.954193 31103 consensus_queue.cc:237] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.954627 31075 raft_consensus.cc:515] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.959010 31075 leader_election.cc:290] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:07.951952 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9859be47a646d28950376449d3bdab" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
W20260709 13:12:07.965236 30997 leader_election.cc:343] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:07.966841 30881 raft_consensus.cc:2468] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:07.968993 30995 leader_election.cc:304] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: ddba9ee70f214b45ad36ec0c2d4eb255
I20260709 13:12:07.971019 31096 raft_consensus.cc:2804] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.971938 31096 raft_consensus.cc:493] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.972407 31096 raft_consensus.cc:3060] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.952067 31105 raft_consensus.cc:515] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.981269 31081 raft_consensus.cc:493] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.982251 31081 raft_consensus.cc:515] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:07.984261 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdce6875f9d4a59bb421b943fc196b6" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:07.985314 31081 leader_election.cc:290] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:07.986572 30956 raft_consensus.cc:3060] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.988052 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7474304b754eec9588b2d66b213c90" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:07.988937 30882 raft_consensus.cc:2468] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:07.990326 30995 leader_election.cc:304] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: 
I20260709 13:12:07.990150 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7474304b754eec9588b2d66b213c90" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:07.991436 30955 raft_consensus.cc:2468] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:07.988175 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdce6875f9d4a59bb421b943fc196b6" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:07.993314 31081 raft_consensus.cc:2804] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:07.994879 31081 raft_consensus.cc:493] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:07.995397 31081 raft_consensus.cc:3060] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:07.994179 30881 raft_consensus.cc:3060] T 7bdce6875f9d4a59bb421b943fc196b6 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.015806 31105 leader_election.cc:290] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:08.019927 31096 raft_consensus.cc:515] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:08.031526 30881 raft_consensus.cc:2468] T 7bdce6875f9d4a59bb421b943fc196b6 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:08.038381 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9859be47a646d28950376449d3bdab" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:08.039340 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9859be47a646d28950376449d3bdab" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:08.048538 31081 raft_consensus.cc:515] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:08.071772 31074 tablet_bootstrap.cc:492] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c: No bootstrap required, opened a new log
I20260709 13:12:08.072198 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7aed4b0dc3422bba7fd99d1a805fc5" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:08.072467 31074 ts_tablet_manager.cc:1403] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c: Time spent bootstrapping tablet: real 0.154s	user 0.029s	sys 0.021s
I20260709 13:12:08.072918 31081 leader_election.cc:290] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:08.058409 30995 leader_election.cc:304] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: 
I20260709 13:12:08.074196 31081 raft_consensus.cc:2804] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.050355 31096 leader_election.cc:290] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:08.074685 31081 raft_consensus.cc:697] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Leader. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:08.075603 31081 consensus_queue.cc:237] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
W20260709 13:12:08.075961 30997 leader_election.cc:343] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.061758 31105 raft_consensus.cc:493] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.077049 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7474304b754eec9588b2d66b213c90" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:08.077816 30880 raft_consensus.cc:3060] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.078305 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7474304b754eec9588b2d66b213c90" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:08.079236 30957 raft_consensus.cc:3060] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.077091 31105 raft_consensus.cc:515] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:08.084636 31105 leader_election.cc:290] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:08.036623 31075 raft_consensus.cc:493] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.086923 31075 raft_consensus.cc:515] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:08.087142 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7aed4b0dc3422bba7fd99d1a805fc5" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:08.072935 30881 raft_consensus.cc:2468] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 0.
I20260709 13:12:08.090045 31075 leader_election.cc:290] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:08.090461 30921 leader_election.cc:304] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:08.091238 30957 raft_consensus.cc:2468] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:08.091763 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb85cafe2b0641ce9a197ecde2048b6c" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:08.092514 30879 raft_consensus.cc:2468] T fb85cafe2b0641ce9a197ecde2048b6c P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 0.
I20260709 13:12:08.093034 30882 raft_consensus.cc:3060] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.093262 30997 leader_election.cc:304] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:08.093870 30921 leader_election.cc:304] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:08.092526 30955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7aed4b0dc3422bba7fd99d1a805fc5" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:08.094746 30955 raft_consensus.cc:2468] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:08.095314 31075 raft_consensus.cc:2804] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.095696 31075 raft_consensus.cc:493] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.096050 31075 raft_consensus.cc:3060] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.096385 30997 leader_election.cc:304] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 7c72385cdf944f068bab65bd12579099
I20260709 13:12:08.098395 31105 raft_consensus.cc:2804] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.099339 31096 raft_consensus.cc:2804] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.099911 31096 raft_consensus.cc:493] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.100412 31096 raft_consensus.cc:3060] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.102943 30880 raft_consensus.cc:2468] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:08.055964 30956 raft_consensus.cc:2468] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:08.105561 31105 raft_consensus.cc:697] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Leader. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:08.108589 31074 raft_consensus.cc:359] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } } peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } }
I20260709 13:12:08.112876 31074 raft_consensus.cc:385] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.113858 31074 raft_consensus.cc:740] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.113543 31071 tablet_bootstrap.cc:492] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255: No bootstrap required, opened a new log
I20260709 13:12:08.114223 31096 raft_consensus.cc:515] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:08.114804 30778 catalog_manager.cc:5697] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c reported cstate change: term changed from 0 to 1, leader changed from <none> to cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3). New cstate: current_term: 1 leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.115736 31071 ts_tablet_manager.cc:1403] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent bootstrapping tablet: real 0.194s	user 0.064s	sys 0.123s
I20260709 13:12:08.116691 30778 catalog_manager.cc:5697] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c reported cstate change: term changed from 0 to 1, leader changed from <none> to cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3). New cstate: current_term: 1 leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.115324 31074 consensus_queue.cc:260] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } } peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } }
I20260709 13:12:08.118695 30882 raft_consensus.cc:2468] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:08.108646 31105 consensus_queue.cc:237] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:08.120965 31071 raft_consensus.cc:359] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:08.122129 31071 raft_consensus.cc:385] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.122470 31071 raft_consensus.cc:740] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.121778 31074 ts_tablet_manager.cc:1434] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:12:08.123777 31071 consensus_queue.cc:260] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:08.125694 30995 leader_election.cc:304] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: ddba9ee70f214b45ad36ec0c2d4eb255
I20260709 13:12:08.126516 31122 raft_consensus.cc:2804] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.126780 31103 raft_consensus.cc:2804] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.127053 31122 raft_consensus.cc:493] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.127507 31071 ts_tablet_manager.cc:1434] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:12:08.123576 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7aed4b0dc3422bba7fd99d1a805fc5" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:08.130017 30880 raft_consensus.cc:3060] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.130725 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7aed4b0dc3422bba7fd99d1a805fc5" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
I20260709 13:12:08.131156 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb85cafe2b0641ce9a197ecde2048b6c" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
I20260709 13:12:08.131649 31031 raft_consensus.cc:2393] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddba9ee70f214b45ad36ec0c2d4eb255 in current term 1: Already voted for candidate cbd0857ed38947e2acd1f78e325fca7c in this term.
I20260709 13:12:08.131888 31030 raft_consensus.cc:2468] T fb85cafe2b0641ce9a197ecde2048b6c P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 0.
I20260709 13:12:08.127506 31122 raft_consensus.cc:3060] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.140590 31103 raft_consensus.cc:697] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Leader. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
W20260709 13:12:08.141819 30921 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:33807, user_credentials={real_user=slave}} blocked reactor thread for 48022.4us
I20260709 13:12:08.142197 31103 consensus_queue.cc:237] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:08.146732 31075 raft_consensus.cc:515] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:08.146027 31096 leader_election.cc:290] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:08.147771 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7aed4b0dc3422bba7fd99d1a805fc5" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:08.148763 30957 raft_consensus.cc:2393] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cbd0857ed38947e2acd1f78e325fca7c in current term 1: Already voted for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in this term.
I20260709 13:12:08.149865 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7aed4b0dc3422bba7fd99d1a805fc5" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:08.147095 31122 raft_consensus.cc:515] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:08.154000 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7aed4b0dc3422bba7fd99d1a805fc5" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
I20260709 13:12:08.154452 31075 leader_election.cc:290] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:08.154840 31030 raft_consensus.cc:2393] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ddba9ee70f214b45ad36ec0c2d4eb255 in current term 1: Already voted for candidate cbd0857ed38947e2acd1f78e325fca7c in this term.
I20260709 13:12:08.154671 30880 raft_consensus.cc:2468] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:08.155805 31122 leader_election.cc:290] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:08.156564 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb85cafe2b0641ce9a197ecde2048b6c" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:08.157123 30882 raft_consensus.cc:3060] T fb85cafe2b0641ce9a197ecde2048b6c P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.158471 30779 catalog_manager.cc:5697] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c reported cstate change: term changed from 0 to 1, leader changed from <none> to cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3). New cstate: current_term: 1 leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.161128 30995 leader_election.cc:304] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: ddba9ee70f214b45ad36ec0c2d4eb255
I20260709 13:12:08.160358 30779 catalog_manager.cc:5697] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c reported cstate change: term changed from 0 to 1, leader changed from <none> to cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3). New cstate: current_term: 1 leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.162737 31103 raft_consensus.cc:2804] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.163110 31096 raft_consensus.cc:493] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.163566 31103 raft_consensus.cc:697] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Leader. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:08.163637 31096 raft_consensus.cc:515] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } } peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } }
I20260709 13:12:08.163956 30922 leader_election.cc:304] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c
I20260709 13:12:08.161132 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb85cafe2b0641ce9a197ecde2048b6c" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
I20260709 13:12:08.164793 31030 raft_consensus.cc:3060] T fb85cafe2b0641ce9a197ecde2048b6c P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.165257 31122 raft_consensus.cc:2749] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.164915 31103 consensus_queue.cc:237] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:08.166855 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81000064a6c74c8c971678afdd7314e1" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:08.167057 31096 leader_election.cc:290] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807)
I20260709 13:12:08.167549 30957 raft_consensus.cc:2468] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:08.168740 30880 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81000064a6c74c8c971678afdd7314e1" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:08.169137 30997 leader_election.cc:304] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:08.169476 30880 raft_consensus.cc:2468] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:08.171146 31096 raft_consensus.cc:2804] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.171638 31096 raft_consensus.cc:493] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.172083 31096 raft_consensus.cc:3060] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.172319 31030 raft_consensus.cc:2468] T fb85cafe2b0641ce9a197ecde2048b6c P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 1.
I20260709 13:12:08.173398 30922 leader_election.cc:304] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:08.174510 31122 raft_consensus.cc:2804] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.175025 31122 raft_consensus.cc:697] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 LEADER]: Becoming Leader. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Running, Role: LEADER
I20260709 13:12:08.176134 31122 consensus_queue.cc:237] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:08.179847 30882 raft_consensus.cc:2468] T fb85cafe2b0641ce9a197ecde2048b6c P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 1.
I20260709 13:12:08.187278 31096 raft_consensus.cc:515] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } } peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } }
I20260709 13:12:08.192435 30957 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81000064a6c74c8c971678afdd7314e1" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:08.192672 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81000064a6c74c8c971678afdd7314e1" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:08.192905 31096 leader_election.cc:290] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Requested vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807)
I20260709 13:12:08.193061 30957 raft_consensus.cc:3060] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.194728 30882 raft_consensus.cc:3060] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.195443 30778 catalog_manager.cc:5697] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c reported cstate change: term changed from 0 to 1, leader changed from <none> to cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3). New cstate: current_term: 1 leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.199559 30779 catalog_manager.cc:5697] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2). New cstate: current_term: 1 leader_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.200273 30957 raft_consensus.cc:2468] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:08.201649 30997 leader_election.cc:304] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:08.202519 31096 raft_consensus.cc:2804] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.203186 31096 raft_consensus.cc:697] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Leader. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:08.204051 31096 consensus_queue.cc:237] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } } peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } }
I20260709 13:12:08.207845 30882 raft_consensus.cc:2468] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:08.213032 30779 catalog_manager.cc:5697] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c reported cstate change: term changed from 0 to 1, leader changed from <none> to cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3). New cstate: current_term: 1 leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.302035 31103 consensus_queue.cc:1048] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:08.302456 31096 consensus_queue.cc:1048] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:08.615036 31122 raft_consensus.cc:493] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.615654 31122 raft_consensus.cc:515] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:08.618062 31122 leader_election.cc:290] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:09.460738 30882 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9859be47a646d28950376449d3bdab" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:09.461789 30882 raft_consensus.cc:2393] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ddba9ee70f214b45ad36ec0c2d4eb255 in current term 1: Already voted for candidate cbd0857ed38947e2acd1f78e325fca7c in this term.
W20260709 13:12:09.461836 30957 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.155s	user 0.023s	sys 0.075s
W20260709 13:12:09.462325 30957 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.156s	user 0.023s	sys 0.075s
I20260709 13:12:09.463166 30957 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 19) took 1158 ms. Trace:
I20260709 13:12:09.464406 30957 rpcz_store.cc:276] 0709 13:12:08.304817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.304975 (+   158us) service_pool.cc:224] Handling call
0709 13:12:08.305359 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:08.305762 (+   403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:08.305808 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:08.306301 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:12:09.462777 (+1156476us) raft_consensus.cc:1645] Marking committed up to 0
0709 13:12:09.462822 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:09.462903 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:09.462953 (+    50us) raft_consensus.cc:1685] finished
0709 13:12:09.462964 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:09.463111 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1269,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":170,"spinlock_wait_cycles":166656,"thread_start_us":1155948,"threads_started":1,"wal-append.queue_time_us":239353}
W20260709 13:12:09.484247 30956 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.178s	user 0.032s	sys 0.046s
W20260709 13:12:09.484819 30956 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.179s	user 0.032s	sys 0.046s
I20260709 13:12:09.485831 30956 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54172 (request call id 18) took 1181 ms. Trace:
I20260709 13:12:09.486321 30956 rpcz_store.cc:276] 0709 13:12:08.304279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.304452 (+   173us) service_pool.cc:224] Handling call
0709 13:12:08.304807 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:08.305217 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:08.305266 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:08.305829 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 13:12:09.485307 (+1179478us) raft_consensus.cc:1645] Marking committed up to 0
0709 13:12:09.485371 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:09.485496 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:09.485569 (+    73us) raft_consensus.cc:1685] finished
0709 13:12:09.485586 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:09.485757 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1547,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":148,"thread_start_us":1178968,"threads_started":1,"wal-append.queue_time_us":239911}
I20260709 13:12:09.527681 30955 raft_consensus.cc:3060] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.579702 31138 consensus_queue.cc:1048] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:09.581789 31138 consensus_queue.cc:1048] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.595678 31138 consensus_queue.cc:1048] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:09.585332 31139 consensus_queue.cc:1048] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:09.582799 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:44251, user_credentials={real_user=slave}} blocked reactor thread for 84127.6us
I20260709 13:12:09.784087 31148 consensus_queue.cc:1048] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:09.607936 31131 consensus_queue.cc:1048] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:09.786748 31131 consensus_queue.cc:1048] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.788426 31131 consensus_queue.cc:1048] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.793831 31143 raft_consensus.cc:493] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.794575 31143 raft_consensus.cc:515] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:09.798748 31139 consensus_queue.cc:1048] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.800284 31139 consensus_queue.cc:1048] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.807960 31149 raft_consensus.cc:493] T 8250ad52ada442dfbc123f7d34b71fac P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.808735 31142 consensus_queue.cc:1048] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:09.789495 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:44251, user_credentials={real_user=slave}} blocked reactor thread for 74689.9us
I20260709 13:12:09.808548 31149 raft_consensus.cc:515] T 8250ad52ada442dfbc123f7d34b71fac P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:09.817955 31149 leader_election.cc:290] T 8250ad52ada442dfbc123f7d34b71fac P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:09.819806 31149 raft_consensus.cc:493] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbd0857ed38947e2acd1f78e325fca7c)
I20260709 13:12:09.820380 31149 raft_consensus.cc:515] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:09.823082 31149 leader_election.cc:290] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:09.789763 31147 raft_consensus.cc:493] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.835625 31147 raft_consensus.cc:515] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:09.837983 31147 leader_election.cc:290] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:09.841634 31143 leader_election.cc:290] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:09.841831 31152 raft_consensus.cc:493] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.842579 31152 raft_consensus.cc:515] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:09.843153 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8250ad52ada442dfbc123f7d34b71fac" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
I20260709 13:12:09.842666 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9859be47a646d28950376449d3bdab" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
I20260709 13:12:09.845162 31149 consensus_queue.cc:1048] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.846529 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55736c0a193e4580936d3d55b3ecca68" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
I20260709 13:12:09.847820 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9859be47a646d28950376449d3bdab" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
I20260709 13:12:09.850308 31131 consensus_queue.cc:1048] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:09.852387 30922 leader_election.cc:304] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c
I20260709 13:12:09.862231 31149 raft_consensus.cc:2749] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.883673 31031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81000064a6c74c8c971678afdd7314e1"
dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
mode: GRACEFUL
new_leader_uuid: "7c72385cdf944f068bab65bd12579099"
 from {username='slave'} at 127.0.0.1:38926
I20260709 13:12:09.884464 31031 raft_consensus.cc:606] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Received request to transfer leadership to TS 7c72385cdf944f068bab65bd12579099
I20260709 13:12:09.898933 31135 consensus_queue.cc:1048] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:09.903906 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8250ad52ada442dfbc123f7d34b71fac" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:09.934362 31152 leader_election.cc:290] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:09.950165 31144 raft_consensus.cc:493] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cbd0857ed38947e2acd1f78e325fca7c)
I20260709 13:12:09.950940 31144 raft_consensus.cc:515] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:09.956177 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7474304b754eec9588b2d66b213c90" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:09.958968 30921 leader_election.cc:304] T 8250ad52ada442dfbc123f7d34b71fac P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c
I20260709 13:12:09.965013 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55736c0a193e4580936d3d55b3ecca68" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:09.972203 30921 leader_election.cc:304] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c
I20260709 13:12:09.974360 31153 raft_consensus.cc:2749] T 8250ad52ada442dfbc123f7d34b71fac P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:09.975431 31153 consensus_queue.cc:1048] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:10.070034 30951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55736c0a193e4580936d3d55b3ecca68" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:10.113765 31153 raft_consensus.cc:2749] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:10.148964 30952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9859be47a646d28950376449d3bdab" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:10.152529 30848 leader_election.cc:304] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c72385cdf944f068bab65bd12579099; no voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255
I20260709 13:12:10.154117 31147 raft_consensus.cc:2749] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:10.157006 31142 consensus_queue.cc:1048] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:12:10.160930 30995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:33807, user_credentials={real_user=slave}} blocked reactor thread for 88741.4us
I20260709 13:12:10.162645 31144 leader_election.cc:290] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:10.198218 31031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b7474304b754eec9588b2d66b213c90"
dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
mode: GRACEFUL
new_leader_uuid: "7c72385cdf944f068bab65bd12579099"
 from {username='slave'} at 127.0.0.1:38926
I20260709 13:12:10.203285 31175 raft_consensus.cc:993] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c: : Instructing follower 7c72385cdf944f068bab65bd12579099 to start an election
I20260709 13:12:10.204603 31175 raft_consensus.cc:1081] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Signalling peer 7c72385cdf944f068bab65bd12579099 to start an election
W20260709 13:12:10.212441 30995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:33807, user_credentials={real_user=slave}} blocked reactor thread for 48301.5us
I20260709 13:12:10.228174 31153 raft_consensus.cc:493] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.229151 31153 raft_consensus.cc:515] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } } peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } }
I20260709 13:12:10.232023 31153 leader_election.cc:290] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195), 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807)
W20260709 13:12:10.234386 30997 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:44251, user_credentials={real_user=slave}} blocked reactor thread for 300921us
I20260709 13:12:10.243635 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81000064a6c74c8c971678afdd7314e1" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:10.265520 30879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81000064a6c74c8c971678afdd7314e1"
dest_uuid: "7c72385cdf944f068bab65bd12579099"
 from {username='slave'} at 127.0.0.1:52784
I20260709 13:12:10.266382 30879 raft_consensus.cc:493] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:10.266856 30879 raft_consensus.cc:3060] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.274636 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55736c0a193e4580936d3d55b3ecca68" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
I20260709 13:12:10.278766 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7474304b754eec9588b2d66b213c90" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
I20260709 13:12:10.281315 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7474304b754eec9588b2d66b213c90" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
I20260709 13:12:10.284240 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81000064a6c74c8c971678afdd7314e1" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
W20260709 13:12:10.294910 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:44251, user_credentials={real_user=slave}} blocked reactor thread for 142847us
I20260709 13:12:10.298249 30922 leader_election.cc:304] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c
I20260709 13:12:10.311190 30922 leader_election.cc:304] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c
I20260709 13:12:10.312008 31153 raft_consensus.cc:2749] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:10.321851 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7474304b754eec9588b2d66b213c90" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:10.356163 31031 raft_consensus.cc:606] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Received request to transfer leadership to TS 7c72385cdf944f068bab65bd12579099
I20260709 13:12:10.360757 30847 leader_election.cc:304] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c72385cdf944f068bab65bd12579099; no voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255
I20260709 13:12:10.361940 31144 raft_consensus.cc:2749] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:10.364238 30847 leader_election.cc:304] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c72385cdf944f068bab65bd12579099; no voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255
I20260709 13:12:10.365084 31144 raft_consensus.cc:2749] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:10.357537 30995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:33807, user_credentials={real_user=slave}} blocked reactor thread for 54645.7us
I20260709 13:12:10.367039 31174 raft_consensus.cc:993] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c: : Instructing follower 7c72385cdf944f068bab65bd12579099 to start an election
I20260709 13:12:10.367503 31175 raft_consensus.cc:1081] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Signalling peer 7c72385cdf944f068bab65bd12579099 to start an election
I20260709 13:12:10.370926 31028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba7aed4b0dc3422bba7fd99d1a805fc5"
dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
mode: GRACEFUL
new_leader_uuid: "7c72385cdf944f068bab65bd12579099"
 from {username='slave'} at 127.0.0.1:38926
I20260709 13:12:10.372536 31028 raft_consensus.cc:606] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Received request to transfer leadership to TS 7c72385cdf944f068bab65bd12579099
I20260709 13:12:10.372586 31153 raft_consensus.cc:2749] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:10.389597 30879 raft_consensus.cc:515] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } } peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } }
I20260709 13:12:10.391402 31028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55736c0a193e4580936d3d55b3ecca68"
dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
mode: GRACEFUL
new_leader_uuid: "7c72385cdf944f068bab65bd12579099"
 from {username='slave'} at 127.0.0.1:38926
I20260709 13:12:10.392099 31028 raft_consensus.cc:606] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Received request to transfer leadership to TS 7c72385cdf944f068bab65bd12579099
I20260709 13:12:10.395903 30879 leader_election.cc:290] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 2 election: Requested vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:10.396176 30876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b7474304b754eec9588b2d66b213c90"
dest_uuid: "7c72385cdf944f068bab65bd12579099"
 from {username='slave'} at 127.0.0.1:52784
I20260709 13:12:10.397110 30876 raft_consensus.cc:493] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:10.397584 30876 raft_consensus.cc:3060] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.403031 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81000064a6c74c8c971678afdd7314e1" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:10.396775 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81000064a6c74c8c971678afdd7314e1" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
I20260709 13:12:10.407613 31028 raft_consensus.cc:3055] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:10.407968 31028 raft_consensus.cc:740] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:10.407879 30876 raft_consensus.cc:515] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:10.406736 31031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d9859be47a646d28950376449d3bdab"
dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
mode: GRACEFUL
new_leader_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
 from {username='slave'} at 127.0.0.1:38926
I20260709 13:12:10.409235 31031 raft_consensus.cc:606] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Received request to transfer leadership to TS ddba9ee70f214b45ad36ec0c2d4eb255
I20260709 13:12:10.411172 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7474304b754eec9588b2d66b213c90" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:10.411903 30956 raft_consensus.cc:3060] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.412372 31028 consensus_queue.cc:260] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } } peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } }
I20260709 13:12:10.413764 31028 raft_consensus.cc:3060] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.422214 30954 raft_consensus.cc:3060] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.425252 31031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bdce6875f9d4a59bb421b943fc196b6"
dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
mode: GRACEFUL
new_leader_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
 from {username='slave'} at 127.0.0.1:38926
I20260709 13:12:10.425730 30956 raft_consensus.cc:2468] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c72385cdf944f068bab65bd12579099 in term 2.
I20260709 13:12:10.430398 30848 leader_election.cc:304] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:10.431324 31144 raft_consensus.cc:2804] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:10.431800 31144 raft_consensus.cc:697] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [term 2 LEADER]: Becoming Leader. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Running, Role: LEADER
I20260709 13:12:10.432940 31028 raft_consensus.cc:2468] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c72385cdf944f068bab65bd12579099 in term 2.
I20260709 13:12:10.432931 31144 consensus_queue.cc:237] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:10.437851 30847 leader_election.cc:304] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: 
I20260709 13:12:10.427744 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b7474304b754eec9588b2d66b213c90" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
I20260709 13:12:10.438890 30954 raft_consensus.cc:2468] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c72385cdf944f068bab65bd12579099 in term 2.
I20260709 13:12:10.439383 31030 raft_consensus.cc:3055] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:10.439888 31030 raft_consensus.cc:740] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:10.426069 31031 raft_consensus.cc:606] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Received request to transfer leadership to TS ddba9ee70f214b45ad36ec0c2d4eb255
I20260709 13:12:10.440919 31030 consensus_queue.cc:260] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:10.442265 31030 raft_consensus.cc:3060] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.450026 31031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9e3dcc2ae5a4949b0d985002d692506"
dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
mode: GRACEFUL
new_leader_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
 from {username='slave'} at 127.0.0.1:38926
I20260709 13:12:10.438885 31147 raft_consensus.cc:2804] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:10.450841 31031 raft_consensus.cc:606] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Received request to transfer leadership to TS ddba9ee70f214b45ad36ec0c2d4eb255
I20260709 13:12:10.452239 30780 catalog_manager.cc:5697] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 reported cstate change: term changed from 1 to 2, leader changed from cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3) to 7c72385cdf944f068bab65bd12579099 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "7c72385cdf944f068bab65bd12579099" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.451107 31147 raft_consensus.cc:697] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [term 2 LEADER]: Becoming Leader. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Running, Role: LEADER
I20260709 13:12:10.458319 31147 consensus_queue.cc:237] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } } peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } }
I20260709 13:12:10.428771 30876 leader_election.cc:290] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 2 election: Requested vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:10.466487 31030 raft_consensus.cc:2468] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c72385cdf944f068bab65bd12579099 in term 2.
W20260709 13:12:10.479805 31052 debug-util.cc:398] Leaking SignalData structure 0x7b0800048fa0 after lost signal to thread 20643
W20260709 13:12:10.481563 31052 debug-util.cc:398] Leaking SignalData structure 0x7b08002c4060 after lost signal to thread 30814
W20260709 13:12:10.483544 31052 debug-util.cc:398] Leaking SignalData structure 0x7b080010b040 after lost signal to thread 30906
W20260709 13:12:10.486174 31052 debug-util.cc:398] Leaking SignalData structure 0x7b0800194b00 after lost signal to thread 30981
W20260709 13:12:10.487931 31052 debug-util.cc:398] Leaking SignalData structure 0x7b08003b6f80 after lost signal to thread 31055
I20260709 13:12:10.492199 30780 catalog_manager.cc:5697] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 reported cstate change: term changed from 1 to 2, leader changed from cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3) to 7c72385cdf944f068bab65bd12579099 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "7c72385cdf944f068bab65bd12579099" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:10.720243 31133 raft_consensus.cc:993] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c: : Instructing follower ddba9ee70f214b45ad36ec0c2d4eb255 to start an election
I20260709 13:12:10.720762 31133 raft_consensus.cc:1081] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Signalling peer ddba9ee70f214b45ad36ec0c2d4eb255 to start an election
I20260709 13:12:10.722572 30954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d9859be47a646d28950376449d3bdab"
dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
 from {username='slave'} at 127.0.0.1:54172
I20260709 13:12:10.723199 30954 raft_consensus.cc:493] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:10.723583 30954 raft_consensus.cc:3060] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.732700 30954 raft_consensus.cc:515] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:10.735118 30954 leader_election.cc:290] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 2 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:10.736343 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9859be47a646d28950376449d3bdab" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:10.737051 30876 raft_consensus.cc:3060] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.737468 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d9859be47a646d28950376449d3bdab" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
I20260709 13:12:10.738161 31030 raft_consensus.cc:3055] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:10.738508 31030 raft_consensus.cc:740] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:10.739439 31030 consensus_queue.cc:260] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:10.741067 31030 raft_consensus.cc:3060] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.745671 31133 raft_consensus.cc:993] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c: : Instructing follower 7c72385cdf944f068bab65bd12579099 to start an election
I20260709 13:12:10.746268 31142 raft_consensus.cc:1081] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Signalling peer 7c72385cdf944f068bab65bd12579099 to start an election
I20260709 13:12:10.746076 30876 raft_consensus.cc:2468] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 2.
I20260709 13:12:10.748728 30879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55736c0a193e4580936d3d55b3ecca68"
dest_uuid: "7c72385cdf944f068bab65bd12579099"
 from {username='slave'} at 127.0.0.1:52784
I20260709 13:12:10.749408 30879 raft_consensus.cc:493] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:10.749920 30879 raft_consensus.cc:3060] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.750370 31142 raft_consensus.cc:993] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c: : Instructing follower ddba9ee70f214b45ad36ec0c2d4eb255 to start an election
I20260709 13:12:10.750260 31030 raft_consensus.cc:2468] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 2.
I20260709 13:12:10.751029 31142 raft_consensus.cc:1081] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Signalling peer ddba9ee70f214b45ad36ec0c2d4eb255 to start an election
I20260709 13:12:10.751803 30922 leader_election.cc:304] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:10.752941 31153 raft_consensus.cc:2804] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:10.753135 30954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bdce6875f9d4a59bb421b943fc196b6"
dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
 from {username='slave'} at 127.0.0.1:54172
I20260709 13:12:10.753500 31153 raft_consensus.cc:697] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 LEADER]: Becoming Leader. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Running, Role: LEADER
I20260709 13:12:10.753856 30954 raft_consensus.cc:493] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:10.754374 30954 raft_consensus.cc:3060] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.754734 31153 consensus_queue.cc:237] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:10.760470 30879 raft_consensus.cc:515] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:10.762581 30954 raft_consensus.cc:515] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:10.764518 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55736c0a193e4580936d3d55b3ecca68" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:10.765158 30954 leader_election.cc:290] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 2 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:10.766422 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdce6875f9d4a59bb421b943fc196b6" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
I20260709 13:12:10.767099 31030 raft_consensus.cc:3055] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:10.765247 30953 raft_consensus.cc:3060] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.767443 31030 raft_consensus.cc:740] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:10.768922 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bdce6875f9d4a59bb421b943fc196b6" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:10.769039 31030 consensus_queue.cc:260] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:10.770123 30876 raft_consensus.cc:3060] T 7bdce6875f9d4a59bb421b943fc196b6 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.770994 31030 raft_consensus.cc:3060] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.774076 30780 catalog_manager.cc:5697] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 reported cstate change: term changed from 1 to 2, leader changed from cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3) to ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.778630 31175 raft_consensus.cc:993] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c: : Instructing follower 7c72385cdf944f068bab65bd12579099 to start an election
I20260709 13:12:10.780880 31175 raft_consensus.cc:1081] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Signalling peer 7c72385cdf944f068bab65bd12579099 to start an election
I20260709 13:12:10.780033 30876 raft_consensus.cc:2468] T 7bdce6875f9d4a59bb421b943fc196b6 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 2.
I20260709 13:12:10.783007 30877 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba7aed4b0dc3422bba7fd99d1a805fc5"
dest_uuid: "7c72385cdf944f068bab65bd12579099"
 from {username='slave'} at 127.0.0.1:52784
I20260709 13:12:10.782809 30953 raft_consensus.cc:2468] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c72385cdf944f068bab65bd12579099 in term 2.
I20260709 13:12:10.782724 31030 raft_consensus.cc:2468] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 2.
I20260709 13:12:10.785169 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55736c0a193e4580936d3d55b3ecca68" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
I20260709 13:12:10.785902 31031 raft_consensus.cc:3055] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:10.785759 30848 leader_election.cc:304] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:10.786353 31031 raft_consensus.cc:740] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:10.787387 31031 consensus_queue.cc:260] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:10.788692 31031 raft_consensus.cc:3060] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.789233 31133 raft_consensus.cc:993] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c: : Instructing follower ddba9ee70f214b45ad36ec0c2d4eb255 to start an election
I20260709 13:12:10.789675 31147 raft_consensus.cc:2804] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:10.789852 31133 raft_consensus.cc:1081] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Signalling peer ddba9ee70f214b45ad36ec0c2d4eb255 to start an election
I20260709 13:12:10.790288 31147 raft_consensus.cc:697] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [term 2 LEADER]: Becoming Leader. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Running, Role: LEADER
I20260709 13:12:10.791390 31147 consensus_queue.cc:237] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:10.783852 30877 raft_consensus.cc:493] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:10.792629 30877 raft_consensus.cc:3060] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.792428 30921 leader_election.cc:304] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:10.794762 31153 raft_consensus.cc:2804] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:10.792399 30954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9e3dcc2ae5a4949b0d985002d692506"
dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
 from {username='slave'} at 127.0.0.1:54172
I20260709 13:12:10.795342 31153 raft_consensus.cc:697] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 LEADER]: Becoming Leader. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Running, Role: LEADER
I20260709 13:12:10.796069 30954 raft_consensus.cc:493] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:10.796589 30954 raft_consensus.cc:3060] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.797372 31153 consensus_queue.cc:237] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:10.785785 30879 leader_election.cc:290] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 2 election: Requested vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:10.809059 30877 raft_consensus.cc:515] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:10.810863 30778 catalog_manager.cc:5697] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 reported cstate change: term changed from 1 to 2, leader changed from cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3) to 7c72385cdf944f068bab65bd12579099 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "7c72385cdf944f068bab65bd12579099" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.815369 30877 leader_election.cc:290] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 2 election: Requested vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:10.816567 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7aed4b0dc3422bba7fd99d1a805fc5" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:10.817418 30953 raft_consensus.cc:3060] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.818049 30780 catalog_manager.cc:5697] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255 reported cstate change: term changed from 1 to 2, leader changed from cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3) to ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.828081 30954 raft_consensus.cc:515] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:10.832746 30952 raft_consensus.cc:1275] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Refusing update from remote peer 7c72385cdf944f068bab65bd12579099: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:10.835863 30953 raft_consensus.cc:2468] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c72385cdf944f068bab65bd12579099 in term 2.
I20260709 13:12:10.836483 31030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7aed4b0dc3422bba7fd99d1a805fc5" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
I20260709 13:12:10.836757 30956 raft_consensus.cc:1240] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Rejecting Update request from peer cbd0857ed38947e2acd1f78e325fca7c for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:10.839836 31030 raft_consensus.cc:3055] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:10.840339 31030 raft_consensus.cc:740] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:10.842195 31133 consensus_queue.cc:1059] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:10.844034 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3dcc2ae5a4949b0d985002d692506" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
I20260709 13:12:10.842242 31147 consensus_queue.cc:1048] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:10.844621 31028 raft_consensus.cc:3055] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:10.844425 30954 leader_election.cc:290] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 2 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:10.845098 31028 raft_consensus.cc:740] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:10.844473 30848 leader_election.cc:304] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:10.846279 31028 consensus_queue.cc:260] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:10.843505 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3dcc2ae5a4949b0d985002d692506" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:10.847606 31028 raft_consensus.cc:3060] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.848901 31147 raft_consensus.cc:2804] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:10.850343 31147 raft_consensus.cc:697] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [term 2 LEADER]: Becoming Leader. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Running, Role: LEADER
I20260709 13:12:10.851418 31147 consensus_queue.cc:237] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:10.847786 30879 raft_consensus.cc:3060] T d9e3dcc2ae5a4949b0d985002d692506 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.853199 31030 consensus_queue.cc:260] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:10.857851 31028 raft_consensus.cc:2468] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 2.
I20260709 13:12:10.854974 31031 raft_consensus.cc:2468] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c72385cdf944f068bab65bd12579099 in term 2.
I20260709 13:12:10.861635 30922 leader_election.cc:304] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:10.862764 31153 raft_consensus.cc:2804] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:10.863286 31153 raft_consensus.cc:697] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 LEADER]: Becoming Leader. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Running, Role: LEADER
I20260709 13:12:10.864413 31153 consensus_queue.cc:237] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:10.879020 31030 raft_consensus.cc:3060] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.882649 30954 raft_consensus.cc:1275] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Refusing update from remote peer 7c72385cdf944f068bab65bd12579099: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:10.889490 31147 consensus_queue.cc:1048] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:10.905905 30780 catalog_manager.cc:5697] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 reported cstate change: term changed from 1 to 2, leader changed from cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3) to 7c72385cdf944f068bab65bd12579099 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "7c72385cdf944f068bab65bd12579099" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.909507 30778 catalog_manager.cc:5697] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 reported cstate change: term changed from 1 to 2, leader changed from cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3) to ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.912101 30879 raft_consensus.cc:2468] T d9e3dcc2ae5a4949b0d985002d692506 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 2.
I20260709 13:12:10.939679 31030 raft_consensus.cc:2468] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c72385cdf944f068bab65bd12579099 in term 2.
W20260709 13:12:10.940407 31133 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:12:10.940883 31031 raft_consensus.cc:1275] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Refusing update from remote peer 7c72385cdf944f068bab65bd12579099: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:10.942972 31147 consensus_queue.cc:1048] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:10.951607 31031 raft_consensus.cc:1275] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Refusing update from remote peer 7c72385cdf944f068bab65bd12579099: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:10.952802 30903 debug-util.cc:398] Leaking SignalData structure 0x7b08000cf340 after lost signal to thread 20643
W20260709 13:12:10.954427 30903 debug-util.cc:398] Leaking SignalData structure 0x7b080013c540 after lost signal to thread 30814
W20260709 13:12:10.956220 30903 debug-util.cc:398] Leaking SignalData structure 0x7b08002c9ac0 after lost signal to thread 30906
W20260709 13:12:10.957688 30903 debug-util.cc:398] Leaking SignalData structure 0x7b08002edce0 after lost signal to thread 30981
W20260709 13:12:10.963111 30903 debug-util.cc:398] Leaking SignalData structure 0x7b08000466e0 after lost signal to thread 31055
I20260709 13:12:10.972306 31144 consensus_queue.cc:1048] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:11.298669 31030 raft_consensus.cc:1275] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Refusing update from remote peer ddba9ee70f214b45ad36ec0c2d4eb255: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:11.300486 31153 consensus_queue.cc:1048] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:11.312229 31031 raft_consensus.cc:1275] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Refusing update from remote peer 7c72385cdf944f068bab65bd12579099: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:11.314460 31193 consensus_queue.cc:1048] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:11.340713 30953 raft_consensus.cc:1275] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Refusing update from remote peer 7c72385cdf944f068bab65bd12579099: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:11.342801 31189 consensus_queue.cc:1048] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:11.350632 30879 raft_consensus.cc:1275] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Refusing update from remote peer ddba9ee70f214b45ad36ec0c2d4eb255: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:11.378144 31152 consensus_queue.cc:1048] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:11.406432 31031 raft_consensus.cc:1275] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Refusing update from remote peer ddba9ee70f214b45ad36ec0c2d4eb255: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:11.409643 31200 consensus_queue.cc:1048] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:11.422674 30877 raft_consensus.cc:1275] T 7bdce6875f9d4a59bb421b943fc196b6 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Refusing update from remote peer ddba9ee70f214b45ad36ec0c2d4eb255: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:11.438110 31199 consensus_queue.cc:1048] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:11.439258 30953 raft_consensus.cc:1275] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Refusing update from remote peer 7c72385cdf944f068bab65bd12579099: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:11.441502 31193 consensus_queue.cc:1048] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:11.449477 30879 raft_consensus.cc:1275] T d9e3dcc2ae5a4949b0d985002d692506 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Refusing update from remote peer ddba9ee70f214b45ad36ec0c2d4eb255: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:11.455132 31200 consensus_queue.cc:1048] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:11.456349 31030 raft_consensus.cc:1275] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Refusing update from remote peer ddba9ee70f214b45ad36ec0c2d4eb255: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:11.460074 31199 consensus_queue.cc:1048] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:11.461229 31030 raft_consensus.cc:1275] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Refusing update from remote peer 7c72385cdf944f068bab65bd12579099: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:11.464712 31189 consensus_queue.cc:1048] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:13.526170 30777 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37848:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:13.530994 30777 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260709 13:12:13.578720 30828 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:13.628363 30867 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1e3b8867a34aa293e15b013a63b5a6 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:13.630723 30943 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1e3b8867a34aa293e15b013a63b5a6 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:13.632819 30943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1e3b8867a34aa293e15b013a63b5a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.638320 31021 tablet_service.cc:1511] Processing CreateTablet for tablet 8a1e3b8867a34aa293e15b013a63b5a6 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:13.641841 30866 tablet_service.cc:1511] Processing CreateTablet for tablet 540e56778ef84b9799b605658e54910e (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:13.640125 31021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1e3b8867a34aa293e15b013a63b5a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.647025 30946 tablet_service.cc:1511] Processing CreateTablet for tablet 540e56778ef84b9799b605658e54910e (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:13.648682 30946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540e56778ef84b9799b605658e54910e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.630736 30867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a1e3b8867a34aa293e15b013a63b5a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.653007 30872 tablet_service.cc:1511] Processing CreateTablet for tablet 42cc54decf47430192c8725dcc83568c (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:13.653932 30866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540e56778ef84b9799b605658e54910e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.655539 30872 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42cc54decf47430192c8725dcc83568c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.655331 31018 tablet_service.cc:1511] Processing CreateTablet for tablet 540e56778ef84b9799b605658e54910e (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:13.656878 31018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540e56778ef84b9799b605658e54910e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.677121 30942 tablet_service.cc:1511] Processing CreateTablet for tablet 42cc54decf47430192c8725dcc83568c (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:13.678222 31017 tablet_service.cc:1511] Processing CreateTablet for tablet 42cc54decf47430192c8725dcc83568c (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:13.678802 30942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42cc54decf47430192c8725dcc83568c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.679636 31017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42cc54decf47430192c8725dcc83568c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.682765 30869 tablet_service.cc:1511] Processing CreateTablet for tablet 050a45fee82743a4a08c51b4602fa3c6 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:13.684311 30940 tablet_service.cc:1511] Processing CreateTablet for tablet 050a45fee82743a4a08c51b4602fa3c6 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:13.685859 30940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050a45fee82743a4a08c51b4602fa3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.685609 31020 tablet_service.cc:1511] Processing CreateTablet for tablet 050a45fee82743a4a08c51b4602fa3c6 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:13.687063 31020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050a45fee82743a4a08c51b4602fa3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.684368 30869 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 050a45fee82743a4a08c51b4602fa3c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.707718 30865 tablet_service.cc:1511] Processing CreateTablet for tablet 4ef1733419404dbda28ed5e64378bfc3 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:13.709252 30865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef1733419404dbda28ed5e64378bfc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.718595 31013 tablet_service.cc:1511] Processing CreateTablet for tablet 4ef1733419404dbda28ed5e64378bfc3 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:13.720088 31013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef1733419404dbda28ed5e64378bfc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.723158 30941 tablet_service.cc:1511] Processing CreateTablet for tablet 4ef1733419404dbda28ed5e64378bfc3 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:13.724599 30941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ef1733419404dbda28ed5e64378bfc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.736068 30870 tablet_service.cc:1511] Processing CreateTablet for tablet 5305bc82efbf44a39baf9d11d4a955c5 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:13.737671 30870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5305bc82efbf44a39baf9d11d4a955c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.746961 30942 tablet_service.cc:1511] Processing CreateTablet for tablet 5305bc82efbf44a39baf9d11d4a955c5 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:13.748363 30942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5305bc82efbf44a39baf9d11d4a955c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.766623 30940 tablet_service.cc:1511] Processing CreateTablet for tablet 2c0815f868884761ae075b7ea1c40949 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:13.768066 30940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c0815f868884761ae075b7ea1c40949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.770399 30867 tablet_service.cc:1511] Processing CreateTablet for tablet 2c0815f868884761ae075b7ea1c40949 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:13.771760 30867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c0815f868884761ae075b7ea1c40949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.773206 31014 tablet_service.cc:1511] Processing CreateTablet for tablet 5305bc82efbf44a39baf9d11d4a955c5 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:13.774799 31014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5305bc82efbf44a39baf9d11d4a955c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.776177 31019 tablet_service.cc:1511] Processing CreateTablet for tablet 2c0815f868884761ae075b7ea1c40949 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:13.778437 31019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c0815f868884761ae075b7ea1c40949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.790661 30866 tablet_service.cc:1511] Processing CreateTablet for tablet d3701027be9f4b619b8b6651cacb7050 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:13.796192 30866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3701027be9f4b619b8b6651cacb7050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.797013 31221 tablet_bootstrap.cc:492] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099: Bootstrap starting.
I20260709 13:12:13.801641 31220 tablet_bootstrap.cc:492] T 540e56778ef84b9799b605658e54910e P ddba9ee70f214b45ad36ec0c2d4eb255: Bootstrap starting.
I20260709 13:12:13.830940 30941 tablet_service.cc:1511] Processing CreateTablet for tablet d3701027be9f4b619b8b6651cacb7050 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:13.833058 30941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3701027be9f4b619b8b6651cacb7050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.840528 30870 tablet_service.cc:1511] Processing CreateTablet for tablet 713e2163847f473bad6adc0396612b07 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:13.841874 30942 tablet_service.cc:1511] Processing CreateTablet for tablet 713e2163847f473bad6adc0396612b07 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:13.850350 30942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713e2163847f473bad6adc0396612b07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.852926 31220 tablet_bootstrap.cc:654] T 540e56778ef84b9799b605658e54910e P ddba9ee70f214b45ad36ec0c2d4eb255: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.843360 31221 tablet_bootstrap.cc:654] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.852537 31017 tablet_service.cc:1511] Processing CreateTablet for tablet 713e2163847f473bad6adc0396612b07 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:13.859177 30870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713e2163847f473bad6adc0396612b07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.859566 31021 tablet_service.cc:1511] Processing CreateTablet for tablet d3701027be9f4b619b8b6651cacb7050 (DEFAULT_TABLE table=soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:13.871510 31017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 713e2163847f473bad6adc0396612b07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.871636 31222 tablet_bootstrap.cc:492] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c: Bootstrap starting.
I20260709 13:12:13.875288 31021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3701027be9f4b619b8b6651cacb7050. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:13.902940 31222 tablet_bootstrap.cc:654] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.904271 31220 tablet_bootstrap.cc:492] T 540e56778ef84b9799b605658e54910e P ddba9ee70f214b45ad36ec0c2d4eb255: No bootstrap required, opened a new log
I20260709 13:12:13.905483 31220 ts_tablet_manager.cc:1403] T 540e56778ef84b9799b605658e54910e P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent bootstrapping tablet: real 0.104s	user 0.019s	sys 0.026s
I20260709 13:12:13.909385 31220 raft_consensus.cc:359] T 540e56778ef84b9799b605658e54910e P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:13.910171 31220 raft_consensus.cc:385] T 540e56778ef84b9799b605658e54910e P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.910502 31220 raft_consensus.cc:740] T 540e56778ef84b9799b605658e54910e P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.911206 31220 consensus_queue.cc:260] T 540e56778ef84b9799b605658e54910e P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:13.917042 31221 tablet_bootstrap.cc:492] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099: No bootstrap required, opened a new log
I20260709 13:12:13.917874 31221 ts_tablet_manager.cc:1403] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099: Time spent bootstrapping tablet: real 0.121s	user 0.016s	sys 0.003s
I20260709 13:12:13.922700 31221 raft_consensus.cc:359] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:13.924319 31221 raft_consensus.cc:385] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.924782 31221 raft_consensus.cc:740] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.925839 31221 consensus_queue.cc:260] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:13.932137 31221 ts_tablet_manager.cc:1434] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.003s
I20260709 13:12:13.933776 31221 tablet_bootstrap.cc:492] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099: Bootstrap starting.
I20260709 13:12:13.945135 31220 ts_tablet_manager.cc:1434] T 540e56778ef84b9799b605658e54910e P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent starting tablet: real 0.039s	user 0.019s	sys 0.017s
I20260709 13:12:13.946637 31220 tablet_bootstrap.cc:492] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255: Bootstrap starting.
I20260709 13:12:13.952517 31222 tablet_bootstrap.cc:492] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c: No bootstrap required, opened a new log
I20260709 13:12:13.953128 31222 ts_tablet_manager.cc:1403] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c: Time spent bootstrapping tablet: real 0.082s	user 0.008s	sys 0.009s
I20260709 13:12:13.956566 31222 raft_consensus.cc:359] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:13.957345 31222 raft_consensus.cc:385] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.957662 31222 raft_consensus.cc:740] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.958178 31221 tablet_bootstrap.cc:654] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.958395 31220 tablet_bootstrap.cc:654] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.958431 31222 consensus_queue.cc:260] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:13.968225 31222 ts_tablet_manager.cc:1434] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:12:13.972523 31222 tablet_bootstrap.cc:492] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c: Bootstrap starting.
I20260709 13:12:13.986445 31221 tablet_bootstrap.cc:492] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099: No bootstrap required, opened a new log
I20260709 13:12:13.987084 31221 ts_tablet_manager.cc:1403] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.017s
I20260709 13:12:13.987416 31220 tablet_bootstrap.cc:492] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255: No bootstrap required, opened a new log
I20260709 13:12:13.988067 31220 ts_tablet_manager.cc:1403] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent bootstrapping tablet: real 0.042s	user 0.023s	sys 0.013s
I20260709 13:12:13.989485 31222 tablet_bootstrap.cc:654] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:13.991601 31221 raft_consensus.cc:359] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:13.992507 31221 raft_consensus.cc:385] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.992267 31220 raft_consensus.cc:359] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:13.992923 31221 raft_consensus.cc:740] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.993383 31220 raft_consensus.cc:385] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:13.994212 31220 raft_consensus.cc:740] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Initialized, Role: FOLLOWER
I20260709 13:12:13.994500 31221 consensus_queue.cc:260] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:13.995167 31220 consensus_queue.cc:260] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:13.997584 31221 ts_tablet_manager.cc:1434] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:12:13.997776 31220 ts_tablet_manager.cc:1434] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:12:13.998643 31221 tablet_bootstrap.cc:492] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099: Bootstrap starting.
I20260709 13:12:13.998984 31220 tablet_bootstrap.cc:492] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255: Bootstrap starting.
I20260709 13:12:14.006013 31220 tablet_bootstrap.cc:654] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.006615 31221 tablet_bootstrap.cc:654] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.031970 31222 tablet_bootstrap.cc:492] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c: No bootstrap required, opened a new log
I20260709 13:12:14.032727 31222 ts_tablet_manager.cc:1403] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.006s
I20260709 13:12:14.037001 31222 raft_consensus.cc:359] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.039206 31222 raft_consensus.cc:385] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.039523 31222 raft_consensus.cc:740] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.040416 31221 tablet_bootstrap.cc:492] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099: No bootstrap required, opened a new log
I20260709 13:12:14.040337 31222 consensus_queue.cc:260] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.040993 31221 ts_tablet_manager.cc:1403] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.028s
I20260709 13:12:14.042822 31222 ts_tablet_manager.cc:1434] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:12:14.044358 31221 raft_consensus.cc:359] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.045231 31221 raft_consensus.cc:385] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.045580 31221 raft_consensus.cc:740] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.046453 31220 tablet_bootstrap.cc:492] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255: No bootstrap required, opened a new log
I20260709 13:12:14.047173 31220 ts_tablet_manager.cc:1403] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent bootstrapping tablet: real 0.048s	user 0.023s	sys 0.023s
I20260709 13:12:14.046609 31221 consensus_queue.cc:260] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.050384 31221 ts_tablet_manager.cc:1434] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.002s
I20260709 13:12:14.051057 31220 raft_consensus.cc:359] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.051569 31221 tablet_bootstrap.cc:492] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099: Bootstrap starting.
I20260709 13:12:14.051990 31220 raft_consensus.cc:385] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.052381 31220 raft_consensus.cc:740] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.053260 31220 consensus_queue.cc:260] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.054234 31222 tablet_bootstrap.cc:492] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c: Bootstrap starting.
I20260709 13:12:14.055881 31220 ts_tablet_manager.cc:1434] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:14.057201 31220 tablet_bootstrap.cc:492] T 8a1e3b8867a34aa293e15b013a63b5a6 P ddba9ee70f214b45ad36ec0c2d4eb255: Bootstrap starting.
I20260709 13:12:14.060226 31221 tablet_bootstrap.cc:654] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.062625 31222 tablet_bootstrap.cc:654] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.063982 31220 tablet_bootstrap.cc:654] T 8a1e3b8867a34aa293e15b013a63b5a6 P ddba9ee70f214b45ad36ec0c2d4eb255: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.088169 31220 tablet_bootstrap.cc:492] T 8a1e3b8867a34aa293e15b013a63b5a6 P ddba9ee70f214b45ad36ec0c2d4eb255: No bootstrap required, opened a new log
I20260709 13:12:14.088812 31220 ts_tablet_manager.cc:1403] T 8a1e3b8867a34aa293e15b013a63b5a6 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.012s
I20260709 13:12:14.091328 31220 raft_consensus.cc:359] T 8a1e3b8867a34aa293e15b013a63b5a6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.091912 31220 raft_consensus.cc:385] T 8a1e3b8867a34aa293e15b013a63b5a6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.092170 31220 raft_consensus.cc:740] T 8a1e3b8867a34aa293e15b013a63b5a6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.092795 31220 consensus_queue.cc:260] T 8a1e3b8867a34aa293e15b013a63b5a6 P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.095336 31220 ts_tablet_manager.cc:1434] T 8a1e3b8867a34aa293e15b013a63b5a6 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:12:14.096570 31220 tablet_bootstrap.cc:492] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255: Bootstrap starting.
I20260709 13:12:14.088207 31221 tablet_bootstrap.cc:492] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099: No bootstrap required, opened a new log
I20260709 13:12:14.098196 31221 ts_tablet_manager.cc:1403] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.009s
I20260709 13:12:14.102473 31222 tablet_bootstrap.cc:492] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c: No bootstrap required, opened a new log
I20260709 13:12:14.102699 31144 raft_consensus.cc:493] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.103116 31222 ts_tablet_manager.cc:1403] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.012s
I20260709 13:12:14.103286 31144 raft_consensus.cc:515] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.105729 31144 leader_election.cc:290] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:14.106897 31222 raft_consensus.cc:359] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.107306 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540e56778ef84b9799b605658e54910e" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
I20260709 13:12:14.107805 31222 raft_consensus.cc:385] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.108042 31031 raft_consensus.cc:2468] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c72385cdf944f068bab65bd12579099 in term 0.
I20260709 13:12:14.108140 31222 raft_consensus.cc:740] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.109157 31222 consensus_queue.cc:260] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.109956 30847 leader_election.cc:304] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: 
I20260709 13:12:14.111387 31219 raft_consensus.cc:2804] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.111887 31219 raft_consensus.cc:493] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.112066 31222 ts_tablet_manager.cc:1434] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:12:14.112268 31219 raft_consensus.cc:3060] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.113263 31222 tablet_bootstrap.cc:492] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c: Bootstrap starting.
I20260709 13:12:14.110199 31221 raft_consensus.cc:359] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.114148 31221 raft_consensus.cc:385] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.114504 31221 raft_consensus.cc:740] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.115290 31221 consensus_queue.cc:260] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.119928 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540e56778ef84b9799b605658e54910e" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:14.120734 30953 raft_consensus.cc:2468] T 540e56778ef84b9799b605658e54910e P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c72385cdf944f068bab65bd12579099 in term 0.
I20260709 13:12:14.123673 31221 ts_tablet_manager.cc:1434] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099: Time spent starting tablet: real 0.025s	user 0.002s	sys 0.006s
I20260709 13:12:14.124683 31220 tablet_bootstrap.cc:654] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.125121 31221 tablet_bootstrap.cc:492] T 4ef1733419404dbda28ed5e64378bfc3 P 7c72385cdf944f068bab65bd12579099: Bootstrap starting.
I20260709 13:12:14.129307 31222 tablet_bootstrap.cc:654] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.139693 31221 tablet_bootstrap.cc:654] T 4ef1733419404dbda28ed5e64378bfc3 P 7c72385cdf944f068bab65bd12579099: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.174304 31221 tablet_bootstrap.cc:492] T 4ef1733419404dbda28ed5e64378bfc3 P 7c72385cdf944f068bab65bd12579099: No bootstrap required, opened a new log
I20260709 13:12:14.174893 31221 ts_tablet_manager.cc:1403] T 4ef1733419404dbda28ed5e64378bfc3 P 7c72385cdf944f068bab65bd12579099: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.005s
I20260709 13:12:14.178097 31221 raft_consensus.cc:359] T 4ef1733419404dbda28ed5e64378bfc3 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.178838 31221 raft_consensus.cc:385] T 4ef1733419404dbda28ed5e64378bfc3 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.179124 31221 raft_consensus.cc:740] T 4ef1733419404dbda28ed5e64378bfc3 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.179877 31221 consensus_queue.cc:260] T 4ef1733419404dbda28ed5e64378bfc3 P 7c72385cdf944f068bab65bd12579099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.181113 31219 raft_consensus.cc:515] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.184360 31219 leader_election.cc:290] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 election: Requested vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:14.184773 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540e56778ef84b9799b605658e54910e" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
I20260709 13:12:14.185779 31031 raft_consensus.cc:3060] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.192854 31221 ts_tablet_manager.cc:1434] T 4ef1733419404dbda28ed5e64378bfc3 P 7c72385cdf944f068bab65bd12579099: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.003s
I20260709 13:12:14.194133 31221 tablet_bootstrap.cc:492] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099: Bootstrap starting.
I20260709 13:12:14.201189 31221 tablet_bootstrap.cc:654] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:14.219631 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:44251, user_credentials={real_user=slave}} blocked reactor thread for 97612.4us
I20260709 13:12:14.222317 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540e56778ef84b9799b605658e54910e" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:14.223205 30953 raft_consensus.cc:3060] T 540e56778ef84b9799b605658e54910e P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.223898 31221 tablet_bootstrap.cc:492] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099: No bootstrap required, opened a new log
I20260709 13:12:14.224503 31221 ts_tablet_manager.cc:1403] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:12:14.243244 31221 raft_consensus.cc:359] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.244163 31221 raft_consensus.cc:385] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.244475 31221 raft_consensus.cc:740] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.245247 31221 consensus_queue.cc:260] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.248211 31221 ts_tablet_manager.cc:1434] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:12:14.248497 31219 raft_consensus.cc:493] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.249411 31221 tablet_bootstrap.cc:492] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099: Bootstrap starting.
I20260709 13:12:14.249107 31219 raft_consensus.cc:515] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.251462 31219 leader_election.cc:290] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:14.252190 31200 raft_consensus.cc:493] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.258158 31221 tablet_bootstrap.cc:654] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.252887 31200 raft_consensus.cc:515] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.266347 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050a45fee82743a4a08c51b4602fa3c6" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
I20260709 13:12:14.267877 31200 leader_election.cc:290] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
W20260709 13:12:14.269320 30922 leader_election.cc:343] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.270566 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5305bc82efbf44a39baf9d11d4a955c5" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
W20260709 13:12:14.273567 30847 leader_election.cc:343] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.278033 31206 raft_consensus.cc:493] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.278791 31206 raft_consensus.cc:515] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.283475 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050a45fee82743a4a08c51b4602fa3c6" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:14.284484 30877 raft_consensus.cc:2468] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 0.
I20260709 13:12:14.287811 31221 tablet_bootstrap.cc:492] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099: No bootstrap required, opened a new log
I20260709 13:12:14.288455 31221 ts_tablet_manager.cc:1403] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.003s
I20260709 13:12:14.291743 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cc54decf47430192c8725dcc83568c" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:14.291939 31221 raft_consensus.cc:359] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.292867 31221 raft_consensus.cc:385] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.292752 30877 raft_consensus.cc:2468] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:14.293308 31221 raft_consensus.cc:740] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.294235 31221 consensus_queue.cc:260] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.295161 30995 leader_election.cc:304] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: 
I20260709 13:12:14.297043 31206 leader_election.cc:290] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:14.297904 31206 raft_consensus.cc:2804] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.298544 31206 raft_consensus.cc:493] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.298957 31221 ts_tablet_manager.cc:1434] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.005s
I20260709 13:12:14.299046 31206 raft_consensus.cc:3060] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.300462 31221 tablet_bootstrap.cc:492] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099: Bootstrap starting.
I20260709 13:12:14.301259 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cc54decf47430192c8725dcc83568c" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:14.304644 30954 raft_consensus.cc:2468] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:14.309718 31200 raft_consensus.cc:493] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.310603 31200 raft_consensus.cc:515] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.302810 30921 leader_election.cc:304] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: cbd0857ed38947e2acd1f78e325fca7c
I20260709 13:12:14.314769 31225 raft_consensus.cc:2804] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.315301 31225 raft_consensus.cc:493] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.315730 31225 raft_consensus.cc:3060] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.320066 31221 tablet_bootstrap.cc:654] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.334089 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5305bc82efbf44a39baf9d11d4a955c5" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
W20260709 13:12:14.338085 30848 leader_election.cc:343] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.338608 31200 leader_election.cc:290] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:14.349821 31221 tablet_bootstrap.cc:492] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099: No bootstrap required, opened a new log
I20260709 13:12:14.350399 31221 ts_tablet_manager.cc:1403] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.001s
I20260709 13:12:14.344286 30953 raft_consensus.cc:2468] T 540e56778ef84b9799b605658e54910e P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c72385cdf944f068bab65bd12579099 in term 1.
I20260709 13:12:14.341315 31225 raft_consensus.cc:515] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.352787 31031 raft_consensus.cc:2468] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c72385cdf944f068bab65bd12579099 in term 1.
I20260709 13:12:14.352944 31225 leader_election.cc:290] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:14.357928 30847 leader_election.cc:304] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: 
I20260709 13:12:14.353912 31221 raft_consensus.cc:359] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.359519 31221 raft_consensus.cc:385] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.359846 31235 raft_consensus.cc:2804] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.360777 31235 raft_consensus.cc:697] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [term 1 LEADER]: Becoming Leader. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Running, Role: LEADER
W20260709 13:12:14.361174 30995 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:33807, user_credentials={real_user=slave}} blocked reactor thread for 66145.4us
I20260709 13:12:14.361377 31206 raft_consensus.cc:515] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.359855 31221 raft_consensus.cc:740] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.363183 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050a45fee82743a4a08c51b4602fa3c6" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
I20260709 13:12:14.363970 31206 leader_election.cc:290] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:14.364081 31221 consensus_queue.cc:260] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.362123 31235 consensus_queue.cc:237] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.368743 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cc54decf47430192c8725dcc83568c" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:14.369637 30956 raft_consensus.cc:3060] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.373698 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cc54decf47430192c8725dcc83568c" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:14.374418 30877 raft_consensus.cc:3060] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:14.374548 30922 leader_election.cc:343] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.376394 31221 ts_tablet_manager.cc:1434] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260709 13:12:14.377485 31221 tablet_bootstrap.cc:492] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099: Bootstrap starting.
I20260709 13:12:14.379645 30956 raft_consensus.cc:2468] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:14.380987 30997 leader_election.cc:304] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:14.382603 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cc54decf47430192c8725dcc83568c" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:14.383710 31220 tablet_bootstrap.cc:492] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255: No bootstrap required, opened a new log
I20260709 13:12:14.384265 31220 ts_tablet_manager.cc:1403] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent bootstrapping tablet: real 0.288s	user 0.053s	sys 0.067s
I20260709 13:12:14.384281 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050a45fee82743a4a08c51b4602fa3c6" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:14.385035 30876 raft_consensus.cc:3060] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.385293 31222 tablet_bootstrap.cc:492] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c: No bootstrap required, opened a new log
I20260709 13:12:14.364908 30848 leader_election.cc:304] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c72385cdf944f068bab65bd12579099; no voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255
I20260709 13:12:14.385848 31222 ts_tablet_manager.cc:1403] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c: Time spent bootstrapping tablet: real 0.273s	user 0.039s	sys 0.078s
I20260709 13:12:14.387724 31144 raft_consensus.cc:2749] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:14.389066 31222 raft_consensus.cc:359] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
W20260709 13:12:14.389101 30848 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.2:44251, user_credentials={real_user=slave}} blocked reactor thread for 51079.6us
I20260709 13:12:14.389711 31242 raft_consensus.cc:2804] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.389946 31222 raft_consensus.cc:385] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.372239 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cc54decf47430192c8725dcc83568c" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
I20260709 13:12:14.392264 31222 raft_consensus.cc:740] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.393240 30876 raft_consensus.cc:2468] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 1.
I20260709 13:12:14.393106 31222 consensus_queue.cc:260] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.390761 30877 raft_consensus.cc:2468] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:14.395707 31220 raft_consensus.cc:359] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.396502 31220 raft_consensus.cc:385] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.396786 31220 raft_consensus.cc:740] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.397308 31144 raft_consensus.cc:493] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.397974 31144 raft_consensus.cc:515] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.398578 31220 consensus_queue.cc:260] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.399233 30921 leader_election.cc:304] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: cbd0857ed38947e2acd1f78e325fca7c
I20260709 13:12:14.401903 31144 leader_election.cc:290] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:14.402207 31221 tablet_bootstrap.cc:654] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.406424 31225 raft_consensus.cc:2804] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.407202 31225 raft_consensus.cc:697] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 LEADER]: Becoming Leader. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Running, Role: LEADER
I20260709 13:12:14.408161 31242 raft_consensus.cc:697] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Leader. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:14.408165 31225 consensus_queue.cc:237] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.408967 31246 raft_consensus.cc:493] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.409471 31242 consensus_queue.cc:237] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.415304 31220 ts_tablet_manager.cc:1434] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.000s
I20260709 13:12:14.416742 31220 tablet_bootstrap.cc:492] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255: Bootstrap starting.
I20260709 13:12:14.416636 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0815f868884761ae075b7ea1c40949" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:14.409567 31246 raft_consensus.cc:515] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.426453 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0815f868884761ae075b7ea1c40949" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
W20260709 13:12:14.430788 30847 leader_election.cc:343] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.431077 31246 leader_election.cc:290] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:14.429046 31248 raft_consensus.cc:493] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.433076 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef1733419404dbda28ed5e64378bfc3" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:14.433905 30956 raft_consensus.cc:2468] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:14.433351 31248 raft_consensus.cc:515] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.434633 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef1733419404dbda28ed5e64378bfc3" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:14.435393 30877 raft_consensus.cc:2468] T 4ef1733419404dbda28ed5e64378bfc3 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:14.435873 30997 leader_election.cc:304] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:14.436509 31248 leader_election.cc:290] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:14.437136 31246 raft_consensus.cc:2804] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.437664 31246 raft_consensus.cc:493] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.437866 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1e3b8867a34aa293e15b013a63b5a6" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:14.438076 31246 raft_consensus.cc:3060] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.438560 30877 raft_consensus.cc:2468] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:14.440125 30995 leader_election.cc:304] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: 
W20260709 13:12:14.445741 30848 leader_election.cc:343] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.446332 30848 leader_election.cc:304] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c72385cdf944f068bab65bd12579099; no voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255
I20260709 13:12:14.447184 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1e3b8867a34aa293e15b013a63b5a6" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:14.448050 30956 raft_consensus.cc:2468] T 8a1e3b8867a34aa293e15b013a63b5a6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:14.457151 31235 raft_consensus.cc:2749] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:14.462559 30779 catalog_manager.cc:5697] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7c72385cdf944f068bab65bd12579099 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "7c72385cdf944f068bab65bd12579099" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:14.464481 30778 catalog_manager.cc:5697] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2). New cstate: current_term: 1 leader_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:14.470111 31246 raft_consensus.cc:515] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.454411 31248 raft_consensus.cc:2804] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.476167 31222 ts_tablet_manager.cc:1434] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c: Time spent starting tablet: real 0.090s	user 0.009s	sys 0.011s
I20260709 13:12:14.477357 31222 tablet_bootstrap.cc:492] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c: Bootstrap starting.
I20260709 13:12:14.478539 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef1733419404dbda28ed5e64378bfc3" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:14.479310 30877 raft_consensus.cc:3060] T 4ef1733419404dbda28ed5e64378bfc3 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.480311 31235 raft_consensus.cc:493] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.480885 31235 raft_consensus.cc:515] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.481491 31248 raft_consensus.cc:493] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.481943 31248 raft_consensus.cc:3060] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.484155 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3701027be9f4b619b8b6651cacb7050" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:14.484496 31235 leader_election.cc:290] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:14.474563 31220 tablet_bootstrap.cc:654] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:14.490041 30848 leader_election.cc:343] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.490648 31246 leader_election.cc:290] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:14.488340 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef1733419404dbda28ed5e64378bfc3" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:14.490031 30877 raft_consensus.cc:2468] T 4ef1733419404dbda28ed5e64378bfc3 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:14.485944 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3701027be9f4b619b8b6651cacb7050" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
I20260709 13:12:14.495522 30995 leader_election.cc:304] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: 
I20260709 13:12:14.493785 30956 raft_consensus.cc:3060] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:14.496474 30847 leader_election.cc:343] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.496949 30847 leader_election.cc:304] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c72385cdf944f068bab65bd12579099; no voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255
I20260709 13:12:14.497666 31235 raft_consensus.cc:2749] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:14.493775 30922 leader_election.cc:304] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c
I20260709 13:12:14.498337 31225 raft_consensus.cc:2749] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:14.499243 31221 tablet_bootstrap.cc:492] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099: No bootstrap required, opened a new log
I20260709 13:12:14.499716 31221 ts_tablet_manager.cc:1403] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099: Time spent bootstrapping tablet: real 0.122s	user 0.029s	sys 0.014s
I20260709 13:12:14.504670 30956 raft_consensus.cc:2468] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:14.505509 31221 raft_consensus.cc:359] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.511301 31221 raft_consensus.cc:385] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.506433 31246 raft_consensus.cc:2804] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.507522 30777 catalog_manager.cc:5697] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c reported cstate change: term changed from 0 to 1, leader changed from <none> to cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3). New cstate: current_term: 1 leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.514696 31246 raft_consensus.cc:697] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Leader. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:14.515666 31246 consensus_queue.cc:237] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.517336 31248 raft_consensus.cc:515] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.516062 31222 tablet_bootstrap.cc:654] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.511647 31221 raft_consensus.cc:740] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.530709 31248 leader_election.cc:290] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:14.531513 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1e3b8867a34aa293e15b013a63b5a6" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:14.526105 31221 consensus_queue.cc:260] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.531888 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1e3b8867a34aa293e15b013a63b5a6" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:14.538933 30877 raft_consensus.cc:3060] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.540439 31221 ts_tablet_manager.cc:1434] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 13:12:14.551793 30956 raft_consensus.cc:3060] T 8a1e3b8867a34aa293e15b013a63b5a6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.549201 30877 raft_consensus.cc:2468] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:14.560447 30995 leader_election.cc:304] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: 
I20260709 13:12:14.561101 31220 tablet_bootstrap.cc:492] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255: No bootstrap required, opened a new log
I20260709 13:12:14.561810 31220 ts_tablet_manager.cc:1403] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent bootstrapping tablet: real 0.145s	user 0.014s	sys 0.012s
I20260709 13:12:14.561738 31246 raft_consensus.cc:2804] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.563344 31246 raft_consensus.cc:697] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Leader. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:14.564284 31246 consensus_queue.cc:237] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.568168 31222 tablet_bootstrap.cc:492] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c: No bootstrap required, opened a new log
I20260709 13:12:14.568830 31222 ts_tablet_manager.cc:1403] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c: Time spent bootstrapping tablet: real 0.092s	user 0.011s	sys 0.004s
I20260709 13:12:14.569227 30956 raft_consensus.cc:2468] T 8a1e3b8867a34aa293e15b013a63b5a6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:14.565802 31220 raft_consensus.cc:359] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.572629 31220 raft_consensus.cc:385] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.573055 31220 raft_consensus.cc:740] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.574194 31220 consensus_queue.cc:260] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.576340 31222 raft_consensus.cc:359] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.578346 31222 raft_consensus.cc:385] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.578701 31222 raft_consensus.cc:740] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.579794 31222 consensus_queue.cc:260] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
W20260709 13:12:14.581265 30828 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:14.582647 31222 ts_tablet_manager.cc:1434] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.006s
I20260709 13:12:14.584106 31222 tablet_bootstrap.cc:492] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c: Bootstrap starting.
I20260709 13:12:14.588038 31220 ts_tablet_manager.cc:1434] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:12:14.589416 31220 tablet_bootstrap.cc:492] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255: Bootstrap starting.
I20260709 13:12:14.604521 31222 tablet_bootstrap.cc:654] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.618654 31220 tablet_bootstrap.cc:654] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.617913 30779 catalog_manager.cc:5697] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c reported cstate change: term changed from 0 to 1, leader changed from <none> to cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3). New cstate: current_term: 1 leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.619940 30779 catalog_manager.cc:5697] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c reported cstate change: term changed from 0 to 1, leader changed from <none> to cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3). New cstate: current_term: 1 leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.643400 31222 tablet_bootstrap.cc:492] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c: No bootstrap required, opened a new log
I20260709 13:12:14.644057 31222 ts_tablet_manager.cc:1403] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.004s
I20260709 13:12:14.648819 31220 tablet_bootstrap.cc:492] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255: No bootstrap required, opened a new log
I20260709 13:12:14.649488 31220 ts_tablet_manager.cc:1403] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.005s
I20260709 13:12:14.656381 31222 raft_consensus.cc:359] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.657399 31222 raft_consensus.cc:385] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.653020 31220 raft_consensus.cc:359] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.657776 31222 raft_consensus.cc:740] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.658034 31220 raft_consensus.cc:385] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.658516 31220 raft_consensus.cc:740] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.658821 31222 consensus_queue.cc:260] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.659512 31220 consensus_queue.cc:260] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.665314 31220 ts_tablet_manager.cc:1434] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:12:14.662777 31222 ts_tablet_manager.cc:1434] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.005s
I20260709 13:12:14.666800 31222 tablet_bootstrap.cc:492] T 050a45fee82743a4a08c51b4602fa3c6 P cbd0857ed38947e2acd1f78e325fca7c: Bootstrap starting.
I20260709 13:12:14.675055 31222 tablet_bootstrap.cc:654] T 050a45fee82743a4a08c51b4602fa3c6 P cbd0857ed38947e2acd1f78e325fca7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.678398 31220 tablet_bootstrap.cc:492] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255: Bootstrap starting.
I20260709 13:12:14.686679 31220 tablet_bootstrap.cc:654] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.704485 31222 tablet_bootstrap.cc:492] T 050a45fee82743a4a08c51b4602fa3c6 P cbd0857ed38947e2acd1f78e325fca7c: No bootstrap required, opened a new log
I20260709 13:12:14.705174 31222 ts_tablet_manager.cc:1403] T 050a45fee82743a4a08c51b4602fa3c6 P cbd0857ed38947e2acd1f78e325fca7c: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.007s
I20260709 13:12:14.711033 31222 raft_consensus.cc:359] T 050a45fee82743a4a08c51b4602fa3c6 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.712034 31222 raft_consensus.cc:385] T 050a45fee82743a4a08c51b4602fa3c6 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.712414 31222 raft_consensus.cc:740] T 050a45fee82743a4a08c51b4602fa3c6 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.713455 31222 consensus_queue.cc:260] T 050a45fee82743a4a08c51b4602fa3c6 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.715298 31220 tablet_bootstrap.cc:492] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255: No bootstrap required, opened a new log
I20260709 13:12:14.715941 31220 ts_tablet_manager.cc:1403] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.013s
I20260709 13:12:14.719193 31220 raft_consensus.cc:359] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.719981 31220 raft_consensus.cc:385] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.720283 31220 raft_consensus.cc:740] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.721379 31220 consensus_queue.cc:260] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.723812 31220 ts_tablet_manager.cc:1434] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:14.725003 31220 tablet_bootstrap.cc:492] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255: Bootstrap starting.
I20260709 13:12:14.735124 31220 tablet_bootstrap.cc:654] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.747892 31222 ts_tablet_manager.cc:1434] T 050a45fee82743a4a08c51b4602fa3c6 P cbd0857ed38947e2acd1f78e325fca7c: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.001s
I20260709 13:12:14.751883 31246 raft_consensus.cc:493] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.752321 31220 tablet_bootstrap.cc:492] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255: No bootstrap required, opened a new log
I20260709 13:12:14.752972 31220 ts_tablet_manager.cc:1403] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.011s
I20260709 13:12:14.752522 31246 raft_consensus.cc:515] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.754596 31248 raft_consensus.cc:493] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.755149 31248 raft_consensus.cc:515] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.756325 31220 raft_consensus.cc:359] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.757239 31220 raft_consensus.cc:385] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.757589 31220 raft_consensus.cc:740] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.758430 31220 consensus_queue.cc:260] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.759223 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5305bc82efbf44a39baf9d11d4a955c5" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:14.759999 30956 raft_consensus.cc:2468] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:14.760996 31220 ts_tablet_manager.cc:1434] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:12:14.762449 30997 leader_election.cc:304] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:14.762557 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5305bc82efbf44a39baf9d11d4a955c5" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:14.763216 31246 leader_election.cc:290] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:14.763444 30877 raft_consensus.cc:2468] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:14.763769 31242 raft_consensus.cc:2804] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.764196 31242 raft_consensus.cc:493] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.764509 31242 raft_consensus.cc:3060] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.767731 31222 tablet_bootstrap.cc:492] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c: Bootstrap starting.
I20260709 13:12:14.772691 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0815f868884761ae075b7ea1c40949" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:14.773592 30877 raft_consensus.cc:2468] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:14.775215 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0815f868884761ae075b7ea1c40949" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:14.775760 31222 tablet_bootstrap.cc:654] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.776067 30956 raft_consensus.cc:2468] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 0.
I20260709 13:12:14.777676 30995 leader_election.cc:304] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: 
I20260709 13:12:14.778604 31246 raft_consensus.cc:2804] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.779172 31246 raft_consensus.cc:493] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.779650 31246 raft_consensus.cc:3060] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.757331 31248 leader_election.cc:290] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:14.792613 31242 raft_consensus.cc:515] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.810477 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5305bc82efbf44a39baf9d11d4a955c5" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:14.811013 31222 tablet_bootstrap.cc:492] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c: No bootstrap required, opened a new log
I20260709 13:12:14.811173 30877 raft_consensus.cc:3060] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.811690 31222 ts_tablet_manager.cc:1403] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c: Time spent bootstrapping tablet: real 0.044s	user 0.024s	sys 0.016s
I20260709 13:12:14.815191 31222 raft_consensus.cc:359] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.816033 31222 raft_consensus.cc:385] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.816361 31222 raft_consensus.cc:740] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.817224 31222 consensus_queue.cc:260] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.820127 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5305bc82efbf44a39baf9d11d4a955c5" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:14.820837 30956 raft_consensus.cc:3060] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.821743 31246 raft_consensus.cc:515] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.826618 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0815f868884761ae075b7ea1c40949" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:14.826668 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0815f868884761ae075b7ea1c40949" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:14.827303 30876 raft_consensus.cc:3060] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.827422 30953 raft_consensus.cc:3060] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.835412 30953 raft_consensus.cc:2468] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:14.835934 31246 leader_election.cc:290] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:14.838661 30997 leader_election.cc:304] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:14.840334 31200 consensus_queue.cc:1048] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:14.840142 31246 raft_consensus.cc:2804] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.842459 31246 raft_consensus.cc:697] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Leader. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:14.843434 31246 consensus_queue.cc:237] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.849773 31222 ts_tablet_manager.cc:1434] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c: Time spent starting tablet: real 0.038s	user 0.010s	sys 0.000s
I20260709 13:12:14.852283 31235 consensus_queue.cc:1048] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:14.855721 31248 consensus_queue.cc:1048] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:14.857636 30876 raft_consensus.cc:2468] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:14.862389 30956 raft_consensus.cc:2468] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:14.863729 30997 leader_election.cc:304] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:14.864732 31248 raft_consensus.cc:2804] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.865258 31248 raft_consensus.cc:697] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Leader. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:14.863898 31222 tablet_bootstrap.cc:492] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c: Bootstrap starting.
I20260709 13:12:14.866181 31248 consensus_queue.cc:237] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.860242 31242 leader_election.cc:290] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:14.885195 31247 consensus_queue.cc:1048] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:14.907801 30877 raft_consensus.cc:2468] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 1.
I20260709 13:12:14.912698 31144 consensus_queue.cc:1048] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:14.913312 30779 catalog_manager.cc:5697] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c reported cstate change: term changed from 0 to 1, leader changed from <none> to cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3). New cstate: current_term: 1 leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:14.939894 31225 raft_consensus.cc:493] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.940522 31225 raft_consensus.cc:515] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.936381 31200 raft_consensus.cc:493] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.953159 31225 leader_election.cc:290] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:14.955176 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713e2163847f473bad6adc0396612b07" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
I20260709 13:12:14.955961 31031 raft_consensus.cc:2468] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 0.
I20260709 13:12:14.956805 31200 raft_consensus.cc:515] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.957266 30922 leader_election.cc:304] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:14.959048 31200 leader_election.cc:290] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:14.959654 31200 raft_consensus.cc:2804] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.963013 31247 consensus_queue.cc:1048] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:14.963968 31206 consensus_queue.cc:1048] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:14.964773 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3701027be9f4b619b8b6651cacb7050" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
I20260709 13:12:14.961304 31200 raft_consensus.cc:493] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.966284 31200 raft_consensus.cc:3060] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:14.966854 30922 leader_election.cc:343] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:14.972266 31144 raft_consensus.cc:493] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.972851 31144 raft_consensus.cc:515] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.975906 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713e2163847f473bad6adc0396612b07" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:14.976570 30877 raft_consensus.cc:2468] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 0.
I20260709 13:12:14.977782 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713e2163847f473bad6adc0396612b07" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c" is_pre_election: true
I20260709 13:12:14.979192 31222 tablet_bootstrap.cc:654] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.978470 31031 raft_consensus.cc:2468] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7c72385cdf944f068bab65bd12579099 in term 0.
I20260709 13:12:14.978350 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3701027be9f4b619b8b6651cacb7050" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:14.980778 30876 raft_consensus.cc:2468] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 0.
I20260709 13:12:14.981460 30847 leader_election.cc:304] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: 
I20260709 13:12:14.982786 31031 raft_consensus.cc:3060] T 050a45fee82743a4a08c51b4602fa3c6 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.985774 31235 raft_consensus.cc:2804] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.986531 31235 raft_consensus.cc:493] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.986881 31235 raft_consensus.cc:3060] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:14.979559 31144 leader_election.cc:290] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:14.994125 30921 leader_election.cc:304] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: cbd0857ed38947e2acd1f78e325fca7c
I20260709 13:12:14.996099 31200 raft_consensus.cc:515] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:14.997859 31225 raft_consensus.cc:2804] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:14.998356 31225 raft_consensus.cc:493] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:14.998709 31225 raft_consensus.cc:3060] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:15.000887 30777 catalog_manager.cc:5697] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c reported cstate change: term changed from 0 to 1, leader changed from <none> to cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3). New cstate: current_term: 1 leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.007357 31225 raft_consensus.cc:515] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.009536 31225 leader_election.cc:290] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:15.010176 31225 consensus_queue.cc:1048] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:15.010378 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713e2163847f473bad6adc0396612b07" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:15.011336 30953 raft_consensus.cc:2393] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7c72385cdf944f068bab65bd12579099 in current term 1: Already voted for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in this term.
I20260709 13:12:15.011443 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713e2163847f473bad6adc0396612b07" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:15.013329 30877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3701027be9f4b619b8b6651cacb7050" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:15.013962 30877 raft_consensus.cc:3060] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:15.017722 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3701027be9f4b619b8b6651cacb7050" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
W20260709 13:12:15.022267 30922 leader_election.cc:343] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:15.027102 30877 raft_consensus.cc:2468] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 1.
I20260709 13:12:15.030506 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713e2163847f473bad6adc0396612b07" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
I20260709 13:12:15.031222 31031 raft_consensus.cc:3060] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:15.029986 31200 leader_election.cc:290] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:15.040099 31235 raft_consensus.cc:515] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.045380 30876 raft_consensus.cc:2393] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ddba9ee70f214b45ad36ec0c2d4eb255 in current term 1: Already voted for candidate 7c72385cdf944f068bab65bd12579099 in this term.
I20260709 13:12:15.047739 31235 leader_election.cc:290] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 election: Requested vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:15.047978 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713e2163847f473bad6adc0396612b07" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:15.048069 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713e2163847f473bad6adc0396612b07" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
I20260709 13:12:15.048944 30956 raft_consensus.cc:2393] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7c72385cdf944f068bab65bd12579099 in current term 1: Already voted for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in this term.
I20260709 13:12:15.053015 30921 leader_election.cc:304] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: cbd0857ed38947e2acd1f78e325fca7c
I20260709 13:12:15.056608 30848 leader_election.cc:304] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7c72385cdf944f068bab65bd12579099; no voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255
I20260709 13:12:15.057886 31222 tablet_bootstrap.cc:492] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c: No bootstrap required, opened a new log
I20260709 13:12:15.057842 31280 raft_consensus.cc:2749] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:15.058815 31222 ts_tablet_manager.cc:1403] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c: Time spent bootstrapping tablet: real 0.195s	user 0.018s	sys 0.001s
I20260709 13:12:15.063603 31278 raft_consensus.cc:2804] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:15.064276 31278 raft_consensus.cc:697] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 LEADER]: Becoming Leader. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Running, Role: LEADER
I20260709 13:12:15.065188 31278 consensus_queue.cc:237] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.072352 31031 raft_consensus.cc:2468] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 1.
I20260709 13:12:15.078930 30922 leader_election.cc:304] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 7c72385cdf944f068bab65bd12579099
I20260709 13:12:15.080210 31225 raft_consensus.cc:2804] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:15.074723 31222 raft_consensus.cc:359] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.080837 31225 raft_consensus.cc:697] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 LEADER]: Becoming Leader. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Running, Role: LEADER
I20260709 13:12:15.080866 31222 raft_consensus.cc:385] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:15.081598 31222 raft_consensus.cc:740] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.082461 31222 consensus_queue.cc:260] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.084641 31225 consensus_queue.cc:237] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.090349 31222 ts_tablet_manager.cc:1434] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.002s
I20260709 13:12:15.108599 31246 consensus_queue.cc:1048] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:15.109834 31206 consensus_queue.cc:1048] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:15.120798 30779 catalog_manager.cc:5697] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2). New cstate: current_term: 1 leader_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:15.142799 30779 catalog_manager.cc:5697] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2). New cstate: current_term: 1 leader_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:15.257020 31247 consensus_queue.cc:1048] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:15.275028 31206 consensus_queue.cc:1048] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:15.282188 31248 consensus_queue.cc:1048] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:15.284047 31242 consensus_queue.cc:1048] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:15.348001 31029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a1e3b8867a34aa293e15b013a63b5a6"
dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
mode: GRACEFUL
new_leader_uuid: "7c72385cdf944f068bab65bd12579099"
 from {username='slave'} at 127.0.0.1:38926
I20260709 13:12:15.348706 31029 raft_consensus.cc:606] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Received request to transfer leadership to TS 7c72385cdf944f068bab65bd12579099
I20260709 13:12:15.360078 31029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42cc54decf47430192c8725dcc83568c"
dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
mode: GRACEFUL
new_leader_uuid: "7c72385cdf944f068bab65bd12579099"
 from {username='slave'} at 127.0.0.1:38926
I20260709 13:12:15.360767 31029 raft_consensus.cc:606] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Received request to transfer leadership to TS 7c72385cdf944f068bab65bd12579099
I20260709 13:12:15.400941 30956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "050a45fee82743a4a08c51b4602fa3c6"
dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
mode: GRACEFUL
new_leader_uuid: "7c72385cdf944f068bab65bd12579099"
 from {username='slave'} at 127.0.0.1:49744
I20260709 13:12:15.401676 30956 raft_consensus.cc:606] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 LEADER]: Received request to transfer leadership to TS 7c72385cdf944f068bab65bd12579099
I20260709 13:12:15.409004 31029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ef1733419404dbda28ed5e64378bfc3"
dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
mode: GRACEFUL
new_leader_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
 from {username='slave'} at 127.0.0.1:38926
I20260709 13:12:15.409708 31029 raft_consensus.cc:606] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Received request to transfer leadership to TS ddba9ee70f214b45ad36ec0c2d4eb255
I20260709 13:12:15.413988 31200 raft_consensus.cc:993] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255: : Instructing follower 7c72385cdf944f068bab65bd12579099 to start an election
I20260709 13:12:15.414516 31200 raft_consensus.cc:1081] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 LEADER]: Signalling peer 7c72385cdf944f068bab65bd12579099 to start an election
I20260709 13:12:15.416034 31029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5305bc82efbf44a39baf9d11d4a955c5"
dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
mode: GRACEFUL
new_leader_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
 from {username='slave'} at 127.0.0.1:38926
I20260709 13:12:15.416818 31029 raft_consensus.cc:606] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Received request to transfer leadership to TS ddba9ee70f214b45ad36ec0c2d4eb255
I20260709 13:12:15.417164 30879 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "050a45fee82743a4a08c51b4602fa3c6"
dest_uuid: "7c72385cdf944f068bab65bd12579099"
 from {username='slave'} at 127.0.0.1:52794
I20260709 13:12:15.418061 30879 raft_consensus.cc:493] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:15.419690 30879 raft_consensus.cc:3060] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.428169 31029 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c0815f868884761ae075b7ea1c40949"
dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
mode: GRACEFUL
new_leader_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
 from {username='slave'} at 127.0.0.1:38926
I20260709 13:12:15.429013 31029 raft_consensus.cc:606] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Received request to transfer leadership to TS ddba9ee70f214b45ad36ec0c2d4eb255
I20260709 13:12:15.441418 31247 raft_consensus.cc:993] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c: : Instructing follower 7c72385cdf944f068bab65bd12579099 to start an election
I20260709 13:12:15.441936 31247 raft_consensus.cc:1081] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Signalling peer 7c72385cdf944f068bab65bd12579099 to start an election
I20260709 13:12:15.444063 30876 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42cc54decf47430192c8725dcc83568c"
dest_uuid: "7c72385cdf944f068bab65bd12579099"
 from {username='slave'} at 127.0.0.1:52784
I20260709 13:12:15.444679 30876 raft_consensus.cc:493] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:15.445052 30876 raft_consensus.cc:3060] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.450817 30953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "713e2163847f473bad6adc0396612b07"
dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
mode: GRACEFUL
new_leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
 from {username='slave'} at 127.0.0.1:49744
I20260709 13:12:15.451574 30953 raft_consensus.cc:606] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 LEADER]: Received request to transfer leadership to TS cbd0857ed38947e2acd1f78e325fca7c
I20260709 13:12:15.428207 30879 raft_consensus.cc:515] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.457340 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050a45fee82743a4a08c51b4602fa3c6" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:15.458011 30953 raft_consensus.cc:3055] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:15.458370 30953 raft_consensus.cc:740] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Running, Role: LEADER
I20260709 13:12:15.459246 30953 consensus_queue.cc:260] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.460628 30953 raft_consensus.cc:3060] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.462158 30876 raft_consensus.cc:515] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.465373 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cc54decf47430192c8725dcc83568c" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:15.466008 30956 raft_consensus.cc:3060] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.470130 30953 raft_consensus.cc:2468] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c72385cdf944f068bab65bd12579099 in term 2.
I20260709 13:12:15.471951 30879 leader_election.cc:290] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 2 election: Requested vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:15.473078 30848 leader_election.cc:304] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:15.474066 31280 raft_consensus.cc:2804] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.474556 31280 raft_consensus.cc:697] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099 [term 2 LEADER]: Becoming Leader. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Running, Role: LEADER
I20260709 13:12:15.475401 31280 consensus_queue.cc:237] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.478470 31029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "050a45fee82743a4a08c51b4602fa3c6" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
I20260709 13:12:15.479161 31029 raft_consensus.cc:3060] T 050a45fee82743a4a08c51b4602fa3c6 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.489748 31029 raft_consensus.cc:2468] T 050a45fee82743a4a08c51b4602fa3c6 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c72385cdf944f068bab65bd12579099 in term 2.
I20260709 13:12:15.495312 30956 raft_consensus.cc:2468] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c72385cdf944f068bab65bd12579099 in term 2.
I20260709 13:12:15.497946 30876 leader_election.cc:290] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 2 election: Requested vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:15.498317 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42cc54decf47430192c8725dcc83568c" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
I20260709 13:12:15.499049 31031 raft_consensus.cc:3055] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:15.499405 31031 raft_consensus.cc:740] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:15.496737 30779 catalog_manager.cc:5697] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099 reported cstate change: term changed from 1 to 2, leader changed from ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2) to 7c72385cdf944f068bab65bd12579099 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "7c72385cdf944f068bab65bd12579099" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:15.500241 31031 consensus_queue.cc:260] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.501498 31031 raft_consensus.cc:3060] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.502055 30848 leader_election.cc:304] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:15.503055 31280 raft_consensus.cc:2804] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.503757 31280 raft_consensus.cc:697] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099 [term 2 LEADER]: Becoming Leader. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Running, Role: LEADER
I20260709 13:12:15.504633 31280 consensus_queue.cc:237] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.513409 31031 raft_consensus.cc:2468] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c72385cdf944f068bab65bd12579099 in term 2.
I20260709 13:12:15.524464 30779 catalog_manager.cc:5697] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099 reported cstate change: term changed from 1 to 2, leader changed from cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3) to 7c72385cdf944f068bab65bd12579099 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "7c72385cdf944f068bab65bd12579099" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:15.532817 31248 raft_consensus.cc:993] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c: : Instructing follower ddba9ee70f214b45ad36ec0c2d4eb255 to start an election
I20260709 13:12:15.533448 31248 raft_consensus.cc:1081] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Signalling peer ddba9ee70f214b45ad36ec0c2d4eb255 to start an election
I20260709 13:12:15.535382 30953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ef1733419404dbda28ed5e64378bfc3"
dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
 from {username='slave'} at 127.0.0.1:54172
I20260709 13:12:15.535987 30953 raft_consensus.cc:493] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:15.536363 30953 raft_consensus.cc:3060] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.548563 30953 raft_consensus.cc:515] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.551729 30953 leader_election.cc:290] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 2 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:15.552160 30876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef1733419404dbda28ed5e64378bfc3" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:15.552623 31247 raft_consensus.cc:493] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.552922 30876 raft_consensus.cc:3060] T 4ef1733419404dbda28ed5e64378bfc3 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.553237 31247 raft_consensus.cc:515] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.555709 31247 leader_election.cc:290] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:15.557919 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3701027be9f4b619b8b6651cacb7050" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" is_pre_election: true
I20260709 13:12:15.559934 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3701027be9f4b619b8b6651cacb7050" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7c72385cdf944f068bab65bd12579099" is_pre_election: true
I20260709 13:12:15.560782 30879 raft_consensus.cc:2393] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbd0857ed38947e2acd1f78e325fca7c in current term 1: Already voted for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in this term.
I20260709 13:12:15.562062 30995 leader_election.cc:304] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c; no voters: 7c72385cdf944f068bab65bd12579099, ddba9ee70f214b45ad36ec0c2d4eb255
I20260709 13:12:15.562430 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ef1733419404dbda28ed5e64378bfc3" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
I20260709 13:12:15.563042 31031 raft_consensus.cc:3055] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:15.563321 31247 raft_consensus.cc:3060] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:15.563390 31031 raft_consensus.cc:740] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:15.562047 30876 raft_consensus.cc:2468] T 4ef1733419404dbda28ed5e64378bfc3 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 2.
I20260709 13:12:15.565701 30921 leader_election.cc:304] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:15.566541 31285 raft_consensus.cc:2804] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.567054 31285 raft_consensus.cc:697] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 LEADER]: Becoming Leader. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Running, Role: LEADER
I20260709 13:12:15.566771 31031 consensus_queue.cc:260] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.568176 31031 raft_consensus.cc:3060] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.567937 31285 consensus_queue.cc:237] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.571521 31247 raft_consensus.cc:2749] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:15.577690 31031 raft_consensus.cc:2468] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 2.
I20260709 13:12:15.577822 30779 catalog_manager.cc:5697] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 reported cstate change: term changed from 1 to 2, leader changed from cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3) to ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:15.602366 31285 consensus_queue.cc:1048] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:15.623659 31278 consensus_queue.cc:1048] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:15.635128 31278 consensus_queue.cc:1048] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:15.648123 31278 consensus_queue.cc:1048] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:15.670917 31206 raft_consensus.cc:993] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c: : Instructing follower ddba9ee70f214b45ad36ec0c2d4eb255 to start an election
I20260709 13:12:15.671379 31206 raft_consensus.cc:1081] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Signalling peer ddba9ee70f214b45ad36ec0c2d4eb255 to start an election
I20260709 13:12:15.673278 30956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5305bc82efbf44a39baf9d11d4a955c5"
dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
 from {username='slave'} at 127.0.0.1:54172
I20260709 13:12:15.673880 30956 raft_consensus.cc:493] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:15.674286 30956 raft_consensus.cc:3060] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.675833 31248 raft_consensus.cc:993] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c: : Instructing follower 7c72385cdf944f068bab65bd12579099 to start an election
I20260709 13:12:15.676331 31248 raft_consensus.cc:1081] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Signalling peer 7c72385cdf944f068bab65bd12579099 to start an election
I20260709 13:12:15.678234 30877 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a1e3b8867a34aa293e15b013a63b5a6"
dest_uuid: "7c72385cdf944f068bab65bd12579099"
 from {username='slave'} at 127.0.0.1:52784
I20260709 13:12:15.678839 30877 raft_consensus.cc:493] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:15.679211 30877 raft_consensus.cc:3060] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.684914 30956 raft_consensus.cc:515] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.692392 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5305bc82efbf44a39baf9d11d4a955c5" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:15.693032 30881 raft_consensus.cc:3060] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.694510 31028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5305bc82efbf44a39baf9d11d4a955c5" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
I20260709 13:12:15.695248 31028 raft_consensus.cc:3055] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:15.695600 31028 raft_consensus.cc:740] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:15.695957 30956 leader_election.cc:290] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 2 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:15.696542 31028 consensus_queue.cc:260] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.698526 31028 raft_consensus.cc:3060] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.701709 30881 raft_consensus.cc:2468] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 2.
I20260709 13:12:15.704221 30921 leader_election.cc:304] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:15.706534 31285 raft_consensus.cc:2804] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.707065 31285 raft_consensus.cc:697] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 LEADER]: Becoming Leader. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Running, Role: LEADER
I20260709 13:12:15.707888 31285 consensus_queue.cc:237] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.709154 30877 raft_consensus.cc:515] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.710551 31028 raft_consensus.cc:2468] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 2.
I20260709 13:12:15.721199 30780 catalog_manager.cc:5697] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 reported cstate change: term changed from 1 to 2, leader changed from cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3) to ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:15.732767 31200 raft_consensus.cc:993] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255: : Instructing follower cbd0857ed38947e2acd1f78e325fca7c to start an election
I20260709 13:12:15.733263 31200 raft_consensus.cc:1081] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 LEADER]: Signalling peer cbd0857ed38947e2acd1f78e325fca7c to start an election
I20260709 13:12:15.735694 31028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "713e2163847f473bad6adc0396612b07"
dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
 from {username='slave'} at 127.0.0.1:38910
I20260709 13:12:15.736339 31028 raft_consensus.cc:493] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:15.736743 31028 raft_consensus.cc:3060] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.745261 31028 raft_consensus.cc:515] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.747576 30956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1e3b8867a34aa293e15b013a63b5a6" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:15.747864 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a1e3b8867a34aa293e15b013a63b5a6" candidate_uuid: "7c72385cdf944f068bab65bd12579099" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
I20260709 13:12:15.748415 30956 raft_consensus.cc:3060] T 8a1e3b8867a34aa293e15b013a63b5a6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.748521 30877 leader_election.cc:290] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 2 election: Requested vote from peers ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:15.748435 31031 raft_consensus.cc:3055] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:15.755511 31031 raft_consensus.cc:740] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:15.756554 31031 consensus_queue.cc:260] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.757776 31031 raft_consensus.cc:3060] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.758273 31028 leader_election.cc:290] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 2 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:15.759577 30953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713e2163847f473bad6adc0396612b07" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:15.760259 30953 raft_consensus.cc:3055] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:15.760428 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "713e2163847f473bad6adc0396612b07" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:15.760567 30953 raft_consensus.cc:740] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Running, Role: LEADER
I20260709 13:12:15.765136 30881 raft_consensus.cc:3060] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.765981 30953 consensus_queue.cc:260] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.767298 30953 raft_consensus.cc:3060] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.770131 31031 raft_consensus.cc:2468] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c72385cdf944f068bab65bd12579099 in term 2.
I20260709 13:12:15.775862 30881 raft_consensus.cc:2468] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 2.
I20260709 13:12:15.776315 30847 leader_election.cc:304] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: 
I20260709 13:12:15.777189 30995 leader_election.cc:304] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: 
I20260709 13:12:15.778141 31247 raft_consensus.cc:2804] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.778400 30956 raft_consensus.cc:2468] T 8a1e3b8867a34aa293e15b013a63b5a6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7c72385cdf944f068bab65bd12579099 in term 2.
I20260709 13:12:15.778650 31247 raft_consensus.cc:697] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c [term 2 LEADER]: Becoming Leader. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:15.779527 31247 consensus_queue.cc:237] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.777225 31235 raft_consensus.cc:2804] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.781456 31235 raft_consensus.cc:697] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099 [term 2 LEADER]: Becoming Leader. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Running, Role: LEADER
I20260709 13:12:15.782258 31235 consensus_queue.cc:237] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.774461 30953 raft_consensus.cc:2468] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 2.
I20260709 13:12:15.792237 30780 catalog_manager.cc:5697] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099 reported cstate change: term changed from 1 to 2, leader changed from cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3) to 7c72385cdf944f068bab65bd12579099 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "7c72385cdf944f068bab65bd12579099" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:15.792237 30779 catalog_manager.cc:5697] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c reported cstate change: term changed from 1 to 2, leader changed from ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2) to cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3). New cstate: current_term: 2 leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.810314 31247 raft_consensus.cc:993] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c: : Instructing follower ddba9ee70f214b45ad36ec0c2d4eb255 to start an election
I20260709 13:12:15.810863 31206 raft_consensus.cc:1081] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Signalling peer ddba9ee70f214b45ad36ec0c2d4eb255 to start an election
I20260709 13:12:15.812608 30953 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c0815f868884761ae075b7ea1c40949"
dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
 from {username='slave'} at 127.0.0.1:54172
I20260709 13:12:15.813727 30953 raft_consensus.cc:493] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:15.814060 30953 raft_consensus.cc:3060] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.819087 30953 raft_consensus.cc:515] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.820932 30953 leader_election.cc:290] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 2 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3:40195)
I20260709 13:12:15.822439 31031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0815f868884761ae075b7ea1c40949" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
I20260709 13:12:15.822990 31031 raft_consensus.cc:3055] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:15.823239 31031 raft_consensus.cc:740] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:15.823884 31031 consensus_queue.cc:260] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.824731 31031 raft_consensus.cc:3060] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.825476 30881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c0815f868884761ae075b7ea1c40949" candidate_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:15.826122 30881 raft_consensus.cc:3060] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.832350 31031 raft_consensus.cc:2468] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 2.
I20260709 13:12:15.833076 30881 raft_consensus.cc:2468] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddba9ee70f214b45ad36ec0c2d4eb255 in term 2.
I20260709 13:12:15.833710 30922 leader_election.cc:304] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:15.834623 31278 raft_consensus.cc:2804] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.835080 31278 raft_consensus.cc:697] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 LEADER]: Becoming Leader. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Running, Role: LEADER
I20260709 13:12:15.835878 31278 consensus_queue.cc:237] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:15.845583 30780 catalog_manager.cc:5697] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 reported cstate change: term changed from 1 to 2, leader changed from cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3) to ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:15.918582 30953 raft_consensus.cc:1275] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Refusing update from remote peer 7c72385cdf944f068bab65bd12579099: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:15.920435 31280 consensus_queue.cc:1048] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:15.933995 31031 raft_consensus.cc:1275] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Refusing update from remote peer 7c72385cdf944f068bab65bd12579099: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:15.935709 31280 consensus_queue.cc:1048] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:15.951031 31031 raft_consensus.cc:1275] T 050a45fee82743a4a08c51b4602fa3c6 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Refusing update from remote peer 7c72385cdf944f068bab65bd12579099: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:15.952265 31144 consensus_queue.cc:1048] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:15.960604 30953 raft_consensus.cc:1275] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Refusing update from remote peer 7c72385cdf944f068bab65bd12579099: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:15.963208 31280 consensus_queue.cc:1048] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:15.990880 30881 raft_consensus.cc:1275] T 4ef1733419404dbda28ed5e64378bfc3 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Refusing update from remote peer ddba9ee70f214b45ad36ec0c2d4eb255: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:15.992532 31285 consensus_queue.cc:1048] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.005190 31028 raft_consensus.cc:1275] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Refusing update from remote peer ddba9ee70f214b45ad36ec0c2d4eb255: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.007139 31278 consensus_queue.cc:1048] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.128984 30881 raft_consensus.cc:1275] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Refusing update from remote peer ddba9ee70f214b45ad36ec0c2d4eb255: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.130499 31285 consensus_queue.cc:1048] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.142731 31028 raft_consensus.cc:1275] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Refusing update from remote peer ddba9ee70f214b45ad36ec0c2d4eb255: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.144376 31200 consensus_queue.cc:1048] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.172756 30881 raft_consensus.cc:1275] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Refusing update from remote peer cbd0857ed38947e2acd1f78e325fca7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.174217 31247 consensus_queue.cc:1048] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.184927 30953 raft_consensus.cc:1275] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Refusing update from remote peer cbd0857ed38947e2acd1f78e325fca7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.187709 31247 consensus_queue.cc:1048] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.230346 30881 raft_consensus.cc:1275] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Refusing update from remote peer ddba9ee70f214b45ad36ec0c2d4eb255: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.231938 31300 consensus_queue.cc:1048] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.241243 31031 raft_consensus.cc:1275] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Refusing update from remote peer ddba9ee70f214b45ad36ec0c2d4eb255: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.242641 31200 consensus_queue.cc:1048] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.309839 31031 raft_consensus.cc:1275] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Refusing update from remote peer 7c72385cdf944f068bab65bd12579099: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.311153 31235 consensus_queue.cc:1048] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.323848 30953 raft_consensus.cc:1275] T 8a1e3b8867a34aa293e15b013a63b5a6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Refusing update from remote peer 7c72385cdf944f068bab65bd12579099: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.325124 31280 consensus_queue.cc:1048] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:18.456029 30779 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37848:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:12:18.478561 30779 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:37848:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:12:18.510496 20640 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:12:18.789773 30921 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:33807, user_credentials={real_user=slave}} blocked reactor thread for 44447.1us
I20260709 13:12:18.872220 31365 tablet.cc:1724] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:18.855021 31370 tablet.cc:1724] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:18.826679 31362 tablet.cc:1724] T 050a45fee82743a4a08c51b4602fa3c6 P cbd0857ed38947e2acd1f78e325fca7c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:18.790249 31355 tablet.cc:1724] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:18.908386 30983 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:2c0815f868884761ae075b7ea1c40949)
W20260709 13:12:18.914335 30983 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:2c0815f868884761ae075b7ea1c40949)
I20260709 13:12:18.866707 31367 tablet.cc:1724] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:18.896085 30922 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:40195, user_credentials={real_user=slave}} blocked reactor thread for 171573us
I20260709 13:12:18.866716 31372 tablet.cc:1724] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:18.878818 31368 tablet.cc:1724] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:18.868732 31366 tablet.cc:1724] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:18.940339 31371 tablet.cc:1724] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:18.949419 30879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "540e56778ef84b9799b605658e54910e"
dest_uuid: "7c72385cdf944f068bab65bd12579099"
mode: GRACEFUL
new_leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
 from {username='slave'} at 127.0.0.1:34506
I20260709 13:12:18.959932 30879 raft_consensus.cc:606] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [term 1 LEADER]: Received request to transfer leadership to TS cbd0857ed38947e2acd1f78e325fca7c
W20260709 13:12:18.962064 31057 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:050a45fee82743a4a08c51b4602fa3c6)
I20260709 13:12:18.970775 31375 tablet.cc:1724] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:19.003166 31338 raft_consensus.cc:993] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099: : Instructing follower cbd0857ed38947e2acd1f78e325fca7c to start an election
I20260709 13:12:19.009419 31338 raft_consensus.cc:1081] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [term 1 LEADER]: Signalling peer cbd0857ed38947e2acd1f78e325fca7c to start an election
I20260709 13:12:19.005571 31365 tablet.cc:1724] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:19.003700 31368 tablet.cc:1724] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:19.000694 31376 tablet.cc:1724] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:19.031980 31371 tablet.cc:1724] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:19.014919 31378 tablet.cc:1724] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:19.020535 31030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "540e56778ef84b9799b605658e54910e"
dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
 from {username='slave'} at 127.0.0.1:38906
I20260709 13:12:19.034931 31030 raft_consensus.cc:493] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:19.035344 31030 raft_consensus.cc:3060] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:19.035205 31367 tablet.cc:1724] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:19.036912 31370 tablet.cc:1724] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:19.032590 31355 tablet.cc:1724] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:19.045423 31362 tablet.cc:1724] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:19.049768 30778 catalog_manager.cc:5789] TS ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251) does not have the latest schema for tablet d3701027be9f4b619b8b6651cacb7050 (table soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]). Expected version 1 got 0
I20260709 13:12:19.050631 31366 tablet.cc:1724] T 4ef1733419404dbda28ed5e64378bfc3 P 7c72385cdf944f068bab65bd12579099: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:19.050631 30778 catalog_manager.cc:5789] TS ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251) does not have the latest schema for tablet 5305bc82efbf44a39baf9d11d4a955c5 (table soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc]). Expected version 1 got 0
I20260709 13:12:19.073959 30954 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3701027be9f4b619b8b6651cacb7050"
dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
mode: GRACEFUL
new_leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
 from {username='slave'} at 127.0.0.1:49750
I20260709 13:12:19.074694 30954 raft_consensus.cc:606] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 LEADER]: Received request to transfer leadership to TS cbd0857ed38947e2acd1f78e325fca7c
I20260709 13:12:19.076378 20640 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:12:19.076983 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:19.070556 31375 tablet.cc:1724] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:19.086490 31365 tablet.cc:1724] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:19.084897 31368 tablet.cc:1724] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:19.096767 30879 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba7aed4b0dc3422bba7fd99d1a805fc5"
dest_uuid: "7c72385cdf944f068bab65bd12579099"
mode: GRACEFUL
new_leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
 from {username='slave'} at 127.0.0.1:34506
I20260709 13:12:19.097419 30879 raft_consensus.cc:606] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [term 2 LEADER]: Received request to transfer leadership to TS cbd0857ed38947e2acd1f78e325fca7c
I20260709 13:12:19.098812 31372 tablet.cc:1724] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:19.098862 31362 tablet.cc:1724] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:19.102847 31030 raft_consensus.cc:515] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:19.105361 30954 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9e3dcc2ae5a4949b0d985002d692506"
dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
mode: GRACEFUL
new_leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
 from {username='slave'} at 127.0.0.1:49750
I20260709 13:12:19.105495 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540e56778ef84b9799b605658e54910e" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:19.105964 30954 raft_consensus.cc:606] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 LEADER]: Received request to transfer leadership to TS cbd0857ed38947e2acd1f78e325fca7c
I20260709 13:12:19.106086 30879 raft_consensus.cc:3055] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:19.106453 30879 raft_consensus.cc:740] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Running, Role: LEADER
I20260709 13:12:19.107235 30879 consensus_queue.cc:260] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:19.108328 30879 raft_consensus.cc:3060] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:19.111670 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:19.112403 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:19.134052 31030 leader_election.cc:290] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 2 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:19.125681 30879 raft_consensus.cc:2468] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 2.
I20260709 13:12:19.135167 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540e56778ef84b9799b605658e54910e" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:19.135839 30954 raft_consensus.cc:3060] T 540e56778ef84b9799b605658e54910e P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:19.138383 30995 leader_election.cc:304] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: 
I20260709 13:12:19.138031 31355 tablet.cc:1724] T 540e56778ef84b9799b605658e54910e P ddba9ee70f214b45ad36ec0c2d4eb255: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:19.139366 31364 raft_consensus.cc:2804] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:19.139868 31364 raft_consensus.cc:697] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c [term 2 LEADER]: Becoming Leader. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:19.140687 31364 consensus_queue.cc:237] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:19.124447 31378 tablet.cc:1724] T 8a1e3b8867a34aa293e15b013a63b5a6 P ddba9ee70f214b45ad36ec0c2d4eb255: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:19.153065 30954 raft_consensus.cc:2468] T 540e56778ef84b9799b605658e54910e P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 2.
I20260709 13:12:19.170876 30780 catalog_manager.cc:5697] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c reported cstate change: term changed from 1 to 2, leader changed from 7c72385cdf944f068bab65bd12579099 (127.20.40.1) to cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3). New cstate: current_term: 2 leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:19.178525 30778 catalog_manager.cc:6242] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1: soft_deleted_table [id=b8237baa3fe945a39d9d61b735b90fcc] alter complete (version 1)
I20260709 13:12:19.209771 31374 raft_consensus.cc:993] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255: : Instructing follower cbd0857ed38947e2acd1f78e325fca7c to start an election
I20260709 13:12:19.210338 31373 raft_consensus.cc:1081] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 LEADER]: Signalling peer cbd0857ed38947e2acd1f78e325fca7c to start an election
I20260709 13:12:19.211746 31030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9e3dcc2ae5a4949b0d985002d692506"
dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
 from {username='slave'} at 127.0.0.1:38910
I20260709 13:12:19.212253 31030 raft_consensus.cc:493] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:19.212560 31030 raft_consensus.cc:3060] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.218561 31030 raft_consensus.cc:515] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:19.219277 31338 raft_consensus.cc:993] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099: : Instructing follower cbd0857ed38947e2acd1f78e325fca7c to start an election
I20260709 13:12:19.220005 31335 raft_consensus.cc:1081] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [term 2 LEADER]: Signalling peer cbd0857ed38947e2acd1f78e325fca7c to start an election
I20260709 13:12:19.221412 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3dcc2ae5a4949b0d985002d692506" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:19.222074 30879 raft_consensus.cc:3060] T d9e3dcc2ae5a4949b0d985002d692506 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.222150 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9e3dcc2ae5a4949b0d985002d692506" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:19.222842 30954 raft_consensus.cc:3055] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:19.223143 30954 raft_consensus.cc:740] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Running, Role: LEADER
I20260709 13:12:19.223834 31030 leader_election.cc:290] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 3 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:19.223904 30954 consensus_queue.cc:260] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:19.225700 30954 raft_consensus.cc:3060] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.225936 31025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba7aed4b0dc3422bba7fd99d1a805fc5"
dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
 from {username='slave'} at 127.0.0.1:38906
I20260709 13:12:19.226512 31025 raft_consensus.cc:493] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:19.226864 31025 raft_consensus.cc:3060] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.229097 30879 raft_consensus.cc:2468] T d9e3dcc2ae5a4949b0d985002d692506 P 7c72385cdf944f068bab65bd12579099 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 3.
I20260709 13:12:19.230345 30995 leader_election.cc:304] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: 
I20260709 13:12:19.231105 31364 raft_consensus.cc:2804] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:19.231580 31364 raft_consensus.cc:697] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 3 LEADER]: Becoming Leader. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:19.232364 31364 consensus_queue.cc:237] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:19.233521 30954 raft_consensus.cc:2468] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 3.
I20260709 13:12:19.234347 31025 raft_consensus.cc:515] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:19.236721 31025 leader_election.cc:290] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 3 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:19.237474 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7aed4b0dc3422bba7fd99d1a805fc5" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:19.238061 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba7aed4b0dc3422bba7fd99d1a805fc5" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:19.238101 30879 raft_consensus.cc:3055] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:19.240314 30954 raft_consensus.cc:3060] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.240336 30879 raft_consensus.cc:740] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7c72385cdf944f068bab65bd12579099, State: Running, Role: LEADER
I20260709 13:12:19.241547 30879 consensus_queue.cc:260] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:19.242622 30879 raft_consensus.cc:3060] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.243234 30778 catalog_manager.cc:5697] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c reported cstate change: term changed from 2 to 3, leader changed from ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2) to cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3). New cstate: current_term: 3 leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:19.247387 30954 raft_consensus.cc:2468] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 3.
I20260709 13:12:19.248624 30997 leader_election.cc:304] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cbd0857ed38947e2acd1f78e325fca7c, ddba9ee70f214b45ad36ec0c2d4eb255; no voters: 
I20260709 13:12:19.249146 30879 raft_consensus.cc:2468] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 3.
I20260709 13:12:19.249467 31364 raft_consensus.cc:2804] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:19.250203 31364 raft_consensus.cc:697] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 3 LEADER]: Becoming Leader. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:19.251034 31364 consensus_queue.cc:237] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:19.258874 30778 catalog_manager.cc:5697] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c reported cstate change: term changed from 2 to 3, leader changed from 7c72385cdf944f068bab65bd12579099 (127.20.40.1) to cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3). New cstate: current_term: 3 leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:19.506810 31374 raft_consensus.cc:993] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255: : Instructing follower cbd0857ed38947e2acd1f78e325fca7c to start an election
I20260709 13:12:19.507356 31373 raft_consensus.cc:1081] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 LEADER]: Signalling peer cbd0857ed38947e2acd1f78e325fca7c to start an election
I20260709 13:12:19.508884 31030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3701027be9f4b619b8b6651cacb7050"
dest_uuid: "cbd0857ed38947e2acd1f78e325fca7c"
 from {username='slave'} at 127.0.0.1:38910
I20260709 13:12:19.509387 31030 raft_consensus.cc:493] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:19.509723 31030 raft_consensus.cc:3060] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:19.514902 31030 raft_consensus.cc:515] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:19.516465 31030 leader_election.cc:290] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 2 election: Requested vote from peers 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807), ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251)
I20260709 13:12:19.517300 30879 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3701027be9f4b619b8b6651cacb7050" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "7c72385cdf944f068bab65bd12579099"
I20260709 13:12:19.517520 30954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3701027be9f4b619b8b6651cacb7050" candidate_uuid: "cbd0857ed38947e2acd1f78e325fca7c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255"
I20260709 13:12:19.517992 30879 raft_consensus.cc:3060] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:19.518056 30954 raft_consensus.cc:3055] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:19.518463 30954 raft_consensus.cc:740] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ddba9ee70f214b45ad36ec0c2d4eb255, State: Running, Role: LEADER
I20260709 13:12:19.519254 30954 consensus_queue.cc:260] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:19.520462 30954 raft_consensus.cc:3060] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:19.525332 30879 raft_consensus.cc:2468] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 2.
I20260709 13:12:19.526592 30995 leader_election.cc:304] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7c72385cdf944f068bab65bd12579099, cbd0857ed38947e2acd1f78e325fca7c; no voters: 
I20260709 13:12:19.527376 31364 raft_consensus.cc:2804] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:19.527441 30954 raft_consensus.cc:2468] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbd0857ed38947e2acd1f78e325fca7c in term 2.
I20260709 13:12:19.527915 31364 raft_consensus.cc:697] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [term 2 LEADER]: Becoming Leader. State: Replica: cbd0857ed38947e2acd1f78e325fca7c, State: Running, Role: LEADER
I20260709 13:12:19.528826 31364 consensus_queue.cc:237] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } }
I20260709 13:12:19.535429 30778 catalog_manager.cc:5697] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c reported cstate change: term changed from 1 to 2, leader changed from ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2) to cbd0857ed38947e2acd1f78e325fca7c (127.20.40.3). New cstate: current_term: 2 leader_uuid: "cbd0857ed38947e2acd1f78e325fca7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cbd0857ed38947e2acd1f78e325fca7c" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 40195 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:19.550737 30954 raft_consensus.cc:1275] T 540e56778ef84b9799b605658e54910e P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Refusing update from remote peer cbd0857ed38947e2acd1f78e325fca7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:19.551931 31364 consensus_queue.cc:1048] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:19.562135 30879 raft_consensus.cc:1275] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Refusing update from remote peer cbd0857ed38947e2acd1f78e325fca7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:19.563970 31364 consensus_queue.cc:1048] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:19.659364 30879 raft_consensus.cc:1275] T d9e3dcc2ae5a4949b0d985002d692506 P 7c72385cdf944f068bab65bd12579099 [term 3 FOLLOWER]: Refusing update from remote peer cbd0857ed38947e2acd1f78e325fca7c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:19.660666 31364 consensus_queue.cc:1048] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:19.671747 30957 raft_consensus.cc:1275] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 3 FOLLOWER]: Refusing update from remote peer cbd0857ed38947e2acd1f78e325fca7c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:19.673259 31364 consensus_queue.cc:1048] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:19.677161 30957 raft_consensus.cc:1275] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 3 FOLLOWER]: Refusing update from remote peer cbd0857ed38947e2acd1f78e325fca7c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:19.678486 31364 consensus_queue.cc:1048] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:19.688520 30879 raft_consensus.cc:1275] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [term 3 FOLLOWER]: Refusing update from remote peer cbd0857ed38947e2acd1f78e325fca7c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:19.689709 31364 consensus_queue.cc:1048] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:20.018326 30957 raft_consensus.cc:1275] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Refusing update from remote peer cbd0857ed38947e2acd1f78e325fca7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:20.019732 31386 consensus_queue.cc:1048] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ddba9ee70f214b45ad36ec0c2d4eb255" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 44251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:20.028976 30879 raft_consensus.cc:1275] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Refusing update from remote peer cbd0857ed38947e2acd1f78e325fca7c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:12:20.031149 31386 consensus_queue.cc:1048] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7c72385cdf944f068bab65bd12579099" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 33807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:20.233953 20640 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:12:20.239177 20640 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:12:20.239748 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:20.245673 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:12:20.246167 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:21.277025 20640 tablet_server.cc:179] TabletServer@127.20.40.1:0 shutting down...
W20260709 13:12:21.300225 30995 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260709 13:12:21.309242 30995 consensus_peers.cc:597] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c -> Peer 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807): Couldn't send request to peer 7c72385cdf944f068bab65bd12579099. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:21.314944 30921 consensus_peers.cc:597] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 -> Peer 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807): Couldn't send request to peer 7c72385cdf944f068bab65bd12579099. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:21.324828 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:21.326175 20640 tablet_replica.cc:333] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099: stopping tablet replica
I20260709 13:12:21.327553 20640 raft_consensus.cc:2243] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.328584 20640 raft_consensus.cc:2272] T 2c0815f868884761ae075b7ea1c40949 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:21.329178 30921 consensus_peers.cc:597] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 -> Peer 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807): Couldn't send request to peer 7c72385cdf944f068bab65bd12579099. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:21.331483 20640 tablet_replica.cc:333] T 4ef1733419404dbda28ed5e64378bfc3 P 7c72385cdf944f068bab65bd12579099: stopping tablet replica
I20260709 13:12:21.332190 20640 raft_consensus.cc:2243] T 4ef1733419404dbda28ed5e64378bfc3 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.332912 20640 raft_consensus.cc:2272] T 4ef1733419404dbda28ed5e64378bfc3 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.335439 20640 tablet_replica.cc:333] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099: stopping tablet replica
I20260709 13:12:21.336023 20640 raft_consensus.cc:2243] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.336974 20640 raft_consensus.cc:2272] T 8a1e3b8867a34aa293e15b013a63b5a6 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.340117 20640 tablet_replica.cc:333] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099: stopping tablet replica
I20260709 13:12:21.341063 20640 raft_consensus.cc:2243] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.341939 20640 raft_consensus.cc:2272] T 713e2163847f473bad6adc0396612b07 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:21.345767 30995 consensus_peers.cc:597] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c -> Peer 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807): Couldn't send request to peer 7c72385cdf944f068bab65bd12579099. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:21.346171 20640 tablet_replica.cc:333] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099: stopping tablet replica
I20260709 13:12:21.346978 20640 raft_consensus.cc:2243] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.348119 20640 raft_consensus.cc:2272] T 050a45fee82743a4a08c51b4602fa3c6 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.350937 20640 tablet_replica.cc:333] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099: stopping tablet replica
I20260709 13:12:21.351794 20640 raft_consensus.cc:2243] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.352653 20640 raft_consensus.cc:2272] T 540e56778ef84b9799b605658e54910e P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.356048 20640 tablet_replica.cc:333] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099: stopping tablet replica
I20260709 13:12:21.356618 20640 raft_consensus.cc:2243] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.357237 20640 raft_consensus.cc:2272] T ba7aed4b0dc3422bba7fd99d1a805fc5 P 7c72385cdf944f068bab65bd12579099 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.359905 20640 tablet_replica.cc:333] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099: stopping tablet replica
I20260709 13:12:21.360790 20640 raft_consensus.cc:2243] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.361855 20640 raft_consensus.cc:2272] T 42cc54decf47430192c8725dcc83568c P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.364538 20640 tablet_replica.cc:333] T fb85cafe2b0641ce9a197ecde2048b6c P 7c72385cdf944f068bab65bd12579099: stopping tablet replica
I20260709 13:12:21.365401 20640 raft_consensus.cc:2243] T fb85cafe2b0641ce9a197ecde2048b6c P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.365981 20640 raft_consensus.cc:2272] T fb85cafe2b0641ce9a197ecde2048b6c P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.368901 20640 tablet_replica.cc:333] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099: stopping tablet replica
I20260709 13:12:21.369585 20640 raft_consensus.cc:2243] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.370281 20640 raft_consensus.cc:2272] T d3701027be9f4b619b8b6651cacb7050 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.373621 20640 tablet_replica.cc:333] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099: stopping tablet replica
I20260709 13:12:21.374221 20640 raft_consensus.cc:2243] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.374989 20640 raft_consensus.cc:2272] T 5305bc82efbf44a39baf9d11d4a955c5 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.377504 20640 tablet_replica.cc:333] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099: stopping tablet replica
I20260709 13:12:21.378153 20640 raft_consensus.cc:2243] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.378680 20640 raft_consensus.cc:2272] T 5d9859be47a646d28950376449d3bdab P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.381386 20640 tablet_replica.cc:333] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099: stopping tablet replica
I20260709 13:12:21.381932 20640 raft_consensus.cc:2243] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.383190 20640 raft_consensus.cc:2272] T 55736c0a193e4580936d3d55b3ecca68 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:21.386467 30995 consensus_peers.cc:597] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c -> Peer 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807): Couldn't send request to peer 7c72385cdf944f068bab65bd12579099. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:21.386762 20640 tablet_replica.cc:333] T d9e3dcc2ae5a4949b0d985002d692506 P 7c72385cdf944f068bab65bd12579099: stopping tablet replica
I20260709 13:12:21.387463 20640 raft_consensus.cc:2243] T d9e3dcc2ae5a4949b0d985002d692506 P 7c72385cdf944f068bab65bd12579099 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.387961 20640 raft_consensus.cc:2272] T d9e3dcc2ae5a4949b0d985002d692506 P 7c72385cdf944f068bab65bd12579099 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.390331 20640 tablet_replica.cc:333] T 8250ad52ada442dfbc123f7d34b71fac P 7c72385cdf944f068bab65bd12579099: stopping tablet replica
I20260709 13:12:21.390905 20640 raft_consensus.cc:2243] T 8250ad52ada442dfbc123f7d34b71fac P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.391422 20640 raft_consensus.cc:2272] T 8250ad52ada442dfbc123f7d34b71fac P 7c72385cdf944f068bab65bd12579099 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.393790 20640 tablet_replica.cc:333] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099: stopping tablet replica
I20260709 13:12:21.394282 20640 raft_consensus.cc:2243] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.395155 20640 raft_consensus.cc:2272] T 7b7474304b754eec9588b2d66b213c90 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.397611 20640 tablet_replica.cc:333] T 7bdce6875f9d4a59bb421b943fc196b6 P 7c72385cdf944f068bab65bd12579099: stopping tablet replica
I20260709 13:12:21.398223 20640 raft_consensus.cc:2243] T 7bdce6875f9d4a59bb421b943fc196b6 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.398695 20640 raft_consensus.cc:2272] T 7bdce6875f9d4a59bb421b943fc196b6 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.400856 20640 tablet_replica.cc:333] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099: stopping tablet replica
I20260709 13:12:21.401335 20640 raft_consensus.cc:2243] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.402206 20640 raft_consensus.cc:2272] T 81000064a6c74c8c971678afdd7314e1 P 7c72385cdf944f068bab65bd12579099 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:21.417179 30921 consensus_peers.cc:597] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 -> Peer 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807): Couldn't send request to peer 7c72385cdf944f068bab65bd12579099. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:21.471498 30921 consensus_peers.cc:597] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 -> Peer 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807): Couldn't send request to peer 7c72385cdf944f068bab65bd12579099. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:33807: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:21.480350 30995 consensus_peers.cc:597] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c -> Peer 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807): Couldn't send request to peer 7c72385cdf944f068bab65bd12579099. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:33807: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:21.482342 20640 tablet_server.cc:196] TabletServer@127.20.40.1:0 shutdown complete.
W20260709 13:12:21.532078 30995 consensus_peers.cc:597] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c -> Peer 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807): Couldn't send request to peer 7c72385cdf944f068bab65bd12579099. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:33807: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:21.532342 20640 tablet_server.cc:179] TabletServer@127.20.40.2:0 shutting down...
W20260709 13:12:21.567698 30921 consensus_peers.cc:597] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 -> Peer 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807): Couldn't send request to peer 7c72385cdf944f068bab65bd12579099. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:33807: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:21.570778 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:21.571592 20640 tablet_replica.cc:333] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255: stopping tablet replica
I20260709 13:12:21.572366 20640 raft_consensus.cc:2243] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.573228 20640 raft_consensus.cc:2272] T 2c0815f868884761ae075b7ea1c40949 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.575543 20640 tablet_replica.cc:333] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255: stopping tablet replica
I20260709 13:12:21.576145 20640 raft_consensus.cc:2243] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.576988 20640 raft_consensus.cc:2272] T 4ef1733419404dbda28ed5e64378bfc3 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.579464 20640 tablet_replica.cc:333] T 8a1e3b8867a34aa293e15b013a63b5a6 P ddba9ee70f214b45ad36ec0c2d4eb255: stopping tablet replica
I20260709 13:12:21.580102 20640 raft_consensus.cc:2243] T 8a1e3b8867a34aa293e15b013a63b5a6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.580678 20640 raft_consensus.cc:2272] T 8a1e3b8867a34aa293e15b013a63b5a6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.582831 20640 tablet_replica.cc:333] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255: stopping tablet replica
I20260709 13:12:21.583364 20640 raft_consensus.cc:2243] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.583849 20640 raft_consensus.cc:2272] T 713e2163847f473bad6adc0396612b07 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.586170 20640 tablet_replica.cc:333] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255: stopping tablet replica
I20260709 13:12:21.586812 20640 raft_consensus.cc:2243] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.587291 20640 raft_consensus.cc:2272] T 050a45fee82743a4a08c51b4602fa3c6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.589414 20640 tablet_replica.cc:333] T 540e56778ef84b9799b605658e54910e P ddba9ee70f214b45ad36ec0c2d4eb255: stopping tablet replica
I20260709 13:12:21.589954 20640 raft_consensus.cc:2243] T 540e56778ef84b9799b605658e54910e P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.590521 20640 raft_consensus.cc:2272] T 540e56778ef84b9799b605658e54910e P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.592765 20640 tablet_replica.cc:333] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255: stopping tablet replica
I20260709 13:12:21.593268 20640 raft_consensus.cc:2243] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.593720 20640 raft_consensus.cc:2272] T d3701027be9f4b619b8b6651cacb7050 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.595746 20640 tablet_replica.cc:333] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255: stopping tablet replica
I20260709 13:12:21.596203 20640 raft_consensus.cc:2243] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.596977 20640 raft_consensus.cc:2272] T 5305bc82efbf44a39baf9d11d4a955c5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.599221 20640 tablet_replica.cc:333] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255: stopping tablet replica
I20260709 13:12:21.599702 20640 raft_consensus.cc:2243] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.600499 20640 raft_consensus.cc:2272] T 5d9859be47a646d28950376449d3bdab P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.602624 20640 tablet_replica.cc:333] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255: stopping tablet replica
I20260709 13:12:21.603129 20640 raft_consensus.cc:2243] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.603967 20640 raft_consensus.cc:2272] T fb85cafe2b0641ce9a197ecde2048b6c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.606662 20640 tablet_replica.cc:333] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255: stopping tablet replica
I20260709 13:12:21.607226 20640 raft_consensus.cc:2243] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.607931 20640 raft_consensus.cc:2272] T 7b7474304b754eec9588b2d66b213c90 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:21.609544 30997 consensus_peers.cc:597] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c -> Peer ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251): Couldn't send request to peer ddba9ee70f214b45ad36ec0c2d4eb255. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:21.610841 20640 tablet_replica.cc:333] T 8250ad52ada442dfbc123f7d34b71fac P ddba9ee70f214b45ad36ec0c2d4eb255: stopping tablet replica
I20260709 13:12:21.611451 20640 raft_consensus.cc:2243] T 8250ad52ada442dfbc123f7d34b71fac P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.611900 20640 raft_consensus.cc:2272] T 8250ad52ada442dfbc123f7d34b71fac P ddba9ee70f214b45ad36ec0c2d4eb255 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.614058 20640 tablet_replica.cc:333] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255: stopping tablet replica
I20260709 13:12:21.614620 20640 raft_consensus.cc:2243] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.615021 20640 raft_consensus.cc:2272] T 55736c0a193e4580936d3d55b3ecca68 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.617203 20640 tablet_replica.cc:333] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255: stopping tablet replica
I20260709 13:12:21.617800 20640 raft_consensus.cc:2243] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.618235 20640 raft_consensus.cc:2272] T d9e3dcc2ae5a4949b0d985002d692506 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.620407 20640 tablet_replica.cc:333] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255: stopping tablet replica
I20260709 13:12:21.620913 20640 raft_consensus.cc:2243] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.621743 20640 raft_consensus.cc:2272] T 7bdce6875f9d4a59bb421b943fc196b6 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.623955 20640 tablet_replica.cc:333] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255: stopping tablet replica
I20260709 13:12:21.624398 20640 raft_consensus.cc:2243] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.624763 20640 raft_consensus.cc:2272] T 81000064a6c74c8c971678afdd7314e1 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.626920 20640 tablet_replica.cc:333] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255: stopping tablet replica
I20260709 13:12:21.627470 20640 raft_consensus.cc:2243] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.627947 20640 raft_consensus.cc:2272] T 42cc54decf47430192c8725dcc83568c P ddba9ee70f214b45ad36ec0c2d4eb255 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.630050 20640 tablet_replica.cc:333] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255: stopping tablet replica
I20260709 13:12:21.630471 20640 raft_consensus.cc:2243] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.630882 20640 raft_consensus.cc:2272] T ba7aed4b0dc3422bba7fd99d1a805fc5 P ddba9ee70f214b45ad36ec0c2d4eb255 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:21.659299 30995 consensus_peers.cc:597] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c -> Peer 7c72385cdf944f068bab65bd12579099 (127.20.40.1:33807): Couldn't send request to peer 7c72385cdf944f068bab65bd12579099. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:33807: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:21.674852 20640 tablet_server.cc:196] TabletServer@127.20.40.2:0 shutdown complete.
I20260709 13:12:21.715535 20640 tablet_server.cc:179] TabletServer@127.20.40.3:0 shutting down...
W20260709 13:12:21.732069 30997 consensus_peers.cc:597] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c -> Peer ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251): Couldn't send request to peer ddba9ee70f214b45ad36ec0c2d4eb255. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:44251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:21.746702 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:21.747781 20640 tablet_replica.cc:333] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c: stopping tablet replica
I20260709 13:12:21.749080 20640 raft_consensus.cc:2243] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.749902 20640 raft_consensus.cc:2272] T 2c0815f868884761ae075b7ea1c40949 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.753515 20640 tablet_replica.cc:333] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c: stopping tablet replica
I20260709 13:12:21.754542 20640 raft_consensus.cc:2243] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:21.754762 30997 consensus_peers.cc:597] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c -> Peer ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251): Couldn't send request to peer ddba9ee70f214b45ad36ec0c2d4eb255. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:44251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:21.755435 20640 raft_consensus.cc:2272] T 8a1e3b8867a34aa293e15b013a63b5a6 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.758045 20640 tablet_replica.cc:333] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c: stopping tablet replica
I20260709 13:12:21.758807 20640 raft_consensus.cc:2243] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.759483 20640 raft_consensus.cc:2272] T 4ef1733419404dbda28ed5e64378bfc3 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:21.761559 30997 consensus_peers.cc:597] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c -> Peer ddba9ee70f214b45ad36ec0c2d4eb255 (127.20.40.2:44251): Couldn't send request to peer ddba9ee70f214b45ad36ec0c2d4eb255. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:44251: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:21.762187 20640 tablet_replica.cc:333] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c: stopping tablet replica
I20260709 13:12:21.762816 20640 raft_consensus.cc:2243] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.763684 20640 raft_consensus.cc:2272] T ba7aed4b0dc3422bba7fd99d1a805fc5 P cbd0857ed38947e2acd1f78e325fca7c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.765959 20640 tablet_replica.cc:333] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c: stopping tablet replica
I20260709 13:12:21.766553 20640 raft_consensus.cc:2243] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.767068 20640 raft_consensus.cc:2272] T 42cc54decf47430192c8725dcc83568c P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.769726 20640 tablet_replica.cc:333] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c: stopping tablet replica
I20260709 13:12:21.770571 20640 raft_consensus.cc:2243] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.771482 20640 raft_consensus.cc:2272] T 713e2163847f473bad6adc0396612b07 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.774173 20640 tablet_replica.cc:333] T 050a45fee82743a4a08c51b4602fa3c6 P cbd0857ed38947e2acd1f78e325fca7c: stopping tablet replica
I20260709 13:12:21.774767 20640 raft_consensus.cc:2243] T 050a45fee82743a4a08c51b4602fa3c6 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.775306 20640 raft_consensus.cc:2272] T 050a45fee82743a4a08c51b4602fa3c6 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.777748 20640 tablet_replica.cc:333] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c: stopping tablet replica
I20260709 13:12:21.778307 20640 raft_consensus.cc:2243] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.779227 20640 raft_consensus.cc:2272] T 540e56778ef84b9799b605658e54910e P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.781711 20640 tablet_replica.cc:333] T fb85cafe2b0641ce9a197ecde2048b6c P cbd0857ed38947e2acd1f78e325fca7c: stopping tablet replica
I20260709 13:12:21.782307 20640 raft_consensus.cc:2243] T fb85cafe2b0641ce9a197ecde2048b6c P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.782812 20640 raft_consensus.cc:2272] T fb85cafe2b0641ce9a197ecde2048b6c P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.785112 20640 tablet_replica.cc:333] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c: stopping tablet replica
I20260709 13:12:21.785816 20640 raft_consensus.cc:2243] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.786806 20640 raft_consensus.cc:2272] T 8250ad52ada442dfbc123f7d34b71fac P cbd0857ed38947e2acd1f78e325fca7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.789325 20640 tablet_replica.cc:333] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c: stopping tablet replica
I20260709 13:12:21.790199 20640 raft_consensus.cc:2243] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.791021 20640 raft_consensus.cc:2272] T 7b7474304b754eec9588b2d66b213c90 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.794291 20640 tablet_replica.cc:333] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c: stopping tablet replica
I20260709 13:12:21.795043 20640 raft_consensus.cc:2243] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.795753 20640 raft_consensus.cc:2272] T d3701027be9f4b619b8b6651cacb7050 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.797884 20640 tablet_replica.cc:333] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c: stopping tablet replica
I20260709 13:12:21.798345 20640 raft_consensus.cc:2243] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.798774 20640 raft_consensus.cc:2272] T 5305bc82efbf44a39baf9d11d4a955c5 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.800607 20640 tablet_replica.cc:333] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c: stopping tablet replica
I20260709 13:12:21.801082 20640 raft_consensus.cc:2243] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.801553 20640 raft_consensus.cc:2272] T 5d9859be47a646d28950376449d3bdab P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.803418 20640 tablet_replica.cc:333] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c: stopping tablet replica
I20260709 13:12:21.803869 20640 raft_consensus.cc:2243] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.804270 20640 raft_consensus.cc:2272] T 81000064a6c74c8c971678afdd7314e1 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.806216 20640 tablet_replica.cc:333] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c: stopping tablet replica
I20260709 13:12:21.806653 20640 raft_consensus.cc:2243] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.807065 20640 raft_consensus.cc:2272] T 7bdce6875f9d4a59bb421b943fc196b6 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.809080 20640 tablet_replica.cc:333] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c: stopping tablet replica
I20260709 13:12:21.809594 20640 raft_consensus.cc:2243] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:21.809983 20640 raft_consensus.cc:2272] T 55736c0a193e4580936d3d55b3ecca68 P cbd0857ed38947e2acd1f78e325fca7c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.811776 20640 tablet_replica.cc:333] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c: stopping tablet replica
I20260709 13:12:21.812284 20640 raft_consensus.cc:2243] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.813086 20640 raft_consensus.cc:2272] T d9e3dcc2ae5a4949b0d985002d692506 P cbd0857ed38947e2acd1f78e325fca7c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.875547 20640 tablet_server.cc:196] TabletServer@127.20.40.3:0 shutdown complete.
I20260709 13:12:21.914969 20640 master.cc:562] Master@127.20.40.62:37657 shutting down...
I20260709 13:12:21.937652 20640 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:21.938287 20640 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:21.938699 20640 tablet_replica.cc:333] T 00000000000000000000000000000000 P a6cebc92fc684d0790a51f81ea43a1d1: stopping tablet replica
I20260709 13:12:21.960577 20640 master.cc:584] Master@127.20.40.62:37657 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (15409 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:12:22.018636 20640 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.20.40.62:36779
I20260709 13:12:22.019764 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:22.026528 31407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:22.027171 31409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:22.027385 31406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:22.029158 20640 server_base.cc:1061] running on GCE node
I20260709 13:12:22.030193 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:22.030421 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:22.030606 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602742030590 us; error 0 us; skew 500 ppm
I20260709 13:12:22.031183 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:22.033825 20640 webserver.cc:533] Webserver started at http://127.20.40.62:35539/ using document root <none> and password file <none>
I20260709 13:12:22.034338 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:22.034523 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:22.034818 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:22.035986 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602420111825-20640-0/minicluster-data/master-0-root/instance:
uuid: "4325adad463344be884ebe2c38e74a1a"
format_stamp: "Formatted at 2026-07-09 13:12:22 on dist-test-slave-rnv4"
I20260709 13:12:22.040519 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:12:22.044068 31414 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:22.045027 20640 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:22.045348 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602420111825-20640-0/minicluster-data/master-0-root
uuid: "4325adad463344be884ebe2c38e74a1a"
format_stamp: "Formatted at 2026-07-09 13:12:22 on dist-test-slave-rnv4"
I20260709 13:12:22.045661 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602420111825-20640-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602420111825-20640-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602420111825-20640-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:22.079823 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:22.081096 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:22.122700 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.62:36779
I20260709 13:12:22.122891 31465 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.62:36779 every 8 connection(s)
I20260709 13:12:22.126844 31466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.139341 31466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a: Bootstrap starting.
I20260709 13:12:22.144853 31466 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.149834 31466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a: No bootstrap required, opened a new log
I20260709 13:12:22.152136 31466 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4325adad463344be884ebe2c38e74a1a" member_type: VOTER }
I20260709 13:12:22.152573 31466 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.152760 31466 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4325adad463344be884ebe2c38e74a1a, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.153548 31466 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4325adad463344be884ebe2c38e74a1a" member_type: VOTER }
I20260709 13:12:22.154007 31466 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:22.154243 31466 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:22.154521 31466 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:22.159283 31466 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4325adad463344be884ebe2c38e74a1a" member_type: VOTER }
I20260709 13:12:22.159786 31466 leader_election.cc:304] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4325adad463344be884ebe2c38e74a1a; no voters: 
I20260709 13:12:22.160991 31466 leader_election.cc:290] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:22.161664 31469 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:22.163102 31469 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a [term 1 LEADER]: Becoming Leader. State: Replica: 4325adad463344be884ebe2c38e74a1a, State: Running, Role: LEADER
I20260709 13:12:22.163832 31469 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4325adad463344be884ebe2c38e74a1a" member_type: VOTER }
I20260709 13:12:22.164188 31466 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:22.168603 31471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4325adad463344be884ebe2c38e74a1a. Latest consensus state: current_term: 1 leader_uuid: "4325adad463344be884ebe2c38e74a1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4325adad463344be884ebe2c38e74a1a" member_type: VOTER } }
I20260709 13:12:22.169126 31470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4325adad463344be884ebe2c38e74a1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4325adad463344be884ebe2c38e74a1a" member_type: VOTER } }
I20260709 13:12:22.169548 31471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:22.170132 31470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:22.173303 31476 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:22.178566 31476 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:22.181473 20640 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:22.187783 31476 catalog_manager.cc:1383] Generated new cluster ID: f00c24aa1ad14ffba6c42e6920f56810
I20260709 13:12:22.188079 31476 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:22.209020 31476 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:22.210521 31476 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:22.223874 31476 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a: Generated new TSK 0
I20260709 13:12:22.224455 31476 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:22.248697 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:22.254905 31487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:22.255847 31488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:22.258687 31490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:22.259892 20640 server_base.cc:1061] running on GCE node
I20260709 13:12:22.260852 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:22.261059 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:22.261240 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602742261220 us; error 0 us; skew 500 ppm
I20260709 13:12:22.261832 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:22.264321 20640 webserver.cc:533] Webserver started at http://127.20.40.1:37373/ using document root <none> and password file <none>
I20260709 13:12:22.264813 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:22.265002 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:22.265287 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:22.266451 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602420111825-20640-0/minicluster-data/ts-0-root/instance:
uuid: "5ccb0482a31a436882a89f5dfdede1c0"
format_stamp: "Formatted at 2026-07-09 13:12:22 on dist-test-slave-rnv4"
I20260709 13:12:22.270727 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:22.274436 31495 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:22.275166 20640 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:12:22.275484 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602420111825-20640-0/minicluster-data/ts-0-root
uuid: "5ccb0482a31a436882a89f5dfdede1c0"
format_stamp: "Formatted at 2026-07-09 13:12:22 on dist-test-slave-rnv4"
I20260709 13:12:22.275815 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602420111825-20640-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602420111825-20640-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602420111825-20640-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:22.289836 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:22.291081 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:22.292584 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:22.294893 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:22.295120 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:22.295368 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:22.295568 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:22.338578 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.1:38671
I20260709 13:12:22.338685 31557 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.1:38671 every 8 connection(s)
I20260709 13:12:22.343645 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:22.351672 31562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:22.353713 31563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:22.357684 31565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:22.357726 20640 server_base.cc:1061] running on GCE node
I20260709 13:12:22.359098 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:22.359288 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:22.359480 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602742359466 us; error 0 us; skew 500 ppm
I20260709 13:12:22.360062 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:22.363319 20640 webserver.cc:533] Webserver started at http://127.20.40.2:41999/ using document root <none> and password file <none>
I20260709 13:12:22.364002 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:22.364264 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:22.364451 31558 heartbeater.cc:344] Connected to a master server at 127.20.40.62:36779
I20260709 13:12:22.364609 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:22.364913 31558 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:22.365715 31558 heartbeater.cc:507] Master 127.20.40.62:36779 requested a full tablet report, sending...
I20260709 13:12:22.366318 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602420111825-20640-0/minicluster-data/ts-1-root/instance:
uuid: "dd26c2c466ca41709432959be327b651"
format_stamp: "Formatted at 2026-07-09 13:12:22 on dist-test-slave-rnv4"
I20260709 13:12:22.367926 31431 ts_manager.cc:194] Registered new tserver with Master: 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671)
I20260709 13:12:22.369864 31431 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40156
I20260709 13:12:22.372561 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:22.376513 31570 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:22.377525 20640 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:12:22.377867 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602420111825-20640-0/minicluster-data/ts-1-root
uuid: "dd26c2c466ca41709432959be327b651"
format_stamp: "Formatted at 2026-07-09 13:12:22 on dist-test-slave-rnv4"
I20260709 13:12:22.378111 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602420111825-20640-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602420111825-20640-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602420111825-20640-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:22.401953 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:22.403158 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:22.404639 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:22.406976 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:22.407166 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:22.407450 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:22.407603 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:22.449102 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.2:42179
I20260709 13:12:22.449273 31632 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.2:42179 every 8 connection(s)
I20260709 13:12:22.454403 20640 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:22.461465 31636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:22.461861 31637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:22.464318 20640 server_base.cc:1061] running on GCE node
W20260709 13:12:22.464524 31639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:22.465863 20640 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:22.466109 20640 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:22.466312 20640 hybrid_clock.cc:648] HybridClock initialized: now 1783602742466294 us; error 0 us; skew 500 ppm
I20260709 13:12:22.467121 20640 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:22.469039 31633 heartbeater.cc:344] Connected to a master server at 127.20.40.62:36779
I20260709 13:12:22.469506 31633 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:22.470530 31633 heartbeater.cc:507] Master 127.20.40.62:36779 requested a full tablet report, sending...
I20260709 13:12:22.470752 20640 webserver.cc:533] Webserver started at http://127.20.40.3:39229/ using document root <none> and password file <none>
I20260709 13:12:22.471618 20640 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:22.471853 20640 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:22.472172 20640 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:22.473783 31431 ts_manager.cc:194] Registered new tserver with Master: dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:22.473820 20640 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602420111825-20640-0/minicluster-data/ts-2-root/instance:
uuid: "b04ac890eb2f4a18b089b0c95bea102f"
format_stamp: "Formatted at 2026-07-09 13:12:22 on dist-test-slave-rnv4"
I20260709 13:12:22.476282 31431 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40172
I20260709 13:12:22.480824 20640 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:22.485638 31644 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:22.486367 20640 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:12:22.486685 20640 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602420111825-20640-0/minicluster-data/ts-2-root
uuid: "b04ac890eb2f4a18b089b0c95bea102f"
format_stamp: "Formatted at 2026-07-09 13:12:22 on dist-test-slave-rnv4"
I20260709 13:12:22.486990 20640 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602420111825-20640-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602420111825-20640-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-tasks6ZD3b/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602420111825-20640-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:22.500021 20640 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:22.501271 20640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:22.502838 20640 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:22.505043 20640 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:22.505282 20640 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:22.505570 20640 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:22.505743 20640 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:22.549144 20640 rpc_server.cc:307] RPC server started. Bound to: 127.20.40.3:38141
I20260709 13:12:22.549257 31706 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.40.3:38141 every 8 connection(s)
I20260709 13:12:22.565323 31707 heartbeater.cc:344] Connected to a master server at 127.20.40.62:36779
I20260709 13:12:22.565961 31707 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:22.566723 31707 heartbeater.cc:507] Master 127.20.40.62:36779 requested a full tablet report, sending...
I20260709 13:12:22.568759 31431 ts_manager.cc:194] Registered new tserver with Master: b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:22.569643 20640 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016087965s
I20260709 13:12:22.570186 31431 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56816
I20260709 13:12:22.597325 31431 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56826:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:22.600163 31431 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:22.683833 31672 tablet_service.cc:1511] Processing CreateTablet for tablet ef63c5c5316a4a1c9f54713562e4b71e (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:22.685452 31672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef63c5c5316a4a1c9f54713562e4b71e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.696241 31522 tablet_service.cc:1511] Processing CreateTablet for tablet ef54fe01a48d40cd8b942819d7863910 (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:22.697854 31522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef54fe01a48d40cd8b942819d7863910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.697504 31523 tablet_service.cc:1511] Processing CreateTablet for tablet ef63c5c5316a4a1c9f54713562e4b71e (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:22.698922 31523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef63c5c5316a4a1c9f54713562e4b71e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.699187 31671 tablet_service.cc:1511] Processing CreateTablet for tablet ef54fe01a48d40cd8b942819d7863910 (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:22.700978 31671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef54fe01a48d40cd8b942819d7863910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.701627 31521 tablet_service.cc:1511] Processing CreateTablet for tablet 95ec93efe22a49fda085f38c3632f8b4 (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:22.704937 31520 tablet_service.cc:1511] Processing CreateTablet for tablet 187fcfffc98a4ca79b719dcba8324de9 (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:22.706995 31520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 187fcfffc98a4ca79b719dcba8324de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.709924 31519 tablet_service.cc:1511] Processing CreateTablet for tablet 0874b76c790a41728e6c7390ab1304e8 (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:22.712002 31519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0874b76c790a41728e6c7390ab1304e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.715765 31518 tablet_service.cc:1511] Processing CreateTablet for tablet 0b03969d68bf4888b6f9954bf28d1793 (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:22.719805 31598 tablet_service.cc:1511] Processing CreateTablet for tablet ef63c5c5316a4a1c9f54713562e4b71e (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:22.723820 31597 tablet_service.cc:1511] Processing CreateTablet for tablet ef54fe01a48d40cd8b942819d7863910 (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:22.725922 31521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ec93efe22a49fda085f38c3632f8b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.728834 31598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef63c5c5316a4a1c9f54713562e4b71e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.730604 31670 tablet_service.cc:1511] Processing CreateTablet for tablet 95ec93efe22a49fda085f38c3632f8b4 (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:22.732008 31670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ec93efe22a49fda085f38c3632f8b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.735239 31517 tablet_service.cc:1511] Processing CreateTablet for tablet 05e5097f777c4d17b18e5e6db1a9b949 (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:22.736832 31517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e5097f777c4d17b18e5e6db1a9b949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.737843 31597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef54fe01a48d40cd8b942819d7863910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.743186 31669 tablet_service.cc:1511] Processing CreateTablet for tablet 187fcfffc98a4ca79b719dcba8324de9 (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:22.744685 31669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 187fcfffc98a4ca79b719dcba8324de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.744952 31515 tablet_service.cc:1511] Processing CreateTablet for tablet 5b6e6d1a6cff4e95b4dfa61751e9632a (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:22.745798 31518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b03969d68bf4888b6f9954bf28d1793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.746590 31515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b6e6d1a6cff4e95b4dfa61751e9632a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.743257 31516 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac2c40173f24fa4b92159ef54a084ae (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:22.748955 31516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac2c40173f24fa4b92159ef54a084ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.759557 31596 tablet_service.cc:1511] Processing CreateTablet for tablet 95ec93efe22a49fda085f38c3632f8b4 (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:22.761091 31596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95ec93efe22a49fda085f38c3632f8b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.763744 31594 tablet_service.cc:1511] Processing CreateTablet for tablet 0874b76c790a41728e6c7390ab1304e8 (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:22.764317 31668 tablet_service.cc:1511] Processing CreateTablet for tablet 0874b76c790a41728e6c7390ab1304e8 (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:22.765736 31668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0874b76c790a41728e6c7390ab1304e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.766603 31593 tablet_service.cc:1511] Processing CreateTablet for tablet 0b03969d68bf4888b6f9954bf28d1793 (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:22.767979 31595 tablet_service.cc:1511] Processing CreateTablet for tablet 187fcfffc98a4ca79b719dcba8324de9 (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:22.765254 31594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0874b76c790a41728e6c7390ab1304e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.769891 31593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b03969d68bf4888b6f9954bf28d1793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.770579 31595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 187fcfffc98a4ca79b719dcba8324de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.783731 31592 tablet_service.cc:1511] Processing CreateTablet for tablet 05e5097f777c4d17b18e5e6db1a9b949 (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:22.785800 31590 tablet_service.cc:1511] Processing CreateTablet for tablet 5b6e6d1a6cff4e95b4dfa61751e9632a (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:22.786666 31591 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac2c40173f24fa4b92159ef54a084ae (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:22.788153 31666 tablet_service.cc:1511] Processing CreateTablet for tablet 05e5097f777c4d17b18e5e6db1a9b949 (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:22.789036 31667 tablet_service.cc:1511] Processing CreateTablet for tablet 0b03969d68bf4888b6f9954bf28d1793 (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:22.790154 31666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e5097f777c4d17b18e5e6db1a9b949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.785311 31592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05e5097f777c4d17b18e5e6db1a9b949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.790999 31590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b6e6d1a6cff4e95b4dfa61751e9632a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.793872 31667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b03969d68bf4888b6f9954bf28d1793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.795190 31591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac2c40173f24fa4b92159ef54a084ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.814853 31665 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac2c40173f24fa4b92159ef54a084ae (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:22.816998 31665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac2c40173f24fa4b92159ef54a084ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.822760 31664 tablet_service.cc:1511] Processing CreateTablet for tablet 5b6e6d1a6cff4e95b4dfa61751e9632a (DEFAULT_TABLE table=test-workload [id=6d2345feb52847e3993a882ca4301bad]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:22.824838 31664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b6e6d1a6cff4e95b4dfa61751e9632a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:22.915405 31722 tablet_bootstrap.cc:492] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0: Bootstrap starting.
I20260709 13:12:22.925649 31724 tablet_bootstrap.cc:492] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f: Bootstrap starting.
I20260709 13:12:22.932817 31724 tablet_bootstrap.cc:654] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.943312 31723 tablet_bootstrap.cc:492] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651: Bootstrap starting.
I20260709 13:12:22.944178 31722 tablet_bootstrap.cc:654] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.955997 31723 tablet_bootstrap.cc:654] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.959715 31724 tablet_bootstrap.cc:492] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f: No bootstrap required, opened a new log
I20260709 13:12:22.960410 31724 ts_tablet_manager.cc:1403] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.000s
I20260709 13:12:22.963155 31723 tablet_bootstrap.cc:492] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651: No bootstrap required, opened a new log
I20260709 13:12:22.963724 31723 ts_tablet_manager.cc:1403] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 13:12:22.963551 31724 raft_consensus.cc:359] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:22.964354 31724 raft_consensus.cc:385] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.964645 31724 raft_consensus.cc:740] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.964761 31722 tablet_bootstrap.cc:492] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0: No bootstrap required, opened a new log
I20260709 13:12:22.966454 31722 ts_tablet_manager.cc:1403] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.019s
I20260709 13:12:22.967352 31723 raft_consensus.cc:359] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:22.968103 31723 raft_consensus.cc:385] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.968407 31723 raft_consensus.cc:740] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd26c2c466ca41709432959be327b651, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.965493 31724 consensus_queue.cc:260] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:22.969144 31723 consensus_queue.cc:260] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:22.969411 31722 raft_consensus.cc:359] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:22.971100 31722 raft_consensus.cc:385] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.971335 31707 heartbeater.cc:499] Master 127.20.40.62:36779 was elected leader, sending a full tablet report...
I20260709 13:12:22.972123 31723 ts_tablet_manager.cc:1434] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:22.972604 31724 ts_tablet_manager.cc:1434] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:12:22.973253 31723 tablet_bootstrap.cc:492] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651: Bootstrap starting.
I20260709 13:12:22.973665 31724 tablet_bootstrap.cc:492] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f: Bootstrap starting.
I20260709 13:12:22.975400 31633 heartbeater.cc:499] Master 127.20.40.62:36779 was elected leader, sending a full tablet report...
I20260709 13:12:22.971402 31722 raft_consensus.cc:740] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.980445 31724 tablet_bootstrap.cc:654] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.981745 31723 tablet_bootstrap.cc:654] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:22.981793 31722 consensus_queue.cc:260] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:22.988248 31724 tablet_bootstrap.cc:492] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f: No bootstrap required, opened a new log
I20260709 13:12:22.989032 31724 ts_tablet_manager.cc:1403] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:12:22.994920 31724 raft_consensus.cc:359] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } }
I20260709 13:12:22.995934 31724 raft_consensus.cc:385] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:22.996309 31724 raft_consensus.cc:740] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Initialized, Role: FOLLOWER
I20260709 13:12:22.997498 31724 consensus_queue.cc:260] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } }
I20260709 13:12:23.000840 31724 ts_tablet_manager.cc:1434] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 13:12:23.002205 31724 tablet_bootstrap.cc:492] T 0874b76c790a41728e6c7390ab1304e8 P b04ac890eb2f4a18b089b0c95bea102f: Bootstrap starting.
I20260709 13:12:23.011217 31724 tablet_bootstrap.cc:654] T 0874b76c790a41728e6c7390ab1304e8 P b04ac890eb2f4a18b089b0c95bea102f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.024842 31724 tablet_bootstrap.cc:492] T 0874b76c790a41728e6c7390ab1304e8 P b04ac890eb2f4a18b089b0c95bea102f: No bootstrap required, opened a new log
I20260709 13:12:23.025707 31724 ts_tablet_manager.cc:1403] T 0874b76c790a41728e6c7390ab1304e8 P b04ac890eb2f4a18b089b0c95bea102f: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.004s
I20260709 13:12:23.029994 31724 raft_consensus.cc:359] T 0874b76c790a41728e6c7390ab1304e8 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.031061 31724 raft_consensus.cc:385] T 0874b76c790a41728e6c7390ab1304e8 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.031425 31724 raft_consensus.cc:740] T 0874b76c790a41728e6c7390ab1304e8 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.032730 31724 consensus_queue.cc:260] T 0874b76c790a41728e6c7390ab1304e8 P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.036267 31724 ts_tablet_manager.cc:1434] T 0874b76c790a41728e6c7390ab1304e8 P b04ac890eb2f4a18b089b0c95bea102f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:12:23.037781 31724 tablet_bootstrap.cc:492] T 187fcfffc98a4ca79b719dcba8324de9 P b04ac890eb2f4a18b089b0c95bea102f: Bootstrap starting.
I20260709 13:12:23.039526 31558 heartbeater.cc:499] Master 127.20.40.62:36779 was elected leader, sending a full tablet report...
I20260709 13:12:23.040073 31722 ts_tablet_manager.cc:1434] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent starting tablet: real 0.073s	user 0.028s	sys 0.032s
I20260709 13:12:23.041599 31722 tablet_bootstrap.cc:492] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0: Bootstrap starting.
I20260709 13:12:23.049513 31722 tablet_bootstrap.cc:654] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.053515 31723 tablet_bootstrap.cc:492] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651: No bootstrap required, opened a new log
I20260709 13:12:23.054648 31723 ts_tablet_manager.cc:1403] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651: Time spent bootstrapping tablet: real 0.082s	user 0.039s	sys 0.038s
W20260709 13:12:23.055398 31708 tablet.cc:2406] T 0874b76c790a41728e6c7390ab1304e8 P b04ac890eb2f4a18b089b0c95bea102f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:23.059091 31723 raft_consensus.cc:359] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.060393 31723 raft_consensus.cc:385] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.060864 31723 raft_consensus.cc:740] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd26c2c466ca41709432959be327b651, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.062103 31723 consensus_queue.cc:260] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.063112 31724 tablet_bootstrap.cc:654] T 187fcfffc98a4ca79b719dcba8324de9 P b04ac890eb2f4a18b089b0c95bea102f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.067180 31723 ts_tablet_manager.cc:1434] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.005s
I20260709 13:12:23.068748 31723 tablet_bootstrap.cc:492] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651: Bootstrap starting.
I20260709 13:12:23.075851 31723 tablet_bootstrap.cc:654] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.076225 31724 tablet_bootstrap.cc:492] T 187fcfffc98a4ca79b719dcba8324de9 P b04ac890eb2f4a18b089b0c95bea102f: No bootstrap required, opened a new log
I20260709 13:12:23.076851 31724 ts_tablet_manager.cc:1403] T 187fcfffc98a4ca79b719dcba8324de9 P b04ac890eb2f4a18b089b0c95bea102f: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.000s
I20260709 13:12:23.080700 31722 tablet_bootstrap.cc:492] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0: No bootstrap required, opened a new log
I20260709 13:12:23.080461 31724 raft_consensus.cc:359] T 187fcfffc98a4ca79b719dcba8324de9 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.081295 31724 raft_consensus.cc:385] T 187fcfffc98a4ca79b719dcba8324de9 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.081323 31722 ts_tablet_manager.cc:1403] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.007s
I20260709 13:12:23.081810 31724 raft_consensus.cc:740] T 187fcfffc98a4ca79b719dcba8324de9 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.082842 31724 consensus_queue.cc:260] T 187fcfffc98a4ca79b719dcba8324de9 P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.084918 31722 raft_consensus.cc:359] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.085805 31724 ts_tablet_manager.cc:1434] T 187fcfffc98a4ca79b719dcba8324de9 P b04ac890eb2f4a18b089b0c95bea102f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 13:12:23.087110 31724 tablet_bootstrap.cc:492] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f: Bootstrap starting.
I20260709 13:12:23.085830 31722 raft_consensus.cc:385] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.088877 31722 raft_consensus.cc:740] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.089779 31722 consensus_queue.cc:260] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.090337 31723 tablet_bootstrap.cc:492] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651: No bootstrap required, opened a new log
I20260709 13:12:23.090924 31723 ts_tablet_manager.cc:1403] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.006s
I20260709 13:12:23.092272 31722 ts_tablet_manager.cc:1434] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:12:23.093403 31722 tablet_bootstrap.cc:492] T 5b6e6d1a6cff4e95b4dfa61751e9632a P 5ccb0482a31a436882a89f5dfdede1c0: Bootstrap starting.
I20260709 13:12:23.094312 31723 raft_consensus.cc:359] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.095191 31723 raft_consensus.cc:385] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.095528 31723 raft_consensus.cc:740] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd26c2c466ca41709432959be327b651, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.096827 31724 tablet_bootstrap.cc:654] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.096365 31723 consensus_queue.cc:260] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.099172 31723 ts_tablet_manager.cc:1434] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:12:23.100369 31723 tablet_bootstrap.cc:492] T ef63c5c5316a4a1c9f54713562e4b71e P dd26c2c466ca41709432959be327b651: Bootstrap starting.
I20260709 13:12:23.102502 31722 tablet_bootstrap.cc:654] T 5b6e6d1a6cff4e95b4dfa61751e9632a P 5ccb0482a31a436882a89f5dfdede1c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.102468 31729 raft_consensus.cc:493] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.103377 31729 raft_consensus.cc:515] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.108157 31723 tablet_bootstrap.cc:654] T ef63c5c5316a4a1c9f54713562e4b71e P dd26c2c466ca41709432959be327b651: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.122511 31729 leader_election.cc:290] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:23.158749 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0874b76c790a41728e6c7390ab1304e8" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0" is_pre_election: true
W20260709 13:12:23.160706 31571 leader_election.cc:343] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.161448 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0874b76c790a41728e6c7390ab1304e8" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f" is_pre_election: true
I20260709 13:12:23.162312 31682 raft_consensus.cc:2468] T 0874b76c790a41728e6c7390ab1304e8 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd26c2c466ca41709432959be327b651 in term 0.
I20260709 13:12:23.164067 31574 leader_election.cc:304] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651; no voters: 5ccb0482a31a436882a89f5dfdede1c0
I20260709 13:12:23.165040 31722 tablet_bootstrap.cc:492] T 5b6e6d1a6cff4e95b4dfa61751e9632a P 5ccb0482a31a436882a89f5dfdede1c0: No bootstrap required, opened a new log
I20260709 13:12:23.165091 31729 raft_consensus.cc:2804] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:23.165789 31729 raft_consensus.cc:493] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.165808 31722 ts_tablet_manager.cc:1403] T 5b6e6d1a6cff4e95b4dfa61751e9632a P 5ccb0482a31a436882a89f5dfdede1c0: Time spent bootstrapping tablet: real 0.073s	user 0.033s	sys 0.037s
I20260709 13:12:23.166028 31724 tablet_bootstrap.cc:492] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f: No bootstrap required, opened a new log
I20260709 13:12:23.166123 31723 tablet_bootstrap.cc:492] T ef63c5c5316a4a1c9f54713562e4b71e P dd26c2c466ca41709432959be327b651: No bootstrap required, opened a new log
I20260709 13:12:23.166352 31729 raft_consensus.cc:3060] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.166776 31724 ts_tablet_manager.cc:1403] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.032s
I20260709 13:12:23.167001 31723 ts_tablet_manager.cc:1403] T ef63c5c5316a4a1c9f54713562e4b71e P dd26c2c466ca41709432959be327b651: Time spent bootstrapping tablet: real 0.067s	user 0.034s	sys 0.027s
I20260709 13:12:23.169202 31722 raft_consensus.cc:359] T 5b6e6d1a6cff4e95b4dfa61751e9632a P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.170043 31722 raft_consensus.cc:385] T 5b6e6d1a6cff4e95b4dfa61751e9632a P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.169811 31724 raft_consensus.cc:359] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.170408 31722 raft_consensus.cc:740] T 5b6e6d1a6cff4e95b4dfa61751e9632a P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.170605 31724 raft_consensus.cc:385] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.170361 31723 raft_consensus.cc:359] T ef63c5c5316a4a1c9f54713562e4b71e P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } }
I20260709 13:12:23.171156 31724 raft_consensus.cc:740] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.171437 31723 raft_consensus.cc:385] T ef63c5c5316a4a1c9f54713562e4b71e P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.171870 31723 raft_consensus.cc:740] T ef63c5c5316a4a1c9f54713562e4b71e P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd26c2c466ca41709432959be327b651, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.171676 31722 consensus_queue.cc:260] T 5b6e6d1a6cff4e95b4dfa61751e9632a P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.172262 31724 consensus_queue.cc:260] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.172945 31723 consensus_queue.cc:260] T ef63c5c5316a4a1c9f54713562e4b71e P dd26c2c466ca41709432959be327b651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } }
I20260709 13:12:23.174921 31722 ts_tablet_manager.cc:1434] T 5b6e6d1a6cff4e95b4dfa61751e9632a P 5ccb0482a31a436882a89f5dfdede1c0: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:12:23.176105 31722 tablet_bootstrap.cc:492] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0: Bootstrap starting.
W20260709 13:12:23.177893 31479 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:23.182480 31724 ts_tablet_manager.cc:1434] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:12:23.182574 31722 tablet_bootstrap.cc:654] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.194730 31724 tablet_bootstrap.cc:492] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f: Bootstrap starting.
I20260709 13:12:23.195565 31722 tablet_bootstrap.cc:492] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0: No bootstrap required, opened a new log
I20260709 13:12:23.196157 31722 ts_tablet_manager.cc:1403] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:12:23.196568 31729 raft_consensus.cc:515] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.199088 31722 raft_consensus.cc:359] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.199896 31722 raft_consensus.cc:385] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.200196 31722 raft_consensus.cc:740] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.200990 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0874b76c790a41728e6c7390ab1304e8" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
I20260709 13:12:23.201682 31724 tablet_bootstrap.cc:654] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.201840 31682 raft_consensus.cc:3060] T 0874b76c790a41728e6c7390ab1304e8 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.205489 31744 raft_consensus.cc:493] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.206012 31744 raft_consensus.cc:515] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.206845 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0874b76c790a41728e6c7390ab1304e8" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
I20260709 13:12:23.200903 31722 consensus_queue.cc:260] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
W20260709 13:12:23.209088 31571 leader_election.cc:343] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.209780 31722 ts_tablet_manager.cc:1434] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:12:23.211155 31722 tablet_bootstrap.cc:492] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0: Bootstrap starting.
I20260709 13:12:23.227303 31723 ts_tablet_manager.cc:1434] T ef63c5c5316a4a1c9f54713562e4b71e P dd26c2c466ca41709432959be327b651: Time spent starting tablet: real 0.060s	user 0.027s	sys 0.022s
I20260709 13:12:23.228826 31724 tablet_bootstrap.cc:492] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f: No bootstrap required, opened a new log
I20260709 13:12:23.229451 31724 ts_tablet_manager.cc:1403] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f: Time spent bootstrapping tablet: real 0.035s	user 0.003s	sys 0.012s
I20260709 13:12:23.230777 31744 leader_election.cc:290] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:23.231137 31723 tablet_bootstrap.cc:492] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651: Bootstrap starting.
I20260709 13:12:23.234150 31681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "187fcfffc98a4ca79b719dcba8324de9" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f" is_pre_election: true
I20260709 13:12:23.235023 31681 raft_consensus.cc:2468] T 187fcfffc98a4ca79b719dcba8324de9 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd26c2c466ca41709432959be327b651 in term 0.
I20260709 13:12:23.236446 31722 tablet_bootstrap.cc:654] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.236531 31574 leader_election.cc:304] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651; no voters: 
I20260709 13:12:23.237763 31744 raft_consensus.cc:2804] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:23.238170 31744 raft_consensus.cc:493] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.238385 31723 tablet_bootstrap.cc:654] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.238513 31744 raft_consensus.cc:3060] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.240593 31724 raft_consensus.cc:359] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.241675 31724 raft_consensus.cc:385] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.242053 31724 raft_consensus.cc:740] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.242714 31731 raft_consensus.cc:493] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.243228 31724 consensus_queue.cc:260] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.243463 31731 raft_consensus.cc:515] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.244805 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "187fcfffc98a4ca79b719dcba8324de9" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0" is_pre_election: true
W20260709 13:12:23.246315 31571 leader_election.cc:343] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.246891 31723 tablet_bootstrap.cc:492] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651: No bootstrap required, opened a new log
I20260709 13:12:23.246973 31731 leader_election.cc:290] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:23.247481 31723 ts_tablet_manager.cc:1403] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651: Time spent bootstrapping tablet: real 0.017s	user 0.005s	sys 0.008s
I20260709 13:12:23.250716 31723 raft_consensus.cc:359] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.251456 31723 raft_consensus.cc:385] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.251748 31723 raft_consensus.cc:740] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd26c2c466ca41709432959be327b651, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.252485 31723 consensus_queue.cc:260] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.255496 31723 ts_tablet_manager.cc:1434] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:12:23.256523 31723 tablet_bootstrap.cc:492] T ef54fe01a48d40cd8b942819d7863910 P dd26c2c466ca41709432959be327b651: Bootstrap starting.
I20260709 13:12:23.262467 31728 raft_consensus.cc:493] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.262938 31723 tablet_bootstrap.cc:654] T ef54fe01a48d40cd8b942819d7863910 P dd26c2c466ca41709432959be327b651: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.263159 31728 raft_consensus.cc:515] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.264173 31729 leader_election.cc:290] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:23.266296 31728 leader_election.cc:290] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:23.266638 31722 tablet_bootstrap.cc:492] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0: No bootstrap required, opened a new log
I20260709 13:12:23.267139 31742 raft_consensus.cc:493] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.267750 31742 raft_consensus.cc:515] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.270571 31742 leader_election.cc:290] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:23.267146 31722 ts_tablet_manager.cc:1403] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.007s
I20260709 13:12:23.273932 31681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac2c40173f24fa4b92159ef54a084ae" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f" is_pre_election: true
W20260709 13:12:23.276093 31574 leader_election.cc:343] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.278048 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac2c40173f24fa4b92159ef54a084ae" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0" is_pre_election: true
I20260709 13:12:23.280915 31724 ts_tablet_manager.cc:1434] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.001s
I20260709 13:12:23.284705 31722 raft_consensus.cc:359] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } }
I20260709 13:12:23.285545 31722 raft_consensus.cc:385] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.285854 31722 raft_consensus.cc:740] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.287492 31744 raft_consensus.cc:515] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.288797 31682 raft_consensus.cc:2468] T 0874b76c790a41728e6c7390ab1304e8 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd26c2c466ca41709432959be327b651 in term 1.
I20260709 13:12:23.292936 31728 raft_consensus.cc:493] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.294030 31728 raft_consensus.cc:515] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } }
I20260709 13:12:23.294822 31574 leader_election.cc:304] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651; no voters: 5ccb0482a31a436882a89f5dfdede1c0
I20260709 13:12:23.296598 31729 raft_consensus.cc:2804] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:23.297355 31729 raft_consensus.cc:697] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [term 1 LEADER]: Becoming Leader. State: Replica: dd26c2c466ca41709432959be327b651, State: Running, Role: LEADER
I20260709 13:12:23.297821 31728 leader_election.cc:290] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671)
I20260709 13:12:23.292822 31722 consensus_queue.cc:260] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } }
I20260709 13:12:23.298606 31729 consensus_queue.cc:237] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.300204 31722 ts_tablet_manager.cc:1434] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0: Time spent starting tablet: real 0.028s	user 0.002s	sys 0.003s
I20260709 13:12:23.292619 31724 tablet_bootstrap.cc:492] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f: Bootstrap starting.
I20260709 13:12:23.303551 31744 leader_election.cc:290] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:23.310230 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "187fcfffc98a4ca79b719dcba8324de9" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
W20260709 13:12:23.312021 31571 leader_election.cc:343] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.312268 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "187fcfffc98a4ca79b719dcba8324de9" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
I20260709 13:12:23.312593 31571 leader_election.cc:304] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd26c2c466ca41709432959be327b651; no voters: 5ccb0482a31a436882a89f5dfdede1c0, b04ac890eb2f4a18b089b0c95bea102f
I20260709 13:12:23.313602 31744 raft_consensus.cc:2749] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:23.313921 31571 leader_election.cc:343] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.309131 31722 tablet_bootstrap.cc:492] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0: Bootstrap starting.
I20260709 13:12:23.318971 31723 tablet_bootstrap.cc:492] T ef54fe01a48d40cd8b942819d7863910 P dd26c2c466ca41709432959be327b651: No bootstrap required, opened a new log
I20260709 13:12:23.319646 31723 ts_tablet_manager.cc:1403] T ef54fe01a48d40cd8b942819d7863910 P dd26c2c466ca41709432959be327b651: Time spent bootstrapping tablet: real 0.063s	user 0.024s	sys 0.027s
I20260709 13:12:23.310916 31682 raft_consensus.cc:3060] T 187fcfffc98a4ca79b719dcba8324de9 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.333413 31723 raft_consensus.cc:359] T ef54fe01a48d40cd8b942819d7863910 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.335389 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e5097f777c4d17b18e5e6db1a9b949" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0" is_pre_election: true
I20260709 13:12:23.340505 31723 raft_consensus.cc:385] T ef54fe01a48d40cd8b942819d7863910 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.340924 31723 raft_consensus.cc:740] T ef54fe01a48d40cd8b942819d7863910 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd26c2c466ca41709432959be327b651, State: Initialized, Role: FOLLOWER
W20260709 13:12:23.341665 31645 leader_election.cc:343] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.336371 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef63c5c5316a4a1c9f54713562e4b71e" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0" is_pre_election: true
I20260709 13:12:23.341761 31723 consensus_queue.cc:260] T ef54fe01a48d40cd8b942819d7863910 P dd26c2c466ca41709432959be327b651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.342625 31532 raft_consensus.cc:2468] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 0.
I20260709 13:12:23.329783 31728 raft_consensus.cc:493] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.343947 31645 leader_election.cc:304] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, b04ac890eb2f4a18b089b0c95bea102f; no voters: 
I20260709 13:12:23.340020 31722 tablet_bootstrap.cc:654] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.343667 31728 raft_consensus.cc:515] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.344892 31723 ts_tablet_manager.cc:1434] T ef54fe01a48d40cd8b942819d7863910 P dd26c2c466ca41709432959be327b651: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:12:23.347849 31723 tablet_bootstrap.cc:492] T 5b6e6d1a6cff4e95b4dfa61751e9632a P dd26c2c466ca41709432959be327b651: Bootstrap starting.
I20260709 13:12:23.348145 31608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e5097f777c4d17b18e5e6db1a9b949" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
I20260709 13:12:23.349114 31608 raft_consensus.cc:2468] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 0.
I20260709 13:12:23.352105 31608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef63c5c5316a4a1c9f54713562e4b71e" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
I20260709 13:12:23.353025 31608 raft_consensus.cc:2468] T ef63c5c5316a4a1c9f54713562e4b71e P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 0.
I20260709 13:12:23.353534 31682 raft_consensus.cc:2468] T 187fcfffc98a4ca79b719dcba8324de9 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd26c2c466ca41709432959be327b651 in term 1.
I20260709 13:12:23.354962 31648 leader_election.cc:304] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651; no voters: 5ccb0482a31a436882a89f5dfdede1c0
I20260709 13:12:23.355520 31728 leader_election.cc:290] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:23.358693 31728 raft_consensus.cc:2804] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:23.359035 31728 raft_consensus.cc:493] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.359597 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6e6d1a6cff4e95b4dfa61751e9632a" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0" is_pre_election: true
I20260709 13:12:23.359963 31607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6e6d1a6cff4e95b4dfa61751e9632a" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
I20260709 13:12:23.360306 31532 raft_consensus.cc:2468] T 5b6e6d1a6cff4e95b4dfa61751e9632a P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 0.
I20260709 13:12:23.361203 31608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b03969d68bf4888b6f9954bf28d1793" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
W20260709 13:12:23.362813 31499 leader_election.cc:343] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd26c2c466ca41709432959be327b651 (127.20.40.2:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.364200 31756 raft_consensus.cc:2804] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:23.365403 31645 leader_election.cc:304] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, b04ac890eb2f4a18b089b0c95bea102f; no voters: 
I20260709 13:12:23.364053 31431 catalog_manager.cc:5697] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd26c2c466ca41709432959be327b651 (127.20.40.2). New cstate: current_term: 1 leader_uuid: "dd26c2c466ca41709432959be327b651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:23.365275 31724 tablet_bootstrap.cc:654] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.366765 31756 raft_consensus.cc:493] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.359344 31728 raft_consensus.cc:3060] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.373093 31723 tablet_bootstrap.cc:654] T 5b6e6d1a6cff4e95b4dfa61751e9632a P dd26c2c466ca41709432959be327b651: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.380237 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b03969d68bf4888b6f9954bf28d1793" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f" is_pre_election: true
W20260709 13:12:23.382129 31499 leader_election.cc:343] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.382579 31499 leader_election.cc:304] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0; no voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651
I20260709 13:12:23.383093 31728 raft_consensus.cc:515] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } }
I20260709 13:12:23.371670 31756 raft_consensus.cc:3060] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.383818 31731 raft_consensus.cc:2749] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:23.386585 31731 raft_consensus.cc:493] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.386659 31574 leader_election.cc:304] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651; no voters: 5ccb0482a31a436882a89f5dfdede1c0
I20260709 13:12:23.387060 31731 raft_consensus.cc:515] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.387856 31729 raft_consensus.cc:2804] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:23.388324 31729 raft_consensus.cc:697] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [term 1 LEADER]: Becoming Leader. State: Replica: dd26c2c466ca41709432959be327b651, State: Running, Role: LEADER
I20260709 13:12:23.389159 31729 consensus_queue.cc:237] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.390831 31608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef54fe01a48d40cd8b942819d7863910" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
I20260709 13:12:23.391767 31608 raft_consensus.cc:2468] T ef54fe01a48d40cd8b942819d7863910 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 0.
I20260709 13:12:23.389184 31731 leader_election.cc:290] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:23.393577 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef54fe01a48d40cd8b942819d7863910" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f" is_pre_election: true
I20260709 13:12:23.396106 31722 tablet_bootstrap.cc:492] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0: No bootstrap required, opened a new log
I20260709 13:12:23.396683 31722 ts_tablet_manager.cc:1403] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0: Time spent bootstrapping tablet: real 0.096s	user 0.006s	sys 0.006s
I20260709 13:12:23.397943 31757 raft_consensus.cc:2804] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:23.398432 31757 raft_consensus.cc:493] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.397140 31728 leader_election.cc:290] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Requested vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671)
W20260709 13:12:23.399209 31648 leader_election.cc:343] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd26c2c466ca41709432959be327b651 (127.20.40.2:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.399470 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef63c5c5316a4a1c9f54713562e4b71e" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
I20260709 13:12:23.400390 31532 raft_consensus.cc:3060] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.405514 31757 raft_consensus.cc:3060] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.399482 31499 leader_election.cc:304] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651; no voters: 
W20260709 13:12:23.407516 31499 leader_election.cc:343] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.409036 31608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef63c5c5316a4a1c9f54713562e4b71e" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651"
I20260709 13:12:23.409936 31608 raft_consensus.cc:3060] T ef63c5c5316a4a1c9f54713562e4b71e P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.410460 31728 raft_consensus.cc:493] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.410974 31728 raft_consensus.cc:515] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.411484 31722 raft_consensus.cc:359] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.412273 31722 raft_consensus.cc:385] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.413188 31728 leader_election.cc:290] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:23.413962 31761 raft_consensus.cc:2804] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:23.414027 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ec93efe22a49fda085f38c3632f8b4" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0" is_pre_election: true
I20260709 13:12:23.412555 31722 raft_consensus.cc:740] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.414702 31761 raft_consensus.cc:493] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.414781 31607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ec93efe22a49fda085f38c3632f8b4" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
I20260709 13:12:23.414963 31533 raft_consensus.cc:2468] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 0.
I20260709 13:12:23.415200 31761 raft_consensus.cc:3060] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:23.416079 31648 leader_election.cc:343] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd26c2c466ca41709432959be327b651 (127.20.40.2:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.415294 31722 consensus_queue.cc:260] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.416695 31645 leader_election.cc:304] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, b04ac890eb2f4a18b089b0c95bea102f; no voters: dd26c2c466ca41709432959be327b651
I20260709 13:12:23.418929 31722 ts_tablet_manager.cc:1434] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:12:23.420342 31728 raft_consensus.cc:2804] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:23.420820 31728 raft_consensus.cc:493] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.421206 31728 raft_consensus.cc:3060] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.422099 31723 tablet_bootstrap.cc:492] T 5b6e6d1a6cff4e95b4dfa61751e9632a P dd26c2c466ca41709432959be327b651: No bootstrap required, opened a new log
I20260709 13:12:23.422680 31723 ts_tablet_manager.cc:1403] T 5b6e6d1a6cff4e95b4dfa61751e9632a P dd26c2c466ca41709432959be327b651: Time spent bootstrapping tablet: real 0.075s	user 0.016s	sys 0.019s
I20260709 13:12:23.424973 31756 raft_consensus.cc:515] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.425752 31723 raft_consensus.cc:359] T 5b6e6d1a6cff4e95b4dfa61751e9632a P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.426543 31723 raft_consensus.cc:385] T 5b6e6d1a6cff4e95b4dfa61751e9632a P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.426877 31723 raft_consensus.cc:740] T 5b6e6d1a6cff4e95b4dfa61751e9632a P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd26c2c466ca41709432959be327b651, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.427731 31723 consensus_queue.cc:260] T 5b6e6d1a6cff4e95b4dfa61751e9632a P dd26c2c466ca41709432959be327b651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.430321 31723 ts_tablet_manager.cc:1434] T 5b6e6d1a6cff4e95b4dfa61751e9632a P dd26c2c466ca41709432959be327b651: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:12:23.431052 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e5097f777c4d17b18e5e6db1a9b949" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
I20260709 13:12:23.431332 31723 tablet_bootstrap.cc:492] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651: Bootstrap starting.
I20260709 13:12:23.432401 31722 tablet_bootstrap.cc:492] T 05e5097f777c4d17b18e5e6db1a9b949 P 5ccb0482a31a436882a89f5dfdede1c0: Bootstrap starting.
I20260709 13:12:23.433779 31724 tablet_bootstrap.cc:492] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f: No bootstrap required, opened a new log
I20260709 13:12:23.434345 31724 ts_tablet_manager.cc:1403] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f: Time spent bootstrapping tablet: real 0.143s	user 0.000s	sys 0.021s
I20260709 13:12:23.432942 31728 raft_consensus.cc:515] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
W20260709 13:12:23.433302 31645 leader_election.cc:343] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.436650 31757 raft_consensus.cc:515] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.438500 31723 tablet_bootstrap.cc:654] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.440201 31728 leader_election.cc:290] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:23.442194 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6e6d1a6cff4e95b4dfa61751e9632a" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
I20260709 13:12:23.442961 31531 raft_consensus.cc:3060] T 5b6e6d1a6cff4e95b4dfa61751e9632a P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.446285 31607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ec93efe22a49fda085f38c3632f8b4" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651"
W20260709 13:12:23.448223 31648 leader_election.cc:343] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dd26c2c466ca41709432959be327b651 (127.20.40.2:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.440636 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ec93efe22a49fda085f38c3632f8b4" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
I20260709 13:12:23.449185 31533 raft_consensus.cc:3060] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.450708 31722 tablet_bootstrap.cc:654] T 05e5097f777c4d17b18e5e6db1a9b949 P 5ccb0482a31a436882a89f5dfdede1c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.458763 31532 raft_consensus.cc:2468] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 1.
I20260709 13:12:23.460974 31645 leader_election.cc:304] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, b04ac890eb2f4a18b089b0c95bea102f; no voters: 
I20260709 13:12:23.464228 31728 raft_consensus.cc:2804] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:23.475931 31533 raft_consensus.cc:2468] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 1.
I20260709 13:12:23.478930 31645 leader_election.cc:304] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, b04ac890eb2f4a18b089b0c95bea102f; no voters: dd26c2c466ca41709432959be327b651
I20260709 13:12:23.482236 31724 raft_consensus.cc:359] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.485997 31607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e5097f777c4d17b18e5e6db1a9b949" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651"
I20260709 13:12:23.486836 31607 raft_consensus.cc:3060] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.489668 31756 leader_election.cc:290] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:23.490195 31731 raft_consensus.cc:493] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.490630 31756 raft_consensus.cc:2804] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:23.490741 31731 raft_consensus.cc:515] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.491375 31756 raft_consensus.cc:697] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Becoming Leader. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Running, Role: LEADER
I20260709 13:12:23.492458 31756 consensus_queue.cc:237] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.493616 31731 leader_election.cc:290] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:23.464852 31761 raft_consensus.cc:515] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.495903 31761 leader_election.cc:290] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 election: Requested vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:23.496647 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac2c40173f24fa4b92159ef54a084ae" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
I20260709 13:12:23.499228 31531 raft_consensus.cc:2468] T 5b6e6d1a6cff4e95b4dfa61751e9632a P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 1.
I20260709 13:12:23.502002 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef54fe01a48d40cd8b942819d7863910" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651"
I20260709 13:12:23.502688 31605 raft_consensus.cc:3060] T ef54fe01a48d40cd8b942819d7863910 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.483362 31724 raft_consensus.cc:385] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.504999 31724 raft_consensus.cc:740] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.505856 31724 consensus_queue.cc:260] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.508224 31724 ts_tablet_manager.cc:1434] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f: Time spent starting tablet: real 0.074s	user 0.005s	sys 0.001s
I20260709 13:12:23.508306 31681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef54fe01a48d40cd8b942819d7863910" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
I20260709 13:12:23.495754 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac2c40173f24fa4b92159ef54a084ae" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f" is_pre_election: true
I20260709 13:12:23.509222 31724 tablet_bootstrap.cc:492] T ef54fe01a48d40cd8b942819d7863910 P b04ac890eb2f4a18b089b0c95bea102f: Bootstrap starting.
I20260709 13:12:23.480929 31608 raft_consensus.cc:2468] T ef63c5c5316a4a1c9f54713562e4b71e P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 1.
I20260709 13:12:23.497334 31606 raft_consensus.cc:2468] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 0.
W20260709 13:12:23.512199 31499 leader_election.cc:343] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.517056 31499 leader_election.cc:304] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651; no voters: 
I20260709 13:12:23.517059 31607 raft_consensus.cc:2468] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 1.
W20260709 13:12:23.518301 31499 leader_election.cc:343] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.518936 31648 leader_election.cc:304] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651; no voters: 5ccb0482a31a436882a89f5dfdede1c0
I20260709 13:12:23.519616 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b6e6d1a6cff4e95b4dfa61751e9632a" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651"
I20260709 13:12:23.520470 31606 raft_consensus.cc:3060] T 5b6e6d1a6cff4e95b4dfa61751e9632a P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.522385 31728 raft_consensus.cc:697] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Becoming Leader. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Running, Role: LEADER
I20260709 13:12:23.526842 31728 consensus_queue.cc:237] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } }
I20260709 13:12:23.530351 31723 tablet_bootstrap.cc:492] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651: No bootstrap required, opened a new log
I20260709 13:12:23.530951 31723 ts_tablet_manager.cc:1403] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651: Time spent bootstrapping tablet: real 0.100s	user 0.016s	sys 0.048s
I20260709 13:12:23.521890 31757 leader_election.cc:290] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:23.531062 31761 raft_consensus.cc:2804] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:23.541749 31761 raft_consensus.cc:493] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.542271 31761 raft_consensus.cc:3060] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.545761 31605 raft_consensus.cc:2468] T ef54fe01a48d40cd8b942819d7863910 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 1.
I20260709 13:12:23.549469 31499 leader_election.cc:304] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651; no voters: b04ac890eb2f4a18b089b0c95bea102f
I20260709 13:12:23.548036 31606 raft_consensus.cc:2468] T 5b6e6d1a6cff4e95b4dfa61751e9632a P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 1.
I20260709 13:12:23.550340 31731 raft_consensus.cc:2804] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:23.557902 31645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.1:38671, user_credentials={real_user=slave}} blocked reactor thread for 79112.3us
I20260709 13:12:23.562007 31723 raft_consensus.cc:359] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.563026 31723 raft_consensus.cc:385] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.563089 31645 leader_election.cc:304] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, b04ac890eb2f4a18b089b0c95bea102f; no voters: 
I20260709 13:12:23.563445 31723 raft_consensus.cc:740] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd26c2c466ca41709432959be327b651, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.564296 31723 consensus_queue.cc:260] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.564742 31766 raft_consensus.cc:2804] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:23.566141 31766 raft_consensus.cc:697] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Becoming Leader. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Running, Role: LEADER
I20260709 13:12:23.566941 31723 ts_tablet_manager.cc:1434] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.001s
I20260709 13:12:23.567022 31766 consensus_queue.cc:237] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.568151 31723 tablet_bootstrap.cc:492] T 95ec93efe22a49fda085f38c3632f8b4 P dd26c2c466ca41709432959be327b651: Bootstrap starting.
I20260709 13:12:23.564304 31728 raft_consensus.cc:2804] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:23.569506 31728 raft_consensus.cc:697] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Becoming Leader. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Running, Role: LEADER
I20260709 13:12:23.568737 31428 catalog_manager.cc:5697] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f reported cstate change: term changed from 0 to 1, leader changed from <none> to b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3). New cstate: current_term: 1 leader_uuid: "b04ac890eb2f4a18b089b0c95bea102f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:23.570305 31728 consensus_queue.cc:237] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.570912 31756 raft_consensus.cc:493] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.571444 31756 raft_consensus.cc:515] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.574923 31723 tablet_bootstrap.cc:654] T 95ec93efe22a49fda085f38c3632f8b4 P dd26c2c466ca41709432959be327b651: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.568773 31724 tablet_bootstrap.cc:654] T ef54fe01a48d40cd8b942819d7863910 P b04ac890eb2f4a18b089b0c95bea102f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.582026 31722 tablet_bootstrap.cc:492] T 05e5097f777c4d17b18e5e6db1a9b949 P 5ccb0482a31a436882a89f5dfdede1c0: No bootstrap required, opened a new log
I20260709 13:12:23.579849 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b03969d68bf4888b6f9954bf28d1793" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
I20260709 13:12:23.573405 31756 leader_election.cc:290] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:23.584065 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b03969d68bf4888b6f9954bf28d1793" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0" is_pre_election: true
I20260709 13:12:23.575552 31761 raft_consensus.cc:515] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.606146 31761 leader_election.cc:290] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 election: Requested vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:23.598903 31606 raft_consensus.cc:2468] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 0.
I20260709 13:12:23.607897 31531 raft_consensus.cc:2468] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 0.
I20260709 13:12:23.608732 31648 leader_election.cc:304] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651; no voters: 
I20260709 13:12:23.608958 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac2c40173f24fa4b92159ef54a084ae" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651"
I20260709 13:12:23.599195 31722 ts_tablet_manager.cc:1403] T 05e5097f777c4d17b18e5e6db1a9b949 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent bootstrapping tablet: real 0.168s	user 0.014s	sys 0.002s
I20260709 13:12:23.610543 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac2c40173f24fa4b92159ef54a084ae" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
I20260709 13:12:23.613746 31606 raft_consensus.cc:3060] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.617683 31722 raft_consensus.cc:359] T 05e5097f777c4d17b18e5e6db1a9b949 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
W20260709 13:12:23.618271 31499 leader_election.cc:343] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:23.618634 31722 raft_consensus.cc:385] T 05e5097f777c4d17b18e5e6db1a9b949 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.619020 31722 raft_consensus.cc:740] T 05e5097f777c4d17b18e5e6db1a9b949 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.620028 31722 consensus_queue.cc:260] T 05e5097f777c4d17b18e5e6db1a9b949 P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.620605 31766 raft_consensus.cc:2804] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:23.621219 31766 raft_consensus.cc:493] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:23.623461 31766 raft_consensus.cc:3060] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.631322 31431 catalog_manager.cc:5697] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd26c2c466ca41709432959be327b651 (127.20.40.2). New cstate: current_term: 1 leader_uuid: "dd26c2c466ca41709432959be327b651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:23.633658 31766 raft_consensus.cc:515] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.632118 31606 raft_consensus.cc:2468] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 1.
I20260709 13:12:23.634013 31722 ts_tablet_manager.cc:1434] T 05e5097f777c4d17b18e5e6db1a9b949 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 13:12:23.636641 31766 leader_election.cc:290] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:23.636348 31499 leader_election.cc:304] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651; no voters: b04ac890eb2f4a18b089b0c95bea102f
I20260709 13:12:23.638613 31773 raft_consensus.cc:2804] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:23.638972 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b03969d68bf4888b6f9954bf28d1793" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651"
I20260709 13:12:23.639369 31773 raft_consensus.cc:697] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Running, Role: LEADER
I20260709 13:12:23.639140 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b03969d68bf4888b6f9954bf28d1793" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
I20260709 13:12:23.640066 31605 raft_consensus.cc:3060] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.641188 31773 consensus_queue.cc:237] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.640151 31531 raft_consensus.cc:3060] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.645916 31761 raft_consensus.cc:493] T 05e5097f777c4d17b18e5e6db1a9b949 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.613644 31731 raft_consensus.cc:697] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Running, Role: LEADER
I20260709 13:12:23.646457 31761 raft_consensus.cc:515] T 05e5097f777c4d17b18e5e6db1a9b949 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.647080 31724 tablet_bootstrap.cc:492] T ef54fe01a48d40cd8b942819d7863910 P b04ac890eb2f4a18b089b0c95bea102f: No bootstrap required, opened a new log
I20260709 13:12:23.647045 31731 consensus_queue.cc:237] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.647822 31724 ts_tablet_manager.cc:1403] T ef54fe01a48d40cd8b942819d7863910 P b04ac890eb2f4a18b089b0c95bea102f: Time spent bootstrapping tablet: real 0.139s	user 0.011s	sys 0.026s
I20260709 13:12:23.648110 31723 tablet_bootstrap.cc:492] T 95ec93efe22a49fda085f38c3632f8b4 P dd26c2c466ca41709432959be327b651: No bootstrap required, opened a new log
I20260709 13:12:23.648720 31723 ts_tablet_manager.cc:1403] T 95ec93efe22a49fda085f38c3632f8b4 P dd26c2c466ca41709432959be327b651: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.021s
I20260709 13:12:23.648953 31761 leader_election.cc:290] T 05e5097f777c4d17b18e5e6db1a9b949 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:23.650660 31724 raft_consensus.cc:359] T ef54fe01a48d40cd8b942819d7863910 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.651361 31724 raft_consensus.cc:385] T ef54fe01a48d40cd8b942819d7863910 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.651197 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e5097f777c4d17b18e5e6db1a9b949" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f" is_pre_election: true
I20260709 13:12:23.651715 31724 raft_consensus.cc:740] T ef54fe01a48d40cd8b942819d7863910 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.652125 31723 raft_consensus.cc:359] T 95ec93efe22a49fda085f38c3632f8b4 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.652954 31723 raft_consensus.cc:385] T 95ec93efe22a49fda085f38c3632f8b4 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.653334 31723 raft_consensus.cc:740] T 95ec93efe22a49fda085f38c3632f8b4 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd26c2c466ca41709432959be327b651, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.653414 31608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e5097f777c4d17b18e5e6db1a9b949" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
I20260709 13:12:23.654349 31608 raft_consensus.cc:2393] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb0482a31a436882a89f5dfdede1c0 in current term 1: Already voted for candidate b04ac890eb2f4a18b089b0c95bea102f in this term.
I20260709 13:12:23.654421 31723 consensus_queue.cc:260] T 95ec93efe22a49fda085f38c3632f8b4 P dd26c2c466ca41709432959be327b651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.652595 31724 consensus_queue.cc:260] T ef54fe01a48d40cd8b942819d7863910 P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.656430 31499 leader_election.cc:304] T 05e5097f777c4d17b18e5e6db1a9b949 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0; no voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651
I20260709 13:12:23.657771 31761 raft_consensus.cc:3060] T 05e5097f777c4d17b18e5e6db1a9b949 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.658190 31724 ts_tablet_manager.cc:1434] T ef54fe01a48d40cd8b942819d7863910 P b04ac890eb2f4a18b089b0c95bea102f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:12:23.658329 31723 ts_tablet_manager.cc:1434] T 95ec93efe22a49fda085f38c3632f8b4 P dd26c2c466ca41709432959be327b651: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:12:23.659193 31724 tablet_bootstrap.cc:492] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f: Bootstrap starting.
I20260709 13:12:23.657020 31428 catalog_manager.cc:5697] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f reported cstate change: term changed from 0 to 1, leader changed from <none> to b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3). New cstate: current_term: 1 leader_uuid: "b04ac890eb2f4a18b089b0c95bea102f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.661136 31428 catalog_manager.cc:5697] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f reported cstate change: term changed from 0 to 1, leader changed from <none> to b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3). New cstate: current_term: 1 leader_uuid: "b04ac890eb2f4a18b089b0c95bea102f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.663112 31428 catalog_manager.cc:5697] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f reported cstate change: term changed from 0 to 1, leader changed from <none> to b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3). New cstate: current_term: 1 leader_uuid: "b04ac890eb2f4a18b089b0c95bea102f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.671307 31722 tablet_bootstrap.cc:492] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0: Bootstrap starting.
I20260709 13:12:23.673844 31531 raft_consensus.cc:2468] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 1.
I20260709 13:12:23.675428 31645 leader_election.cc:304] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, b04ac890eb2f4a18b089b0c95bea102f; no voters: 
I20260709 13:12:23.675650 31605 raft_consensus.cc:2468] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 1.
I20260709 13:12:23.676347 31761 raft_consensus.cc:2749] T 05e5097f777c4d17b18e5e6db1a9b949 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:23.676589 31766 raft_consensus.cc:2804] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:23.677244 31766 raft_consensus.cc:697] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Becoming Leader. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Running, Role: LEADER
I20260709 13:12:23.678176 31766 consensus_queue.cc:237] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.681877 31724 tablet_bootstrap.cc:654] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.698392 31722 tablet_bootstrap.cc:654] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.699281 31724 tablet_bootstrap.cc:492] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f: No bootstrap required, opened a new log
I20260709 13:12:23.699795 31724 ts_tablet_manager.cc:1403] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.009s
I20260709 13:12:23.702709 31724 raft_consensus.cc:359] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.703671 31724 raft_consensus.cc:385] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.704059 31724 raft_consensus.cc:740] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.704648 31722 tablet_bootstrap.cc:492] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0: No bootstrap required, opened a new log
I20260709 13:12:23.705219 31722 ts_tablet_manager.cc:1403] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.000s
I20260709 13:12:23.704105 31430 catalog_manager.cc:5697] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "5ccb0482a31a436882a89f5dfdede1c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:23.707679 31724 consensus_queue.cc:260] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.708182 31722 raft_consensus.cc:359] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.709008 31722 raft_consensus.cc:385] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.709308 31722 raft_consensus.cc:740] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.710271 31724 ts_tablet_manager.cc:1434] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:12:23.710204 31722 consensus_queue.cc:260] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.712272 31722 ts_tablet_manager.cc:1434] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:12:23.713212 31722 tablet_bootstrap.cc:492] T 0874b76c790a41728e6c7390ab1304e8 P 5ccb0482a31a436882a89f5dfdede1c0: Bootstrap starting.
I20260709 13:12:23.716679 31428 catalog_manager.cc:5697] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f reported cstate change: term changed from 0 to 1, leader changed from <none> to b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3). New cstate: current_term: 1 leader_uuid: "b04ac890eb2f4a18b089b0c95bea102f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:23.718983 31722 tablet_bootstrap.cc:654] T 0874b76c790a41728e6c7390ab1304e8 P 5ccb0482a31a436882a89f5dfdede1c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:23.722549 31430 catalog_manager.cc:5697] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "5ccb0482a31a436882a89f5dfdede1c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:23.723508 31722 tablet_bootstrap.cc:492] T 0874b76c790a41728e6c7390ab1304e8 P 5ccb0482a31a436882a89f5dfdede1c0: No bootstrap required, opened a new log
I20260709 13:12:23.723994 31722 ts_tablet_manager.cc:1403] T 0874b76c790a41728e6c7390ab1304e8 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent bootstrapping tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:12:23.726723 31722 raft_consensus.cc:359] T 0874b76c790a41728e6c7390ab1304e8 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.727355 31722 raft_consensus.cc:385] T 0874b76c790a41728e6c7390ab1304e8 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:23.727636 31722 raft_consensus.cc:740] T 0874b76c790a41728e6c7390ab1304e8 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Initialized, Role: FOLLOWER
I20260709 13:12:23.728376 31722 consensus_queue.cc:260] T 0874b76c790a41728e6c7390ab1304e8 P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.730296 31722 ts_tablet_manager.cc:1434] T 0874b76c790a41728e6c7390ab1304e8 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:12:23.766907 31766 raft_consensus.cc:493] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.767534 31766 raft_consensus.cc:515] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.769289 31766 leader_election.cc:290] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:23.770416 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac2c40173f24fa4b92159ef54a084ae" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
I20260709 13:12:23.770416 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac2c40173f24fa4b92159ef54a084ae" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0" is_pre_election: true
I20260709 13:12:23.771740 31605 raft_consensus.cc:2393] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b04ac890eb2f4a18b089b0c95bea102f in current term 1: Already voted for candidate 5ccb0482a31a436882a89f5dfdede1c0 in this term.
I20260709 13:12:23.772697 31648 leader_election.cc:304] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f; no voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651
I20260709 13:12:23.773392 31766 raft_consensus.cc:3060] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.778918 31729 consensus_queue.cc:1048] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:23.779268 31766 raft_consensus.cc:2749] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:23.789162 31531 raft_consensus.cc:3060] T 0874b76c790a41728e6c7390ab1304e8 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.797576 31729 consensus_queue.cc:1048] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:23.821381 31531 raft_consensus.cc:3060] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.828756 31729 consensus_queue.cc:1048] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:23.831176 31682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef63c5c5316a4a1c9f54713562e4b71e"
dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
mode: GRACEFUL
new_leader_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
 from {username='slave'} at 127.0.0.1:51904
I20260709 13:12:23.831970 31682 raft_consensus.cc:606] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Received request to transfer leadership to TS 5ccb0482a31a436882a89f5dfdede1c0
I20260709 13:12:23.842315 31742 consensus_queue.cc:1048] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:23.845845 31681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95ec93efe22a49fda085f38c3632f8b4"
dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
mode: GRACEFUL
new_leader_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
 from {username='slave'} at 127.0.0.1:51904
I20260709 13:12:23.846495 31681 raft_consensus.cc:606] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Received request to transfer leadership to TS 5ccb0482a31a436882a89f5dfdede1c0
I20260709 13:12:23.877269 31605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "187fcfffc98a4ca79b719dcba8324de9"
dest_uuid: "dd26c2c466ca41709432959be327b651"
mode: GRACEFUL
new_leader_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
 from {username='slave'} at 127.0.0.1:58286
I20260709 13:12:23.877964 31605 raft_consensus.cc:606] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [term 1 LEADER]: Received request to transfer leadership to TS 5ccb0482a31a436882a89f5dfdede1c0
I20260709 13:12:23.887158 31682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b03969d68bf4888b6f9954bf28d1793"
dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
mode: GRACEFUL
new_leader_uuid: "dd26c2c466ca41709432959be327b651"
 from {username='slave'} at 127.0.0.1:51904
I20260709 13:12:23.887744 31682 raft_consensus.cc:606] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Received request to transfer leadership to TS dd26c2c466ca41709432959be327b651
I20260709 13:12:23.893131 31682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05e5097f777c4d17b18e5e6db1a9b949"
dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
mode: GRACEFUL
new_leader_uuid: "dd26c2c466ca41709432959be327b651"
 from {username='slave'} at 127.0.0.1:51904
I20260709 13:12:23.893718 31682 raft_consensus.cc:606] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Received request to transfer leadership to TS dd26c2c466ca41709432959be327b651
I20260709 13:12:23.907904 31531 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ac2c40173f24fa4b92159ef54a084ae"
dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
mode: GRACEFUL
new_leader_uuid: "dd26c2c466ca41709432959be327b651"
 from {username='slave'} at 127.0.0.1:58434
I20260709 13:12:23.908486 31531 raft_consensus.cc:606] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 LEADER]: Received request to transfer leadership to TS dd26c2c466ca41709432959be327b651
I20260709 13:12:23.969017 31766 raft_consensus.cc:493] T ef54fe01a48d40cd8b942819d7863910 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:23.969641 31766 raft_consensus.cc:515] T ef54fe01a48d40cd8b942819d7863910 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:23.971524 31766 leader_election.cc:290] T ef54fe01a48d40cd8b942819d7863910 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:23.972656 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef54fe01a48d40cd8b942819d7863910" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
I20260709 13:12:23.972513 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef54fe01a48d40cd8b942819d7863910" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0" is_pre_election: true
I20260709 13:12:23.973572 31605 raft_consensus.cc:2393] T ef54fe01a48d40cd8b942819d7863910 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b04ac890eb2f4a18b089b0c95bea102f in current term 1: Already voted for candidate 5ccb0482a31a436882a89f5dfdede1c0 in this term.
I20260709 13:12:23.974660 31648 leader_election.cc:304] T ef54fe01a48d40cd8b942819d7863910 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f; no voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651
I20260709 13:12:23.975454 31728 raft_consensus.cc:3060] T ef54fe01a48d40cd8b942819d7863910 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.976871 31605 raft_consensus.cc:3060] T 95ec93efe22a49fda085f38c3632f8b4 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:23.983269 31728 raft_consensus.cc:2749] T ef54fe01a48d40cd8b942819d7863910 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:23.985419 31728 consensus_queue.cc:1048] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:23.996639 31756 consensus_queue.cc:1048] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:23.997578 31766 consensus_queue.cc:1048] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:24.008100 31766 raft_consensus.cc:993] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f: : Instructing follower 5ccb0482a31a436882a89f5dfdede1c0 to start an election
I20260709 13:12:24.008587 31766 raft_consensus.cc:1081] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Signalling peer 5ccb0482a31a436882a89f5dfdede1c0 to start an election
I20260709 13:12:24.012126 31533 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95ec93efe22a49fda085f38c3632f8b4"
dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
 from {username='slave'} at 127.0.0.1:58418
I20260709 13:12:24.012915 31533 raft_consensus.cc:493] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:24.013342 31533 raft_consensus.cc:3060] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.018463 31757 consensus_queue.cc:1048] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:24.022258 31533 raft_consensus.cc:515] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:24.025686 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ec93efe22a49fda085f38c3632f8b4" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd26c2c466ca41709432959be327b651"
I20260709 13:12:24.026336 31605 raft_consensus.cc:3060] T 95ec93efe22a49fda085f38c3632f8b4 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.026943 31533 leader_election.cc:290] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 2 election: Requested vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:24.028203 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ec93efe22a49fda085f38c3632f8b4" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
I20260709 13:12:24.029022 31682 raft_consensus.cc:3055] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:24.029233 31757 consensus_queue.cc:1048] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:24.029606 31682 raft_consensus.cc:740] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Running, Role: LEADER
I20260709 13:12:24.030799 31682 consensus_queue.cc:260] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:24.032133 31682 raft_consensus.cc:3060] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.036532 31605 raft_consensus.cc:2468] T 95ec93efe22a49fda085f38c3632f8b4 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 2.
I20260709 13:12:24.038069 31499 leader_election.cc:304] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651; no voters: 
I20260709 13:12:24.039031 31773 raft_consensus.cc:2804] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:24.039567 31773 raft_consensus.cc:697] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 LEADER]: Becoming Leader. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Running, Role: LEADER
I20260709 13:12:24.040439 31773 consensus_queue.cc:237] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:24.044597 31728 raft_consensus.cc:993] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f: : Instructing follower dd26c2c466ca41709432959be327b651 to start an election
I20260709 13:12:24.045295 31682 raft_consensus.cc:2468] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 2.
I20260709 13:12:24.045557 31728 raft_consensus.cc:1081] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Signalling peer dd26c2c466ca41709432959be327b651 to start an election
I20260709 13:12:24.048488 31605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05e5097f777c4d17b18e5e6db1a9b949"
dest_uuid: "dd26c2c466ca41709432959be327b651"
 from {username='slave'} at 127.0.0.1:58284
I20260709 13:12:24.049291 31605 raft_consensus.cc:493] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:24.049818 31605 raft_consensus.cc:3060] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.056808 31728 consensus_queue.cc:1048] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:24.059350 31767 raft_consensus.cc:993] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f: : Instructing follower 5ccb0482a31a436882a89f5dfdede1c0 to start an election
I20260709 13:12:24.059870 31767 raft_consensus.cc:1081] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Signalling peer 5ccb0482a31a436882a89f5dfdede1c0 to start an election
I20260709 13:12:24.062244 31533 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef63c5c5316a4a1c9f54713562e4b71e"
dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
 from {username='slave'} at 127.0.0.1:58418
I20260709 13:12:24.062868 31533 raft_consensus.cc:493] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:24.063268 31533 raft_consensus.cc:3060] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.067904 31605 raft_consensus.cc:515] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:24.069594 31606 raft_consensus.cc:1240] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Rejecting Update request from peer b04ac890eb2f4a18b089b0c95bea102f for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:24.071452 31605 leader_election.cc:290] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:24.071648 31533 raft_consensus.cc:515] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } }
I20260709 13:12:24.072815 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e5097f777c4d17b18e5e6db1a9b949" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
I20260709 13:12:24.073053 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05e5097f777c4d17b18e5e6db1a9b949" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
I20260709 13:12:24.073585 31682 raft_consensus.cc:3055] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:24.074069 31682 raft_consensus.cc:740] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Running, Role: LEADER
I20260709 13:12:24.074960 31682 consensus_queue.cc:260] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:24.075963 31757 consensus_queue.cc:1059] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:24.077486 31682 raft_consensus.cc:3060] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.078295 31681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef63c5c5316a4a1c9f54713562e4b71e" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
I20260709 13:12:24.079041 31681 raft_consensus.cc:3055] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:24.079416 31681 raft_consensus.cc:740] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Running, Role: LEADER
I20260709 13:12:24.080372 31681 consensus_queue.cc:260] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } }
I20260709 13:12:24.080220 31428 catalog_manager.cc:5697] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 reported cstate change: term changed from 1 to 2, leader changed from b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3) to 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "5ccb0482a31a436882a89f5dfdede1c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.081908 31681 raft_consensus.cc:3060] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.083433 31682 raft_consensus.cc:2468] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd26c2c466ca41709432959be327b651 in term 2.
I20260709 13:12:24.084899 31533 leader_election.cc:290] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 2 election: Requested vote from peers b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:24.086440 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef63c5c5316a4a1c9f54713562e4b71e" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd26c2c466ca41709432959be327b651"
I20260709 13:12:24.087049 31574 leader_election.cc:304] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651; no voters: 5ccb0482a31a436882a89f5dfdede1c0
I20260709 13:12:24.087230 31606 raft_consensus.cc:3060] T ef63c5c5316a4a1c9f54713562e4b71e P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.088779 31792 raft_consensus.cc:2804] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:24.089320 31792 raft_consensus.cc:697] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [term 2 LEADER]: Becoming Leader. State: Replica: dd26c2c466ca41709432959be327b651, State: Running, Role: LEADER
I20260709 13:12:24.090287 31792 consensus_queue.cc:237] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:24.096642 31728 consensus_queue.cc:1048] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:24.101461 31606 raft_consensus.cc:2468] T ef63c5c5316a4a1c9f54713562e4b71e P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 2.
I20260709 13:12:24.101275 31431 catalog_manager.cc:5697] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 reported cstate change: term changed from 1 to 2, leader changed from b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3) to dd26c2c466ca41709432959be327b651 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "dd26c2c466ca41709432959be327b651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.103123 31499 leader_election.cc:304] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651; no voters: 
I20260709 13:12:24.104139 31773 raft_consensus.cc:2804] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:24.104655 31773 raft_consensus.cc:697] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 LEADER]: Becoming Leader. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Running, Role: LEADER
I20260709 13:12:24.105554 31773 consensus_queue.cc:237] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } }
I20260709 13:12:24.107635 31681 raft_consensus.cc:2468] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 2.
I20260709 13:12:24.115654 31428 catalog_manager.cc:5697] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0 reported cstate change: term changed from 1 to 2, leader changed from b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3) to 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "5ccb0482a31a436882a89f5dfdede1c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:24.123503 31757 consensus_queue.cc:1048] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:24.178792 31773 consensus_queue.cc:1048] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:24.192174 31806 consensus_queue.cc:1048] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:24.192863 31773 consensus_queue.cc:1048] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:24.194300 31773 consensus_queue.cc:1048] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:24.206220 31761 raft_consensus.cc:993] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0: : Instructing follower dd26c2c466ca41709432959be327b651 to start an election
I20260709 13:12:24.207747 31806 raft_consensus.cc:1081] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 LEADER]: Signalling peer dd26c2c466ca41709432959be327b651 to start an election
I20260709 13:12:24.215210 31608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ac2c40173f24fa4b92159ef54a084ae"
dest_uuid: "dd26c2c466ca41709432959be327b651"
 from {username='slave'} at 127.0.0.1:58278
I20260709 13:12:24.215903 31608 raft_consensus.cc:493] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:24.216372 31608 raft_consensus.cc:3060] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.225674 31757 consensus_queue.cc:1048] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:24.225741 31608 raft_consensus.cc:515] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:24.228718 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac2c40173f24fa4b92159ef54a084ae" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
I20260709 13:12:24.229313 31531 raft_consensus.cc:3055] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:24.229745 31531 raft_consensus.cc:740] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Running, Role: LEADER
I20260709 13:12:24.229781 31608 leader_election.cc:290] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:24.230563 31531 consensus_queue.cc:260] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:24.231824 31531 raft_consensus.cc:3060] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.231704 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac2c40173f24fa4b92159ef54a084ae" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
I20260709 13:12:24.232461 31682 raft_consensus.cc:3060] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.241825 31682 raft_consensus.cc:2468] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd26c2c466ca41709432959be327b651 in term 2.
I20260709 13:12:24.243005 31574 leader_election.cc:304] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651; no voters: 
I20260709 13:12:24.244040 31744 raft_consensus.cc:2804] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:24.244516 31744 raft_consensus.cc:697] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [term 2 LEADER]: Becoming Leader. State: Replica: dd26c2c466ca41709432959be327b651, State: Running, Role: LEADER
I20260709 13:12:24.245357 31744 consensus_queue.cc:237] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:24.248176 31766 consensus_queue.cc:1048] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:24.242954 31531 raft_consensus.cc:2468] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd26c2c466ca41709432959be327b651 in term 2.
I20260709 13:12:24.257513 31766 raft_consensus.cc:993] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f: : Instructing follower dd26c2c466ca41709432959be327b651 to start an election
I20260709 13:12:24.258013 31728 raft_consensus.cc:1081] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Signalling peer dd26c2c466ca41709432959be327b651 to start an election
I20260709 13:12:24.258033 31428 catalog_manager.cc:5697] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 reported cstate change: term changed from 1 to 2, leader changed from 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1) to dd26c2c466ca41709432959be327b651 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "dd26c2c466ca41709432959be327b651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.259882 31608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b03969d68bf4888b6f9954bf28d1793"
dest_uuid: "dd26c2c466ca41709432959be327b651"
 from {username='slave'} at 127.0.0.1:58284
I20260709 13:12:24.260456 31608 raft_consensus.cc:493] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:24.260814 31608 raft_consensus.cc:3060] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.267089 31608 raft_consensus.cc:515] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:24.269167 31608 leader_election.cc:290] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:24.270011 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b03969d68bf4888b6f9954bf28d1793" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
I20260709 13:12:24.270241 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b03969d68bf4888b6f9954bf28d1793" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
I20260709 13:12:24.271188 31531 raft_consensus.cc:3060] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.271214 31682 raft_consensus.cc:3055] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:24.271731 31682 raft_consensus.cc:740] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Running, Role: LEADER
I20260709 13:12:24.272464 31682 consensus_queue.cc:260] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:24.273514 31682 raft_consensus.cc:3060] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.278476 31531 raft_consensus.cc:2468] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd26c2c466ca41709432959be327b651 in term 2.
I20260709 13:12:24.279309 31682 raft_consensus.cc:2468] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd26c2c466ca41709432959be327b651 in term 2.
I20260709 13:12:24.279865 31571 leader_election.cc:304] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651; no voters: 
I20260709 13:12:24.280783 31744 raft_consensus.cc:2804] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:24.281256 31744 raft_consensus.cc:697] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [term 2 LEADER]: Becoming Leader. State: Replica: dd26c2c466ca41709432959be327b651, State: Running, Role: LEADER
I20260709 13:12:24.282303 31744 consensus_queue.cc:237] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:24.289336 31428 catalog_manager.cc:5697] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 reported cstate change: term changed from 1 to 2, leader changed from b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3) to dd26c2c466ca41709432959be327b651 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "dd26c2c466ca41709432959be327b651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.372308 31792 raft_consensus.cc:993] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651: : Instructing follower 5ccb0482a31a436882a89f5dfdede1c0 to start an election
I20260709 13:12:24.372798 31813 raft_consensus.cc:1081] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [term 1 LEADER]: Signalling peer 5ccb0482a31a436882a89f5dfdede1c0 to start an election
I20260709 13:12:24.374550 31531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "187fcfffc98a4ca79b719dcba8324de9"
dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
 from {username='slave'} at 127.0.0.1:58406
I20260709 13:12:24.375069 31531 raft_consensus.cc:493] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:24.375392 31531 raft_consensus.cc:3060] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.381319 31531 raft_consensus.cc:515] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:24.383277 31531 leader_election.cc:290] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 2 election: Requested vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:24.384281 31608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "187fcfffc98a4ca79b719dcba8324de9" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd26c2c466ca41709432959be327b651"
I20260709 13:12:24.384377 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "187fcfffc98a4ca79b719dcba8324de9" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
I20260709 13:12:24.385053 31608 raft_consensus.cc:3055] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:24.385126 31682 raft_consensus.cc:3060] T 187fcfffc98a4ca79b719dcba8324de9 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.385421 31608 raft_consensus.cc:740] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd26c2c466ca41709432959be327b651, State: Running, Role: LEADER
I20260709 13:12:24.386296 31608 consensus_queue.cc:260] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:24.387332 31608 raft_consensus.cc:3060] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.390758 31682 raft_consensus.cc:2468] T 187fcfffc98a4ca79b719dcba8324de9 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 2.
I20260709 13:12:24.391983 31499 leader_election.cc:304] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, b04ac890eb2f4a18b089b0c95bea102f; no voters: 
I20260709 13:12:24.392813 31773 raft_consensus.cc:2804] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:24.393152 31608 raft_consensus.cc:2468] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 2.
I20260709 13:12:24.393361 31773 raft_consensus.cc:697] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 LEADER]: Becoming Leader. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Running, Role: LEADER
I20260709 13:12:24.394379 31773 consensus_queue.cc:237] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:24.400838 31428 catalog_manager.cc:5697] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0 reported cstate change: term changed from 1 to 2, leader changed from dd26c2c466ca41709432959be327b651 (127.20.40.2) to 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "5ccb0482a31a436882a89f5dfdede1c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.490443 31682 raft_consensus.cc:1275] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Refusing update from remote peer 5ccb0482a31a436882a89f5dfdede1c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:24.491804 31773 consensus_queue.cc:1048] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:24.502120 31608 raft_consensus.cc:1275] T 95ec93efe22a49fda085f38c3632f8b4 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb0482a31a436882a89f5dfdede1c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:24.504120 31761 consensus_queue.cc:1048] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:24.615345 31682 raft_consensus.cc:1275] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Refusing update from remote peer dd26c2c466ca41709432959be327b651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:24.616039 31531 raft_consensus.cc:3060] T 05e5097f777c4d17b18e5e6db1a9b949 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.616940 31813 consensus_queue.cc:1048] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:24.623715 31531 raft_consensus.cc:1275] T 05e5097f777c4d17b18e5e6db1a9b949 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Refusing update from remote peer dd26c2c466ca41709432959be327b651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:24.625334 31792 consensus_queue.cc:1048] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:24.672847 31682 raft_consensus.cc:1275] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Refusing update from remote peer dd26c2c466ca41709432959be327b651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:24.674269 31729 consensus_queue.cc:1048] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:24.683127 31533 raft_consensus.cc:1275] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Refusing update from remote peer dd26c2c466ca41709432959be327b651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:24.679534 31531 raft_consensus.cc:1275] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Refusing update from remote peer dd26c2c466ca41709432959be327b651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:24.685005 31792 consensus_queue.cc:1048] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:24.686064 31729 consensus_queue.cc:1048] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:24.696300 31682 raft_consensus.cc:1275] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Refusing update from remote peer dd26c2c466ca41709432959be327b651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:24.698071 31792 consensus_queue.cc:1048] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:24.712841 31608 raft_consensus.cc:1275] T ef63c5c5316a4a1c9f54713562e4b71e P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb0482a31a436882a89f5dfdede1c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:24.714567 31761 consensus_queue.cc:1048] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:24.724507 31682 raft_consensus.cc:1275] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Refusing update from remote peer 5ccb0482a31a436882a89f5dfdede1c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:24.726310 31761 consensus_queue.cc:1048] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:24.925292 31608 raft_consensus.cc:1275] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb0482a31a436882a89f5dfdede1c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:24.926796 31805 consensus_queue.cc:1048] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:24.935838 31682 raft_consensus.cc:1275] T 187fcfffc98a4ca79b719dcba8324de9 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Refusing update from remote peer 5ccb0482a31a436882a89f5dfdede1c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:24.938258 31761 consensus_queue.cc:1048] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:26.939131 31430 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56828:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:26.941637 31430 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:26.992882 31517 tablet_service.cc:1511] Processing CreateTablet for tablet d910acb7832449f89582dac7611ae3f3 (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:26.994166 31596 tablet_service.cc:1511] Processing CreateTablet for tablet d910acb7832449f89582dac7611ae3f3 (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:26.995610 31596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d910acb7832449f89582dac7611ae3f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.995383 31665 tablet_service.cc:1511] Processing CreateTablet for tablet d910acb7832449f89582dac7611ae3f3 (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:26.996675 31665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d910acb7832449f89582dac7611ae3f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.996975 31520 tablet_service.cc:1511] Processing CreateTablet for tablet 00f5b064fec14d58bbd0b717a74ca3c7 (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:26.994215 31517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d910acb7832449f89582dac7611ae3f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:26.998327 31520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f5b064fec14d58bbd0b717a74ca3c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.002065 31593 tablet_service.cc:1511] Processing CreateTablet for tablet 00f5b064fec14d58bbd0b717a74ca3c7 (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:27.003463 31593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f5b064fec14d58bbd0b717a74ca3c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.003155 31519 tablet_service.cc:1511] Processing CreateTablet for tablet f5321310673e483e92aedb4c6cca19c4 (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:27.004534 31519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5321310673e483e92aedb4c6cca19c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.002125 31590 tablet_service.cc:1511] Processing CreateTablet for tablet f5321310673e483e92aedb4c6cca19c4 (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:27.006691 31590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5321310673e483e92aedb4c6cca19c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.006861 31518 tablet_service.cc:1511] Processing CreateTablet for tablet 725bb603dd8d43fba4dcd318ea5fa6fd (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:27.008234 31518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 725bb603dd8d43fba4dcd318ea5fa6fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.009239 31521 tablet_service.cc:1511] Processing CreateTablet for tablet 9abf8d04896f4fca9fe2248c288e4799 (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:27.010605 31521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9abf8d04896f4fca9fe2248c288e4799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.010389 31667 tablet_service.cc:1511] Processing CreateTablet for tablet 00f5b064fec14d58bbd0b717a74ca3c7 (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:27.011773 31667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f5b064fec14d58bbd0b717a74ca3c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.014560 31516 tablet_service.cc:1511] Processing CreateTablet for tablet 2e02a21fb5c544faaa64ad2c506072ee (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:27.015642 31666 tablet_service.cc:1511] Processing CreateTablet for tablet 725bb603dd8d43fba4dcd318ea5fa6fd (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:27.017005 31666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 725bb603dd8d43fba4dcd318ea5fa6fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.018287 31523 tablet_service.cc:1511] Processing CreateTablet for tablet d24e9da72f7e48318f96034b21288f97 (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:27.018311 31664 tablet_service.cc:1511] Processing CreateTablet for tablet 9abf8d04896f4fca9fe2248c288e4799 (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:27.020694 31664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9abf8d04896f4fca9fe2248c288e4799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.013127 31671 tablet_service.cc:1511] Processing CreateTablet for tablet f5321310673e483e92aedb4c6cca19c4 (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:27.022975 31597 tablet_service.cc:1511] Processing CreateTablet for tablet 725bb603dd8d43fba4dcd318ea5fa6fd (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:27.024202 31597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 725bb603dd8d43fba4dcd318ea5fa6fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.024092 31592 tablet_service.cc:1511] Processing CreateTablet for tablet 9abf8d04896f4fca9fe2248c288e4799 (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:27.023022 31671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5321310673e483e92aedb4c6cca19c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.025559 31592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9abf8d04896f4fca9fe2248c288e4799. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.016112 31516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e02a21fb5c544faaa64ad2c506072ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.029914 31523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d24e9da72f7e48318f96034b21288f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.034277 31598 tablet_service.cc:1511] Processing CreateTablet for tablet 2e02a21fb5c544faaa64ad2c506072ee (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:27.035722 31598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e02a21fb5c544faaa64ad2c506072ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.036198 31515 tablet_service.cc:1511] Processing CreateTablet for tablet dfaf881c01af408c82dde838f114c3a5 (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:27.037714 31515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfaf881c01af408c82dde838f114c3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.038411 31670 tablet_service.cc:1511] Processing CreateTablet for tablet d24e9da72f7e48318f96034b21288f97 (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:27.039693 31670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d24e9da72f7e48318f96034b21288f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.042513 31668 tablet_service.cc:1511] Processing CreateTablet for tablet dfaf881c01af408c82dde838f114c3a5 (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:27.042930 31522 tablet_service.cc:1511] Processing CreateTablet for tablet b62e43c0adf14243abb4449897b332cb (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:27.043848 31668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfaf881c01af408c82dde838f114c3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.044153 31522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b62e43c0adf14243abb4449897b332cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.036857 31669 tablet_service.cc:1511] Processing CreateTablet for tablet 2e02a21fb5c544faaa64ad2c506072ee (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:27.046393 31669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e02a21fb5c544faaa64ad2c506072ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.048242 31591 tablet_service.cc:1511] Processing CreateTablet for tablet d24e9da72f7e48318f96034b21288f97 (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:27.049556 31591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d24e9da72f7e48318f96034b21288f97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.054970 31595 tablet_service.cc:1511] Processing CreateTablet for tablet dfaf881c01af408c82dde838f114c3a5 (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:27.056367 31595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfaf881c01af408c82dde838f114c3a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.065557 31672 tablet_service.cc:1511] Processing CreateTablet for tablet b62e43c0adf14243abb4449897b332cb (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:27.066928 31672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b62e43c0adf14243abb4449897b332cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.070914 31594 tablet_service.cc:1511] Processing CreateTablet for tablet b62e43c0adf14243abb4449897b332cb (DEFAULT_TABLE table=soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:27.072243 31594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b62e43c0adf14243abb4449897b332cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:27.119416 31830 tablet_bootstrap.cc:492] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651: Bootstrap starting.
I20260709 13:12:27.186605 31831 tablet_bootstrap.cc:492] T 00f5b064fec14d58bbd0b717a74ca3c7 P b04ac890eb2f4a18b089b0c95bea102f: Bootstrap starting.
I20260709 13:12:27.202286 31830 tablet_bootstrap.cc:654] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.206549 31831 tablet_bootstrap.cc:654] T 00f5b064fec14d58bbd0b717a74ca3c7 P b04ac890eb2f4a18b089b0c95bea102f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.207053 31832 tablet_bootstrap.cc:492] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0: Bootstrap starting.
I20260709 13:12:27.210395 31830 tablet_bootstrap.cc:492] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651: No bootstrap required, opened a new log
I20260709 13:12:27.210937 31830 ts_tablet_manager.cc:1403] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651: Time spent bootstrapping tablet: real 0.092s	user 0.013s	sys 0.001s
I20260709 13:12:27.211585 31831 tablet_bootstrap.cc:492] T 00f5b064fec14d58bbd0b717a74ca3c7 P b04ac890eb2f4a18b089b0c95bea102f: No bootstrap required, opened a new log
I20260709 13:12:27.212133 31831 ts_tablet_manager.cc:1403] T 00f5b064fec14d58bbd0b717a74ca3c7 P b04ac890eb2f4a18b089b0c95bea102f: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:12:27.213167 31832 tablet_bootstrap.cc:654] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.214296 31830 raft_consensus.cc:359] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.215096 31830 raft_consensus.cc:385] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.215018 31831 raft_consensus.cc:359] T 00f5b064fec14d58bbd0b717a74ca3c7 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.215538 31830 raft_consensus.cc:740] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd26c2c466ca41709432959be327b651, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.215930 31831 raft_consensus.cc:385] T 00f5b064fec14d58bbd0b717a74ca3c7 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.216306 31831 raft_consensus.cc:740] T 00f5b064fec14d58bbd0b717a74ca3c7 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.216466 31830 consensus_queue.cc:260] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.217120 31831 consensus_queue.cc:260] T 00f5b064fec14d58bbd0b717a74ca3c7 P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.219151 31832 tablet_bootstrap.cc:492] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0: No bootstrap required, opened a new log
I20260709 13:12:27.219821 31832 ts_tablet_manager.cc:1403] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 13:12:27.219430 31831 ts_tablet_manager.cc:1434] T 00f5b064fec14d58bbd0b717a74ca3c7 P b04ac890eb2f4a18b089b0c95bea102f: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.006s
I20260709 13:12:27.220268 31830 ts_tablet_manager.cc:1434] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:12:27.221292 31830 tablet_bootstrap.cc:492] T d910acb7832449f89582dac7611ae3f3 P dd26c2c466ca41709432959be327b651: Bootstrap starting.
I20260709 13:12:27.223780 31831 tablet_bootstrap.cc:492] T 9abf8d04896f4fca9fe2248c288e4799 P b04ac890eb2f4a18b089b0c95bea102f: Bootstrap starting.
I20260709 13:12:27.227916 31830 tablet_bootstrap.cc:654] T d910acb7832449f89582dac7611ae3f3 P dd26c2c466ca41709432959be327b651: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.230286 31832 raft_consensus.cc:359] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.230911 31831 tablet_bootstrap.cc:654] T 9abf8d04896f4fca9fe2248c288e4799 P b04ac890eb2f4a18b089b0c95bea102f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.231249 31832 raft_consensus.cc:385] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.231649 31832 raft_consensus.cc:740] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Initialized, Role: FOLLOWER
W20260709 13:12:27.231899 31479 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:27.232479 31832 consensus_queue.cc:260] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.235175 31832 ts_tablet_manager.cc:1434] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:12:27.236343 31832 tablet_bootstrap.cc:492] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0: Bootstrap starting.
I20260709 13:12:27.243175 31832 tablet_bootstrap.cc:654] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.254942 31832 tablet_bootstrap.cc:492] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0: No bootstrap required, opened a new log
I20260709 13:12:27.255520 31832 ts_tablet_manager.cc:1403] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 13:12:27.258634 31832 raft_consensus.cc:359] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.259497 31832 raft_consensus.cc:385] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.259864 31832 raft_consensus.cc:740] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.260703 31832 consensus_queue.cc:260] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.278348 31832 ts_tablet_manager.cc:1434] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:12:27.282331 31832 tablet_bootstrap.cc:492] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0: Bootstrap starting.
W20260709 13:12:27.291059 31645 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.1:38671, user_credentials={real_user=slave}} blocked reactor thread for 61285us
I20260709 13:12:27.292290 31832 tablet_bootstrap.cc:654] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.296787 31819 raft_consensus.cc:493] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.297355 31819 raft_consensus.cc:515] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.299439 31831 tablet_bootstrap.cc:492] T 9abf8d04896f4fca9fe2248c288e4799 P b04ac890eb2f4a18b089b0c95bea102f: No bootstrap required, opened a new log
I20260709 13:12:27.301095 31608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abf8d04896f4fca9fe2248c288e4799" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
I20260709 13:12:27.303764 31831 ts_tablet_manager.cc:1403] T 9abf8d04896f4fca9fe2248c288e4799 P b04ac890eb2f4a18b089b0c95bea102f: Time spent bootstrapping tablet: real 0.080s	user 0.023s	sys 0.044s
I20260709 13:12:27.303874 31608 raft_consensus.cc:2468] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 0.
I20260709 13:12:27.304765 31819 leader_election.cc:290] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:27.305253 31499 leader_election.cc:304] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651; no voters: 
I20260709 13:12:27.305373 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abf8d04896f4fca9fe2248c288e4799" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f" is_pre_election: true
I20260709 13:12:27.306143 31819 raft_consensus.cc:2804] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.306559 31819 raft_consensus.cc:493] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.306917 31819 raft_consensus.cc:3060] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.307312 31831 raft_consensus.cc:359] T 9abf8d04896f4fca9fe2248c288e4799 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.308419 31831 raft_consensus.cc:385] T 9abf8d04896f4fca9fe2248c288e4799 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.308804 31831 raft_consensus.cc:740] T 9abf8d04896f4fca9fe2248c288e4799 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.311262 31830 tablet_bootstrap.cc:492] T d910acb7832449f89582dac7611ae3f3 P dd26c2c466ca41709432959be327b651: No bootstrap required, opened a new log
I20260709 13:12:27.311051 31831 consensus_queue.cc:260] T 9abf8d04896f4fca9fe2248c288e4799 P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.311868 31830 ts_tablet_manager.cc:1403] T d910acb7832449f89582dac7611ae3f3 P dd26c2c466ca41709432959be327b651: Time spent bootstrapping tablet: real 0.091s	user 0.041s	sys 0.031s
I20260709 13:12:27.313824 31819 raft_consensus.cc:515] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.315821 31830 raft_consensus.cc:359] T d910acb7832449f89582dac7611ae3f3 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.316656 31830 raft_consensus.cc:385] T d910acb7832449f89582dac7611ae3f3 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.317005 31830 raft_consensus.cc:740] T d910acb7832449f89582dac7611ae3f3 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd26c2c466ca41709432959be327b651, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.317742 31832 tablet_bootstrap.cc:492] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0: No bootstrap required, opened a new log
I20260709 13:12:27.318421 31832 ts_tablet_manager.cc:1403] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.005s
I20260709 13:12:27.317811 31830 consensus_queue.cc:260] T d910acb7832449f89582dac7611ae3f3 P dd26c2c466ca41709432959be327b651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.320578 31830 ts_tablet_manager.cc:1434] T d910acb7832449f89582dac7611ae3f3 P dd26c2c466ca41709432959be327b651: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:27.321640 31830 tablet_bootstrap.cc:492] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651: Bootstrap starting.
I20260709 13:12:27.321552 31832 raft_consensus.cc:359] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.322474 31832 raft_consensus.cc:385] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.322782 31832 raft_consensus.cc:740] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.323405 31608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abf8d04896f4fca9fe2248c288e4799" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651"
I20260709 13:12:27.313841 31831 ts_tablet_manager.cc:1434] T 9abf8d04896f4fca9fe2248c288e4799 P b04ac890eb2f4a18b089b0c95bea102f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 13:12:27.324112 31608 raft_consensus.cc:3060] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.324818 31831 tablet_bootstrap.cc:492] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f: Bootstrap starting.
I20260709 13:12:27.328964 31830 tablet_bootstrap.cc:654] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.331864 31831 tablet_bootstrap.cc:654] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.333931 31819 leader_election.cc:290] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 election: Requested vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:27.323532 31832 consensus_queue.cc:260] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
W20260709 13:12:27.342386 31499 leader_election.cc:343] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.345027 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abf8d04896f4fca9fe2248c288e4799" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
I20260709 13:12:27.346665 31832 ts_tablet_manager.cc:1434] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:12:27.347311 31682 raft_consensus.cc:3060] T 9abf8d04896f4fca9fe2248c288e4799 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.350826 31608 raft_consensus.cc:2468] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 1.
I20260709 13:12:27.352650 31832 tablet_bootstrap.cc:492] T dfaf881c01af408c82dde838f114c3a5 P 5ccb0482a31a436882a89f5dfdede1c0: Bootstrap starting.
I20260709 13:12:27.353999 31499 leader_election.cc:304] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651; no voters: 
I20260709 13:12:27.354779 31819 raft_consensus.cc:2804] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.355230 31819 raft_consensus.cc:697] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Running, Role: LEADER
I20260709 13:12:27.356026 31819 consensus_queue.cc:237] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.357280 31682 raft_consensus.cc:2468] T 9abf8d04896f4fca9fe2248c288e4799 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 1.
I20260709 13:12:27.359645 31832 tablet_bootstrap.cc:654] T dfaf881c01af408c82dde838f114c3a5 P 5ccb0482a31a436882a89f5dfdede1c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.360184 31830 tablet_bootstrap.cc:492] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651: No bootstrap required, opened a new log
I20260709 13:12:27.360795 31830 ts_tablet_manager.cc:1403] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.009s
I20260709 13:12:27.365144 31830 raft_consensus.cc:359] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.366123 31830 raft_consensus.cc:385] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.366501 31830 raft_consensus.cc:740] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd26c2c466ca41709432959be327b651, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.367473 31830 consensus_queue.cc:260] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.370553 31830 ts_tablet_manager.cc:1434] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:12:27.372285 31830 tablet_bootstrap.cc:492] T 725bb603dd8d43fba4dcd318ea5fa6fd P dd26c2c466ca41709432959be327b651: Bootstrap starting.
I20260709 13:12:27.378672 31830 tablet_bootstrap.cc:654] T 725bb603dd8d43fba4dcd318ea5fa6fd P dd26c2c466ca41709432959be327b651: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.379259 31831 tablet_bootstrap.cc:492] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f: No bootstrap required, opened a new log
I20260709 13:12:27.379982 31831 ts_tablet_manager.cc:1403] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.013s
I20260709 13:12:27.384091 31831 raft_consensus.cc:359] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.385108 31831 raft_consensus.cc:385] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.385506 31831 raft_consensus.cc:740] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.386523 31831 consensus_queue.cc:260] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.389372 31831 ts_tablet_manager.cc:1434] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:12:27.391084 31831 tablet_bootstrap.cc:492] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f: Bootstrap starting.
I20260709 13:12:27.391451 31832 tablet_bootstrap.cc:492] T dfaf881c01af408c82dde838f114c3a5 P 5ccb0482a31a436882a89f5dfdede1c0: No bootstrap required, opened a new log
I20260709 13:12:27.392060 31832 ts_tablet_manager.cc:1403] T dfaf881c01af408c82dde838f114c3a5 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent bootstrapping tablet: real 0.040s	user 0.005s	sys 0.013s
I20260709 13:12:27.394990 31832 raft_consensus.cc:359] T dfaf881c01af408c82dde838f114c3a5 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.395677 31832 raft_consensus.cc:385] T dfaf881c01af408c82dde838f114c3a5 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.396103 31832 raft_consensus.cc:740] T dfaf881c01af408c82dde838f114c3a5 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.395576 31428 catalog_manager.cc:5697] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "5ccb0482a31a436882a89f5dfdede1c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.397209 31831 tablet_bootstrap.cc:654] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.396806 31832 consensus_queue.cc:260] T dfaf881c01af408c82dde838f114c3a5 P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.401026 31830 tablet_bootstrap.cc:492] T 725bb603dd8d43fba4dcd318ea5fa6fd P dd26c2c466ca41709432959be327b651: No bootstrap required, opened a new log
I20260709 13:12:27.401543 31832 ts_tablet_manager.cc:1434] T dfaf881c01af408c82dde838f114c3a5 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:12:27.401572 31830 ts_tablet_manager.cc:1403] T 725bb603dd8d43fba4dcd318ea5fa6fd P dd26c2c466ca41709432959be327b651: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.012s
I20260709 13:12:27.402776 31832 tablet_bootstrap.cc:492] T d24e9da72f7e48318f96034b21288f97 P 5ccb0482a31a436882a89f5dfdede1c0: Bootstrap starting.
I20260709 13:12:27.404769 31830 raft_consensus.cc:359] T 725bb603dd8d43fba4dcd318ea5fa6fd P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.405459 31830 raft_consensus.cc:385] T 725bb603dd8d43fba4dcd318ea5fa6fd P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.405745 31830 raft_consensus.cc:740] T 725bb603dd8d43fba4dcd318ea5fa6fd P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd26c2c466ca41709432959be327b651, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.406533 31830 consensus_queue.cc:260] T 725bb603dd8d43fba4dcd318ea5fa6fd P dd26c2c466ca41709432959be327b651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.409024 31830 ts_tablet_manager.cc:1434] T 725bb603dd8d43fba4dcd318ea5fa6fd P dd26c2c466ca41709432959be327b651: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:27.410019 31830 tablet_bootstrap.cc:492] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651: Bootstrap starting.
I20260709 13:12:27.412675 31832 tablet_bootstrap.cc:654] T d24e9da72f7e48318f96034b21288f97 P 5ccb0482a31a436882a89f5dfdede1c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.416260 31830 tablet_bootstrap.cc:654] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.420078 31832 tablet_bootstrap.cc:492] T d24e9da72f7e48318f96034b21288f97 P 5ccb0482a31a436882a89f5dfdede1c0: No bootstrap required, opened a new log
I20260709 13:12:27.420078 31831 tablet_bootstrap.cc:492] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f: No bootstrap required, opened a new log
I20260709 13:12:27.420861 31832 ts_tablet_manager.cc:1403] T d24e9da72f7e48318f96034b21288f97 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 13:12:27.420989 31831 ts_tablet_manager.cc:1403] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.005s
I20260709 13:12:27.424429 31831 raft_consensus.cc:359] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.424633 31832 raft_consensus.cc:359] T d24e9da72f7e48318f96034b21288f97 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.425271 31831 raft_consensus.cc:385] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.425642 31832 raft_consensus.cc:385] T d24e9da72f7e48318f96034b21288f97 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.426076 31832 raft_consensus.cc:740] T d24e9da72f7e48318f96034b21288f97 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.426950 31832 consensus_queue.cc:260] T d24e9da72f7e48318f96034b21288f97 P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.429163 31830 tablet_bootstrap.cc:492] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651: No bootstrap required, opened a new log
I20260709 13:12:27.429597 31832 ts_tablet_manager.cc:1434] T d24e9da72f7e48318f96034b21288f97 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:12:27.429730 31830 ts_tablet_manager.cc:1403] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 13:12:27.425664 31831 raft_consensus.cc:740] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.430832 31832 tablet_bootstrap.cc:492] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0: Bootstrap starting.
I20260709 13:12:27.434362 31830 raft_consensus.cc:359] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.435693 31830 raft_consensus.cc:385] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.436141 31830 raft_consensus.cc:740] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd26c2c466ca41709432959be327b651, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.437048 31830 consensus_queue.cc:260] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.436985 31831 consensus_queue.cc:260] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.439752 31830 ts_tablet_manager.cc:1434] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:12:27.440007 31831 ts_tablet_manager.cc:1434] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:12:27.440752 31830 tablet_bootstrap.cc:492] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651: Bootstrap starting.
I20260709 13:12:27.441208 31831 tablet_bootstrap.cc:492] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f: Bootstrap starting.
I20260709 13:12:27.444715 31832 tablet_bootstrap.cc:654] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.447082 31830 tablet_bootstrap.cc:654] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.458380 31830 tablet_bootstrap.cc:492] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651: No bootstrap required, opened a new log
I20260709 13:12:27.458890 31830 ts_tablet_manager.cc:1403] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:12:27.461555 31830 raft_consensus.cc:359] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.462265 31830 raft_consensus.cc:385] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.462558 31830 raft_consensus.cc:740] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd26c2c466ca41709432959be327b651, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.467310 31831 tablet_bootstrap.cc:654] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.463436 31830 consensus_queue.cc:260] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.471911 31830 ts_tablet_manager.cc:1434] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 13:12:27.472988 31832 tablet_bootstrap.cc:492] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0: No bootstrap required, opened a new log
I20260709 13:12:27.473119 31830 tablet_bootstrap.cc:492] T 00f5b064fec14d58bbd0b717a74ca3c7 P dd26c2c466ca41709432959be327b651: Bootstrap starting.
I20260709 13:12:27.473855 31832 ts_tablet_manager.cc:1403] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.018s
I20260709 13:12:27.478844 31832 raft_consensus.cc:359] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.479596 31832 raft_consensus.cc:385] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.479902 31832 raft_consensus.cc:740] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.480782 31830 tablet_bootstrap.cc:654] T 00f5b064fec14d58bbd0b717a74ca3c7 P dd26c2c466ca41709432959be327b651: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.480882 31831 tablet_bootstrap.cc:492] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f: No bootstrap required, opened a new log
I20260709 13:12:27.481550 31831 ts_tablet_manager.cc:1403] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.016s
I20260709 13:12:27.480587 31832 consensus_queue.cc:260] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.483811 31832 ts_tablet_manager.cc:1434] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:12:27.484826 31832 tablet_bootstrap.cc:492] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0: Bootstrap starting.
I20260709 13:12:27.484553 31831 raft_consensus.cc:359] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.485335 31831 raft_consensus.cc:385] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.485654 31831 raft_consensus.cc:740] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.486375 31831 consensus_queue.cc:260] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.488652 31831 ts_tablet_manager.cc:1434] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 13:12:27.492681 31831 tablet_bootstrap.cc:492] T dfaf881c01af408c82dde838f114c3a5 P b04ac890eb2f4a18b089b0c95bea102f: Bootstrap starting.
I20260709 13:12:27.494697 31832 tablet_bootstrap.cc:654] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.502915 31819 raft_consensus.cc:493] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.503755 31831 tablet_bootstrap.cc:654] T dfaf881c01af408c82dde838f114c3a5 P b04ac890eb2f4a18b089b0c95bea102f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.503701 31819 raft_consensus.cc:515] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.507627 31608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f5b064fec14d58bbd0b717a74ca3c7" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
W20260709 13:12:27.510476 31499 leader_election.cc:343] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd26c2c466ca41709432959be327b651 (127.20.40.2:42179): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.516069 31832 tablet_bootstrap.cc:492] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0: No bootstrap required, opened a new log
I20260709 13:12:27.516848 31832 ts_tablet_manager.cc:1403] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.006s
I20260709 13:12:27.511610 31681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f5b064fec14d58bbd0b717a74ca3c7" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f" is_pre_election: true
I20260709 13:12:27.520773 31832 raft_consensus.cc:359] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.521306 31681 raft_consensus.cc:2468] T 00f5b064fec14d58bbd0b717a74ca3c7 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 0.
I20260709 13:12:27.521839 31832 raft_consensus.cc:385] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.522301 31832 raft_consensus.cc:740] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.523527 31499 leader_election.cc:304] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, b04ac890eb2f4a18b089b0c95bea102f; no voters: dd26c2c466ca41709432959be327b651
I20260709 13:12:27.524991 31842 raft_consensus.cc:2804] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.525363 31842 raft_consensus.cc:493] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.525682 31819 leader_election.cc:290] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:27.525743 31842 raft_consensus.cc:3060] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.523489 31832 consensus_queue.cc:260] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.537057 31832 ts_tablet_manager.cc:1434] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent starting tablet: real 0.020s	user 0.009s	sys 0.000s
I20260709 13:12:27.538098 31832 tablet_bootstrap.cc:492] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0: Bootstrap starting.
I20260709 13:12:27.542645 31842 raft_consensus.cc:515] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.547171 31831 tablet_bootstrap.cc:492] T dfaf881c01af408c82dde838f114c3a5 P b04ac890eb2f4a18b089b0c95bea102f: No bootstrap required, opened a new log
I20260709 13:12:27.547446 31830 tablet_bootstrap.cc:492] T 00f5b064fec14d58bbd0b717a74ca3c7 P dd26c2c466ca41709432959be327b651: No bootstrap required, opened a new log
I20260709 13:12:27.547780 31831 ts_tablet_manager.cc:1403] T dfaf881c01af408c82dde838f114c3a5 P b04ac890eb2f4a18b089b0c95bea102f: Time spent bootstrapping tablet: real 0.055s	user 0.028s	sys 0.020s
I20260709 13:12:27.548208 31830 ts_tablet_manager.cc:1403] T 00f5b064fec14d58bbd0b717a74ca3c7 P dd26c2c466ca41709432959be327b651: Time spent bootstrapping tablet: real 0.075s	user 0.032s	sys 0.020s
I20260709 13:12:27.548599 31832 tablet_bootstrap.cc:654] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.550218 31608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f5b064fec14d58bbd0b717a74ca3c7" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651"
I20260709 13:12:27.551132 31831 raft_consensus.cc:359] T dfaf881c01af408c82dde838f114c3a5 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.551940 31831 raft_consensus.cc:385] T dfaf881c01af408c82dde838f114c3a5 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.551544 31830 raft_consensus.cc:359] T 00f5b064fec14d58bbd0b717a74ca3c7 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.552029 31843 raft_consensus.cc:493] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.552302 31831 raft_consensus.cc:740] T dfaf881c01af408c82dde838f114c3a5 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.552619 31830 raft_consensus.cc:385] T 00f5b064fec14d58bbd0b717a74ca3c7 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.553165 31830 raft_consensus.cc:740] T 00f5b064fec14d58bbd0b717a74ca3c7 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd26c2c466ca41709432959be327b651, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.553100 31843 raft_consensus.cc:515] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.553483 31831 consensus_queue.cc:260] T dfaf881c01af408c82dde838f114c3a5 P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.556200 31831 ts_tablet_manager.cc:1434] T dfaf881c01af408c82dde838f114c3a5 P b04ac890eb2f4a18b089b0c95bea102f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:12:27.557248 31831 tablet_bootstrap.cc:492] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f: Bootstrap starting.
I20260709 13:12:27.557101 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24e9da72f7e48318f96034b21288f97" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0" is_pre_election: true
I20260709 13:12:27.557821 31531 raft_consensus.cc:2468] T d24e9da72f7e48318f96034b21288f97 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd26c2c466ca41709432959be327b651 in term 0.
I20260709 13:12:27.564273 31831 tablet_bootstrap.cc:654] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.563992 31571 leader_election.cc:304] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651; no voters: 
I20260709 13:12:27.565600 31792 raft_consensus.cc:2804] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.566097 31792 raft_consensus.cc:493] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.566550 31792 raft_consensus.cc:3060] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.554358 31830 consensus_queue.cc:260] T 00f5b064fec14d58bbd0b717a74ca3c7 P dd26c2c466ca41709432959be327b651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.573650 31608 raft_consensus.cc:3060] T 00f5b064fec14d58bbd0b717a74ca3c7 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.577991 31830 ts_tablet_manager.cc:1434] T 00f5b064fec14d58bbd0b717a74ca3c7 P dd26c2c466ca41709432959be327b651: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.002s
I20260709 13:12:27.582701 31830 tablet_bootstrap.cc:492] T f5321310673e483e92aedb4c6cca19c4 P dd26c2c466ca41709432959be327b651: Bootstrap starting.
I20260709 13:12:27.590066 31860 raft_consensus.cc:493] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.590477 31843 leader_election.cc:290] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:27.590838 31860 raft_consensus.cc:515] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.593470 31860 leader_election.cc:290] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:27.594156 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfaf881c01af408c82dde838f114c3a5" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0" is_pre_election: true
I20260709 13:12:27.594533 31681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24e9da72f7e48318f96034b21288f97" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f" is_pre_election: true
I20260709 13:12:27.594661 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfaf881c01af408c82dde838f114c3a5" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f" is_pre_election: true
I20260709 13:12:27.594910 31531 raft_consensus.cc:2468] T dfaf881c01af408c82dde838f114c3a5 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd26c2c466ca41709432959be327b651 in term 0.
I20260709 13:12:27.595504 31682 raft_consensus.cc:2468] T dfaf881c01af408c82dde838f114c3a5 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd26c2c466ca41709432959be327b651 in term 0.
W20260709 13:12:27.596052 31574 leader_election.cc:343] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.596210 31571 leader_election.cc:304] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651; no voters: 
I20260709 13:12:27.597000 31860 raft_consensus.cc:2804] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.597271 31819 raft_consensus.cc:493] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.597352 31860 raft_consensus.cc:493] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.598022 31860 raft_consensus.cc:3060] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.598053 31819 raft_consensus.cc:515] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.600934 31819 leader_election.cc:290] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:27.602828 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62e43c0adf14243abb4449897b332cb" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f" is_pre_election: true
I20260709 13:12:27.603078 31830 tablet_bootstrap.cc:654] T f5321310673e483e92aedb4c6cca19c4 P dd26c2c466ca41709432959be327b651: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.604255 31836 raft_consensus.cc:493] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.604779 31836 raft_consensus.cc:515] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.605566 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62e43c0adf14243abb4449897b332cb" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
I20260709 13:12:27.605778 31860 raft_consensus.cc:515] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.607026 31836 leader_election.cc:290] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
W20260709 13:12:27.607445 31499 leader_election.cc:343] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd26c2c466ca41709432959be327b651 (127.20.40.2:42179): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:27.608147 31499 leader_election.cc:343] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.608884 31860 leader_election.cc:290] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:27.609019 31499 leader_election.cc:304] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0; no voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651
I20260709 13:12:27.610158 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d910acb7832449f89582dac7611ae3f3" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0" is_pre_election: true
W20260709 13:12:27.611884 31645 leader_election.cc:343] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.613118 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfaf881c01af408c82dde838f114c3a5" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
I20260709 13:12:27.613888 31682 raft_consensus.cc:3060] T dfaf881c01af408c82dde838f114c3a5 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.618919 31830 tablet_bootstrap.cc:492] T f5321310673e483e92aedb4c6cca19c4 P dd26c2c466ca41709432959be327b651: No bootstrap required, opened a new log
I20260709 13:12:27.619692 31830 ts_tablet_manager.cc:1403] T f5321310673e483e92aedb4c6cca19c4 P dd26c2c466ca41709432959be327b651: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.013s
I20260709 13:12:27.623447 31830 raft_consensus.cc:359] T f5321310673e483e92aedb4c6cca19c4 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.624540 31830 raft_consensus.cc:385] T f5321310673e483e92aedb4c6cca19c4 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.624691 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfaf881c01af408c82dde838f114c3a5" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
I20260709 13:12:27.625006 31830 raft_consensus.cc:740] T f5321310673e483e92aedb4c6cca19c4 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd26c2c466ca41709432959be327b651, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.625622 31531 raft_consensus.cc:3060] T dfaf881c01af408c82dde838f114c3a5 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.626274 31830 consensus_queue.cc:260] T f5321310673e483e92aedb4c6cca19c4 P dd26c2c466ca41709432959be327b651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.629176 31830 ts_tablet_manager.cc:1434] T f5321310673e483e92aedb4c6cca19c4 P dd26c2c466ca41709432959be327b651: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:12:27.622900 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d910acb7832449f89582dac7611ae3f3" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
I20260709 13:12:27.630528 31830 tablet_bootstrap.cc:492] T b62e43c0adf14243abb4449897b332cb P dd26c2c466ca41709432959be327b651: Bootstrap starting.
I20260709 13:12:27.630980 31606 raft_consensus.cc:2468] T d910acb7832449f89582dac7611ae3f3 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 0.
I20260709 13:12:27.632385 31648 leader_election.cc:304] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651; no voters: 5ccb0482a31a436882a89f5dfdede1c0
I20260709 13:12:27.633577 31836 raft_consensus.cc:2804] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.633942 31836 raft_consensus.cc:493] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.634303 31836 raft_consensus.cc:3060] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.639923 31830 tablet_bootstrap.cc:654] T b62e43c0adf14243abb4449897b332cb P dd26c2c466ca41709432959be327b651: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.645961 31766 raft_consensus.cc:493] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.646824 31766 raft_consensus.cc:515] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.651451 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e02a21fb5c544faaa64ad2c506072ee" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0" is_pre_election: true
I20260709 13:12:27.651741 31766 leader_election.cc:290] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
W20260709 13:12:27.653623 31645 leader_election.cc:343] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.654354 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e02a21fb5c544faaa64ad2c506072ee" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
I20260709 13:12:27.655449 31606 raft_consensus.cc:2468] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 0.
I20260709 13:12:27.657032 31648 leader_election.cc:304] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651; no voters: 5ccb0482a31a436882a89f5dfdede1c0
I20260709 13:12:27.658216 31830 tablet_bootstrap.cc:492] T b62e43c0adf14243abb4449897b332cb P dd26c2c466ca41709432959be327b651: No bootstrap required, opened a new log
I20260709 13:12:27.659152 31766 raft_consensus.cc:2804] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.667738 31766 raft_consensus.cc:493] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.667922 31830 ts_tablet_manager.cc:1403] T b62e43c0adf14243abb4449897b332cb P dd26c2c466ca41709432959be327b651: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.012s
I20260709 13:12:27.668392 31766 raft_consensus.cc:3060] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.672564 31830 raft_consensus.cc:359] T b62e43c0adf14243abb4449897b332cb P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.661484 31819 raft_consensus.cc:2749] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:27.673837 31830 raft_consensus.cc:385] T b62e43c0adf14243abb4449897b332cb P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.674388 31830 raft_consensus.cc:740] T b62e43c0adf14243abb4449897b332cb P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd26c2c466ca41709432959be327b651, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.675419 31830 consensus_queue.cc:260] T b62e43c0adf14243abb4449897b332cb P dd26c2c466ca41709432959be327b651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.678368 31830 ts_tablet_manager.cc:1434] T b62e43c0adf14243abb4449897b332cb P dd26c2c466ca41709432959be327b651: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:12:27.662750 31842 leader_election.cc:290] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 election: Requested vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
W20260709 13:12:27.660661 31499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.20.40.3:38141, user_credentials={real_user=slave}} blocked reactor thread for 52534.6us
I20260709 13:12:27.683445 31682 raft_consensus.cc:2468] T dfaf881c01af408c82dde838f114c3a5 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd26c2c466ca41709432959be327b651 in term 1.
I20260709 13:12:27.677253 31608 raft_consensus.cc:2468] T 00f5b064fec14d58bbd0b717a74ca3c7 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 1.
I20260709 13:12:27.683965 31681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f5b064fec14d58bbd0b717a74ca3c7" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
I20260709 13:12:27.684437 31792 raft_consensus.cc:515] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.689881 31681 raft_consensus.cc:3060] T 00f5b064fec14d58bbd0b717a74ca3c7 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.691366 31792 leader_election.cc:290] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:27.685113 31574 leader_election.cc:304] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651; no voters: 
I20260709 13:12:27.693971 31792 raft_consensus.cc:2804] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.694525 31792 raft_consensus.cc:697] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [term 1 LEADER]: Becoming Leader. State: Replica: dd26c2c466ca41709432959be327b651, State: Running, Role: LEADER
I20260709 13:12:27.695391 31792 consensus_queue.cc:237] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.696975 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24e9da72f7e48318f96034b21288f97" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
I20260709 13:12:27.697698 31533 raft_consensus.cc:3060] T d24e9da72f7e48318f96034b21288f97 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.698999 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24e9da72f7e48318f96034b21288f97" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
W20260709 13:12:27.702437 31574 leader_election.cc:343] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.707695 31531 raft_consensus.cc:2468] T dfaf881c01af408c82dde838f114c3a5 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd26c2c466ca41709432959be327b651 in term 1.
I20260709 13:12:27.709895 31766 raft_consensus.cc:515] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.713959 31766 leader_election.cc:290] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:27.716667 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e02a21fb5c544faaa64ad2c506072ee" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
W20260709 13:12:27.719274 31645 leader_election.cc:343] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.723142 31608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e02a21fb5c544faaa64ad2c506072ee" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651"
I20260709 13:12:27.724221 31608 raft_consensus.cc:3060] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.726271 31431 catalog_manager.cc:5697] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd26c2c466ca41709432959be327b651 (127.20.40.2). New cstate: current_term: 1 leader_uuid: "dd26c2c466ca41709432959be327b651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:27.737882 31499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.2:42179, user_credentials={real_user=slave}} blocked reactor thread for 48403.1us
I20260709 13:12:27.738891 31842 raft_consensus.cc:493] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.680663 31836 raft_consensus.cc:515] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.739727 31842 raft_consensus.cc:515] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.738997 31499 leader_election.cc:304] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651; no voters: 
I20260709 13:12:27.745218 31819 raft_consensus.cc:2804] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.745898 31842 leader_election.cc:290] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:27.748006 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725bb603dd8d43fba4dcd318ea5fa6fd" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
I20260709 13:12:27.748893 31606 raft_consensus.cc:2468] T 725bb603dd8d43fba4dcd318ea5fa6fd P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 0.
I20260709 13:12:27.749193 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d910acb7832449f89582dac7611ae3f3" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
I20260709 13:12:27.749569 31819 raft_consensus.cc:697] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Running, Role: LEADER
I20260709 13:12:27.749841 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d910acb7832449f89582dac7611ae3f3" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651"
W20260709 13:12:27.750614 31645 leader_election.cc:343] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.748610 31836 leader_election.cc:290] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:27.750739 31819 consensus_queue.cc:237] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.750739 31605 raft_consensus.cc:3060] T d910acb7832449f89582dac7611ae3f3 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.757136 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725bb603dd8d43fba4dcd318ea5fa6fd" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f" is_pre_election: true
I20260709 13:12:27.758463 31533 raft_consensus.cc:2468] T d24e9da72f7e48318f96034b21288f97 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd26c2c466ca41709432959be327b651 in term 1.
W20260709 13:12:27.758615 31499 leader_election.cc:343] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.760038 31571 leader_election.cc:304] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651; no voters: b04ac890eb2f4a18b089b0c95bea102f
I20260709 13:12:27.760357 31831 tablet_bootstrap.cc:492] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f: No bootstrap required, opened a new log
I20260709 13:12:27.761036 31608 raft_consensus.cc:2468] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 1.
I20260709 13:12:27.761250 31831 ts_tablet_manager.cc:1403] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f: Time spent bootstrapping tablet: real 0.204s	user 0.048s	sys 0.114s
I20260709 13:12:27.761703 31792 raft_consensus.cc:2804] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.762352 31648 leader_election.cc:304] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651; no voters: 5ccb0482a31a436882a89f5dfdede1c0
I20260709 13:12:27.762427 31792 raft_consensus.cc:697] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [term 1 LEADER]: Becoming Leader. State: Replica: dd26c2c466ca41709432959be327b651, State: Running, Role: LEADER
I20260709 13:12:27.763721 31836 raft_consensus.cc:2804] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.764269 31836 raft_consensus.cc:697] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Becoming Leader. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Running, Role: LEADER
I20260709 13:12:27.763811 31792 consensus_queue.cc:237] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.760339 31681 raft_consensus.cc:2468] T 00f5b064fec14d58bbd0b717a74ca3c7 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 1.
I20260709 13:12:27.765308 31831 raft_consensus.cc:359] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.765151 31836 consensus_queue.cc:237] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.766207 31831 raft_consensus.cc:385] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.766729 31831 raft_consensus.cc:740] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.767511 31831 consensus_queue.cc:260] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.770179 31831 ts_tablet_manager.cc:1434] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:12:27.771461 31831 tablet_bootstrap.cc:492] T d24e9da72f7e48318f96034b21288f97 P b04ac890eb2f4a18b089b0c95bea102f: Bootstrap starting.
I20260709 13:12:27.772153 31832 tablet_bootstrap.cc:492] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0: No bootstrap required, opened a new log
I20260709 13:12:27.772758 31832 ts_tablet_manager.cc:1403] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent bootstrapping tablet: real 0.235s	user 0.065s	sys 0.109s
I20260709 13:12:27.775141 31499 leader_election.cc:304] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651; no voters: b04ac890eb2f4a18b089b0c95bea102f
I20260709 13:12:27.776499 31842 raft_consensus.cc:2804] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.776856 31842 raft_consensus.cc:493] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.777240 31842 raft_consensus.cc:3060] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.778437 31605 raft_consensus.cc:2468] T d910acb7832449f89582dac7611ae3f3 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 1.
I20260709 13:12:27.779878 31648 leader_election.cc:304] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651; no voters: 5ccb0482a31a436882a89f5dfdede1c0
I20260709 13:12:27.781114 31766 raft_consensus.cc:2804] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.781651 31766 raft_consensus.cc:697] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Becoming Leader. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Running, Role: LEADER
I20260709 13:12:27.782449 31766 consensus_queue.cc:237] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.786676 31842 raft_consensus.cc:515] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.793321 31831 tablet_bootstrap.cc:654] T d24e9da72f7e48318f96034b21288f97 P b04ac890eb2f4a18b089b0c95bea102f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.795089 31431 catalog_manager.cc:5697] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd26c2c466ca41709432959be327b651 (127.20.40.2). New cstate: current_term: 1 leader_uuid: "dd26c2c466ca41709432959be327b651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.791528 31832 raft_consensus.cc:359] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.798031 31832 raft_consensus.cc:385] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.798826 31832 raft_consensus.cc:740] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.798404 31842 leader_election.cc:290] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 election: Requested vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:27.798940 31681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725bb603dd8d43fba4dcd318ea5fa6fd" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
I20260709 13:12:27.799464 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725bb603dd8d43fba4dcd318ea5fa6fd" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651"
W20260709 13:12:27.805763 31499 leader_election.cc:343] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:27.808215 31831 tablet_bootstrap.cc:492] T d24e9da72f7e48318f96034b21288f97 P b04ac890eb2f4a18b089b0c95bea102f: No bootstrap required, opened a new log
I20260709 13:12:27.808554 31605 raft_consensus.cc:3060] T 725bb603dd8d43fba4dcd318ea5fa6fd P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.803377 31766 raft_consensus.cc:493] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.809541 31766 raft_consensus.cc:515] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.804374 31832 consensus_queue.cc:260] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.812203 31832 ts_tablet_manager.cc:1434] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 13:12:27.811653 31431 catalog_manager.cc:5697] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "5ccb0482a31a436882a89f5dfdede1c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.816599 31832 tablet_bootstrap.cc:492] T 2e02a21fb5c544faaa64ad2c506072ee P 5ccb0482a31a436882a89f5dfdede1c0: Bootstrap starting.
I20260709 13:12:27.812467 31766 leader_election.cc:290] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:27.821408 31842 raft_consensus.cc:493] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.813733 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5321310673e483e92aedb4c6cca19c4" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
I20260709 13:12:27.823686 31842 raft_consensus.cc:515] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.823905 31606 raft_consensus.cc:2468] T f5321310673e483e92aedb4c6cca19c4 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 0.
I20260709 13:12:27.813875 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5321310673e483e92aedb4c6cca19c4" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0" is_pre_election: true
I20260709 13:12:27.825001 31531 raft_consensus.cc:2468] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 0.
I20260709 13:12:27.825317 31648 leader_election.cc:304] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651; no voters: 
I20260709 13:12:27.825994 31605 raft_consensus.cc:2468] T 725bb603dd8d43fba4dcd318ea5fa6fd P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 1.
I20260709 13:12:27.826242 31766 raft_consensus.cc:2804] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.808759 31831 ts_tablet_manager.cc:1403] T d24e9da72f7e48318f96034b21288f97 P b04ac890eb2f4a18b089b0c95bea102f: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.002s
I20260709 13:12:27.827168 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5321310673e483e92aedb4c6cca19c4" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
I20260709 13:12:27.822628 31832 tablet_bootstrap.cc:654] T 2e02a21fb5c544faaa64ad2c506072ee P 5ccb0482a31a436882a89f5dfdede1c0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.827247 31499 leader_election.cc:304] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651; no voters: b04ac890eb2f4a18b089b0c95bea102f
I20260709 13:12:27.828074 31606 raft_consensus.cc:2468] T f5321310673e483e92aedb4c6cca19c4 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 0.
I20260709 13:12:27.828929 31819 raft_consensus.cc:2804] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.829193 31499 leader_election.cc:304] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651; no voters: 
I20260709 13:12:27.829658 31819 raft_consensus.cc:697] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Running, Role: LEADER
I20260709 13:12:27.830189 31864 raft_consensus.cc:2804] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.830071 31831 raft_consensus.cc:359] T d24e9da72f7e48318f96034b21288f97 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.830354 31681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5321310673e483e92aedb4c6cca19c4" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f" is_pre_election: true
I20260709 13:12:27.830724 31864 raft_consensus.cc:493] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.822237 31430 catalog_manager.cc:5697] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f reported cstate change: term changed from 0 to 1, leader changed from <none> to b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3). New cstate: current_term: 1 leader_uuid: "b04ac890eb2f4a18b089b0c95bea102f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:27.830541 31819 consensus_queue.cc:237] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.831250 31864 raft_consensus.cc:3060] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.840701 31864 raft_consensus.cc:515] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.830835 31831 raft_consensus.cc:385] T d24e9da72f7e48318f96034b21288f97 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.843904 31831 raft_consensus.cc:740] T d24e9da72f7e48318f96034b21288f97 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.844419 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5321310673e483e92aedb4c6cca19c4" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651"
I20260709 13:12:27.845094 31606 raft_consensus.cc:3060] T f5321310673e483e92aedb4c6cca19c4 P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.845144 31831 consensus_queue.cc:260] T d24e9da72f7e48318f96034b21288f97 P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.848665 31831 ts_tablet_manager.cc:1434] T d24e9da72f7e48318f96034b21288f97 P b04ac890eb2f4a18b089b0c95bea102f: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:12:27.849972 31831 tablet_bootstrap.cc:492] T 725bb603dd8d43fba4dcd318ea5fa6fd P b04ac890eb2f4a18b089b0c95bea102f: Bootstrap starting.
I20260709 13:12:27.858628 31831 tablet_bootstrap.cc:654] T 725bb603dd8d43fba4dcd318ea5fa6fd P b04ac890eb2f4a18b089b0c95bea102f: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:27.827286 31766 raft_consensus.cc:493] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.861029 31766 raft_consensus.cc:3060] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.827184 31842 leader_election.cc:290] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:27.871778 31831 tablet_bootstrap.cc:492] T 725bb603dd8d43fba4dcd318ea5fa6fd P b04ac890eb2f4a18b089b0c95bea102f: No bootstrap required, opened a new log
I20260709 13:12:27.872574 31831 ts_tablet_manager.cc:1403] T 725bb603dd8d43fba4dcd318ea5fa6fd P b04ac890eb2f4a18b089b0c95bea102f: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
I20260709 13:12:27.876606 31831 raft_consensus.cc:359] T 725bb603dd8d43fba4dcd318ea5fa6fd P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.877743 31831 raft_consensus.cc:385] T 725bb603dd8d43fba4dcd318ea5fa6fd P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.878142 31831 raft_consensus.cc:740] T 725bb603dd8d43fba4dcd318ea5fa6fd P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.879315 31831 consensus_queue.cc:260] T 725bb603dd8d43fba4dcd318ea5fa6fd P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.882227 31831 ts_tablet_manager.cc:1434] T 725bb603dd8d43fba4dcd318ea5fa6fd P b04ac890eb2f4a18b089b0c95bea102f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.003s
I20260709 13:12:27.887390 31836 raft_consensus.cc:493] T d24e9da72f7e48318f96034b21288f97 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.888042 31836 raft_consensus.cc:515] T d24e9da72f7e48318f96034b21288f97 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.890614 31836 leader_election.cc:290] T d24e9da72f7e48318f96034b21288f97 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:27.892182 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24e9da72f7e48318f96034b21288f97" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
I20260709 13:12:27.892993 31606 raft_consensus.cc:2468] T f5321310673e483e92aedb4c6cca19c4 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 1.
I20260709 13:12:27.893716 31864 leader_election.cc:290] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 election: Requested vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:27.886548 31842 consensus_queue.cc:1048] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:12:27.894910 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5321310673e483e92aedb4c6cca19c4" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
I20260709 13:12:27.897648 31499 leader_election.cc:304] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651; no voters: 
I20260709 13:12:27.898638 31842 raft_consensus.cc:2804] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.899118 31842 raft_consensus.cc:697] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 LEADER]: Becoming Leader. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Running, Role: LEADER
I20260709 13:12:27.899992 31842 consensus_queue.cc:237] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.900770 31766 raft_consensus.cc:515] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.901242 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24e9da72f7e48318f96034b21288f97" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0" is_pre_election: true
I20260709 13:12:27.902155 31681 raft_consensus.cc:2393] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb0482a31a436882a89f5dfdede1c0 in current term 1: Already voted for candidate b04ac890eb2f4a18b089b0c95bea102f in this term.
I20260709 13:12:27.904868 31832 tablet_bootstrap.cc:492] T 2e02a21fb5c544faaa64ad2c506072ee P 5ccb0482a31a436882a89f5dfdede1c0: No bootstrap required, opened a new log
I20260709 13:12:27.905568 31766 leader_election.cc:290] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:27.906304 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5321310673e483e92aedb4c6cca19c4" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
I20260709 13:12:27.902179 31531 raft_consensus.cc:2393] T d24e9da72f7e48318f96034b21288f97 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b04ac890eb2f4a18b089b0c95bea102f in current term 1: Already voted for candidate dd26c2c466ca41709432959be327b651 in this term.
I20260709 13:12:27.906744 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5321310673e483e92aedb4c6cca19c4" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651"
I20260709 13:12:27.907850 31606 raft_consensus.cc:2393] T f5321310673e483e92aedb4c6cca19c4 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b04ac890eb2f4a18b089b0c95bea102f in current term 1: Already voted for candidate 5ccb0482a31a436882a89f5dfdede1c0 in this term.
I20260709 13:12:27.908685 31645 leader_election.cc:304] T d24e9da72f7e48318f96034b21288f97 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f; no voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651
I20260709 13:12:27.909176 31648 leader_election.cc:304] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f; no voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651
I20260709 13:12:27.909983 31836 raft_consensus.cc:3060] T d24e9da72f7e48318f96034b21288f97 P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.911850 31430 catalog_manager.cc:5697] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f reported cstate change: term changed from 0 to 1, leader changed from <none> to b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3). New cstate: current_term: 1 leader_uuid: "b04ac890eb2f4a18b089b0c95bea102f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:27.912989 31428 catalog_manager.cc:5697] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "5ccb0482a31a436882a89f5dfdede1c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.918308 31836 raft_consensus.cc:2749] T d24e9da72f7e48318f96034b21288f97 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:27.921697 31842 consensus_queue.cc:1048] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:27.922735 31766 raft_consensus.cc:2749] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:27.927680 31836 raft_consensus.cc:493] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.928376 31836 raft_consensus.cc:515] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.905448 31832 ts_tablet_manager.cc:1403] T 2e02a21fb5c544faaa64ad2c506072ee P 5ccb0482a31a436882a89f5dfdede1c0: Time spent bootstrapping tablet: real 0.089s	user 0.013s	sys 0.018s
I20260709 13:12:27.937112 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62e43c0adf14243abb4449897b332cb" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0" is_pre_election: true
I20260709 13:12:27.937798 31531 raft_consensus.cc:2468] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 0.
I20260709 13:12:27.939180 31645 leader_election.cc:304] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, b04ac890eb2f4a18b089b0c95bea102f; no voters: 
I20260709 13:12:27.940121 31766 raft_consensus.cc:2804] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:27.940580 31766 raft_consensus.cc:493] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.940999 31766 raft_consensus.cc:3060] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.944279 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62e43c0adf14243abb4449897b332cb" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
I20260709 13:12:27.944744 31842 raft_consensus.cc:493] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.945001 31606 raft_consensus.cc:2468] T b62e43c0adf14243abb4449897b332cb P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 0.
I20260709 13:12:27.945523 31842 raft_consensus.cc:515] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.949204 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d910acb7832449f89582dac7611ae3f3" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651" is_pre_election: true
I20260709 13:12:27.948854 31428 catalog_manager.cc:5697] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1). New cstate: current_term: 1 leader_uuid: "5ccb0482a31a436882a89f5dfdede1c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:27.950119 31606 raft_consensus.cc:2393] T d910acb7832449f89582dac7611ae3f3 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ccb0482a31a436882a89f5dfdede1c0 in current term 1: Already voted for candidate b04ac890eb2f4a18b089b0c95bea102f in this term.
I20260709 13:12:27.950156 31681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d910acb7832449f89582dac7611ae3f3" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f" is_pre_election: true
I20260709 13:12:27.950990 31842 leader_election.cc:290] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:27.940601 31836 leader_election.cc:290] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:27.958603 31499 leader_election.cc:304] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0; no voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651
I20260709 13:12:27.955688 31766 raft_consensus.cc:515] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.960480 31842 raft_consensus.cc:3060] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.961707 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62e43c0adf14243abb4449897b332cb" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
I20260709 13:12:27.947259 31832 raft_consensus.cc:359] T 2e02a21fb5c544faaa64ad2c506072ee P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.962373 31832 raft_consensus.cc:385] T 2e02a21fb5c544faaa64ad2c506072ee P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:27.962373 31533 raft_consensus.cc:3060] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.962704 31832 raft_consensus.cc:740] T 2e02a21fb5c544faaa64ad2c506072ee P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.968281 31832 consensus_queue.cc:260] T 2e02a21fb5c544faaa64ad2c506072ee P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.970508 31533 raft_consensus.cc:2468] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 1.
I20260709 13:12:27.973140 31606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b62e43c0adf14243abb4449897b332cb" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd26c2c466ca41709432959be327b651"
I20260709 13:12:27.974210 31606 raft_consensus.cc:3060] T b62e43c0adf14243abb4449897b332cb P dd26c2c466ca41709432959be327b651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:27.975905 31842 raft_consensus.cc:2749] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:27.973254 31832 ts_tablet_manager.cc:1434] T 2e02a21fb5c544faaa64ad2c506072ee P 5ccb0482a31a436882a89f5dfdede1c0: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:12:27.982065 31606 raft_consensus.cc:2468] T b62e43c0adf14243abb4449897b332cb P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 1.
I20260709 13:12:27.983414 31645 leader_election.cc:304] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, b04ac890eb2f4a18b089b0c95bea102f; no voters: 
I20260709 13:12:27.984977 31836 raft_consensus.cc:2804] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:27.985486 31836 raft_consensus.cc:697] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Becoming Leader. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Running, Role: LEADER
I20260709 13:12:27.986341 31836 consensus_queue.cc:237] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:27.983906 31766 leader_election.cc:290] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 1 election: Requested vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:28.002277 31428 catalog_manager.cc:5697] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f reported cstate change: term changed from 0 to 1, leader changed from <none> to b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3). New cstate: current_term: 1 leader_uuid: "b04ac890eb2f4a18b089b0c95bea102f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:28.022253 31682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d910acb7832449f89582dac7611ae3f3"
dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
mode: GRACEFUL
new_leader_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
 from {username='slave'} at 127.0.0.1:51904
I20260709 13:12:28.022789 31682 raft_consensus.cc:606] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Received request to transfer leadership to TS 5ccb0482a31a436882a89f5dfdede1c0
I20260709 13:12:28.037573 31533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9abf8d04896f4fca9fe2248c288e4799"
dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
mode: GRACEFUL
new_leader_uuid: "dd26c2c466ca41709432959be327b651"
 from {username='slave'} at 127.0.0.1:58434
I20260709 13:12:28.038184 31533 raft_consensus.cc:606] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 LEADER]: Received request to transfer leadership to TS dd26c2c466ca41709432959be327b651
I20260709 13:12:28.044149 31682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e02a21fb5c544faaa64ad2c506072ee"
dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
mode: GRACEFUL
new_leader_uuid: "dd26c2c466ca41709432959be327b651"
 from {username='slave'} at 127.0.0.1:51904
I20260709 13:12:28.044680 31682 raft_consensus.cc:606] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Received request to transfer leadership to TS dd26c2c466ca41709432959be327b651
I20260709 13:12:28.110862 31792 consensus_queue.cc:1048] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:28.122224 31883 consensus_queue.cc:1048] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:28.166846 31836 consensus_queue.cc:1048] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:28.173705 31766 raft_consensus.cc:993] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f: : Instructing follower 5ccb0482a31a436882a89f5dfdede1c0 to start an election
I20260709 13:12:28.174190 31766 raft_consensus.cc:1081] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Signalling peer 5ccb0482a31a436882a89f5dfdede1c0 to start an election
I20260709 13:12:28.177173 31531 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d910acb7832449f89582dac7611ae3f3"
dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
 from {username='slave'} at 127.0.0.1:58418
I20260709 13:12:28.177773 31531 raft_consensus.cc:493] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:28.178164 31531 raft_consensus.cc:3060] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:28.178829 31766 consensus_queue.cc:1048] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:28.189061 31531 raft_consensus.cc:515] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:28.191077 31531 leader_election.cc:290] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 2 election: Requested vote from peers dd26c2c466ca41709432959be327b651 (127.20.40.2:42179), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:28.192160 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d910acb7832449f89582dac7611ae3f3" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
I20260709 13:12:28.192786 31682 raft_consensus.cc:3055] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:28.193084 31682 raft_consensus.cc:740] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Running, Role: LEADER
I20260709 13:12:28.193106 31605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d910acb7832449f89582dac7611ae3f3" candidate_uuid: "5ccb0482a31a436882a89f5dfdede1c0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd26c2c466ca41709432959be327b651"
I20260709 13:12:28.193917 31605 raft_consensus.cc:3060] T d910acb7832449f89582dac7611ae3f3 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:28.193877 31682 consensus_queue.cc:260] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:28.195183 31682 raft_consensus.cc:3060] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:28.199901 31682 raft_consensus.cc:2468] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 2.
I20260709 13:12:28.199914 31605 raft_consensus.cc:2468] T d910acb7832449f89582dac7611ae3f3 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ccb0482a31a436882a89f5dfdede1c0 in term 2.
I20260709 13:12:28.200889 31499 leader_election.cc:304] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, b04ac890eb2f4a18b089b0c95bea102f; no voters: 
I20260709 13:12:28.201581 31842 raft_consensus.cc:2804] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:28.202066 31842 raft_consensus.cc:697] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 LEADER]: Becoming Leader. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Running, Role: LEADER
I20260709 13:12:28.202714 31842 consensus_queue.cc:237] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:28.209339 31430 catalog_manager.cc:5697] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 reported cstate change: term changed from 1 to 2, leader changed from b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3) to 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1). New cstate: current_term: 2 leader_uuid: "5ccb0482a31a436882a89f5dfdede1c0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:28.210355 31842 consensus_queue.cc:1048] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:28.217379 31531 raft_consensus.cc:3060] T 2e02a21fb5c544faaa64ad2c506072ee P 5ccb0482a31a436882a89f5dfdede1c0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:28.218709 31682 raft_consensus.cc:3060] T 725bb603dd8d43fba4dcd318ea5fa6fd P b04ac890eb2f4a18b089b0c95bea102f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:28.225996 31836 consensus_queue.cc:1048] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:28.227351 31842 consensus_queue.cc:1048] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:28.229630 31870 consensus_queue.cc:1048] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:28.253299 31840 consensus_queue.cc:1048] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:28.260784 31842 consensus_queue.cc:1048] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:28.271606 31766 raft_consensus.cc:993] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f: : Instructing follower dd26c2c466ca41709432959be327b651 to start an election
I20260709 13:12:28.272225 31840 raft_consensus.cc:1081] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Signalling peer dd26c2c466ca41709432959be327b651 to start an election
I20260709 13:12:28.274251 31606 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e02a21fb5c544faaa64ad2c506072ee"
dest_uuid: "dd26c2c466ca41709432959be327b651"
 from {username='slave'} at 127.0.0.1:58284
I20260709 13:12:28.274940 31606 raft_consensus.cc:493] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:28.275339 31606 raft_consensus.cc:3060] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:28.283890 31606 raft_consensus.cc:515] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:28.286597 31533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e02a21fb5c544faaa64ad2c506072ee" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
I20260709 13:12:28.287218 31533 raft_consensus.cc:3060] T 2e02a21fb5c544faaa64ad2c506072ee P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:28.288321 31606 leader_election.cc:290] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:28.289374 31682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e02a21fb5c544faaa64ad2c506072ee" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
I20260709 13:12:28.289989 31682 raft_consensus.cc:3055] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:28.290292 31682 raft_consensus.cc:740] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Running, Role: LEADER
I20260709 13:12:28.291034 31682 consensus_queue.cc:260] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:28.292239 31682 raft_consensus.cc:3060] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:28.294682 31533 raft_consensus.cc:2468] T 2e02a21fb5c544faaa64ad2c506072ee P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd26c2c466ca41709432959be327b651 in term 2.
I20260709 13:12:28.295742 31571 leader_election.cc:304] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, dd26c2c466ca41709432959be327b651; no voters: 
I20260709 13:12:28.296482 31883 raft_consensus.cc:2804] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:28.296917 31883 raft_consensus.cc:697] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651 [term 2 LEADER]: Becoming Leader. State: Replica: dd26c2c466ca41709432959be327b651, State: Running, Role: LEADER
I20260709 13:12:28.297703 31883 consensus_queue.cc:237] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:28.299191 31682 raft_consensus.cc:2468] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd26c2c466ca41709432959be327b651 in term 2.
I20260709 13:12:28.303865 31430 catalog_manager.cc:5697] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651 reported cstate change: term changed from 1 to 2, leader changed from b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3) to dd26c2c466ca41709432959be327b651 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "dd26c2c466ca41709432959be327b651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:28.307485 31883 consensus_queue.cc:1048] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:28.319612 31792 consensus_queue.cc:1048] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:28.323587 31864 consensus_queue.cc:1048] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:28.325098 31842 consensus_queue.cc:1048] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:28.473274 31840 consensus_queue.cc:1048] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:28.487506 31766 consensus_queue.cc:1048] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:28.494410 31842 raft_consensus.cc:993] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0: : Instructing follower dd26c2c466ca41709432959be327b651 to start an election
I20260709 13:12:28.494993 31842 raft_consensus.cc:1081] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 LEADER]: Signalling peer dd26c2c466ca41709432959be327b651 to start an election
I20260709 13:12:28.496718 31605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9abf8d04896f4fca9fe2248c288e4799"
dest_uuid: "dd26c2c466ca41709432959be327b651"
 from {username='slave'} at 127.0.0.1:58278
I20260709 13:12:28.497287 31605 raft_consensus.cc:493] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:28.497678 31605 raft_consensus.cc:3060] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:28.503211 31605 raft_consensus.cc:515] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:28.505112 31605 leader_election.cc:290] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 2 election: Requested vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3:38141)
I20260709 13:12:28.506110 31681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abf8d04896f4fca9fe2248c288e4799" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
I20260709 13:12:28.506132 31531 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9abf8d04896f4fca9fe2248c288e4799" candidate_uuid: "dd26c2c466ca41709432959be327b651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
I20260709 13:12:28.506806 31681 raft_consensus.cc:3060] T 9abf8d04896f4fca9fe2248c288e4799 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:28.506908 31531 raft_consensus.cc:3055] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:28.507302 31531 raft_consensus.cc:740] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Running, Role: LEADER
I20260709 13:12:28.507890 31531 consensus_queue.cc:260] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:28.508746 31531 raft_consensus.cc:3060] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:28.512158 31681 raft_consensus.cc:2468] T 9abf8d04896f4fca9fe2248c288e4799 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd26c2c466ca41709432959be327b651 in term 2.
I20260709 13:12:28.513406 31574 leader_election.cc:304] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651; no voters: 
I20260709 13:12:28.513778 31531 raft_consensus.cc:2468] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd26c2c466ca41709432959be327b651 in term 2.
I20260709 13:12:28.514262 31883 raft_consensus.cc:2804] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:28.514737 31883 raft_consensus.cc:697] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651 [term 2 LEADER]: Becoming Leader. State: Replica: dd26c2c466ca41709432959be327b651, State: Running, Role: LEADER
I20260709 13:12:28.515517 31883 consensus_queue.cc:237] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:28.523655 31431 catalog_manager.cc:5697] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651 reported cstate change: term changed from 1 to 2, leader changed from 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1) to dd26c2c466ca41709432959be327b651 (127.20.40.2). New cstate: current_term: 2 leader_uuid: "dd26c2c466ca41709432959be327b651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:28.726363 31605 raft_consensus.cc:1275] T d910acb7832449f89582dac7611ae3f3 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Refusing update from remote peer 5ccb0482a31a436882a89f5dfdede1c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.727643 31842 consensus_queue.cc:1048] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.734544 31681 raft_consensus.cc:1275] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Refusing update from remote peer 5ccb0482a31a436882a89f5dfdede1c0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.737493 31870 consensus_queue.cc:1048] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.789021 31531 raft_consensus.cc:1275] T 2e02a21fb5c544faaa64ad2c506072ee P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Refusing update from remote peer dd26c2c466ca41709432959be327b651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.790223 31860 consensus_queue.cc:1048] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.798966 31681 raft_consensus.cc:1275] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Refusing update from remote peer dd26c2c466ca41709432959be327b651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.800264 31860 consensus_queue.cc:1048] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.925618 31681 raft_consensus.cc:1275] T 9abf8d04896f4fca9fe2248c288e4799 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Refusing update from remote peer dd26c2c466ca41709432959be327b651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.926896 31883 consensus_queue.cc:1048] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:28.938717 31531 raft_consensus.cc:1275] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Refusing update from remote peer dd26c2c466ca41709432959be327b651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:28.940061 31860 consensus_queue.cc:1048] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:31.057619 31431 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56828:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:12:31.086138 31431 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56828:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:12:31.154451 20640 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:31.285813 31939 tablet.cc:1724] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:31.291620 31925 log.cc:927] Time spent T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:12:31.354279 31946 tablet.cc:1724] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:31.374706 31926 log.cc:927] Time spent T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:12:31.409778 31912 log.cc:927] Time spent T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
W20260709 13:12:31.456349 31574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:38141, user_credentials={real_user=slave}} blocked reactor thread for 69773us
W20260709 13:12:31.466125 31499 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.20.40.3:38141, user_credentials={real_user=slave}} blocked reactor thread for 59124us
I20260709 13:12:31.526144 31968 tablet.cc:1724] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:31.528904 31959 log.cc:927] Time spent T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:12:31.499362 31946 tablet.cc:1724] T 725bb603dd8d43fba4dcd318ea5fa6fd P b04ac890eb2f4a18b089b0c95bea102f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.444046 31953 tablet.cc:1724] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.546900 31957 tablet.cc:1724] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.564640 31606 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b03969d68bf4888b6f9954bf28d1793"
dest_uuid: "dd26c2c466ca41709432959be327b651"
mode: GRACEFUL
new_leader_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
 from {username='slave'} at 127.0.0.1:58290
I20260709 13:12:31.565623 31606 raft_consensus.cc:606] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [term 2 LEADER]: Received request to transfer leadership to TS b04ac890eb2f4a18b089b0c95bea102f
I20260709 13:12:31.574337 31958 raft_consensus.cc:993] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651: : Instructing follower b04ac890eb2f4a18b089b0c95bea102f to start an election
I20260709 13:12:31.574976 31958 raft_consensus.cc:1081] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [term 2 LEADER]: Signalling peer b04ac890eb2f4a18b089b0c95bea102f to start an election
I20260709 13:12:31.510749 31960 tablet.cc:1724] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.577147 31681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b03969d68bf4888b6f9954bf28d1793"
dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
 from {username='slave'} at 127.0.0.1:51884
I20260709 13:12:31.578202 31681 raft_consensus.cc:493] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:31.578748 31681 raft_consensus.cc:3060] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.581609 31939 tablet.cc:1724] T d910acb7832449f89582dac7611ae3f3 P dd26c2c466ca41709432959be327b651: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:12:31.587736 31962 log.cc:927] Time spent T d24e9da72f7e48318f96034b21288f97 P 5ccb0482a31a436882a89f5dfdede1c0: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:12:31.525279 31970 tablet.cc:1724] T 9abf8d04896f4fca9fe2248c288e4799 P b04ac890eb2f4a18b089b0c95bea102f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.607265 31971 tablet.cc:1724] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.603698 31969 tablet.cc:1724] T 00f5b064fec14d58bbd0b717a74ca3c7 P b04ac890eb2f4a18b089b0c95bea102f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.574147 31967 tablet.cc:1724] T 725bb603dd8d43fba4dcd318ea5fa6fd P dd26c2c466ca41709432959be327b651: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.619109 31681 raft_consensus.cc:515] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:31.622424 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b03969d68bf4888b6f9954bf28d1793" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
I20260709 13:12:31.623232 31532 raft_consensus.cc:3060] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.631543 31532 raft_consensus.cc:2468] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 3.
I20260709 13:12:31.633076 31645 leader_election.cc:304] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ccb0482a31a436882a89f5dfdede1c0, b04ac890eb2f4a18b089b0c95bea102f; no voters: 
I20260709 13:12:31.633616 31973 tablet.cc:1724] T f5321310673e483e92aedb4c6cca19c4 P dd26c2c466ca41709432959be327b651: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.634295 31836 raft_consensus.cc:2804] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:31.635030 31836 raft_consensus.cc:697] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 3 LEADER]: Becoming Leader. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Running, Role: LEADER
I20260709 13:12:31.636135 31836 consensus_queue.cc:237] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:31.638044 31681 leader_election.cc:290] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:31.640177 31608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b03969d68bf4888b6f9954bf28d1793" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dd26c2c466ca41709432959be327b651"
I20260709 13:12:31.640790 31608 raft_consensus.cc:3055] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:31.641101 31608 raft_consensus.cc:740] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: dd26c2c466ca41709432959be327b651, State: Running, Role: LEADER
I20260709 13:12:31.642040 31608 consensus_queue.cc:260] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:31.643465 31608 raft_consensus.cc:3060] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.643152 31968 tablet.cc:1724] T b62e43c0adf14243abb4449897b332cb P dd26c2c466ca41709432959be327b651: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.614679 31946 tablet.cc:1724] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.649998 31971 tablet.cc:1724] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.669396 31969 tablet.cc:1724] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.674974 31608 raft_consensus.cc:2468] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 3.
I20260709 13:12:31.676733 31953 tablet.cc:1724] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.671522 31975 tablet.cc:1724] T d24e9da72f7e48318f96034b21288f97 P b04ac890eb2f4a18b089b0c95bea102f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.702088 31957 tablet.cc:1724] T 2e02a21fb5c544faaa64ad2c506072ee P 5ccb0482a31a436882a89f5dfdede1c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.707173 31970 tablet.cc:1724] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.710896 31533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "95ec93efe22a49fda085f38c3632f8b4"
dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
mode: GRACEFUL
new_leader_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
 from {username='slave'} at 127.0.0.1:58436
I20260709 13:12:31.711603 31533 raft_consensus.cc:606] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 LEADER]: Received request to transfer leadership to TS b04ac890eb2f4a18b089b0c95bea102f
I20260709 13:12:31.711107 31960 tablet.cc:1724] T d24e9da72f7e48318f96034b21288f97 P 5ccb0482a31a436882a89f5dfdede1c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.713642 31431 catalog_manager.cc:5697] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f reported cstate change: term changed from 2 to 3, leader changed from dd26c2c466ca41709432959be327b651 (127.20.40.2) to b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3). New cstate: current_term: 3 leader_uuid: "b04ac890eb2f4a18b089b0c95bea102f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:31.717285 20640 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:31.718036 20640 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:31.720101 31967 tablet.cc:1724] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.721110 31946 tablet.cc:1724] T dfaf881c01af408c82dde838f114c3a5 P b04ac890eb2f4a18b089b0c95bea102f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.722134 31939 tablet.cc:1724] T 00f5b064fec14d58bbd0b717a74ca3c7 P dd26c2c466ca41709432959be327b651: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.735983 31971 tablet.cc:1724] T dfaf881c01af408c82dde838f114c3a5 P 5ccb0482a31a436882a89f5dfdede1c0: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.747690 31968 tablet.cc:1724] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:12:31.786077 31430 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a: soft_deleted_table [id=10455f026cfa4e4291ee41a04173d8b1] alter complete (version 1)
I20260709 13:12:31.799605 31950 raft_consensus.cc:993] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0: : Instructing follower b04ac890eb2f4a18b089b0c95bea102f to start an election
I20260709 13:12:31.800114 31904 raft_consensus.cc:1081] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 LEADER]: Signalling peer b04ac890eb2f4a18b089b0c95bea102f to start an election
I20260709 13:12:31.801553 31681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "95ec93efe22a49fda085f38c3632f8b4"
dest_uuid: "b04ac890eb2f4a18b089b0c95bea102f"
 from {username='slave'} at 127.0.0.1:51898
I20260709 13:12:31.801971 31681 raft_consensus.cc:493] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:31.802318 31681 raft_consensus.cc:3060] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.807178 31681 raft_consensus.cc:515] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:31.808708 31681 leader_election.cc:290] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 3 election: Requested vote from peers 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671), dd26c2c466ca41709432959be327b651 (127.20.40.2:42179)
I20260709 13:12:31.809701 31532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ec93efe22a49fda085f38c3632f8b4" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5ccb0482a31a436882a89f5dfdede1c0"
I20260709 13:12:31.809882 31608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95ec93efe22a49fda085f38c3632f8b4" candidate_uuid: "b04ac890eb2f4a18b089b0c95bea102f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "dd26c2c466ca41709432959be327b651"
I20260709 13:12:31.810432 31608 raft_consensus.cc:3060] T 95ec93efe22a49fda085f38c3632f8b4 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.810432 31532 raft_consensus.cc:3055] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:31.811041 31532 raft_consensus.cc:740] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ccb0482a31a436882a89f5dfdede1c0, State: Running, Role: LEADER
I20260709 13:12:31.812011 31532 consensus_queue.cc:260] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:31.813525 31532 raft_consensus.cc:3060] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:31.815635 31608 raft_consensus.cc:2468] T 95ec93efe22a49fda085f38c3632f8b4 P dd26c2c466ca41709432959be327b651 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 3.
I20260709 13:12:31.816998 31648 leader_election.cc:304] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b04ac890eb2f4a18b089b0c95bea102f, dd26c2c466ca41709432959be327b651; no voters: 
I20260709 13:12:31.817970 31836 raft_consensus.cc:2804] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:31.818463 31836 raft_consensus.cc:697] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 3 LEADER]: Becoming Leader. State: Replica: b04ac890eb2f4a18b089b0c95bea102f, State: Running, Role: LEADER
I20260709 13:12:31.819278 31836 consensus_queue.cc:237] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } }
I20260709 13:12:31.820465 31532 raft_consensus.cc:2468] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b04ac890eb2f4a18b089b0c95bea102f in term 3.
I20260709 13:12:31.827430 31431 catalog_manager.cc:5697] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f reported cstate change: term changed from 2 to 3, leader changed from 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1) to b04ac890eb2f4a18b089b0c95bea102f (127.20.40.3). New cstate: current_term: 3 leader_uuid: "b04ac890eb2f4a18b089b0c95bea102f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b04ac890eb2f4a18b089b0c95bea102f" member_type: VOTER last_known_addr { host: "127.20.40.3" port: 38141 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:32.171543 31532 raft_consensus.cc:1275] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [term 3 FOLLOWER]: Refusing update from remote peer b04ac890eb2f4a18b089b0c95bea102f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:32.172930 31836 consensus_queue.cc:1048] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:32.186000 31608 raft_consensus.cc:1275] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [term 3 FOLLOWER]: Refusing update from remote peer b04ac890eb2f4a18b089b0c95bea102f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:32.187808 31963 consensus_queue.cc:1048] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:32.307251 31532 raft_consensus.cc:1275] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 3 FOLLOWER]: Refusing update from remote peer b04ac890eb2f4a18b089b0c95bea102f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:32.308586 31963 consensus_queue.cc:1048] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ccb0482a31a436882a89f5dfdede1c0" member_type: VOTER last_known_addr { host: "127.20.40.1" port: 38671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:32.317659 31608 raft_consensus.cc:1275] T 95ec93efe22a49fda085f38c3632f8b4 P dd26c2c466ca41709432959be327b651 [term 3 FOLLOWER]: Refusing update from remote peer b04ac890eb2f4a18b089b0c95bea102f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:32.319141 31836 consensus_queue.cc:1048] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd26c2c466ca41709432959be327b651" member_type: VOTER last_known_addr { host: "127.20.40.2" port: 42179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:32.779755 20640 tablet_server.cc:179] TabletServer@127.20.40.1:0 shutting down...
W20260709 13:12:32.807919 31645 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 16 similar messages]
I20260709 13:12:32.819854 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:12:32.820353 31645 consensus_peers.cc:597] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f -> Peer 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671): Couldn't send request to peer 5ccb0482a31a436882a89f5dfdede1c0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:32.821012 20640 tablet_replica.cc:333] T 2e02a21fb5c544faaa64ad2c506072ee P 5ccb0482a31a436882a89f5dfdede1c0: stopping tablet replica
I20260709 13:12:32.822352 20640 raft_consensus.cc:2243] T 2e02a21fb5c544faaa64ad2c506072ee P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:32.822932 20640 raft_consensus.cc:2272] T 2e02a21fb5c544faaa64ad2c506072ee P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.825169 20640 tablet_replica.cc:333] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0: stopping tablet replica
I20260709 13:12:32.825865 20640 raft_consensus.cc:2243] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:32.826650 20640 raft_consensus.cc:2272] T f5321310673e483e92aedb4c6cca19c4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.828823 20640 tablet_replica.cc:333] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0: stopping tablet replica
I20260709 13:12:32.829586 20640 raft_consensus.cc:2243] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:32.830420 20640 raft_consensus.cc:2272] T d910acb7832449f89582dac7611ae3f3 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.832800 20640 tablet_replica.cc:333] T d24e9da72f7e48318f96034b21288f97 P 5ccb0482a31a436882a89f5dfdede1c0: stopping tablet replica
I20260709 13:12:32.833823 20640 raft_consensus.cc:2243] T d24e9da72f7e48318f96034b21288f97 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:32.834422 20640 raft_consensus.cc:2272] T d24e9da72f7e48318f96034b21288f97 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.837399 20640 tablet_replica.cc:333] T dfaf881c01af408c82dde838f114c3a5 P 5ccb0482a31a436882a89f5dfdede1c0: stopping tablet replica
I20260709 13:12:32.838402 20640 raft_consensus.cc:2243] T dfaf881c01af408c82dde838f114c3a5 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:32.838946 20640 raft_consensus.cc:2272] T dfaf881c01af408c82dde838f114c3a5 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.840999 20640 tablet_replica.cc:333] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0: stopping tablet replica
I20260709 13:12:32.841624 20640 raft_consensus.cc:2243] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:32.842415 20640 raft_consensus.cc:2272] T 00f5b064fec14d58bbd0b717a74ca3c7 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.844561 20640 tablet_replica.cc:333] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0: stopping tablet replica
I20260709 13:12:32.845191 20640 raft_consensus.cc:2243] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:32.845682 20640 raft_consensus.cc:2272] T b62e43c0adf14243abb4449897b332cb P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.848150 20640 tablet_replica.cc:333] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0: stopping tablet replica
I20260709 13:12:32.848732 20640 raft_consensus.cc:2243] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:32.849601 20640 raft_consensus.cc:2272] T 725bb603dd8d43fba4dcd318ea5fa6fd P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.851791 20640 tablet_replica.cc:333] T 0874b76c790a41728e6c7390ab1304e8 P 5ccb0482a31a436882a89f5dfdede1c0: stopping tablet replica
I20260709 13:12:32.852351 20640 raft_consensus.cc:2243] T 0874b76c790a41728e6c7390ab1304e8 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:32.852764 20640 raft_consensus.cc:2272] T 0874b76c790a41728e6c7390ab1304e8 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.854961 20640 tablet_replica.cc:333] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0: stopping tablet replica
I20260709 13:12:32.855494 20640 raft_consensus.cc:2243] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:32.855922 20640 raft_consensus.cc:2272] T 9abf8d04896f4fca9fe2248c288e4799 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.858086 20640 tablet_replica.cc:333] T 05e5097f777c4d17b18e5e6db1a9b949 P 5ccb0482a31a436882a89f5dfdede1c0: stopping tablet replica
I20260709 13:12:32.858605 20640 raft_consensus.cc:2243] T 05e5097f777c4d17b18e5e6db1a9b949 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:32.859068 20640 raft_consensus.cc:2272] T 05e5097f777c4d17b18e5e6db1a9b949 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.861210 20640 tablet_replica.cc:333] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0: stopping tablet replica
I20260709 13:12:32.861845 20640 raft_consensus.cc:2243] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:32.862282 20640 raft_consensus.cc:2272] T 3ac2c40173f24fa4b92159ef54a084ae P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.864490 20640 tablet_replica.cc:333] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0: stopping tablet replica
I20260709 13:12:32.865006 20640 raft_consensus.cc:2243] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:32.865515 20640 raft_consensus.cc:2272] T 0b03969d68bf4888b6f9954bf28d1793 P 5ccb0482a31a436882a89f5dfdede1c0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.868348 20640 tablet_replica.cc:333] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0: stopping tablet replica
I20260709 13:12:32.868985 20640 raft_consensus.cc:2243] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:32.869983 20640 raft_consensus.cc:2272] T ef63c5c5316a4a1c9f54713562e4b71e P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.872303 20640 tablet_replica.cc:333] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0: stopping tablet replica
I20260709 13:12:32.872848 20640 raft_consensus.cc:2243] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:32.873819 20640 raft_consensus.cc:2272] T 187fcfffc98a4ca79b719dcba8324de9 P 5ccb0482a31a436882a89f5dfdede1c0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.876331 20640 tablet_replica.cc:333] T 5b6e6d1a6cff4e95b4dfa61751e9632a P 5ccb0482a31a436882a89f5dfdede1c0: stopping tablet replica
I20260709 13:12:32.876979 20640 raft_consensus.cc:2243] T 5b6e6d1a6cff4e95b4dfa61751e9632a P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:32.877648 20640 raft_consensus.cc:2272] T 5b6e6d1a6cff4e95b4dfa61751e9632a P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.880396 20640 tablet_replica.cc:333] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0: stopping tablet replica
I20260709 13:12:32.881011 20640 raft_consensus.cc:2243] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:32.881570 20640 raft_consensus.cc:2272] T 95ec93efe22a49fda085f38c3632f8b4 P 5ccb0482a31a436882a89f5dfdede1c0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.884099 20640 tablet_replica.cc:333] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0: stopping tablet replica
I20260709 13:12:32.884680 20640 raft_consensus.cc:2243] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:32.885689 20640 raft_consensus.cc:2272] T ef54fe01a48d40cd8b942819d7863910 P 5ccb0482a31a436882a89f5dfdede1c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:32.929169 20640 tablet_server.cc:196] TabletServer@127.20.40.1:0 shutdown complete.
I20260709 13:12:32.964763 20640 tablet_server.cc:179] TabletServer@127.20.40.2:0 shutting down...
W20260709 13:12:32.992030 31571 consensus_peers.cc:597] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 -> Peer 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671): Couldn't send request to peer 5ccb0482a31a436882a89f5dfdede1c0. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:38671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.005944 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:33.006707 20640 tablet_replica.cc:333] T f5321310673e483e92aedb4c6cca19c4 P dd26c2c466ca41709432959be327b651: stopping tablet replica
I20260709 13:12:33.007480 20640 raft_consensus.cc:2243] T f5321310673e483e92aedb4c6cca19c4 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.008023 20640 raft_consensus.cc:2272] T f5321310673e483e92aedb4c6cca19c4 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.010180 20640 tablet_replica.cc:333] T b62e43c0adf14243abb4449897b332cb P dd26c2c466ca41709432959be327b651: stopping tablet replica
I20260709 13:12:33.010771 20640 raft_consensus.cc:2243] T b62e43c0adf14243abb4449897b332cb P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.011211 20640 raft_consensus.cc:2272] T b62e43c0adf14243abb4449897b332cb P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.013175 20640 tablet_replica.cc:333] T 00f5b064fec14d58bbd0b717a74ca3c7 P dd26c2c466ca41709432959be327b651: stopping tablet replica
I20260709 13:12:33.013784 20640 raft_consensus.cc:2243] T 00f5b064fec14d58bbd0b717a74ca3c7 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.014228 20640 raft_consensus.cc:2272] T 00f5b064fec14d58bbd0b717a74ca3c7 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.016249 20640 tablet_replica.cc:333] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651: stopping tablet replica
I20260709 13:12:33.016837 20640 raft_consensus.cc:2243] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.017685 20640 raft_consensus.cc:2272] T dfaf881c01af408c82dde838f114c3a5 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.019747 20640 tablet_replica.cc:333] T 725bb603dd8d43fba4dcd318ea5fa6fd P dd26c2c466ca41709432959be327b651: stopping tablet replica
I20260709 13:12:33.020320 20640 raft_consensus.cc:2243] T 725bb603dd8d43fba4dcd318ea5fa6fd P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.020753 20640 raft_consensus.cc:2272] T 725bb603dd8d43fba4dcd318ea5fa6fd P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.022866 20640 tablet_replica.cc:333] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651: stopping tablet replica
I20260709 13:12:33.023485 20640 raft_consensus.cc:2243] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.024255 20640 raft_consensus.cc:2272] T 2e02a21fb5c544faaa64ad2c506072ee P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.026461 20640 tablet_replica.cc:333] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651: stopping tablet replica
I20260709 13:12:33.027047 20640 raft_consensus.cc:2243] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.027849 20640 raft_consensus.cc:2272] T 0874b76c790a41728e6c7390ab1304e8 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.030014 20640 tablet_replica.cc:333] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651: stopping tablet replica
I20260709 13:12:33.030571 20640 raft_consensus.cc:2243] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.031447 20640 raft_consensus.cc:2272] T 05e5097f777c4d17b18e5e6db1a9b949 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.034372 20640 tablet_replica.cc:333] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651: stopping tablet replica
I20260709 13:12:33.035043 20640 raft_consensus.cc:2243] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.035948 20640 raft_consensus.cc:2272] T 9abf8d04896f4fca9fe2248c288e4799 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:33.038146 31645 consensus_peers.cc:597] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f -> Peer 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671): Couldn't send request to peer 5ccb0482a31a436882a89f5dfdede1c0. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:38671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.038846 20640 tablet_replica.cc:333] T ef54fe01a48d40cd8b942819d7863910 P dd26c2c466ca41709432959be327b651: stopping tablet replica
I20260709 13:12:33.039481 20640 raft_consensus.cc:2243] T ef54fe01a48d40cd8b942819d7863910 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.039867 20640 raft_consensus.cc:2272] T ef54fe01a48d40cd8b942819d7863910 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.041960 20640 tablet_replica.cc:333] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651: stopping tablet replica
I20260709 13:12:33.042502 20640 raft_consensus.cc:2243] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.043260 20640 raft_consensus.cc:2272] T d24e9da72f7e48318f96034b21288f97 P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.045248 20640 tablet_replica.cc:333] T d910acb7832449f89582dac7611ae3f3 P dd26c2c466ca41709432959be327b651: stopping tablet replica
I20260709 13:12:33.045831 20640 raft_consensus.cc:2243] T d910acb7832449f89582dac7611ae3f3 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.046291 20640 raft_consensus.cc:2272] T d910acb7832449f89582dac7611ae3f3 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.048403 20640 tablet_replica.cc:333] T 95ec93efe22a49fda085f38c3632f8b4 P dd26c2c466ca41709432959be327b651: stopping tablet replica
I20260709 13:12:33.048947 20640 raft_consensus.cc:2243] T 95ec93efe22a49fda085f38c3632f8b4 P dd26c2c466ca41709432959be327b651 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.049394 20640 raft_consensus.cc:2272] T 95ec93efe22a49fda085f38c3632f8b4 P dd26c2c466ca41709432959be327b651 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.051940 20640 tablet_replica.cc:333] T 5b6e6d1a6cff4e95b4dfa61751e9632a P dd26c2c466ca41709432959be327b651: stopping tablet replica
I20260709 13:12:33.052500 20640 raft_consensus.cc:2243] T 5b6e6d1a6cff4e95b4dfa61751e9632a P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.052940 20640 raft_consensus.cc:2272] T 5b6e6d1a6cff4e95b4dfa61751e9632a P dd26c2c466ca41709432959be327b651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.055575 20640 tablet_replica.cc:333] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651: stopping tablet replica
I20260709 13:12:33.056190 20640 raft_consensus.cc:2243] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.056705 20640 raft_consensus.cc:2272] T 0b03969d68bf4888b6f9954bf28d1793 P dd26c2c466ca41709432959be327b651 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.060782 20640 tablet_replica.cc:333] T ef63c5c5316a4a1c9f54713562e4b71e P dd26c2c466ca41709432959be327b651: stopping tablet replica
I20260709 13:12:33.061834 20640 raft_consensus.cc:2243] T ef63c5c5316a4a1c9f54713562e4b71e P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.062637 20640 raft_consensus.cc:2272] T ef63c5c5316a4a1c9f54713562e4b71e P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.065755 20640 tablet_replica.cc:333] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651: stopping tablet replica
I20260709 13:12:33.066323 20640 raft_consensus.cc:2243] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.067327 20640 raft_consensus.cc:2272] T 3ac2c40173f24fa4b92159ef54a084ae P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.070436 20640 tablet_replica.cc:333] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651: stopping tablet replica
I20260709 13:12:33.071171 20640 raft_consensus.cc:2243] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.071774 20640 raft_consensus.cc:2272] T 187fcfffc98a4ca79b719dcba8324de9 P dd26c2c466ca41709432959be327b651 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:33.094702 31648 consensus_peers.cc:597] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f -> Peer dd26c2c466ca41709432959be327b651 (127.20.40.2:42179): Couldn't send request to peer dd26c2c466ca41709432959be327b651. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.111333 20640 tablet_server.cc:196] TabletServer@127.20.40.2:0 shutdown complete.
W20260709 13:12:33.116861 31645 consensus_peers.cc:597] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f -> Peer 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671): Couldn't send request to peer 5ccb0482a31a436882a89f5dfdede1c0. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:38671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.146842 20640 tablet_server.cc:179] TabletServer@127.20.40.3:0 shutting down...
I20260709 13:12:33.174544 20640 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:33.175318 20640 tablet_replica.cc:333] T 725bb603dd8d43fba4dcd318ea5fa6fd P b04ac890eb2f4a18b089b0c95bea102f: stopping tablet replica
I20260709 13:12:33.176129 20640 raft_consensus.cc:2243] T 725bb603dd8d43fba4dcd318ea5fa6fd P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.176633 20640 raft_consensus.cc:2272] T 725bb603dd8d43fba4dcd318ea5fa6fd P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.179026 20640 tablet_replica.cc:333] T dfaf881c01af408c82dde838f114c3a5 P b04ac890eb2f4a18b089b0c95bea102f: stopping tablet replica
I20260709 13:12:33.179848 20640 raft_consensus.cc:2243] T dfaf881c01af408c82dde838f114c3a5 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.180372 20640 raft_consensus.cc:2272] T dfaf881c01af408c82dde838f114c3a5 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.182776 20640 tablet_replica.cc:333] T d24e9da72f7e48318f96034b21288f97 P b04ac890eb2f4a18b089b0c95bea102f: stopping tablet replica
W20260709 13:12:33.182683 31645 consensus_peers.cc:597] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f -> Peer 5ccb0482a31a436882a89f5dfdede1c0 (127.20.40.1:38671): Couldn't send request to peer 5ccb0482a31a436882a89f5dfdede1c0. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.1:38671: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.183884 20640 raft_consensus.cc:2243] T d24e9da72f7e48318f96034b21288f97 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.184463 20640 raft_consensus.cc:2272] T d24e9da72f7e48318f96034b21288f97 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.187412 20640 tablet_replica.cc:333] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f: stopping tablet replica
I20260709 13:12:33.188309 20640 raft_consensus.cc:2243] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.188774 20640 raft_consensus.cc:2272] T d910acb7832449f89582dac7611ae3f3 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:33.190598 31648 consensus_peers.cc:597] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f -> Peer dd26c2c466ca41709432959be327b651 (127.20.40.2:42179): Couldn't send request to peer dd26c2c466ca41709432959be327b651. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:42179: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.191380 20640 tablet_replica.cc:333] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f: stopping tablet replica
I20260709 13:12:33.192039 20640 raft_consensus.cc:2243] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.192427 20640 raft_consensus.cc:2272] T f5321310673e483e92aedb4c6cca19c4 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.194787 20640 tablet_replica.cc:333] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f: stopping tablet replica
I20260709 13:12:33.195465 20640 raft_consensus.cc:2243] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.195987 20640 raft_consensus.cc:2272] T 2e02a21fb5c544faaa64ad2c506072ee P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.198398 20640 tablet_replica.cc:333] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f: stopping tablet replica
W20260709 13:12:33.198313 31648 consensus_peers.cc:597] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f -> Peer dd26c2c466ca41709432959be327b651 (127.20.40.2:42179): Couldn't send request to peer dd26c2c466ca41709432959be327b651. Status: Network error: Client connection negotiation failed: client connection to 127.20.40.2:42179: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:33.199240 20640 raft_consensus.cc:2243] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.199977 20640 raft_consensus.cc:2272] T b62e43c0adf14243abb4449897b332cb P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.201848 20640 tablet_replica.cc:333] T 00f5b064fec14d58bbd0b717a74ca3c7 P b04ac890eb2f4a18b089b0c95bea102f: stopping tablet replica
I20260709 13:12:33.202324 20640 raft_consensus.cc:2243] T 00f5b064fec14d58bbd0b717a74ca3c7 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.202685 20640 raft_consensus.cc:2272] T 00f5b064fec14d58bbd0b717a74ca3c7 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.204416 20640 tablet_replica.cc:333] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f: stopping tablet replica
I20260709 13:12:33.204882 20640 raft_consensus.cc:2243] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.205265 20640 raft_consensus.cc:2272] T 3ac2c40173f24fa4b92159ef54a084ae P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.207239 20640 tablet_replica.cc:333] T 0874b76c790a41728e6c7390ab1304e8 P b04ac890eb2f4a18b089b0c95bea102f: stopping tablet replica
I20260709 13:12:33.207711 20640 raft_consensus.cc:2243] T 0874b76c790a41728e6c7390ab1304e8 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.208079 20640 raft_consensus.cc:2272] T 0874b76c790a41728e6c7390ab1304e8 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.210093 20640 tablet_replica.cc:333] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f: stopping tablet replica
I20260709 13:12:33.210582 20640 raft_consensus.cc:2243] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.210987 20640 raft_consensus.cc:2272] T 05e5097f777c4d17b18e5e6db1a9b949 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.212934 20640 tablet_replica.cc:333] T 9abf8d04896f4fca9fe2248c288e4799 P b04ac890eb2f4a18b089b0c95bea102f: stopping tablet replica
I20260709 13:12:33.213394 20640 raft_consensus.cc:2243] T 9abf8d04896f4fca9fe2248c288e4799 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.213852 20640 raft_consensus.cc:2272] T 9abf8d04896f4fca9fe2248c288e4799 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.215752 20640 tablet_replica.cc:333] T ef54fe01a48d40cd8b942819d7863910 P b04ac890eb2f4a18b089b0c95bea102f: stopping tablet replica
I20260709 13:12:33.216214 20640 raft_consensus.cc:2243] T ef54fe01a48d40cd8b942819d7863910 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.216563 20640 raft_consensus.cc:2272] T ef54fe01a48d40cd8b942819d7863910 P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.218487 20640 tablet_replica.cc:333] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f: stopping tablet replica
I20260709 13:12:33.218986 20640 raft_consensus.cc:2243] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.219708 20640 raft_consensus.cc:2272] T 5b6e6d1a6cff4e95b4dfa61751e9632a P b04ac890eb2f4a18b089b0c95bea102f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.221760 20640 tablet_replica.cc:333] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f: stopping tablet replica
I20260709 13:12:33.222218 20640 raft_consensus.cc:2243] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.222906 20640 raft_consensus.cc:2272] T 95ec93efe22a49fda085f38c3632f8b4 P b04ac890eb2f4a18b089b0c95bea102f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.225209 20640 tablet_replica.cc:333] T 187fcfffc98a4ca79b719dcba8324de9 P b04ac890eb2f4a18b089b0c95bea102f: stopping tablet replica
I20260709 13:12:33.225747 20640 raft_consensus.cc:2243] T 187fcfffc98a4ca79b719dcba8324de9 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.226116 20640 raft_consensus.cc:2272] T 187fcfffc98a4ca79b719dcba8324de9 P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.227891 20640 tablet_replica.cc:333] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f: stopping tablet replica
I20260709 13:12:33.228307 20640 raft_consensus.cc:2243] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.228973 20640 raft_consensus.cc:2272] T 0b03969d68bf4888b6f9954bf28d1793 P b04ac890eb2f4a18b089b0c95bea102f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.230805 20640 tablet_replica.cc:333] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f: stopping tablet replica
I20260709 13:12:33.231204 20640 raft_consensus.cc:2243] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:33.231568 20640 raft_consensus.cc:2272] T ef63c5c5316a4a1c9f54713562e4b71e P b04ac890eb2f4a18b089b0c95bea102f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.271664 20640 tablet_server.cc:196] TabletServer@127.20.40.3:0 shutdown complete.
I20260709 13:12:33.307370 20640 master.cc:562] Master@127.20.40.62:36779 shutting down...
I20260709 13:12:33.330894 20640 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:33.331387 20640 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:33.331669 20640 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4325adad463344be884ebe2c38e74a1a: stopping tablet replica
I20260709 13:12:33.351790 20640 master.cc:584] Master@127.20.40.62:36779 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11387 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (26796 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (333127 ms total)
[  PASSED  ] 8 tests.
I20260709 13:12:33.408614 20640 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 409 messages since previous log ~14 seconds ago
I20260709 13:12:33.408892 20640 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 411 messages since previous log ~14 seconds ago
I20260709 13:12:33.409042 20640 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 411 messages since previous log ~14 seconds ago
I20260709 13:12:33.409247 20640 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:12:33.409497 20640 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:12:33.409799 20640 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:5227: suppressed but not reported on 1 messages since previous log ~137 seconds ago
I20260709 13:12:33.410060 20640 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 7 messages since previous log ~0 seconds ago
I20260709 13:12:33.410431 20640 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 51 messages since previous log ~10 seconds ago
